W0706 11:45:20.618675 1 cmd.go:257] Using insecure, self-signed certificates I0706 11:45:20.975131 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:20.975466 1 observer_polling.go:159] Starting file observer W0706 11:45:20.996447 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0706 11:45:21.726546 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0706 11:45:21.726775 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0706 11:45:21.727311 1 secure_serving.go:57] Forcing use of http/1.1 only W0706 11:45:21.727331 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0706 11:45:21.727336 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0706 11:45:21.727340 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0706 11:45:21.727342 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0706 11:45:21.727345 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0706 11:45:21.727348 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0706 11:45:21.727476 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0706 11:45:21.730718 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0706 11:45:21.730793 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0706 11:45:21.731827 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0706 11:45:21.731839 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0706 11:45:21.731872 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0706 11:45:21.731882 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0706 11:45:21.731896 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0706 11:45:21.731888 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0706 11:45:21.731999 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1250365251/tls.crt::/tmp/serving-cert-1250365251/tls.key" I0706 11:45:21.732310 1 secure_serving.go:213] Serving securely on [::]:8443 I0706 11:45:21.732362 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0706 11:45:21.735307 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0706 11:45:21.735338 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status E0706 11:45:21.735362 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bfb0c14d1941f6 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-06 11:45:21.730683382 +0000 UTC m=+1.157225486,LastTimestamp:2026-07-06 11:45:21.730683382 +0000 UTC m=+1.157225486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0706 11:45:21.735412 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0706 11:45:21.739846 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0706 11:45:21.739863 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0706 11:45:21.743433 1 secretconfigobserver.go:119] support secret does not exist I0706 11:45:21.747182 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0706 11:45:21.751196 1 secretconfigobserver.go:119] support secret does not exist I0706 11:45:21.753575 1 recorder.go:156] Pruning old reports every 6h0m32s, max age is 288h0m0s I0706 11:45:21.757684 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0706 11:45:21.757690 1 periodic.go:212] Running clusterconfig gatherer I0706 11:45:21.757704 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0706 11:45:21.757731 1 tasks_processing.go:45] number of workers: 32 I0706 11:45:21.757732 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0706 11:45:21.757740 1 insightsreport.go:296] Starting report retriever I0706 11:45:21.757747 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0706 11:45:21.757763 1 tasks_processing.go:69] worker 5 listening for tasks. I0706 11:45:21.757761 1 tasks_processing.go:69] worker 0 listening for tasks. I0706 11:45:21.757773 1 tasks_processing.go:69] worker 6 listening for tasks. I0706 11:45:21.757775 1 tasks_processing.go:71] worker 5 working on container_images task. I0706 11:45:21.757783 1 tasks_processing.go:71] worker 6 working on infrastructures task. I0706 11:45:21.757784 1 tasks_processing.go:69] worker 4 listening for tasks. I0706 11:45:21.757784 1 tasks_processing.go:69] worker 3 listening for tasks. I0706 11:45:21.757787 1 tasks_processing.go:69] worker 2 listening for tasks. I0706 11:45:21.757766 1 tasks_processing.go:69] worker 8 listening for tasks. I0706 11:45:21.757798 1 tasks_processing.go:69] worker 26 listening for tasks. I0706 11:45:21.757797 1 tasks_processing.go:69] worker 20 listening for tasks. I0706 11:45:21.757803 1 tasks_processing.go:69] worker 12 listening for tasks. I0706 11:45:21.757808 1 tasks_processing.go:69] worker 21 listening for tasks. I0706 11:45:21.757810 1 tasks_processing.go:69] worker 15 listening for tasks. I0706 11:45:21.757812 1 tasks_processing.go:69] worker 23 listening for tasks. I0706 11:45:21.757807 1 tasks_processing.go:69] worker 14 listening for tasks. I0706 11:45:21.757814 1 tasks_processing.go:69] worker 9 listening for tasks. I0706 11:45:21.757820 1 tasks_processing.go:69] worker 24 listening for tasks. I0706 11:45:21.757821 1 tasks_processing.go:69] worker 13 listening for tasks. I0706 11:45:21.757825 1 tasks_processing.go:69] worker 22 listening for tasks. I0706 11:45:21.757827 1 tasks_processing.go:69] worker 10 listening for tasks. I0706 11:45:21.757832 1 tasks_processing.go:69] worker 25 listening for tasks. I0706 11:45:21.757835 1 tasks_processing.go:69] worker 29 listening for tasks. I0706 11:45:21.757836 1 tasks_processing.go:69] worker 7 listening for tasks. I0706 11:45:21.757837 1 tasks_processing.go:69] worker 27 listening for tasks. I0706 11:45:21.757842 1 tasks_processing.go:69] worker 28 listening for tasks. I0706 11:45:21.757837 1 tasks_processing.go:69] worker 16 listening for tasks. I0706 11:45:21.757845 1 tasks_processing.go:69] worker 31 listening for tasks. I0706 11:45:21.757845 1 tasks_processing.go:69] worker 30 listening for tasks. I0706 11:45:21.757845 1 tasks_processing.go:69] worker 17 listening for tasks. I0706 11:45:21.757852 1 tasks_processing.go:69] worker 18 listening for tasks. I0706 11:45:21.757856 1 tasks_processing.go:69] worker 19 listening for tasks. I0706 11:45:21.757775 1 tasks_processing.go:69] worker 1 listening for tasks. I0706 11:45:21.757776 1 tasks_processing.go:71] worker 0 working on oauths task. I0706 11:45:21.757879 1 tasks_processing.go:69] worker 11 listening for tasks. I0706 11:45:21.757926 1 tasks_processing.go:71] worker 23 working on certificate_signing_requests task. I0706 11:45:21.757955 1 tasks_processing.go:71] worker 24 working on mutating_webhook_configurations task. I0706 11:45:21.757957 1 tasks_processing.go:71] worker 18 working on operators task. I0706 11:45:21.757927 1 tasks_processing.go:71] worker 20 working on monitoring_persistent_volumes task. I0706 11:45:21.757932 1 tasks_processing.go:71] worker 4 working on ingress_certificates task. I0706 11:45:21.757933 1 tasks_processing.go:71] worker 27 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0706 11:45:21.757936 1 tasks_processing.go:71] worker 3 working on openstack_version task. I0706 11:45:21.757936 1 tasks_processing.go:71] worker 28 working on openstack_dataplanedeployments task. I0706 11:45:21.757939 1 tasks_processing.go:71] worker 2 working on crds task. I0706 11:45:21.757938 1 tasks_processing.go:71] worker 7 working on networks task. I0706 11:45:21.757941 1 tasks_processing.go:71] worker 16 working on tsdb_status task. W0706 11:45:21.758846 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:21.758860 1 tasks_processing.go:71] worker 16 working on silenced_alerts task. I0706 11:45:21.757944 1 tasks_processing.go:71] worker 8 working on operators_pods_and_events task. W0706 11:45:21.758876 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:21.758893 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 40.798µs to process 0 records I0706 11:45:21.758910 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 18.241µs to process 0 records I0706 11:45:21.758919 1 tasks_processing.go:71] worker 16 working on config_maps task. I0706 11:45:21.757945 1 tasks_processing.go:71] worker 31 working on cluster_apiserver task. I0706 11:45:21.757946 1 tasks_processing.go:71] worker 13 working on pdbs task. I0706 11:45:21.757945 1 tasks_processing.go:71] worker 22 working on overlapping_namespace_uids task. I0706 11:45:21.757949 1 tasks_processing.go:71] worker 30 working on ingress task. I0706 11:45:21.757948 1 tasks_processing.go:71] worker 26 working on dvo_metrics task. I0706 11:45:21.757950 1 tasks_processing.go:71] worker 14 working on image task. I0706 11:45:21.757951 1 tasks_processing.go:71] worker 10 working on jaegers task. I0706 11:45:21.757953 1 tasks_processing.go:71] worker 17 working on active_alerts task. I0706 11:45:21.757955 1 tasks_processing.go:71] worker 25 working on machine_healthchecks task. W0706 11:45:21.759498 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:21.759510 1 tasks_processing.go:71] worker 17 working on support_secret task. I0706 11:45:21.759539 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 29.351µs to process 0 records I0706 11:45:21.757954 1 tasks_processing.go:71] worker 9 working on image_pruners task. I0706 11:45:21.757959 1 tasks_processing.go:71] worker 29 working on nodenetworkconfigurationpolicies task. I0706 11:45:21.757961 1 tasks_processing.go:71] worker 19 working on machine_sets task. I0706 11:45:21.757961 1 tasks_processing.go:71] worker 1 working on storage_classes task. I0706 11:45:21.757982 1 tasks_processing.go:71] worker 21 working on machine_config_pools task. I0706 11:45:21.757985 1 tasks_processing.go:71] worker 12 working on validating_webhook_configurations task. I0706 11:45:21.757986 1 tasks_processing.go:71] worker 15 working on node_logs task. I0706 11:45:21.757928 1 tasks_processing.go:71] worker 11 working on service_accounts task. I0706 11:45:21.769009 1 tasks_processing.go:71] worker 28 working on openshift_logging task. I0706 11:45:21.769016 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 10.502487ms to process 0 records I0706 11:45:21.769030 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 10.634227ms to process 0 records I0706 11:45:21.769065 1 tasks_processing.go:71] worker 3 working on container_runtime_configs task. I0706 11:45:21.769291 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0706 11:45:21.769311 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0706 11:45:21.769318 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0706 11:45:21.769324 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0706 11:45:21.769341 1 controller.go:458] The operator is still being initialized I0706 11:45:21.769350 1 controller.go:481] The operator is healthy I0706 11:45:21.769368 1 tasks_processing.go:71] worker 6 working on aggregated_monitoring_cr_names task. I0706 11:45:21.771275 1 recorder.go:70] Recording config/infrastructure with fingerprint=dbe6088e81a702b3df4f07adf69e8c333029594de263b4731bdcf6ccb90a29c3 I0706 11:45:21.771364 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 11.567984ms to process 1 records I0706 11:45:21.771709 1 tasks_processing.go:71] worker 0 working on sap_datahubs task. I0706 11:45:21.772551 1 recorder.go:70] Recording config/oauth with fingerprint=075d7603866ec582b476540c4e2f83323a46ac95aada6feade272181bed18ddf I0706 11:45:21.772870 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 11.61618ms to process 1 records I0706 11:45:21.772882 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 11.360253ms to process 0 records I0706 11:45:21.772940 1 tasks_processing.go:71] worker 20 working on proxies task. I0706 11:45:21.773063 1 tasks_processing.go:71] worker 24 working on storage_cluster task. I0706 11:45:21.773117 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=988b5802d344c05e4e4deb246aa30a33f75a9c2be11a99822d56bd504622531f I0706 11:45:21.773182 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=d0e2d7c938935a7792beb75c6d55ec10a2823540c9f6ab03440ad6c0570fcb76 I0706 11:45:21.773233 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1c96be0677679602fbb9de069b01088f6dfd3a607986046362dade3d9383f17c I0706 11:45:21.773247 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 11.626767ms to process 3 records I0706 11:45:21.773338 1 tasks_processing.go:71] worker 13 working on ceph_cluster task. I0706 11:45:21.773368 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=7af12c0e3ee719a9bdffc01e77dbd52673e2efc6383a610fc36e0bbc3ba4b8d9 I0706 11:45:21.773390 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=533622a692626b18019c21b366739bf6611680b31fb6ff37f1b54a9e8b5d5cf7 I0706 11:45:21.773411 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=c24fdb845104495f90ebc7438b3802494ee79f015f1dbdc8f655df92ee71011b I0706 11:45:21.773421 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 10.917374ms to process 3 records I0706 11:45:21.773506 1 tasks_processing.go:71] worker 7 working on openshift_machine_api_events task. I0706 11:45:21.773599 1 recorder.go:70] Recording config/network with fingerprint=a55c62cdb727283201d1e78b9391c9dfe5a2908efbd7aff3450be6041b6e5259 I0706 11:45:21.773615 1 gather.go:177] gatherer "clusterconfig" function "networks" took 12.142715ms to process 1 records I0706 11:45:21.773700 1 tasks_processing.go:71] worker 31 working on pod_network_connectivity_checks task. I0706 11:45:21.773780 1 recorder.go:70] Recording config/apiserver with fingerprint=d318a58b289074b1ae4c10af8a2495c6af0f1d001dd319df9bd11ed64ce20dbf I0706 11:45:21.773792 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 12.173922ms to process 1 records I0706 11:45:21.773805 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 13.629211ms to process 0 records I0706 11:45:21.773816 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0706 11:45:21.775793 1 tasks_processing.go:71] worker 29 working on cost_management_metrics_configs task. I0706 11:45:21.775877 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 16.045623ms to process 0 records E0706 11:45:21.775920 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0706 11:45:21.775934 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 16.371475ms to process 0 records I0706 11:45:21.775949 1 tasks_processing.go:71] worker 25 working on olm_operators task. I0706 11:45:21.775957 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 16.480884ms to process 0 records I0706 11:45:21.775983 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 16.055305ms to process 0 records I0706 11:45:21.775995 1 tasks_processing.go:71] worker 10 working on authentication task. I0706 11:45:21.776013 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 16.017721ms to process 0 records I0706 11:45:21.776057 1 tasks_processing.go:71] worker 21 working on machine_autoscalers task. I0706 11:45:21.776073 1 tasks_processing.go:71] worker 19 working on openstack_controlplanes task. I0706 11:45:21.777854 1 tasks_processing.go:71] worker 5 working on nodenetworkstates task. I0706 11:45:21.777942 1 recorder.go:70] Recording config/running_containers with fingerprint=ec150bd234e2cc3472458cc560ba6d2b0120f390c5349614fd4a22fc347fa685 I0706 11:45:21.777961 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 20.061424ms to process 1 records I0706 11:45:21.780134 1 tasks_processing.go:71] worker 14 working on nodes task. I0706 11:45:21.780243 1 recorder.go:70] Recording config/image with fingerprint=e1ba101de663f8248405303eec785294fc0fc931d57278396e02078706cc72b4 I0706 11:45:21.780261 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.807148ms to process 1 records I0706 11:45:21.783581 1 tasks_processing.go:71] worker 15 working on machine_configs task. I0706 11:45:21.783782 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 23.460585ms to process 0 records I0706 11:45:21.783883 1 tasks_processing.go:71] worker 17 working on sap_pods task. E0706 11:45:21.784164 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0706 11:45:21.784225 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 24.363261ms to process 0 records I0706 11:45:21.785886 1 tasks_processing.go:71] worker 28 working on image_registries task. I0706 11:45:21.785893 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 16.861147ms to process 0 records I0706 11:45:21.786203 1 tasks_processing.go:71] worker 30 working on openstack_dataplanenodesets task. I0706 11:45:21.786401 1 recorder.go:70] Recording config/ingress with fingerprint=0dd2ba92f59b0170d02d0bb3d9819c0b952c730c39491926a8ffdea24d93198e I0706 11:45:21.786423 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 27.051274ms to process 1 records I0706 11:45:21.789348 1 tasks_processing.go:71] worker 3 working on feature_gates task. I0706 11:45:21.789366 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 20.270261ms to process 0 records I0706 11:45:21.789917 1 tasks_processing.go:71] worker 9 working on schedulers task. I0706 11:45:21.790250 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=029d4ac356ca6478dfd827d9da0885048f76f5eab270e484faf1ce86753fe721 I0706 11:45:21.790274 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 30.28507ms to process 1 records I0706 11:45:21.792100 1 tasks_processing.go:71] worker 1 working on metrics task. W0706 11:45:21.792137 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:21.792278 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=57438a5cf58322efc07fb5d633ae27fc78505ab5abe7f5bdbd89e76c0354f797 I0706 11:45:21.792309 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=4e6e666345e5d6a942cce0cbf6b33cadec7b4d78ccebda1e72d28a923cb0148f I0706 11:45:21.792319 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 32.252439ms to process 2 records I0706 11:45:21.792330 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 31.511µs to process 0 records I0706 11:45:21.792339 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 19.156868ms to process 0 records I0706 11:45:21.792346 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 18.889085ms to process 0 records E0706 11:45:21.792351 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0706 11:45:21.792358 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 18.588262ms to process 0 records I0706 11:45:21.792365 1 tasks_processing.go:71] worker 24 working on version task. I0706 11:45:21.792390 1 tasks_processing.go:71] worker 31 working on lokistack task. I0706 11:45:21.792445 1 tasks_processing.go:71] worker 1 working on sap_config task. I0706 11:45:21.792539 1 recorder.go:70] Recording config/proxy with fingerprint=1cd47fa101cd0527ecb7e3467c2dd32e0e1c90c221917618dcab3285310b7751 I0706 11:45:21.792594 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 19.495385ms to process 1 records I0706 11:45:21.792450 1 tasks_processing.go:71] worker 20 working on machines task. I0706 11:45:21.792458 1 tasks_processing.go:71] worker 13 working on install_plans task. W0706 11:45:21.794234 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0706 11:45:21.794887 1 tasks_processing.go:74] worker 7 stopped. I0706 11:45:21.794900 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 21.369758ms to process 0 records I0706 11:45:21.795021 1 tasks_processing.go:74] worker 29 stopped. I0706 11:45:21.795038 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 19.213179ms to process 0 records I0706 11:45:21.795250 1 tasks_processing.go:74] worker 0 stopped. I0706 11:45:21.795263 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 23.320077ms to process 0 records I0706 11:45:21.795299 1 tasks_processing.go:74] worker 17 stopped. I0706 11:45:21.795318 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 11.352106ms to process 0 records I0706 11:45:21.795357 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 19.229921ms to process 0 records I0706 11:45:21.795367 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 19.232204ms to process 0 records I0706 11:45:21.795376 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 9.097058ms to process 0 records I0706 11:45:21.795383 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 17.455827ms to process 0 records I0706 11:45:21.795392 1 tasks_processing.go:74] worker 5 stopped. I0706 11:45:21.795397 1 tasks_processing.go:74] worker 21 stopped. I0706 11:45:21.795402 1 tasks_processing.go:74] worker 19 stopped. I0706 11:45:21.795403 1 tasks_processing.go:74] worker 2 stopped. I0706 11:45:21.795411 1 tasks_processing.go:74] worker 30 stopped. I0706 11:45:21.797892 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=18239b7083df73b07734f42043ffa7bf534f7fad6076e2c0e24da7f28e95fbda I0706 11:45:21.798451 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=cc8fd407f57a907559432ffbaac629a263e6ee19b06fb597ec91215ce0411229 I0706 11:45:21.798514 1 gather.go:177] gatherer "clusterconfig" function "crds" took 36.813826ms to process 2 records I0706 11:45:21.798718 1 tasks_processing.go:74] worker 12 stopped. I0706 11:45:21.798839 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=9dc4a71f95fc31938d35a1494e150a8dcb1a6488a8264f4febeb64dcb8ddccc9 I0706 11:45:21.799698 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=bff70f38d7cfce1ad10123d2be66910fba3ed713f7ad85aea73d723728e6d957 I0706 11:45:21.799766 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=2e96b38fc4719c4181b46125a2a6418bd115dcb0b93cbd90d7988a55a0506abb I0706 11:45:21.799843 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=42814a3209805635af05e8b5c0d3db161b68f80c68cb0d39ef5256674a5104cf I0706 11:45:21.799901 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=da5f0af3dc98a8bc70743601caf2757dcb4f62d46b3ca8e65e290476a3b20f15 I0706 11:45:21.800004 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=b65f4d15af929bdb11824186906aa52945c51a01939e2d4ac8e866129dcdd162 I0706 11:45:21.800073 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=83a797e5790bfac8c6a2ecd5ffc854ac1a67f01538ab94fc93aebbf363c08b77 I0706 11:45:21.800143 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=69339f790c861ac5c37f78bce04f07e628471a1a6a269df2368e77e6c3d7becf I0706 11:45:21.800162 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0706 11:45:21.800190 1 operator.go:287] started I0706 11:45:21.800199 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0706 11:45:21.800211 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0706 11:45:21.800392 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=cbfc2923edd959c51a9648bf1327647ab1739508550191b4a8bd2d608d19d288 I0706 11:45:21.800615 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=67acd16907ea0aec83e2fde0255d2068065ddc7aa43c489fda0b3314315f134a I0706 11:45:21.800674 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=069e38b61a0b2668ee6c63cc704ee68c67e75cde70cf311b93607e99eaa7d5ad I0706 11:45:21.800687 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 36.118856ms to process 11 records I0706 11:45:21.800784 1 tasks_processing.go:74] worker 10 stopped. I0706 11:45:21.801041 1 recorder.go:70] Recording config/authentication with fingerprint=c638994c6493d9d818599e6224864151cf9492eafbe79fc08f195e0b0c7e47d9 I0706 11:45:21.801058 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 20.139687ms to process 1 records I0706 11:45:21.801147 1 tasks_processing.go:74] worker 14 stopped. I0706 11:45:21.801497 1 recorder.go:70] Recording config/node/ip-10-0-1-4.ec2.internal with fingerprint=7994b6536a0e193d7b680f37bbf98c641de17df2e5105219343b5fded9298063 I0706 11:45:21.801513 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 16.203583ms to process 1 records I0706 11:45:21.801537 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0706 11:45:21.801550 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.182054ms to process 1 records I0706 11:45:21.801557 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 7.635746ms to process 0 records I0706 11:45:21.801564 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 7.543054ms to process 0 records E0706 11:45:21.801571 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0706 11:45:21.801584 1 gather.go:177] gatherer "clusterconfig" function "machines" took 7.479719ms to process 0 records I0706 11:45:21.801591 1 tasks_processing.go:74] worker 31 stopped. I0706 11:45:21.801596 1 tasks_processing.go:74] worker 22 stopped. I0706 11:45:21.801600 1 tasks_processing.go:74] worker 20 stopped. I0706 11:45:21.801611 1 tasks_processing.go:74] worker 1 stopped. I0706 11:45:21.801652 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=ada3dda20e2122747426f52a2a75917857c73314b14c87cd8528ee778839ab20 I0706 11:45:21.801662 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 10.210874ms to process 1 records I0706 11:45:21.801672 1 tasks_processing.go:74] worker 9 stopped. I0706 11:45:21.801732 1 tasks_processing.go:74] worker 3 stopped. I0706 11:45:21.801757 1 recorder.go:70] Recording config/featuregate with fingerprint=602fa65c0112a9a9619fdbebb522fe30ef06c3d7973e0e87b59059ee0f3115ee I0706 11:45:21.801766 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 10.894671ms to process 1 records I0706 11:45:21.801775 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 24.449475ms to process 0 records I0706 11:45:21.801788 1 tasks_processing.go:74] worker 25 stopped. I0706 11:45:21.801847 1 tasks_processing.go:74] worker 28 stopped. I0706 11:45:21.802164 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=2c69ffcfd6b1c949f39d97ab71ccc6543365214a68c159ddf439214101b422a4 I0706 11:45:21.802177 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 15.723388ms to process 1 records E0706 11:45:21.802187 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0706 11:45:21.802204 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0706 11:45:21.802213 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 18.429328ms to process 1 records I0706 11:45:21.802219 1 tasks_processing.go:74] worker 15 stopped. I0706 11:45:21.805197 1 tasks_processing.go:74] worker 27 stopped. I0706 11:45:21.805213 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 46.893082ms to process 0 records I0706 11:45:21.805539 1 tasks_processing.go:74] worker 23 stopped. I0706 11:45:21.805792 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=11fc329f6b913e1bdefa6411464637479ade949d0a002721eb0131b81b76723e I0706 11:45:21.805904 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b97949daa94330facbc0a049083b063b5c14a66321c9f77a53ca04ea4cf15fab I0706 11:45:21.805916 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 31.713818ms to process 2 records I0706 11:45:21.808368 1 tasks_processing.go:74] worker 6 stopped. I0706 11:45:21.808390 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 38.951415ms to process 0 records I0706 11:45:21.809724 1 controller.go:203] Source scaController *sca.Controller is not ready I0706 11:45:21.809740 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0706 11:45:21.809744 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0706 11:45:21.809747 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0706 11:45:21.809750 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0706 11:45:21.809768 1 controller.go:458] The operator is still being initialized I0706 11:45:21.809773 1 controller.go:481] The operator is healthy I0706 11:45:21.813778 1 prometheus_rules.go:88] Prometheus rules successfully created I0706 11:45:21.821548 1 tasks_processing.go:74] worker 16 stopped. E0706 11:45:21.821563 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0706 11:45:21.821569 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0706 11:45:21.821572 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0706 11:45:21.821581 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0706 11:45:21.821617 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0706 11:45:21.821629 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0706 11:45:21.821636 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0706 11:45:21.821642 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0706 11:45:21.821700 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0706 11:45:21.821713 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0706 11:45:21.821719 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 62.613648ms to process 7 records E0706 11:45:21.821931 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271cee3b83-d8b4-4eaa-b436-0fcd8e32bb78%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.18:60336->172.30.0.10:53: read: connection refused I0706 11:45:21.821943 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271cee3b83-d8b4-4eaa-b436-0fcd8e32bb78%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.18:60336->172.30.0.10:53: read: connection refused I0706 11:45:21.832264 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0706 11:45:21.832279 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0706 11:45:21.832294 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0706 11:45:21.835477 1 base_controller.go:82] Caches are synced for ConfigController I0706 11:45:21.835494 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0706 11:45:21.838910 1 configmapobserver.go:84] configmaps "insights-config" not found I0706 11:45:21.865089 1 tasks_processing.go:74] worker 24 stopped. I0706 11:45:21.865584 1 recorder.go:70] Recording config/version with fingerprint=41a0041aa18ebddcb3ab3b11c7612fd95e3b06c985eb648d440e5ff53a25b4b4 I0706 11:45:21.865598 1 recorder.go:70] Recording config/id with fingerprint=d9a305ab31710da6cabf6bfc2a91403c6972bf5a39d4aec7bbc6c357df98175e I0706 11:45:21.865605 1 gather.go:177] gatherer "clusterconfig" function "version" took 72.684445ms to process 2 records I0706 11:45:21.890201 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0706 11:45:21.894660 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.18:58109->172.30.0.10:53: read: connection refused I0706 11:45:21.894673 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.18:58109->172.30.0.10:53: read: connection refused I0706 11:45:21.900689 1 base_controller.go:82] Caches are synced for LoggingSyncer I0706 11:45:21.900711 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0706 11:45:21.900713 1 tasks_processing.go:74] worker 4 stopped. E0706 11:45:21.900732 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0706 11:45:21.900742 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rck3v7inkn887odr36s60t1g35pn18f-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rck3v7inkn887odr36s60t1g35pn18f-primary-cert-bundle-secret" not found I0706 11:45:21.900838 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=43b65b5eeea31d4e732551b993920a19325fe94dcc8a652f602d978fa3d819c6 I0706 11:45:21.900864 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 142.477602ms to process 1 records I0706 11:45:22.211815 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0706 11:45:22.411383 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0706 11:45:22.793008 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0706 11:45:22.993749 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 14 containers I0706 11:45:22.993844 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1797558 bytes I0706 11:45:22.994993 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-npfnh pod in namespace openshift-dns (previous: false). I0706 11:45:23.214823 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0706 11:45:23.220354 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-npfnh pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-npfnh\" is waiting to start: ContainerCreating" I0706 11:45:23.220375 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-npfnh\" is waiting to start: ContainerCreating" I0706 11:45:23.220385 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-npfnh pod in namespace openshift-dns (previous: false). I0706 11:45:23.396954 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-npfnh pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-npfnh\" is waiting to start: ContainerCreating" I0706 11:45:23.397014 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-npfnh\" is waiting to start: ContainerCreating" I0706 11:45:23.397050 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9g959 pod in namespace openshift-dns (previous: false). I0706 11:45:23.596198 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0706 11:45:23.596218 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6bcb5b9f5b-bcl5r pod in namespace openshift-image-registry (previous: false). I0706 11:45:23.793269 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0706 11:45:23.793288 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d56698467-47bmx pod in namespace openshift-image-registry (previous: false). W0706 11:45:23.793959 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0706 11:45:23.815218 1 tasks_processing.go:74] worker 18 stopped. I0706 11:45:23.815275 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=7486614502fbfe4b38096eb21a463a9571c5bada6f466e4085b067af25f829ed I0706 11:45:23.815309 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ddd40a1d22dab9514599864dfcb8f9d0bbe7d5390b6bb1b967f5dcd58a55a5e2 I0706 11:45:23.815344 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0706 11:45:23.815374 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=50011be4839a2977deba77aeafc94ef2e6b2e81692acc7a403eed20888b9a6db I0706 11:45:23.815400 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0706 11:45:23.815435 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=a4a1baeb366bf7a27401c36a2302a0811f9bffd8887aec37b7cda6868e011e1a I0706 11:45:23.815472 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=f206a1ed8434c42145e5b10acb81da4065ed67d4341f8352d31266def3977b1f I0706 11:45:23.815506 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=9b37d14aa2c680eca3b48d110e18c087839e34b468f3ffbd41ef23dda83e2a1d I0706 11:45:23.815525 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=d22ccc61872eea2d3a4528480410b9c2be1e73b8c21e3aa27b3e193e44c9e37d I0706 11:45:23.815545 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=eaf3db6b32391b504b6b671cb8e2912a2c0fd960ce35fb0bf3518d4bb5a73f23 I0706 11:45:23.815556 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0706 11:45:23.815578 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=bfcccf1b13c41bdc10c8bbbb09e99b6a6bc710fa1b755fece4a646d5c1ec5a31 I0706 11:45:23.815592 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0706 11:45:23.815608 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=19e09b86487d94210ce15dbd61c6d6114da95ff54b88b6480495fccabb8680d4 I0706 11:45:23.815620 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0706 11:45:23.815640 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=0127186d48129fd3f0e4791d8f8713c39121473e18a58e8916211d0b8e9a3f58 I0706 11:45:23.815652 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0706 11:45:23.815672 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=de97e3b2f639644678f2934c34a776e4bbe2b63630b8532f7cd26791413ecd2f I0706 11:45:23.815787 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=2e18787a395c1f7da3af8b3abaa0cc10477bcf005a1ab38c9b42d55a51d17196 I0706 11:45:23.815821 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0706 11:45:23.815845 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=b7f0811cff66f332f385608b1c6051999a1da144ca12da27ae79d37f35152c7c I0706 11:45:23.815869 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=0be520c4aae07ff2744f5ab38f142e9844e123156384e6df8c8ea60aa5bd8926 I0706 11:45:23.815881 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0706 11:45:23.815905 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=834f863fb62f07ac61f80816e0eccfa576cf6dd1199ba39515b548989922ac9e I0706 11:45:23.815917 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0706 11:45:23.815931 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=44ce10a475f3da7c32ca3ae0d7f92127010c4218e0d4cab39881dc4002415dbd I0706 11:45:23.815947 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=fbf804bd4e3567043a2d39873318acbd638ef4b12f74ea588e742e3b5efad8cb I0706 11:45:23.815978 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6550688bb70d43c0eee636816fe5ac83176c3501f260d6ed3e239ce79c5e21b4 I0706 11:45:23.815999 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c3b78b0a8a96180a838cad50b267f18c21515385138b18d31d23e86d55ab1877 I0706 11:45:23.816022 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=a4e9b4ef4c247fdf224a6aa6d9062630ebb6b4907b9bfc5c0403cb09f7522df9 I0706 11:45:23.816033 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0706 11:45:23.816068 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=903281b7588a7265b33f37feda50bdfb99267b9d42faacedf4672c2805e27984 I0706 11:45:23.816087 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0706 11:45:23.816097 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0706 11:45:23.816104 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.057117292s to process 34 records I0706 11:45:23.997129 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d56698467-47bmx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d56698467-47bmx\" is waiting to start: ContainerCreating" I0706 11:45:23.997147 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d56698467-47bmx\" is waiting to start: ContainerCreating" I0706 11:45:23.997159 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d56698467-mxjzh pod in namespace openshift-image-registry (previous: false). I0706 11:45:24.192200 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0706 11:45:24.192217 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t8z7k pod in namespace openshift-image-registry (previous: false). I0706 11:45:24.396753 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0706 11:45:24.396769 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-597749d998-jwhbj pod in namespace openshift-ingress (previous: false). I0706 11:45:24.596577 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-597749d998-jwhbj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-597749d998-jwhbj\" is waiting to start: ContainerCreating" I0706 11:45:24.596605 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-597749d998-jwhbj\" is waiting to start: ContainerCreating" I0706 11:45:24.596617 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-597749d998-x5hmb pod in namespace openshift-ingress (previous: false). I0706 11:45:24.792805 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0706 11:45:24.792831 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d576594b7-ftm88 pod in namespace openshift-ingress (previous: false). W0706 11:45:24.794407 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0706 11:45:24.996749 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6d576594b7-ftm88 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6d576594b7-ftm88\" is waiting to start: ContainerCreating" I0706 11:45:24.996769 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6d576594b7-ftm88\" is waiting to start: ContainerCreating" I0706 11:45:24.996780 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-b5kqd pod in namespace openshift-ingress-canary (previous: false). I0706 11:45:25.196707 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-b5kqd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-b5kqd\" is waiting to start: ContainerCreating" I0706 11:45:25.196727 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-b5kqd\" is waiting to start: ContainerCreating" I0706 11:45:25.196738 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-bvldt pod in namespace openshift-kube-storage-version-migrator (previous: false). I0706 11:45:25.398020 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-bvldt pod in namespace openshift-kube-storage-version-migrator (previous: false). I0706 11:45:25.597488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-gnwmn pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). W0706 11:45:25.796305 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0706 11:45:25.800676 1 tasks_processing.go:74] worker 8 stopped. I0706 11:45:25.800812 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=3227f2db0f47a1dd768ef46fda75f870568fa41c41bc89175dec817c93b136fe I0706 11:45:25.800849 1 recorder.go:70] Recording events/openshift-dns with fingerprint=a1cc0df4af8befb4a9b0dc08cf88bdb919827ee40318fae3cfdd06fb1bbf3cc5 I0706 11:45:25.800959 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=2fbb27a42af2c7d30eadc64f484f826166fa7b85b575e8d3301acec386faac0a I0706 11:45:25.801029 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=d08d82dc114323d3f476e741529c08a14bc24ab2805a136cf9346f2d51343d56 I0706 11:45:25.801105 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=d340382399281db6de3bca0cc4a8fe2699b721681c7492e85e4de7361e80fa4d I0706 11:45:25.801122 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=da3dea77744e4e3fb598e5afa3f3e7d76221ac0aaa602d50cfe9b7229afcb7f1 I0706 11:45:25.801143 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=d90430f2452a9f26a8dc7b1c060bde70a2106fc91da7e419c867dcfb74b51e7c I0706 11:45:25.801223 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=eeb2b7814e58f8b0e04188fd61210e716284459025c3c9047de6ebb4e4e2a480 I0706 11:45:25.801247 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-bvldt/migrator_current.log with fingerprint=3e782b435532d39439322dde7cf7a79486ceca44d9183201f206bd941fe533bf I0706 11:45:25.801257 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-bvldt/graceful-termination_current.log with fingerprint=de7721cbe77eb930153c7fc59570ca02bfc35a02da689cd477de87899c0c244b I0706 11:45:25.801418 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-gnwmn/kube-storage-version-migrator-operator_current.log with fingerprint=bcb8ff958b909aae4d4caeb4eec8fef4e672927e4ddadb58e8440d5b7ff8079e I0706 11:45:25.801432 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.041793582s to process 11 records W0706 11:45:26.794158 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0706 11:45:26.794198 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0706 11:45:26.794214 1 tasks_processing.go:74] worker 26 stopped. E0706 11:45:26.794223 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0706 11:45:26.794236 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0706 11:45:26.794249 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0706 11:45:26.794264 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.034957983s to process 1 records I0706 11:45:33.656662 1 configmapobserver.go:84] configmaps "insights-config" not found I0706 11:45:34.682369 1 tasks_processing.go:74] worker 13 stopped. I0706 11:45:34.682406 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0706 11:45:34.682418 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.889628422s to process 1 records I0706 11:45:34.736756 1 configmapobserver.go:84] configmaps "insights-config" not found I0706 11:45:34.938393 1 configmapobserver.go:84] configmaps "insights-config" not found I0706 11:45:35.366205 1 tasks_processing.go:74] worker 11 stopped. I0706 11:45:35.366545 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=0e15902d75958c6ece09dbb74d031a849762e6d8787c810476e01f34a975078d I0706 11:45:35.366563 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605992038s to process 1 records E0706 11:45:35.366622 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.608s with: function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0706 11:45:35.367735 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0706 11:45:35.367752 1 periodic.go:212] Running workloads gatherer I0706 11:45:35.367774 1 tasks_processing.go:45] number of workers: 2 I0706 11:45:35.367791 1 tasks_processing.go:69] worker 1 listening for tasks. I0706 11:45:35.367798 1 tasks_processing.go:71] worker 1 working on workload_info task. I0706 11:45:35.367801 1 tasks_processing.go:69] worker 0 listening for tasks. I0706 11:45:35.367880 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0706 11:45:35.386435 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 18s for image data I0706 11:45:35.390108 1 tasks_processing.go:74] worker 0 stopped. I0706 11:45:35.390122 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 22.209204ms to process 0 records I0706 11:45:35.394584 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (8ms) I0706 11:45:35.402246 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (8ms) I0706 11:45:35.409822 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (8ms) I0706 11:45:35.417021 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (7ms) I0706 11:45:35.424562 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (8ms) I0706 11:45:35.434146 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (10ms) I0706 11:45:35.441819 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (8ms) I0706 11:45:35.449761 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (8ms) I0706 11:45:35.458884 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (9ms) I0706 11:45:35.466426 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (8ms) I0706 11:45:35.494688 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (28ms) I0706 11:45:35.595403 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (101ms) I0706 11:45:35.695396 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms) I0706 11:45:35.796184 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (101ms) I0706 11:45:35.895160 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (99ms) I0706 11:45:35.995527 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms) I0706 11:45:36.095516 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (100ms) I0706 11:45:36.195634 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms) I0706 11:45:36.295666 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (100ms) I0706 11:45:36.396172 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms) I0706 11:45:36.495228 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (99ms) I0706 11:45:36.595427 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I0706 11:45:36.695646 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (100ms) I0706 11:45:36.794952 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (99ms) I0706 11:45:36.896115 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I0706 11:45:36.995591 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (99ms) I0706 11:45:37.095879 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I0706 11:45:37.196080 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I0706 11:45:37.295283 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (99ms) I0706 11:45:37.399430 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (104ms) I0706 11:45:37.497820 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (98ms) I0706 11:45:37.497854 1 tasks_processing.go:74] worker 1 stopped. E0706 11:45:37.497867 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0706 11:45:37.498146 1 recorder.go:70] Recording config/workload_info with fingerprint=5c93ad889bca4d2b52c2b3f90bb92f85b3b42d8530e12f4caaa1bea939f7add9 I0706 11:45:37.498166 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.130047351s to process 1 records E0706 11:45:37.498201 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.13s with: function \"workload_info\" failed with an error" I0706 11:45:37.499304 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0706 11:45:37.499318 1 periodic.go:212] Running conditional gatherer I0706 11:45:37.522392 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0706 11:45:37.529499 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.18:52169->172.30.0.10:53: read: connection refused E0706 11:45:37.529768 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0706 11:45:37.529829 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0706 11:45:37.543264 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0706 11:45:37.543279 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543284 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543288 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543292 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543296 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543299 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543302 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543305 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0706 11:45:37.543308 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0706 11:45:37.543322 1 tasks_processing.go:45] number of workers: 3 I0706 11:45:37.543329 1 tasks_processing.go:69] worker 2 listening for tasks. I0706 11:45:37.543333 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0706 11:45:37.543338 1 tasks_processing.go:69] worker 0 listening for tasks. I0706 11:45:37.543351 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0706 11:45:37.543357 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0706 11:45:37.543366 1 tasks_processing.go:69] worker 1 listening for tasks. I0706 11:45:37.543380 1 tasks_processing.go:74] worker 1 stopped. I0706 11:45:37.543430 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0706 11:45:37.543442 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.026µs to process 1 records I0706 11:45:37.543476 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0706 11:45:37.543484 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.456µs to process 1 records I0706 11:45:37.543502 1 tasks_processing.go:74] worker 0 stopped. I0706 11:45:37.543646 1 tasks_processing.go:74] worker 2 stopped. I0706 11:45:37.543658 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 283.049µs to process 0 records I0706 11:45:37.543691 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.18:52169->172.30.0.10:53: read: connection refused I0706 11:45:37.543710 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0706 11:45:37.589736 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=396d70f7d08aa7696985d87d617e5e8e56413e1ded5ab9dbb28e266fd9f740c4 I0706 11:45:37.589877 1 diskrecorder.go:70] Writing 101 records to /var/lib/insights-operator/insights-2026-07-06-114537.tar.gz I0706 11:45:37.596448 1 diskrecorder.go:51] Wrote 101 records to disk in 6ms I0706 11:45:37.596477 1 periodic.go:281] Gathering cluster info every 2h0m0s I0706 11:45:37.596492 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0706 11:45:47.018858 1 configmapobserver.go:84] configmaps "insights-config" not found I0706 11:46:40.976153 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="563c747ff465a6ebf6e59b939313f33126642ccfff6198e5f384757938155413") W0706 11:46:40.976187 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0706 11:46:40.976231 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="c9e174ef4899f310082770c1e6f3f0131e0b5358cbc513c17e66e169779554af") I0706 11:46:40.976270 1 base_controller.go:181] Shutting down ConfigController ... I0706 11:46:40.976281 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0706 11:46:40.976296 1 periodic.go:173] Shutting down I0706 11:46:40.976310 1 base_controller.go:181] Shutting down LoggingSyncer ... I0706 11:46:40.976325 1 base_controller.go:123] Shutting down worker of ConfigController controller ...