I0705 06:07:49.975067 1 cmd.go:253] Using service-serving-cert provided certificates I0705 06:07:49.975505 1 observer_polling.go:159] Starting file observer W0705 06:07:49.994522 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0705 06:07:50.305492 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0705 06:07:50.305743 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0705 06:07:50.306746 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0705 06:07:50.306853 1 secure_serving.go:57] Forcing use of http/1.1 only W0705 06:07:50.306887 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0705 06:07:50.306893 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0705 06:07:50.306899 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0705 06:07:50.306907 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0705 06:07:50.306911 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0705 06:07:50.306915 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0705 06:07:50.311804 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0705 06:07:50.311831 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0705 06:07:50.312102 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0705 06:07:50.311842 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0705 06:07:50.312262 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0705 06:07:50.311883 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0705 06:07:50.312955 1 secure_serving.go:213] Serving securely on [::]:8443 I0705 06:07:50.313023 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0705 06:07:50.313141 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I0705 06:07:50.315269 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0705 06:07:50.315405 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E0705 06:07:50.320296 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bf4fc1955df350 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-05 06:07:50.315250512 +0000 UTC m=+0.384992150,LastTimestamp:2026-07-05 06:07:50.315250512 +0000 UTC m=+0.384992150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0705 06:07:50.321056 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0705 06:07:50.321079 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0705 06:07:50.321196 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0705 06:07:50.326098 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:07:50.326116 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0705 06:07:50.330465 1 secretconfigobserver.go:119] support secret does not exist I0705 06:07:50.334909 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:07:50.339490 1 secretconfigobserver.go:119] support secret does not exist I0705 06:07:50.344221 1 recorder.go:156] Pruning old reports every 8h21m33s, max age is 288h0m0s I0705 06:07:50.349521 1 periodic.go:212] Running clusterconfig gatherer I0705 06:07:50.349533 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0705 06:07:50.349553 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0705 06:07:50.349575 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0705 06:07:50.349575 1 tasks_processing.go:45] number of workers: 32 I0705 06:07:50.349581 1 insightsreport.go:296] Starting report retriever I0705 06:07:50.349586 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0705 06:07:50.349627 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 06:07:50.349643 1 tasks_processing.go:69] worker 15 listening for tasks. I0705 06:07:50.349643 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 06:07:50.349658 1 tasks_processing.go:69] worker 2 listening for tasks. I0705 06:07:50.349659 1 tasks_processing.go:69] worker 13 listening for tasks. I0705 06:07:50.349667 1 tasks_processing.go:69] worker 14 listening for tasks. I0705 06:07:50.349670 1 tasks_processing.go:71] worker 13 working on sap_datahubs task. I0705 06:07:50.349669 1 tasks_processing.go:71] worker 2 working on oauths task. I0705 06:07:50.349649 1 tasks_processing.go:71] worker 0 working on authentication task. I0705 06:07:50.349688 1 tasks_processing.go:69] worker 11 listening for tasks. I0705 06:07:50.349702 1 tasks_processing.go:69] worker 8 listening for tasks. I0705 06:07:50.349681 1 tasks_processing.go:69] worker 6 listening for tasks. I0705 06:07:50.349703 1 tasks_processing.go:69] worker 12 listening for tasks. I0705 06:07:50.349715 1 tasks_processing.go:69] worker 7 listening for tasks. I0705 06:07:50.349718 1 tasks_processing.go:69] worker 3 listening for tasks. I0705 06:07:50.349659 1 tasks_processing.go:71] worker 1 working on silenced_alerts task. I0705 06:07:50.349725 1 tasks_processing.go:69] worker 9 listening for tasks. I0705 06:07:50.349726 1 tasks_processing.go:69] worker 4 listening for tasks. I0705 06:07:50.349733 1 tasks_processing.go:69] worker 5 listening for tasks. I0705 06:07:50.349650 1 tasks_processing.go:71] worker 15 working on machines task. I0705 06:07:50.349742 1 tasks_processing.go:69] worker 24 listening for tasks. I0705 06:07:50.349751 1 tasks_processing.go:69] worker 17 listening for tasks. I0705 06:07:50.349778 1 tasks_processing.go:69] worker 18 listening for tasks. I0705 06:07:50.349789 1 tasks_processing.go:69] worker 19 listening for tasks. I0705 06:07:50.349801 1 tasks_processing.go:69] worker 20 listening for tasks. I0705 06:07:50.349810 1 tasks_processing.go:69] worker 21 listening for tasks. I0705 06:07:50.349818 1 tasks_processing.go:69] worker 22 listening for tasks. I0705 06:07:50.349827 1 tasks_processing.go:69] worker 23 listening for tasks. I0705 06:07:50.349836 1 tasks_processing.go:69] worker 28 listening for tasks. I0705 06:07:50.349846 1 tasks_processing.go:69] worker 27 listening for tasks. I0705 06:07:50.349855 1 tasks_processing.go:69] worker 25 listening for tasks. I0705 06:07:50.349860 1 tasks_processing.go:69] worker 26 listening for tasks. I0705 06:07:50.349865 1 tasks_processing.go:69] worker 30 listening for tasks. I0705 06:07:50.349650 1 tasks_processing.go:69] worker 10 listening for tasks. I0705 06:07:50.349871 1 tasks_processing.go:69] worker 31 listening for tasks. I0705 06:07:50.349875 1 tasks_processing.go:69] worker 29 listening for tasks. I0705 06:07:50.349883 1 tasks_processing.go:71] worker 7 working on image_registries task. I0705 06:07:50.349884 1 tasks_processing.go:71] worker 4 working on olm_operators task. I0705 06:07:50.349892 1 tasks_processing.go:71] worker 5 working on service_accounts task. I0705 06:07:50.349896 1 tasks_processing.go:71] worker 8 working on machine_configs task. I0705 06:07:50.349659 1 tasks_processing.go:69] worker 16 listening for tasks. I0705 06:07:50.349940 1 tasks_processing.go:71] worker 16 working on mutating_webhook_configurations task. I0705 06:07:50.349961 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0705 06:07:50.349887 1 tasks_processing.go:71] worker 29 working on openstack_controlplanes task. I0705 06:07:50.350154 1 tasks_processing.go:71] worker 19 working on install_plans task. I0705 06:07:50.350240 1 tasks_processing.go:71] worker 14 working on networks task. I0705 06:07:50.350304 1 tasks_processing.go:71] worker 17 working on aggregated_monitoring_cr_names task. I0705 06:07:50.350386 1 tasks_processing.go:71] worker 6 working on openstack_dataplanedeployments task. I0705 06:07:50.350426 1 tasks_processing.go:71] worker 28 working on metrics task. I0705 06:07:50.350496 1 tasks_processing.go:71] worker 11 working on operators_pods_and_events task. I0705 06:07:50.349947 1 tasks_processing.go:71] worker 3 working on monitoring_persistent_volumes task. I0705 06:07:50.350540 1 tasks_processing.go:71] worker 20 working on jaegers task. I0705 06:07:50.349951 1 tasks_processing.go:71] worker 9 working on nodenetworkconfigurationpolicies task. I0705 06:07:50.350543 1 tasks_processing.go:71] worker 21 working on openshift_logging task. I0705 06:07:50.350549 1 tasks_processing.go:71] worker 22 working on support_secret task. I0705 06:07:50.350555 1 tasks_processing.go:71] worker 30 working on active_alerts task. I0705 06:07:50.350560 1 tasks_processing.go:71] worker 27 working on ingress_certificates task. I0705 06:07:50.350563 1 tasks_processing.go:71] worker 25 working on version task. I0705 06:07:50.350560 1 tasks_processing.go:71] worker 24 working on ingress task. I0705 06:07:50.350570 1 tasks_processing.go:71] worker 12 working on operators task. I0705 06:07:50.350582 1 tasks_processing.go:71] worker 31 working on ceph_cluster task. I0705 06:07:50.350587 1 tasks_processing.go:71] worker 10 working on sap_pods task. I0705 06:07:50.350568 1 tasks_processing.go:71] worker 26 working on infrastructures task. I0705 06:07:50.350627 1 tasks_processing.go:71] worker 18 working on container_runtime_configs task. I0705 06:07:50.355045 1 tasks_processing.go:71] worker 13 working on pod_network_connectivity_checks task. I0705 06:07:50.355047 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.36195ms to process 0 records I0705 06:07:50.355162 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.657687ms to process 0 records I0705 06:07:50.355169 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.01721ms to process 0 records E0705 06:07:50.355175 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0705 06:07:50.355179 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.34295ms to process 0 records I0705 06:07:50.355185 1 tasks_processing.go:71] worker 15 working on certificate_signing_requests task. I0705 06:07:50.355302 1 tasks_processing.go:71] worker 29 working on image task. I0705 06:07:50.355313 1 tasks_processing.go:71] worker 6 working on storage_cluster task. E0705 06:07:50.357699 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.15.5:9091: connect: connection refused I0705 06:07:50.357726 1 tasks_processing.go:71] worker 28 working on storage_classes task. E0705 06:07:50.357740 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.15.5:9091: connect: connection refused I0705 06:07:50.357771 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 7.246194ms to process 0 records I0705 06:07:50.367331 1 tasks_processing.go:71] worker 20 working on cost_management_metrics_configs task. I0705 06:07:50.367362 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 16.474237ms to process 0 records I0705 06:07:50.367667 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 16.207861ms to process 0 records I0705 06:07:50.367701 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 16.750243ms to process 0 records I0705 06:07:50.367757 1 tasks_processing.go:71] worker 9 working on openstack_dataplanenodesets task. I0705 06:07:50.367799 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.65065ms to process 0 records I0705 06:07:50.367814 1 tasks_processing.go:71] worker 21 working on container_images task. I0705 06:07:50.367770 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0705 06:07:50.368099 1 controller.go:317] The initial operator extension status is healthy I0705 06:07:50.368139 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 06:07:50.368176 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0705 06:07:50.368209 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0705 06:07:50.368262 1 controller.go:458] The operator is still being initialized I0705 06:07:50.368296 1 controller.go:481] The operator is healthy I0705 06:07:50.368800 1 recorder.go:70] Recording config/oauth with fingerprint=0c56f28a4f9239cd22e3e3c57cded95429e1921990cfa22fa3a5e7af930df173 I0705 06:07:50.368879 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 18.210741ms to process 1 records I0705 06:07:50.367893 1 tasks_processing.go:71] worker 2 working on dvo_metrics task. I0705 06:07:50.367818 1 tasks_processing.go:71] worker 18 working on overlapping_namespace_uids task. I0705 06:07:50.369405 1 tasks_processing.go:71] worker 0 working on machine_healthchecks task. W0705 06:07:50.369776 1 operator.go:287] started I0705 06:07:50.369863 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0705 06:07:50.369880 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0705 06:07:50.370285 1 recorder.go:70] Recording config/authentication with fingerprint=0bc094f65a426ba9fcd967c5c58b4f9ec8db125b017077d70d9e71c8a417a2bc I0705 06:07:50.372307 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 18.343955ms to process 1 records E0705 06:07:50.372376 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0705 06:07:50.370775 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0705 06:07:50.372409 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.971176ms to process 0 records I0705 06:07:50.372417 1 tasks_processing.go:71] worker 22 working on config_maps task. I0705 06:07:50.372485 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 16.842612ms to process 0 records I0705 06:07:50.372970 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 18.17516ms to process 0 records I0705 06:07:50.372492 1 tasks_processing.go:71] worker 10 working on validating_webhook_configurations task. I0705 06:07:50.373411 1 tasks_processing.go:71] worker 7 working on machine_autoscalers task. I0705 06:07:50.373041 1 tasks_processing.go:71] worker 3 working on tsdb_status task. I0705 06:07:50.374713 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=235902cf1e2caae7bb4419d564016853c80ee473b23fe811e73b9aa3caa496c2 I0705 06:07:50.374735 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 21.002276ms to process 1 records I0705 06:07:50.374753 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 20.402181ms to process 0 records I0705 06:07:50.374795 1 tasks_processing.go:71] worker 31 working on pdbs task. I0705 06:07:50.374945 1 recorder.go:70] Recording config/network with fingerprint=13aa736518b77903be3f4c5bffc8828a5fc1c72c89b6ada1379ea16b139589fc I0705 06:07:50.375014 1 gather.go:177] gatherer "clusterconfig" function "networks" took 22.175314ms to process 1 records I0705 06:07:50.374944 1 tasks_processing.go:71] worker 14 working on machine_config_pools task. I0705 06:07:50.375038 1 tasks_processing.go:71] worker 13 working on nodes task. E0705 06:07:50.375031 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0705 06:07:50.375349 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 17.710647ms to process 0 records I0705 06:07:50.375390 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 17.4961ms to process 0 records I0705 06:07:50.375529 1 tasks_processing.go:71] worker 6 working on schedulers task. I0705 06:07:50.375658 1 recorder.go:70] Recording config/ingress with fingerprint=7d20f30c125fffbeccc23ec28d0b88068e0e85b531e99787056181c84d0e03ab I0705 06:07:50.375714 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 21.151236ms to process 1 records I0705 06:07:50.375725 1 tasks_processing.go:71] worker 24 working on openshift_machine_api_events task. I0705 06:07:50.375934 1 tasks_processing.go:71] worker 26 working on sap_config task. I0705 06:07:50.376667 1 recorder.go:70] Recording config/infrastructure with fingerprint=0f5d45a0d6c7894c5de0fb143b98502ba3cb9810279d3e909c53e66f5a9fe98c I0705 06:07:50.376686 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 20.925675ms to process 1 records I0705 06:07:50.376702 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.950327ms to process 0 records I0705 06:07:50.376779 1 tasks_processing.go:71] worker 9 working on machine_sets task. I0705 06:07:50.376857 1 tasks_processing.go:71] worker 16 working on image_pruners task. I0705 06:07:50.376918 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f1ec1a199e52093953c2cddb54bc8fc9c72c3a174e40e6f4a779e59f46d67278 I0705 06:07:50.376978 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=0d0818049670a2ff708d31d59782de4736cdb19cc02113e997a7b1cc40637adc I0705 06:07:50.377030 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=78019e40c583013407f470f9b4b50bc70636f8f035a6be28f974c664c14e8b31 I0705 06:07:50.377084 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 23.854354ms to process 3 records I0705 06:07:50.377102 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 6.49569ms to process 0 records E0705 06:07:50.377110 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0705 06:07:50.377122 1 tasks_processing.go:71] worker 20 working on proxies task. I0705 06:07:50.377134 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0705 06:07:50.377146 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 23.984702ms to process 1 records I0705 06:07:50.377196 1 tasks_processing.go:71] worker 8 working on crds task. I0705 06:07:50.377340 1 tasks_processing.go:71] worker 29 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0705 06:07:50.377552 1 recorder.go:70] Recording config/image with fingerprint=b17f373665d7d10521b268f7009c3b6bc3426414a7d345021629e29b422b4872 I0705 06:07:50.377567 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.307812ms to process 1 records I0705 06:07:50.377673 1 tasks_processing.go:71] worker 28 working on nodenetworkstates task. I0705 06:07:50.377853 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=0f7a6ef83bf3428ce56da4f516ed2d1c715993083f5e3044315db397fc1a3950 I0705 06:07:50.377900 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=e9c1e1576ba0cad894c385ddc55b5ad107b83b16e1b1cf3df9336f4e0c036001 I0705 06:07:50.377910 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 19.938691ms to process 2 records E0705 06:07:50.377921 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0705 06:07:50.377930 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 8.294209ms to process 0 records I0705 06:07:50.377942 1 tasks_processing.go:71] worker 0 working on feature_gates task. I0705 06:07:50.378229 1 tasks_processing.go:71] worker 23 working on node_logs task. I0705 06:07:50.378836 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b4b526a25857e1e9d0f40f41b7b4c0349e77daff8883c4a2c7ba81e5ae1dade6 E0705 06:07:50.378841 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.15.5:9091: connect: connection refused I0705 06:07:50.379016 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=2aa772001e34dc5ff620adc2ed70fe75165f53cc65a677df5c2bcfab0dfd5e19 I0705 06:07:50.379140 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 28.208041ms to process 2 records E0705 06:07:50.379157 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.15.5:9091: connect: connection refused I0705 06:07:50.379174 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.30511ms to process 0 records I0705 06:07:50.379194 1 tasks_processing.go:71] worker 3 working on openstack_version task. I0705 06:07:50.379448 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 24.249454ms to process 0 records I0705 06:07:50.379468 1 tasks_processing.go:71] worker 15 working on cluster_apiserver task. I0705 06:07:50.381723 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0705 06:07:50.381742 1 controller.go:203] Source scaController *sca.Controller is not ready I0705 06:07:50.381749 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0705 06:07:50.381754 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 06:07:50.381757 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0705 06:07:50.381776 1 controller.go:458] The operator is still being initialized I0705 06:07:50.381783 1 controller.go:481] The operator is healthy I0705 06:07:50.384081 1 tasks_processing.go:71] worker 7 working on lokistack task. I0705 06:07:50.384108 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 10.649795ms to process 0 records I0705 06:07:50.395216 1 tasks_processing.go:74] worker 14 stopped. I0705 06:07:50.395233 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 20.169238ms to process 0 records I0705 06:07:50.395636 1 tasks_processing.go:74] worker 9 stopped. I0705 06:07:50.395648 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 18.822205ms to process 0 records I0705 06:07:50.395811 1 tasks_processing.go:74] worker 28 stopped. I0705 06:07:50.395836 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 18.082266ms to process 0 records I0705 06:07:50.396125 1 tasks_processing.go:74] worker 26 stopped. I0705 06:07:50.396138 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 20.178178ms to process 0 records I0705 06:07:50.396385 1 tasks_processing.go:74] worker 3 stopped. I0705 06:07:50.396403 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 17.17855ms to process 0 records I0705 06:07:50.396526 1 tasks_processing.go:74] worker 4 stopped. I0705 06:07:50.396614 1 recorder.go:70] Recording config/olm_operators with fingerprint=c4a92d5a60c95d79143766ba5710403d8c61c696f8fa0ac8691c11d039a066cb I0705 06:07:50.396625 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 46.626636ms to process 1 records I0705 06:07:50.397872 1 tasks_processing.go:74] worker 24 stopped. I0705 06:07:50.397891 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 22.059637ms to process 0 records I0705 06:07:50.398188 1 tasks_processing.go:74] worker 25 stopped. I0705 06:07:50.399082 1 recorder.go:70] Recording config/version with fingerprint=709ce3226da232213b260024882e161173e0a76aaf9339060df02a475408c692 I0705 06:07:50.399109 1 recorder.go:70] Recording config/id with fingerprint=42af361bac1587f7be4274bf7862a2678bd1ca72bc95104a12ce8d487affabea I0705 06:07:50.399120 1 gather.go:177] gatherer "clusterconfig" function "version" took 46.558652ms to process 2 records I0705 06:07:50.399137 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 14.262822ms to process 0 records I0705 06:07:50.399209 1 tasks_processing.go:74] worker 7 stopped. I0705 06:07:50.399278 1 tasks_processing.go:74] worker 15 stopped. I0705 06:07:50.399398 1 recorder.go:70] Recording config/apiserver with fingerprint=57286001c3dbf7da16a8606e7c132c4c3113e043b4e5b170e10c31bfb1e23a7b I0705 06:07:50.399414 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 19.466793ms to process 1 records I0705 06:07:50.399439 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0705 06:07:50.399452 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 29.765337ms to process 1 records I0705 06:07:50.399465 1 tasks_processing.go:74] worker 18 stopped. I0705 06:07:50.401120 1 tasks_processing.go:74] worker 23 stopped. I0705 06:07:50.401175 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 22.842532ms to process 0 records I0705 06:07:50.401313 1 recorder.go:70] Recording config/proxy with fingerprint=02bccc073207cf86eddb626e9617c8fe6a5fa2db602887e00c5fce5953b30a02 I0705 06:07:50.401349 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.077979ms to process 1 records I0705 06:07:50.401438 1 tasks_processing.go:74] worker 20 stopped. I0705 06:07:50.401487 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=573147b63904abde939c3ed727f6c8a08f06a22ec743ed6af1657a8ca21d9f61 I0705 06:07:50.402090 1 tasks_processing.go:74] worker 10 stopped. I0705 06:07:50.402581 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1872ea6d96a4cfbbb1bbb97115c5f958bfada38172d1076f9f29bc61704cab0c I0705 06:07:50.402802 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=5f9e2ab3d790f15eccd32f477a5f553ac5e32265173b8c2dd22a9a44c33440ad I0705 06:07:50.402868 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5e99ff7d9189ce726d152f1ba897c94cb7538e49be528bc3836590a25ced7797 I0705 06:07:50.402944 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=244415225ea154af6098b08413d8a5a4865bef08d72e31649874aebcfb35a2c0 I0705 06:07:50.403015 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=96da617fcd78c09df24b2e9fc93bf736f37b2cd08ab6ea4dca15d3d6e3f3f45e I0705 06:07:50.403111 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=770a5f9fa0b3783359fd42fd56d104c6d6d9c4d7e610df4980e4d322cb708604 I0705 06:07:50.403194 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=da5ef56d8abcbdce8cfa23be55496e2b512d097b901285a4db5f19c914620ef2 I0705 06:07:50.403273 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=37e15555791bea5918e9a433602c46149d4f538b78df4a512b81f81928679f57 I0705 06:07:50.403362 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=782582fd1d0271e5495976d8d9f579b125b31049231d54d1a70e070657a1086a I0705 06:07:50.403429 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=58d168e676f63fc9c7b7ef6dd3ee0a60ce4673f459a91aa7a1cce9a14e10c5ad I0705 06:07:50.403502 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=b9b272e4f5b82e76e5ea6547120d1f3585795bba31a6a11c0730a0a3496df385 I0705 06:07:50.403572 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=a1b380b430df49cd0ba8af4a06eede0008d11248ddda68c5eaa212b879fea3a2 I0705 06:07:50.403633 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 28.183351ms to process 13 records I0705 06:07:50.403788 1 tasks_processing.go:74] worker 31 stopped. I0705 06:07:50.403844 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=2200fa9358c1b4349645a77081d0e4e82da66f7025044286178e219bc48e3c11 I0705 06:07:50.403920 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=80ccebf4f34576ace836da878e70ad813b2a118b4581a766821b51f898ab7eaf I0705 06:07:50.403988 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=eba35ce1b05e6849fe612f829ec5188e307938db7777950ccfb198c9eb114134 I0705 06:07:50.404041 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=18bfdd81ac846676e12e6a0f570516b03047559be25eddc4aa75ef00c971e659 I0705 06:07:50.404093 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=e173716d2e61cb93fd9b427f86347fd249cd8ce0cf7d70d8ebd53aa48b98f721 I0705 06:07:50.404150 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=2054afe103e767861218715bdfaedeef6b840a0305130d193f730d82a976bfb9 I0705 06:07:50.404204 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=854a95dfffa0090c23f8f9dea5f5087cd0db1e0da1b6c47e1e3c8f1a9aaec08c I0705 06:07:50.404254 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=8d32e3e127ee87c58d9d010713b7e753c61994f7d9330a48b1bb519326febeea I0705 06:07:50.404308 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=9eff7ee23cc1a9f14fbea8878845b1300e1ea4d18f8acb670fd7d0a1c5a80337 I0705 06:07:50.404428 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=ff5aa7cbc22f0122031626ecad20da82d32b6d3823b402041de6f224b0231613 I0705 06:07:50.404577 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=90a1ef94e39b95d4ea259024f28721974beb484ec20aadbcd4deaad3e4386619 I0705 06:07:50.404721 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 26.62182ms to process 11 records I0705 06:07:50.404910 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=07df5eeee2cea058709ffe58206db4e09f324546d80b9d4c08938bea76f93a4d I0705 06:07:50.404942 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.588033ms to process 1 records I0705 06:07:50.405119 1 tasks_processing.go:74] worker 16 stopped. I0705 06:07:50.405128 1 recorder.go:70] Recording config/featuregate with fingerprint=76163df63e6c89786361ccdcabc6bc1f3ea4e37b41f1f2a8916671e7b5e7e0ee I0705 06:07:50.405181 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 24.070712ms to process 1 records I0705 06:07:50.405156 1 tasks_processing.go:74] worker 0 stopped. I0705 06:07:50.405316 1 tasks_processing.go:74] worker 6 stopped. I0705 06:07:50.405344 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=f23de7c882b3e9f029d69b337ee35553826634e6ec44ad7346281b80335ee5e5 I0705 06:07:50.405403 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 27.053174ms to process 1 records I0705 06:07:50.405422 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 52.726161ms to process 0 records I0705 06:07:50.405460 1 tasks_processing.go:74] worker 17 stopped. I0705 06:07:50.405498 1 tasks_processing.go:74] worker 13 stopped. I0705 06:07:50.406190 1 recorder.go:70] Recording config/node/ip-10-0-0-98.ec2.internal with fingerprint=9c7989887ef0e6322a036932371cd3065a4c1dc9c573ef3f01e1ec0bc6c96879 I0705 06:07:50.406261 1 recorder.go:70] Recording config/node/ip-10-0-1-151.ec2.internal with fingerprint=366a8adc03f1e93c79dadfd4cd27d2a48f77103ab9cde3c9c118d846a90c1ca1 I0705 06:07:50.406324 1 recorder.go:70] Recording config/node/ip-10-0-2-166.ec2.internal with fingerprint=20089386e20458d42717d95c09d2f087d80cdf7994f8a34bcbbff2152130b908 I0705 06:07:50.406334 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 28.640531ms to process 3 records W0705 06:07:50.408477 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0705 06:07:50.412740 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0705 06:07:50.412751 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0705 06:07:50.412764 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0705 06:07:50.421798 1 base_controller.go:82] Caches are synced for ConfigController I0705 06:07:50.421810 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0705 06:07:50.422517 1 tasks_processing.go:74] worker 8 stopped. I0705 06:07:50.424074 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=f16c47aaacd7bac0f07600a71009d6c1ba2ba64e4690e1dfe0bd45ad4c36d4a4 I0705 06:07:50.424514 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=7e220402f9c394af25bd59157c76ddf403d4efdd8fcad18fe5ee8e1cb3effa94 I0705 06:07:50.424546 1 gather.go:177] gatherer "clusterconfig" function "crds" took 45.30034ms to process 2 records I0705 06:07:50.430464 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0705 06:07:50.431033 1 tasks_processing.go:74] worker 21 stopped. I0705 06:07:50.432136 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:07:50.433381 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-2wtcq with fingerprint=453bb4760a017cce6904d0611a6527dde19aa4bdabb8f034f87215e0eca62d57 I0705 06:07:50.433523 1 recorder.go:70] Recording config/running_containers with fingerprint=fa4b61c9c0cd95a6530859d0485a80e30e2a91c0249f47ea8ac36ed9ae98b50c I0705 06:07:50.433540 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 63.11784ms to process 2 records I0705 06:07:50.436564 1 tasks_processing.go:74] worker 29 stopped. I0705 06:07:50.436578 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 59.205764ms to process 0 records I0705 06:07:50.447286 1 tasks_processing.go:74] worker 22 stopped. E0705 06:07:50.447299 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0705 06:07:50.447304 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0705 06:07:50.447307 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0705 06:07:50.447316 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0705 06:07:50.447349 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0705 06:07:50.447356 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0705 06:07:50.447361 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0705 06:07:50.447371 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0705 06:07:50.447408 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0705 06:07:50.447417 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0705 06:07:50.447422 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 74.748537ms to process 7 records I0705 06:07:50.472855 1 base_controller.go:82] Caches are synced for LoggingSyncer I0705 06:07:50.472867 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0705 06:07:50.511549 1 tasks_processing.go:74] worker 27 stopped. E0705 06:07:50.511568 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0705 06:07:50.511580 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rbq2l748mdfs60a0htsh76rnsd5q3s9-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rbq2l748mdfs60a0htsh76rnsd5q3s9-primary-cert-bundle-secret" not found I0705 06:07:50.511680 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=6bb29b731adcf8a911ce836473bc581b99de723127699b862c89dff7eba9a523 I0705 06:07:50.511699 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 160.010467ms to process 1 records I0705 06:07:50.520655 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 15 containers I0705 06:07:50.520665 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes I0705 06:07:50.521168 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jc7pc pod in namespace openshift-dns (previous: false). I0705 06:07:50.523674 1 cluster_transfer.go:102] no available accepted cluster transfer I0705 06:07:50.523691 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0705 06:07:50.610639 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jc7pc pod in namespace openshift-dns (previous: false). I0705 06:07:50.658774 1 sca.go:266] etc-pki-entitlement secret successfully created I0705 06:07:50.658799 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0705 06:07:50.788464 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-p9pmk pod in namespace openshift-dns (previous: false). I0705 06:07:51.006982 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p9pmk pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-p9pmk\" is waiting to start: ContainerCreating" I0705 06:07:51.007000 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-p9pmk\" is waiting to start: ContainerCreating" I0705 06:07:51.007008 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-p9pmk pod in namespace openshift-dns (previous: false). I0705 06:07:51.187417 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p9pmk pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-p9pmk\" is waiting to start: ContainerCreating" I0705 06:07:51.187435 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-p9pmk\" is waiting to start: ContainerCreating" I0705 06:07:51.187461 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xr642 pod in namespace openshift-dns (previous: false). I0705 06:07:51.219499 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0705 06:07:51.398078 1 tasks_processing.go:74] worker 30 stopped. I0705 06:07:51.398133 1 recorder.go:70] Recording config/alerts with fingerprint=071c3d684dfea88ad027c7c506c96eaf7472ba44edfdec0d29d8857fd7110edf I0705 06:07:51.398147 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.046718301s to process 1 records I0705 06:07:51.398165 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0705 06:07:51.398177 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.048346086s to process 1 records I0705 06:07:51.398187 1 tasks_processing.go:74] worker 1 stopped. W0705 06:07:51.407812 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0705 06:07:51.412481 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xr642 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xr642\" is waiting to start: ContainerCreating" I0705 06:07:51.412498 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xr642\" is waiting to start: ContainerCreating" I0705 06:07:51.412507 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xr642 pod in namespace openshift-dns (previous: false). I0705 06:07:51.419290 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0705 06:07:51.589007 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xr642 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xr642\" is waiting to start: ContainerCreating" I0705 06:07:51.589023 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xr642\" is waiting to start: ContainerCreating" I0705 06:07:51.589033 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5flvg pod in namespace openshift-dns (previous: false). I0705 06:07:51.789971 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-779lk pod in namespace openshift-dns (previous: false). I0705 06:07:51.988401 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-89bgt pod in namespace openshift-dns (previous: false). I0705 06:07:52.188479 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6b99c96d88-gfpx7 pod in namespace openshift-ingress (previous: false). I0705 06:07:52.390633 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6b99c96d88-hfnjn pod in namespace openshift-ingress (previous: false). W0705 06:07:52.408297 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0705 06:07:52.591304 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f4c9ccc9c-vx5lv pod in namespace openshift-ingress (previous: false). I0705 06:07:52.791077 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jstpt pod in namespace openshift-ingress-canary (previous: false). I0705 06:07:52.822790 1 tasks_processing.go:74] worker 12 stopped. I0705 06:07:52.822917 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=9da7239d01adb00a1e40ccea67504e37aa6bf0347ccd53716a4c4fa22fe22d0f I0705 06:07:52.822967 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0705 06:07:52.822992 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=b8f84c24388f78170cafa9051ac62fbe51a4fcb8639e8412967c5e44d394ecbf I0705 06:07:52.823003 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0705 06:07:52.823025 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=dddd82d8a8e354f8123efbe2529b326c2da789ba06599d26955eebbf97d72482 I0705 06:07:52.823042 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0705 06:07:52.823063 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=15cb3a90279d06c90b01f1860afdb5f7def10fbef2594e940e26b830512dbee7 I0705 06:07:52.823100 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=e0bf62957b3e653d3198ce5eecab4dd0f51848c9bad78d9a82667c8f4f1bfe0a I0705 06:07:52.823126 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=a05aa25f4c8fa876195d1a90661fe341beed9259c907f41fd61a706e3e2b5567 I0705 06:07:52.823156 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=d97bf4de71c3e81b5bd83eb0157ccb08baea406ba71ffea130e0d5e2dcfd5163 I0705 06:07:52.823447 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=f9aa726420886136f4b40bace00259f023d6728440d3092420c682dfb5de4a19 I0705 06:07:52.823467 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=2990b658ac670558c26b380861d815ac71470f5de8624e4e17f76890511b9843 I0705 06:07:52.823477 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0705 06:07:52.823494 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=951a0c12225d388148a2ec430a2d6fe8f5dec7f0bb55b03180c6407f3032d94a I0705 06:07:52.823505 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0705 06:07:52.823520 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=7ef69fc990044f9332bf20f38b40dcf8519b054eff3fd60864668d450c99394f I0705 06:07:52.823531 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0705 06:07:52.823553 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=4aea99d2bc3525f1350dd20c6c8481ada43d9a5a42d181f37a770c76bd18c787 I0705 06:07:52.823565 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0705 06:07:52.823585 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=18181f84595f3f06c591099a1d0192ebcfd605061aa2f56bcb2ba0778c095211 I0705 06:07:52.823701 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=75d80edc81d2a53e860408c1e915b18d6298e81df15cf284c04f41fc6c11fabc I0705 06:07:52.823728 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0705 06:07:52.823752 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=72322f6b18c394ee27ebff6c599c274602e84961458e2059d33382aa3d412844 I0705 06:07:52.823775 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=724072e92a50311acc9be5d2936b7d4abfa22e9823b88b3717fc8e1b0e6f5c69 I0705 06:07:52.823786 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0705 06:07:52.823802 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f13a238334fceee3cf05d54e5fe99c2aef91e5a94a673c38bbe467cc47d9a225 I0705 06:07:52.823812 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0705 06:07:52.823829 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=66720b48a2d61726d727dc45d546a252de7d56b8faac4bc6679a41efad26ddc8 I0705 06:07:52.823841 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0705 06:07:52.823854 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=66dfff3f4b60a51a567243a508b51d025946808efbcb1b49b58124d12858f03a I0705 06:07:52.823870 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=c190aa957b89bdbb87c10388d6046569a756e5307e2e042713331c13ba0b76ce I0705 06:07:52.823888 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=70144b347c3b8ac4245f3c2500f8d4868626ebf741f859ad74a2f80d9c9b4339 I0705 06:07:52.823911 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=e34cc0161571b43d5c1e5bc19702d214983a278adac014d8191c44d6d8b013dc I0705 06:07:52.823922 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0705 06:07:52.823949 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=1a1b48f39a215f1225eeac65f1cac8fc453ab083bf98c8db1fc133282ff5eac3 I0705 06:07:52.823969 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0705 06:07:52.823979 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0705 06:07:52.823986 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.470942053s to process 37 records I0705 06:07:52.987897 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-jstpt pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jstpt\" is waiting to start: ContainerCreating" I0705 06:07:52.987917 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jstpt\" is waiting to start: ContainerCreating" I0705 06:07:52.987928 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sbczb pod in namespace openshift-ingress-canary (previous: false). I0705 06:07:53.196633 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-x2sxv pod in namespace openshift-ingress-canary (previous: false). I0705 06:07:53.390412 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-x2sxv pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-x2sxv\" is waiting to start: ContainerCreating" I0705 06:07:53.390428 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-x2sxv\" is waiting to start: ContainerCreating" I0705 06:07:53.390453 1 tasks_processing.go:74] worker 11 stopped. I0705 06:07:53.390540 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=b4dae61da0d3b610479b1c7488b38480c9fa7f42d4b38827092404f0b28851cc I0705 06:07:53.390634 1 recorder.go:70] Recording events/openshift-dns with fingerprint=4b2889f0d88998f10da68cf4ae1aa5d8c453d08a65eaff0edd099ed74cb5112e I0705 06:07:53.390665 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=d85a94de5086af82e1943c33cbe82cebddf966c75cd4dd2101b3d24ca8584ceb I0705 06:07:53.390753 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=eae7f369aa3c011f4fe0de34e0b4ddce30dbf537bd4110abcd4a58bc00030185 I0705 06:07:53.390790 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=1049ba2ae81834dd0b8d443121d0f5cddf36f49a11d4824edaeff882bd104566 I0705 06:07:53.390806 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-jc7pc/dns_current.log with fingerprint=c16043a3029adc755b65ae0cac1817f8c0919fb30543e04180aa5ce51e03e32e I0705 06:07:53.390819 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-jc7pc/kube-rbac-proxy_current.log with fingerprint=856216cee0a1c5637508106e6059a42034253b35445ddd0ad374da1548363ce1 I0705 06:07:53.390967 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-p9pmk with fingerprint=d2ce7adfcec8cd1050cd602907002bf1bcea0b3b768a1a8b4b203c47a9d4b423 I0705 06:07:53.391062 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-xr642 with fingerprint=23809652bc0bd8caaf0dc85fd8c390b7194da82a1d75c34e0bdb70c100dd34cd I0705 06:07:53.391074 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-5flvg/dns-node-resolver_current.log with fingerprint=d8deb40e8b9d5d37bd8554831c16d756e11ac1c6d55d614438f20a62bf5dfadd I0705 06:07:53.391084 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-779lk/dns-node-resolver_current.log with fingerprint=84ff1888a0c9736954a3aa20983ff7e2303a691ac11657941fc6e4312c7f78b0 I0705 06:07:53.391104 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-89bgt/dns-node-resolver_current.log with fingerprint=a0adb279c18ab58ae500083161cb6b65a9435c80aff5c8161eea4869f4bc7e5b I0705 06:07:53.391141 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-6b99c96d88-gfpx7/router_current.log with fingerprint=776f6cbe913ffe553522e677081ad6c04426529dc0b46d0316b3ff8c744bcae8 I0705 06:07:53.391187 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-6b99c96d88-hfnjn/router_current.log with fingerprint=8e137bdd109d451aacb6a1973cc4013c12f7cdc8da47dbb0d4aba63cd58a9677 I0705 06:07:53.391216 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-f4c9ccc9c-vx5lv/router_current.log with fingerprint=ed723e6c77d37aef9f06d28e3589e06bca57efac6537b6922125ede22c651438 I0705 06:07:53.391291 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-jstpt with fingerprint=e9b85f4d519d57cb6aa36762ba7e0f71551e933a5707d6d6bb168f3cc17649e3 I0705 06:07:53.391301 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-sbczb/serve-healthcheck-canary_current.log with fingerprint=a06c14b47b2fad110451e137a7a40e6d98ef1062240dadab85775c9f9e9eed7a I0705 06:07:53.391365 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-x2sxv with fingerprint=eba1b3ab3d4514e8caf6e85575b1fc37ac5be3b7882393ec7cba3474627ace9b I0705 06:07:53.391377 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.039710304s to process 18 records W0705 06:07:53.408235 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0705 06:07:54.408258 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0705 06:07:55.403575 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0705 06:07:55.403613 1 tasks_processing.go:74] worker 2 stopped. E0705 06:07:55.403629 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0705 06:07:55.403644 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0705 06:07:55.403653 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.034551217s to process 1 records I0705 06:08:03.379632 1 tasks_processing.go:74] worker 19 stopped. I0705 06:08:03.379675 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0705 06:08:03.379689 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.029417576s to process 1 records I0705 06:08:04.156095 1 tasks_processing.go:74] worker 5 stopped. I0705 06:08:04.156434 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3 I0705 06:08:04.156459 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.806185289s to process 1 records E0705 06:08:04.156540 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.807s with: function \"machines\" failed with an error, function \"metrics\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"tsdb_status\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0705 06:08:04.157632 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "metrics" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "tsdb_status" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0705 06:08:04.157650 1 periodic.go:212] Running workloads gatherer I0705 06:08:04.157666 1 tasks_processing.go:45] number of workers: 2 I0705 06:08:04.157675 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 06:08:04.157679 1 tasks_processing.go:71] worker 1 working on workload_info task. I0705 06:08:04.157693 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 06:08:04.157772 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0705 06:08:04.163934 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-98.ec2.internal... I0705 06:08:04.163936 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-151.ec2.internal... I0705 06:08:04.163947 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-166.ec2.internal... I0705 06:08:04.183211 1 tasks_processing.go:74] worker 0 stopped. I0705 06:08:04.183225 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 25.416388ms to process 0 records I0705 06:08:08.441653 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0705 06:08:08.464816 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I0705 06:08:08.473484 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (10ms) I0705 06:08:08.482735 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (9ms) I0705 06:08:08.491827 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (9ms) I0705 06:08:08.501230 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (9ms) I0705 06:08:08.509874 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (9ms) I0705 06:08:08.519942 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (10ms) I0705 06:08:08.528637 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (9ms) I0705 06:08:08.537392 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (9ms) I0705 06:08:08.545998 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (9ms) I0705 06:08:08.554989 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (9ms) I0705 06:08:08.573530 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (19ms) I0705 06:08:08.674018 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (100ms) I0705 06:08:08.776538 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (103ms) I0705 06:08:08.874506 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (98ms) I0705 06:08:08.974355 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I0705 06:08:09.074823 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms) I0705 06:08:09.174296 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (99ms) I0705 06:08:09.274885 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (101ms) I0705 06:08:09.375293 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I0705 06:08:09.474774 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (99ms) I0705 06:08:09.574560 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (100ms) I0705 06:08:09.674562 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (100ms) I0705 06:08:09.774325 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (100ms) I0705 06:08:09.874026 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (100ms) I0705 06:08:09.974674 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (101ms) I0705 06:08:10.074791 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (100ms) I0705 06:08:10.182211 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (107ms) I0705 06:08:10.279988 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (98ms) I0705 06:08:10.378971 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (99ms) I0705 06:08:10.474866 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (96ms) I0705 06:08:10.574682 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms) I0705 06:08:10.674251 1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (100ms) I0705 06:08:10.775001 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (101ms) I0705 06:08:10.875199 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (100ms) I0705 06:08:10.975463 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (100ms) I0705 06:08:11.074442 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (99ms) I0705 06:08:11.175119 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (101ms) I0705 06:08:11.274741 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms) I0705 06:08:11.374909 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (100ms) I0705 06:08:11.474772 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms) I0705 06:08:11.574072 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (99ms) I0705 06:08:11.674763 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (101ms) I0705 06:08:11.774258 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (99ms) I0705 06:08:11.874104 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (100ms) I0705 06:08:11.974888 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (101ms) I0705 06:08:12.075372 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms) I0705 06:08:12.174986 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I0705 06:08:12.274427 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (99ms) I0705 06:08:12.374231 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (100ms) I0705 06:08:12.374263 1 tasks_processing.go:74] worker 1 stopped. I0705 06:08:12.374626 1 recorder.go:70] Recording config/workload_info with fingerprint=3fa7fdfc2bfaf9aac0408d3f84df1d94f48460c8506a4ab82c6bc849c1d9f5fe I0705 06:08:12.374643 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.216575561s to process 1 records I0705 06:08:12.374658 1 periodic.go:259] Periodic gather workloads completed in 8.217s I0705 06:08:12.374668 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0705 06:08:12.374672 1 periodic.go:212] Running conditional gatherer I0705 06:08:12.382769 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0705 06:08:12.507153 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E0705 06:08:12.511788 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.15.5:9091: connect: connection refused I0705 06:08:12.511872 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0705 06:08:12.520319 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0705 06:08:12.520333 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520338 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520342 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520345 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520347 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520351 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520354 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520356 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520359 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0705 06:08:12.520363 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0705 06:08:12.520379 1 tasks_processing.go:45] number of workers: 3 I0705 06:08:12.520395 1 tasks_processing.go:69] worker 2 listening for tasks. I0705 06:08:12.520402 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0705 06:08:12.520403 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 06:08:12.520418 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0705 06:08:12.520412 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 06:08:12.520426 1 tasks_processing.go:74] worker 1 stopped. I0705 06:08:12.520431 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0705 06:08:12.520519 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0705 06:08:12.520532 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.726µs to process 1 records I0705 06:08:12.520566 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0705 06:08:12.520574 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.509µs to process 1 records I0705 06:08:12.520580 1 tasks_processing.go:74] worker 0 stopped. I0705 06:08:12.520739 1 tasks_processing.go:74] worker 2 stopped. I0705 06:08:12.520753 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 291.681µs to process 0 records I0705 06:08:12.520767 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0705 06:08:12.520783 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0705 06:08:12.545175 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=f9542ef680a8a13193e928d8a9f9d1f20eb6ee44706557225e7fb368f6d67935 I0705 06:08:12.545292 1 diskrecorder.go:70] Writing 127 records to /var/lib/insights-operator/insights-2026-07-05-060812.tar.gz I0705 06:08:12.553420 1 diskrecorder.go:51] Wrote 127 records to disk in 8ms I0705 06:08:12.553449 1 periodic.go:281] Gathering cluster info every 2h0m0s I0705 06:08:12.553465 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0705 06:09:20.349771 1 diskrecorder.go:223] Found files to send: insights-2026-07-05-060812.tar.gz I0705 06:09:20.349805 1 insightsuploader.go:150] Checking archives to upload periodically every 15m29.638786854s I0705 06:09:20.349813 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0705 06:09:20.361883 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0705 06:09:20.453743 1 requests.go:87] Successfully reported id=2026-07-05T06:09:20Z x-rh-insights-request-id=5de3f415010340859e59ed1a1580b005, wrote=63488 I0705 06:09:20.453835 1 insightsuploader.go:187] Uploaded report successfully in 104.018422ms I0705 06:09:20.453857 1 controller.go:119] Initializing last reported time to 2026-07-05T06:09:20Z I0705 06:09:20.453928 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0705 06:09:20.453943 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0705 06:09:20.453950 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0705 06:09:20.459287 1 controller.go:481] The operator is healthy I0705 06:09:50.375854 1 controller.go:481] The operator is healthy I0705 06:10:22.618123 1 insightsreport.go:137] Pulling report from smart-proxy I0705 06:10:22.618152 1 insightsreport.go:149] Retrieving report I0705 06:10:22.628412 1 requests.go:110] Retrieving report for cluster: 28a41331-54b7-49c5-8ddb-1eaeaa561073 I0705 06:10:22.628425 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/28a41331-54b7-49c5-8ddb-1eaeaa561073/reports I0705 06:10:22.631263 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/28a41331-54b7-49c5-8ddb-1eaeaa561073/reports I0705 06:10:22.811767 1 insightsreport.go:184] Report retrieved I0705 06:10:22.871130 1 insightsreport.go:239] Report retrieved correctly I0705 06:11:50.375977 1 controller.go:481] The operator is healthy I0705 06:12:50.339709 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:12:50.345330 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:12:50.345350 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:12:50.349408 1 secretconfigobserver.go:119] support secret does not exist I0705 06:13:50.375954 1 controller.go:481] The operator is healthy I0705 06:15:50.376228 1 controller.go:481] The operator is healthy I0705 06:17:50.336513 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:17:50.349624 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:17:50.353989 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:17:50.354004 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:17:50.357834 1 secretconfigobserver.go:119] support secret does not exist I0705 06:17:50.374947 1 controller.go:481] The operator is healthy I0705 06:19:50.375786 1 controller.go:481] The operator is healthy I0705 06:21:50.375589 1 controller.go:481] The operator is healthy I0705 06:22:50.358784 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:22:50.364025 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:22:50.364043 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:22:50.367854 1 secretconfigobserver.go:119] support secret does not exist I0705 06:23:50.375579 1 controller.go:481] The operator is healthy I0705 06:24:55.093472 1 insightsuploader.go:146] Nothing to report since 2026-07-05T06:09:20Z I0705 06:25:50.375870 1 controller.go:481] The operator is healthy I0705 06:27:50.337752 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:27:50.368892 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:27:50.373395 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:27:50.373413 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:27:50.375173 1 controller.go:481] The operator is healthy I0705 06:27:50.377049 1 secretconfigobserver.go:119] support secret does not exist I0705 06:29:50.376741 1 controller.go:481] The operator is healthy I0705 06:31:50.375659 1 controller.go:481] The operator is healthy I0705 06:32:50.377708 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:32:50.382095 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:32:50.382113 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:32:50.386125 1 secretconfigobserver.go:119] support secret does not exist I0705 06:33:50.376790 1 controller.go:481] The operator is healthy I0705 06:35:50.375772 1 controller.go:481] The operator is healthy I0705 06:37:50.337532 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:37:50.341843 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:37:50.375428 1 controller.go:481] The operator is healthy I0705 06:37:50.386298 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:37:50.392892 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:37:50.392913 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:37:50.397449 1 secretconfigobserver.go:119] support secret does not exist I0705 06:39:50.376809 1 controller.go:481] The operator is healthy I0705 06:40:34.425339 1 insightsuploader.go:146] Nothing to report since 2026-07-05T06:09:20Z I0705 06:41:50.376542 1 controller.go:481] The operator is healthy I0705 06:42:50.398404 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:42:50.404292 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:42:50.404319 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:42:50.408379 1 secretconfigobserver.go:119] support secret does not exist I0705 06:43:50.376291 1 controller.go:481] The operator is healthy I0705 06:45:50.376078 1 controller.go:481] The operator is healthy I0705 06:47:50.338079 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 06:47:50.375868 1 controller.go:481] The operator is healthy I0705 06:47:50.408862 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 06:47:50.413280 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 06:47:50.413303 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 06:47:50.417017 1 secretconfigobserver.go:119] support secret does not exist