W0703 22:00:27.718794       1 cmd.go:257] Using insecure, self-signed certificates
I0703 22:00:27.878852       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:27.879182       1 observer_polling.go:159] Starting file observer
W0703 22:00:27.902478       1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights"
I0703 22:00:28.233282       1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$
I0703 22:00:28.233526       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0703 22:00:28.234037       1 secure_serving.go:57] Forcing use of http/1.1 only
W0703 22:00:28.234062       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0703 22:00:28.234069       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0703 22:00:28.234074       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0703 22:00:28.234078       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0703 22:00:28.234081       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0703 22:00:28.234085       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0703 22:00:28.234181       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0703 22:00:28.239064       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0703 22:00:28.239100       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0703 22:00:28.239112       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0703 22:00:28.239085       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0703 22:00:28.239119       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0703 22:00:28.239145       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0703 22:00:28.239409       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2054292551/tls.crt::/tmp/serving-cert-2054292551/tls.key"
I0703 22:00:28.239557       1 secure_serving.go:213] Serving securely on [::]:8443
I0703 22:00:28.239598       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I0703 22:00:28.239746       1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot]
I0703 22:00:28.239885       1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
E0703 22:00:28.243455       1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bee6949088d1b2  openshift-insights    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-03 22:00:28.239729074 +0000 UTC m=+0.565588019,LastTimestamp:2026-07-03 22:00:28.239729074 +0000 UTC m=+0.565588019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}"
W0703 22:00:28.244778       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0703 22:00:28.244807       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0703 22:00:28.244926       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0703 22:00:28.249408       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0703 22:00:28.249427       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0703 22:00:28.253498       1 secretconfigobserver.go:119] support secret does not exist
I0703 22:00:28.257807       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0703 22:00:28.261790       1 secretconfigobserver.go:119] support secret does not exist
I0703 22:00:28.265234       1 recorder.go:156] Pruning old reports every 6h42m1s, max age is 288h0m0s
I0703 22:00:28.269808       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0703 22:00:28.269825       1 periodic.go:212] Running clusterconfig gatherer
I0703 22:00:28.269829       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0703 22:00:28.269855       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0703 22:00:28.269860       1 insightsreport.go:296] Starting report retriever
I0703 22:00:28.269866       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0703 22:00:28.269875       1 tasks_processing.go:45] number of workers: 32
I0703 22:00:28.269911       1 tasks_processing.go:69] worker 0 listening for tasks.
I0703 22:00:28.269917       1 tasks_processing.go:69] worker 31 listening for tasks.
I0703 22:00:28.269917       1 tasks_processing.go:69] worker 6 listening for tasks.
I0703 22:00:28.269928       1 tasks_processing.go:69] worker 24 listening for tasks.
I0703 22:00:28.269929       1 tasks_processing.go:71] worker 31 working on feature_gates task.
I0703 22:00:28.269933       1 tasks_processing.go:71] worker 6 working on crds task.
I0703 22:00:28.269937       1 tasks_processing.go:69] worker 25 listening for tasks.
I0703 22:00:28.269937       1 tasks_processing.go:69] worker 23 listening for tasks.
I0703 22:00:28.269943       1 tasks_processing.go:69] worker 8 listening for tasks.
I0703 22:00:28.269946       1 tasks_processing.go:69] worker 26 listening for tasks.
I0703 22:00:28.269951       1 tasks_processing.go:69] worker 20 listening for tasks.
I0703 22:00:28.269921       1 tasks_processing.go:69] worker 16 listening for tasks.
I0703 22:00:28.269958       1 tasks_processing.go:69] worker 9 listening for tasks.
I0703 22:00:28.269952       1 tasks_processing.go:69] worker 27 listening for tasks.
I0703 22:00:28.269955       1 tasks_processing.go:69] worker 19 listening for tasks.
I0703 22:00:28.269965       1 tasks_processing.go:69] worker 21 listening for tasks.
I0703 22:00:28.269964       1 tasks_processing.go:69] worker 28 listening for tasks.
I0703 22:00:28.269967       1 tasks_processing.go:69] worker 17 listening for tasks.
I0703 22:00:28.269971       1 tasks_processing.go:69] worker 29 listening for tasks.
I0703 22:00:28.269974       1 tasks_processing.go:69] worker 18 listening for tasks.
I0703 22:00:28.269978       1 tasks_processing.go:69] worker 30 listening for tasks.
I0703 22:00:28.269982       1 tasks_processing.go:69] worker 22 listening for tasks.
I0703 22:00:28.269973       1 tasks_processing.go:69] worker 10 listening for tasks.
I0703 22:00:28.269980       1 tasks_processing.go:69] worker 11 listening for tasks.
I0703 22:00:28.269923       1 tasks_processing.go:71] worker 0 working on certificate_signing_requests task.
I0703 22:00:28.269994       1 tasks_processing.go:69] worker 13 listening for tasks.
I0703 22:00:28.269997       1 tasks_processing.go:69] worker 5 listening for tasks.
I0703 22:00:28.269998       1 tasks_processing.go:69] worker 1 listening for tasks.
I0703 22:00:28.270003       1 tasks_processing.go:69] worker 14 listening for tasks.
I0703 22:00:28.270005       1 tasks_processing.go:69] worker 2 listening for tasks.
I0703 22:00:28.269987       1 tasks_processing.go:69] worker 12 listening for tasks.
I0703 22:00:28.270012       1 tasks_processing.go:69] worker 15 listening for tasks.
I0703 22:00:28.270013       1 tasks_processing.go:69] worker 3 listening for tasks.
I0703 22:00:28.270019       1 tasks_processing.go:71] worker 27 working on openstack_version task.
I0703 22:00:28.270022       1 tasks_processing.go:71] worker 8 working on tsdb_status task.
I0703 22:00:28.270024       1 tasks_processing.go:71] worker 3 working on pdbs task.
W0703 22:00:28.270064       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:28.270081       1 tasks_processing.go:71] worker 8 working on machine_config_pools task.
I0703 22:00:28.270090       1 tasks_processing.go:71] worker 19 working on nodenetworkconfigurationpolicies task.
I0703 22:00:28.269933       1 tasks_processing.go:69] worker 7 listening for tasks.
I0703 22:00:28.270199       1 tasks_processing.go:71] worker 20 working on active_alerts task.
I0703 22:00:28.270233       1 tasks_processing.go:71] worker 16 working on cost_management_metrics_configs task.
I0703 22:00:28.270308       1 tasks_processing.go:71] worker 30 working on pod_network_connectivity_checks task.
I0703 22:00:28.269986       1 tasks_processing.go:69] worker 4 listening for tasks.
I0703 22:00:28.270414       1 tasks_processing.go:71] worker 4 working on version task.
I0703 22:00:28.270310       1 tasks_processing.go:71] worker 11 working on dvo_metrics task.
W0703 22:00:28.270246       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:28.270267       1 tasks_processing.go:71] worker 9 working on storage_cluster task.
I0703 22:00:28.270256       1 tasks_processing.go:71] worker 26 working on networks task.
I0703 22:00:28.270277       1 tasks_processing.go:71] worker 23 working on mutating_webhook_configurations task.
I0703 22:00:28.270277       1 tasks_processing.go:71] worker 24 working on schedulers task.
I0703 22:00:28.270279       1 tasks_processing.go:71] worker 25 working on nodenetworkstates task.
I0703 22:00:28.270286       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 51.97µs to process 0 records
I0703 22:00:28.270288       1 tasks_processing.go:71] worker 10 working on container_runtime_configs task.
I0703 22:00:28.270948       1 tasks_processing.go:71] worker 20 working on image_registries task.
I0703 22:00:28.270293       1 tasks_processing.go:71] worker 28 working on service_accounts task.
I0703 22:00:28.270296       1 tasks_processing.go:71] worker 17 working on image_pruners task.
I0703 22:00:28.270300       1 tasks_processing.go:71] worker 29 working on machines task.
I0703 22:00:28.270295       1 tasks_processing.go:71] worker 7 working on infrastructures task.
I0703 22:00:28.270304       1 tasks_processing.go:71] worker 18 working on storage_classes task.
I0703 22:00:28.270305       1 tasks_processing.go:71] worker 1 working on aggregated_monitoring_cr_names task.
I0703 22:00:28.270313       1 tasks_processing.go:71] worker 14 working on install_plans task.
I0703 22:00:28.270314       1 tasks_processing.go:71] worker 13 working on machine_autoscalers task.
I0703 22:00:28.270317       1 tasks_processing.go:71] worker 2 working on proxies task.
I0703 22:00:28.270323       1 tasks_processing.go:71] worker 12 working on nodes task.
I0703 22:00:28.270318       1 tasks_processing.go:71] worker 5 working on monitoring_persistent_volumes task.
I0703 22:00:28.270327       1 tasks_processing.go:71] worker 15 working on operators_pods_and_events task.
I0703 22:00:28.270328       1 tasks_processing.go:71] worker 22 working on node_logs task.
I0703 22:00:28.270291       1 tasks_processing.go:71] worker 21 working on ingress task.
I0703 22:00:28.270939       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 280.253µs to process 0 records
I0703 22:00:28.273613       1 tasks_processing.go:71] worker 27 working on clusterroles task.
I0703 22:00:28.273624       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 3.581618ms to process 0 records
I0703 22:00:28.273754       1 tasks_processing.go:71] worker 8 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0703 22:00:28.273756       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 3.659185ms to process 0 records
I0703 22:00:28.273772       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 3.654372ms to process 0 records
I0703 22:00:28.273818       1 tasks_processing.go:71] worker 19 working on openstack_controlplanes task.
I0703 22:00:28.274614       1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z
I0703 22:00:28.274631       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0703 22:00:28.274635       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0703 22:00:28.274639       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0703 22:00:28.274651       1 controller.go:458] The operator is still being initialized
I0703 22:00:28.274655       1 controller.go:481] The operator is healthy
I0703 22:00:28.275905       1 tasks_processing.go:71] worker 30 working on jaegers task.
E0703 22:00:28.275952       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0703 22:00:28.275969       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 5.561295ms to process 0 records
I0703 22:00:28.276874       1 tasks_processing.go:71] worker 9 working on overlapping_namespace_uids task.
I0703 22:00:28.276910       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 6.359251ms to process 0 records
I0703 22:00:28.277158       1 tasks_processing.go:71] worker 16 working on lokistack task.
I0703 22:00:28.277196       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 6.845132ms to process 0 records
I0703 22:00:28.277300       1 tasks_processing.go:71] worker 31 working on openshift_logging task.
I0703 22:00:28.277429       1 recorder.go:70] Recording config/featuregate with fingerprint=2f45a62f0f8a1476f3519fcf55977c1176f1bc5355e6e5edb7268953258f44b4
I0703 22:00:28.277448       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 7.270907ms to process 1 records
I0703 22:00:28.277465       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 3.483403ms to process 0 records
I0703 22:00:28.277475       1 tasks_processing.go:71] worker 19 working on authentication task.
I0703 22:00:28.288336       1 tasks_processing.go:71] worker 25 working on openshift_machine_api_events task.
I0703 22:00:28.288349       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 17.505277ms to process 0 records
E0703 22:00:28.288524       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0703 22:00:28.288543       1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.345289ms to process 0 records
I0703 22:00:28.288649       1 tasks_processing.go:71] worker 29 working on oauths task.
I0703 22:00:28.288726       1 tasks_processing.go:71] worker 30 working on config_maps task.
I0703 22:00:28.288769       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.799206ms to process 0 records
I0703 22:00:28.288981       1 tasks_processing.go:71] worker 31 working on sap_datahubs task.
I0703 22:00:28.289000       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 11.667612ms to process 0 records
I0703 22:00:28.289190       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 18.043788ms to process 0 records
I0703 22:00:28.289212       1 tasks_processing.go:71] worker 10 working on cluster_apiserver task.
I0703 22:00:28.289353       1 tasks_processing.go:71] worker 3 working on sap_pods task.
I0703 22:00:28.289373       1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=3319b4d97251d253d934285e4be94469a45baf8967fff160d360d07bd689baf1
I0703 22:00:28.289404       1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e395caa6b0eecbfdc73e05c702ed6bef7baaeeae331c9a9390d7b5147f591919
I0703 22:00:28.289435       1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4811bb39ddcf0755718bc150b9eb3e5120724faf9e86a84a2657cd2afd5c1342
I0703 22:00:28.289444       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 19.00176ms to process 3 records
I0703 22:00:28.289527       1 tasks_processing.go:71] worker 26 working on ceph_cluster task.
I0703 22:00:28.289714       1 recorder.go:70] Recording config/network with fingerprint=ea3fa945e5a625c19e4b9188e431b3a5f67dd29fa9ca65b00ad889a001e6b52c
I0703 22:00:28.289728       1 gather.go:177] gatherer "clusterconfig" function "networks" took 18.585864ms to process 1 records
I0703 22:00:28.294841       1 tasks_processing.go:71] worker 13 working on image task.
I0703 22:00:28.294862       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 23.250594ms to process 0 records
I0703 22:00:28.295098       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.785273ms to process 0 records
I0703 22:00:28.295115       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.59477ms to process 0 records
I0703 22:00:28.295122       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 17.907542ms to process 0 records
I0703 22:00:28.295146       1 tasks_processing.go:71] worker 31 working on machine_sets task.
I0703 22:00:28.295182       1 tasks_processing.go:71] worker 16 working on sap_config task.
I0703 22:00:28.295185       1 tasks_processing.go:71] worker 3 working on silenced_alerts task.
W0703 22:00:28.295216       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:28.295266       1 tasks_processing.go:71] worker 3 working on openstack_dataplanenodesets task.
I0703 22:00:28.295332       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 68.171µs to process 0 records
I0703 22:00:28.295748       1 tasks_processing.go:71] worker 22 working on support_secret task.
I0703 22:00:28.295821       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 23.728977ms to process 0 records
I0703 22:00:28.296071       1 recorder.go:70] Recording config/ingress with fingerprint=65443f34a6e155f148db92dd265797e891f47776ef144c408d3d6e00f80a7547
I0703 22:00:28.296095       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.706024ms to process 1 records
I0703 22:00:28.296406       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e29bbce8596c174ad584b74eaa4381886d26a7b2346634567eb62c14021b76f9
I0703 22:00:28.297583       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.86019ms to process 1 records
W0703 22:00:28.296492       1 operator.go:287] started
I0703 22:00:28.296515       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0703 22:00:28.296538       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0703 22:00:28.296552       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0703 22:00:28.296618       1 tasks_processing.go:71] worker 17 working on machine_healthchecks task.
I0703 22:00:28.296082       1 tasks_processing.go:71] worker 21 working on container_images task.
I0703 22:00:28.298551       1 recorder.go:70] Recording config/infrastructure with fingerprint=5af3ce09c6483fe4afe8714b907d7a38e07676b2eb87039a355789ddf71be06c
I0703 22:00:28.299368       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.827806ms to process 1 records
I0703 22:00:28.299492       1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=268e8f6680565e76dda4dc48b5b7bcea4e456074b636226953ede024078e7da0
I0703 22:00:28.299534       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 25.440816ms to process 1 records
I0703 22:00:28.298558       1 tasks_processing.go:71] worker 7 working on openstack_dataplanedeployments task.
I0703 22:00:28.299837       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=d2f4bc0550d54df31a14859ef6aff67ca8b6d19e96fa8aa24da9c2cf07e847e7
I0703 22:00:28.299941       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=7e3465cf39ce4b2d52c7f189d2efd30736056f601941e9b23caac2835391b464
I0703 22:00:28.300031       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=60a68eff8b5679f736176666036fe83a16afaa21cc9bbb546507cfa59d064170
I0703 22:00:28.300098       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 25.864634ms to process 3 records
I0703 22:00:28.300154       1 tasks_processing.go:71] worker 23 working on ingress_certificates task.
I0703 22:00:28.300121       1 tasks_processing.go:71] worker 24 working on machine_configs task.
I0703 22:00:28.300309       1 tasks_processing.go:71] worker 5 working on validating_webhook_configurations task.
I0703 22:00:28.300156       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 25.336977ms to process 0 records
I0703 22:00:28.300712       1 tasks_processing.go:71] worker 20 working on metrics task.
W0703 22:00:28.300784       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:28.302207       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ea93f86b27e7095ab17d6e5246a83af03043a9037d3a76ce5b75dd8865c06f03
I0703 22:00:28.302282       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 26.559882ms to process 1 records
I0703 22:00:28.302519       1 tasks_processing.go:71] worker 19 working on olm_operators task.
I0703 22:00:28.302768       1 recorder.go:70] Recording config/authentication with fingerprint=30eac3ab70e8d40c5a60e9e58a6cb737e08bd2074ac5475321373f37760f747b
I0703 22:00:28.302797       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 20.159423ms to process 1 records
I0703 22:00:28.303220       1 tasks_processing.go:71] worker 12 working on operators task.
I0703 22:00:28.303772       1 recorder.go:70] Recording config/node/ip-10-0-0-17.ec2.internal with fingerprint=85019406fd5cd45065aa26b64ea96d3049413c1d82d2e1564e7260ec1ac84dd9
I0703 22:00:28.304048       1 recorder.go:70] Recording config/node/ip-10-0-1-70.ec2.internal with fingerprint=0a7f45bf1b950a254cb67f9e2b6dc8c1ef708a77278e51830257086840a05d60
I0703 22:00:28.304850       1 recorder.go:70] Recording config/node/ip-10-0-2-81.ec2.internal with fingerprint=c364a66a76641f363ceae0d2b0071d1f01af6444b8192613218362456e5c5d52
I0703 22:00:28.304980       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 26.573621ms to process 3 records
I0703 22:00:28.305028       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.883696ms to process 0 records
I0703 22:00:28.305042       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 9.371328ms to process 0 records
I0703 22:00:28.305101       1 tasks_processing.go:74] worker 0 stopped.
I0703 22:00:28.305151       1 tasks_processing.go:74] worker 26 stopped.
I0703 22:00:28.305170       1 tasks_processing.go:74] worker 18 stopped.
I0703 22:00:28.305178       1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=82029949b56481a163ff21297ddb466c2487a1fef61eae69408487fe74da4405
I0703 22:00:28.305243       1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=98af004556841e5892107f304e9e428311a2c5e8168a9de22fd39a8d67ebe4e3
I0703 22:00:28.305257       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 28.278238ms to process 2 records
I0703 22:00:28.305323       1 tasks_processing.go:74] worker 10 stopped.
W0703 22:00:28.305446       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0703 22:00:28.305473       1 recorder.go:70] Recording config/apiserver with fingerprint=7ddb5e667edf3b91d0f904a97cac4ac39ceae28397e3b081a475cb990a042453
I0703 22:00:28.305488       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 11.190618ms to process 1 records
I0703 22:00:28.305560       1 recorder.go:70] Recording config/proxy with fingerprint=6a23d68b9e04d4e7b4ff3804c2a401feb8a304c9b9f3e15a72b19b43529de064
I0703 22:00:28.305568       1 tasks_processing.go:74] worker 2 stopped.
I0703 22:00:28.305574       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.779445ms to process 1 records
I0703 22:00:28.305589       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 5.369183ms to process 0 records
I0703 22:00:28.305599       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.418448ms to process 0 records
I0703 22:00:28.305604       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 59.671µs to process 0 records
I0703 22:00:28.305608       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 8.575968ms to process 0 records
I0703 22:00:28.305612       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 15.672635ms to process 0 records
I0703 22:00:28.305661       1 tasks_processing.go:74] worker 20 stopped.
I0703 22:00:28.305672       1 tasks_processing.go:74] worker 16 stopped.
I0703 22:00:28.305677       1 tasks_processing.go:74] worker 31 stopped.
I0703 22:00:28.305675       1 tasks_processing.go:74] worker 3 stopped.
I0703 22:00:28.305683       1 tasks_processing.go:74] worker 25 stopped.
I0703 22:00:28.305718       1 tasks_processing.go:74] worker 6 stopped.
I0703 22:00:28.306155       1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=4105e4a237eb40502e30a4cb47cd32968513d28d22fa539c110d89be647066a4
I0703 22:00:28.306386       1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=323cb9bff4bcd4d4b7534a73bcec9b3d96398fbe32fca539f7fff08bbb267bfa
I0703 22:00:28.306401       1 gather.go:177] gatherer "clusterconfig" function "crds" took 35.351195ms to process 2 records
I0703 22:00:28.306491       1 tasks_processing.go:74] worker 29 stopped.
I0703 22:00:28.306697       1 recorder.go:70] Recording config/oauth with fingerprint=d5c0dcfb18d3bdd76ea43fc5b408102de4299e2fdf5f930a5875bad73de206dd
I0703 22:00:28.306714       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 17.228194ms to process 1 records
I0703 22:00:28.311640       1 tasks_processing.go:74] worker 13 stopped.
I0703 22:00:28.311789       1 recorder.go:70] Recording config/image with fingerprint=01c8055c8f1e2df228dacff6d2d543b6a4c71a1ef11dfc1201207fb8b1a79132
I0703 22:00:28.311842       1 gather.go:177] gatherer "clusterconfig" function "image" took 16.730378ms to process 1 records
I0703 22:00:28.311858       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 38.049338ms to process 0 records
I0703 22:00:28.311866       1 tasks_processing.go:74] worker 8 stopped.
I0703 22:00:28.311931       1 tasks_processing.go:74] worker 17 stopped.
E0703 22:00:28.311944       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0703 22:00:28.311951       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 13.345812ms to process 0 records
I0703 22:00:28.311960       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 12.08543ms to process 0 records
I0703 22:00:28.311969       1 tasks_processing.go:74] worker 7 stopped.
I0703 22:00:28.312113       1 tasks_processing.go:74] worker 27 stopped.
I0703 22:00:28.312307       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=fd45a997b8fd2360fec0464c4d58140b8293b4a00b91a1fd0584b26522a86c97
I0703 22:00:28.312398       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=a47efb35a75a95206c99b0492ef5b272f2fc419454d9f591544478efab85ff4e
I0703 22:00:28.312412       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 38.483489ms to process 2 records
I0703 22:00:28.313684       1 tasks_processing.go:74] worker 22 stopped.
E0703 22:00:28.313696       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0703 22:00:28.313706       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 17.914267ms to process 0 records
I0703 22:00:28.313925       1 prometheus_rules.go:88] Prometheus rules successfully created
I0703 22:00:28.314238       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0703 22:00:28.314249       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0703 22:00:28.314252       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0703 22:00:28.314256       1 controller.go:203] Source scaController *sca.Controller is not ready
I0703 22:00:28.314259       1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready
I0703 22:00:28.314274       1 controller.go:458] The operator is still being initialized
I0703 22:00:28.314281       1 controller.go:481] The operator is healthy
I0703 22:00:28.315282       1 tasks_processing.go:74] worker 24 stopped.
E0703 22:00:28.315291       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0703 22:00:28.315317       1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0703 22:00:28.315330       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 15.108726ms to process 1 records
I0703 22:00:28.332019       1 tasks_processing.go:74] worker 5 stopped.
I0703 22:00:28.332232       1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f6a0908c76cc423445a0e351b09d5f7249141b7aa38781eaf6cb0100f2ea61f9
I0703 22:00:28.332397       1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=de35c7221da704af6ee84420bf28d1780dc2e612d12b3b550fe9ba643ce20bb5
I0703 22:00:28.332429       1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=157e09e0e01e4ce709bb37199aa8a88591807f3023e3207aabfdd25c5b777831
I0703 22:00:28.332482       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=848db42e9e2cbc0d378b3f52ccd0c65414001fd76241fc7896f34865e5729b3c
I0703 22:00:28.332534       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=96ca33ff4ec4e10cf3380411dcbc2f33e9427286576f3a9139caa955251e0401
I0703 22:00:28.332585       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=9628801c492491a05b7faa607ef9d01c7b7b7e07edda0545b6efa13ef014ad5b
I0703 22:00:28.332636       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=9932e9f6d3251c081df5ebaa396cb234de1857194def2f521e227a6685d36d5e
I0703 22:00:28.332703       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=e8525457ad37aa0668cb60daae80084c9e3fda61834a7828122c1eb92ff3483c
I0703 22:00:28.332756       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=140c9dc0a4bf2764a379d825a48fc6ddcf7a4fde855452b081ce1aa133c942c1
I0703 22:00:28.332806       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=cae4a8ae1b57a6eaae3614da17e85bf97000f27f4282161f761eba7b09eb4c77
I0703 22:00:28.332857       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=64ff4550155dbd33fd99ad690cbba9f21ecc98407c4ea1c3c247e6dfb7f6e543
I0703 22:00:28.332869       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 31.684007ms to process 11 records
I0703 22:00:28.332880       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 60.639936ms to process 0 records
I0703 22:00:28.332888       1 tasks_processing.go:74] worker 1 stopped.
E0703 22:00:28.334005       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c081ef2f-63a6-4b95-86cd-f5a4e923b253%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:38381->172.30.0.10:53: read: connection refused
I0703 22:00:28.334021       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c081ef2f-63a6-4b95-86cd-f5a4e923b253%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:38381->172.30.0.10:53: read: connection refused
I0703 22:00:28.339565       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0703 22:00:28.339574       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0703 22:00:28.339585       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0703 22:00:28.345027       1 base_controller.go:82] Caches are synced for ConfigController 
I0703 22:00:28.345041       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0703 22:00:28.352198       1 tasks_processing.go:74] worker 19 stopped.
I0703 22:00:28.352282       1 recorder.go:70] Recording config/olm_operators with fingerprint=6a8d923006e763feb3f403ee04303e9bdfa7477c6eb852f0f4a6a4056703e609
I0703 22:00:28.352295       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 49.622291ms to process 1 records
I0703 22:00:28.357030       1 configmapobserver.go:84] configmaps "insights-config" not found
I0703 22:00:28.368378       1 tasks_processing.go:74] worker 30 stopped.
E0703 22:00:28.368397       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0703 22:00:28.368410       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0703 22:00:28.368416       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0703 22:00:28.368426       1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17
I0703 22:00:28.368467       1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb
I0703 22:00:28.368477       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0703 22:00:28.368482       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4
I0703 22:00:28.368487       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0703 22:00:28.368533       1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0703 22:00:28.368543       1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0703 22:00:28.368549       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 79.618216ms to process 7 records
I0703 22:00:28.394155       1 tasks_processing.go:74] worker 9 stopped.
I0703 22:00:28.394188       1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0703 22:00:28.394205       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 117.263372ms to process 1 records
I0703 22:00:28.397604       1 tasks_processing.go:74] worker 4 stopped.
I0703 22:00:28.398163       1 recorder.go:70] Recording config/version with fingerprint=5b227365f8f99817c1006c773ef083f2a9a4cb25633efb8eb5694f3b1bea6fc5
I0703 22:00:28.398177       1 recorder.go:70] Recording config/id with fingerprint=5cd2fb0b6bfb16ad5f3f80e0ba7ed791e34c5c833b3ec2d4d315020502dacbb9
I0703 22:00:28.398183       1 gather.go:177] gatherer "clusterconfig" function "version" took 127.176747ms to process 2 records
I0703 22:00:28.398791       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0703 22:00:28.398803       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0703 22:00:28.413201       1 tasks_processing.go:74] worker 21 stopped.
I0703 22:00:28.414925       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-hsxrt with fingerprint=0bd6588a2f57680a74c01637a3283f342872027e7f262192658b5df9a3ab5ab2
I0703 22:00:28.415147       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-qc7ww with fingerprint=79806bf7e538296a7dcc0112df5f793245bb40ce8e3b35a3e8ee183dc5f0ce8a
I0703 22:00:28.415196       1 recorder.go:70] Recording config/running_containers with fingerprint=58284aa1dbe94a75e3ca30b633a9bc3c54c6bdee78c7f3b90a5b095cfe772369
I0703 22:00:28.415212       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 114.390024ms to process 3 records
I0703 22:00:28.416021       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator"
I0703 22:00:28.418874       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress"
I0703 22:00:28.418955       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0703 22:00:28.422916       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:51096->172.30.0.10:53: read: connection refused
I0703 22:00:28.422929       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:51096->172.30.0.10:53: read: connection refused
I0703 22:00:28.462651       1 tasks_processing.go:74] worker 23 stopped.
E0703 22:00:28.462674       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0703 22:00:28.462683       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ratrgfui8ps4lphf45b481fcd6e9qkk-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ratrgfui8ps4lphf45b481fcd6e9qkk-primary-cert-bundle-secret" not found
I0703 22:00:28.462763       1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=905b2bf18b4341bfffa5bba6d219dbca77c98d8ef8d98ce6a8a79ac61f05cf72
I0703 22:00:28.462787       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 162.477817ms to process 1 records
I0703 22:00:28.706363       1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers
I0703 22:00:28.706379       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes
I0703 22:00:28.706576       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2vgn7 pod in namespace openshift-dns (previous: false).
I0703 22:00:28.937065       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2vgn7 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-2vgn7\" is waiting to start: ContainerCreating"
I0703 22:00:28.937086       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-2vgn7\" is waiting to start: ContainerCreating"
I0703 22:00:28.937094       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2vgn7 pod in namespace openshift-dns (previous: false).
I0703 22:00:28.958330       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
I0703 22:00:29.117419       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2vgn7 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-2vgn7\" is waiting to start: ContainerCreating"
I0703 22:00:29.117439       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-2vgn7\" is waiting to start: ContainerCreating"
I0703 22:00:29.117467       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-9s89j pod in namespace openshift-dns (previous: false).
I0703 22:00:29.157534       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
W0703 22:00:29.300595       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0703 22:00:29.342299       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9s89j pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-9s89j\" is waiting to start: ContainerCreating"
I0703 22:00:29.342319       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-9s89j\" is waiting to start: ContainerCreating"
I0703 22:00:29.342327       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-9s89j pod in namespace openshift-dns (previous: false).
I0703 22:00:29.515263       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9s89j pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-9s89j\" is waiting to start: ContainerCreating"
I0703 22:00:29.515282       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-9s89j\" is waiting to start: ContainerCreating"
I0703 22:00:29.515311       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qp4xr pod in namespace openshift-dns (previous: false).
I0703 22:00:29.732652       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qp4xr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qp4xr\" is waiting to start: ContainerCreating"
I0703 22:00:29.732671       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qp4xr\" is waiting to start: ContainerCreating"
I0703 22:00:29.732679       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qp4xr pod in namespace openshift-dns (previous: false).
I0703 22:00:29.909748       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qp4xr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qp4xr\" is waiting to start: ContainerCreating"
I0703 22:00:29.909769       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qp4xr\" is waiting to start: ContainerCreating"
I0703 22:00:29.909778       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9vkn5 pod in namespace openshift-dns (previous: false).
I0703 22:00:29.959269       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0703 22:00:30.109266       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:30.109284       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fx9d2 pod in namespace openshift-dns (previous: false).
W0703 22:00:30.299893       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0703 22:00:30.310303       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:30.310320       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-gq729 pod in namespace openshift-dns (previous: false).
I0703 22:00:30.364044       1 tasks_processing.go:74] worker 12 stopped.
I0703 22:00:30.364101       1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=38584b91798e41a0259289afa3a4e1a4de113d05a755ead40a377e928c321211
I0703 22:00:30.364154       1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ff5755f570a8c33b15fc5c9cd73768c92deb004a3c53ab261f9d850123c54fb9
I0703 22:00:30.364191       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0703 22:00:30.364227       1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=623a6225b4987879760be48bb6beb1246c78d1fc360ccf5f8d6d3bf8142cc7a6
I0703 22:00:30.364247       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0703 22:00:30.364272       1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=39ebf8113b129f7fc1a73f94ab32ea0673278f8673cea13f52acbfeab1bf9882
I0703 22:00:30.364310       1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=f39fc1eb1af1480670ebb8fdd85a3455695c9bb5496e20366bd0e76b3957e11b
I0703 22:00:30.364337       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b3d050277c0bcf023ea29b69982b19320aa5b42cf21dc084aa3051001627a60f
I0703 22:00:30.364369       1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=3f9288d49bbfef1ff3535e4d00653922289a2527e784947f49b8ea8bf4ec44e4
I0703 22:00:30.364386       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70
I0703 22:00:30.364404       1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=d01c435d016aee49d4712c6ba0860f22cb8a75bf7154ee8df3e0186ecc77b105
I0703 22:00:30.364416       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0703 22:00:30.364433       1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=ce6521b6fce89da4c08e0684a9b294ea03863bac422931fb9aa95768970cf807
I0703 22:00:30.364447       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0703 22:00:30.364472       1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=e9d57dbc63328112200c0429f69dd75b3d62c9044f2db38e48cd993466c85c8f
I0703 22:00:30.364484       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0703 22:00:30.364499       1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=7b89aa570e8cc9b4b42fc254095c1e3803b7d552625a34bee666bab40724261e
I0703 22:00:30.364511       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0703 22:00:30.364528       1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=e6afc9d2070eb6889d906cf0e7771fded617b945336ef3223fc04683462c1b00
I0703 22:00:30.364662       1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=a8b14fc157746aa30104f91d0f25c69d6041bb54e11b3c399a0e41ae001001ad
I0703 22:00:30.364697       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0703 22:00:30.364722       1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=113da3c5e15d77be996f0196c3902ac7750daf114299d8ed5fb1726fa9a72f2b
I0703 22:00:30.364745       1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=856afb02bc07593dfdc2ffc1edfa8b595247fe0f71bdb41848e518b971e221e4
I0703 22:00:30.364764       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0703 22:00:30.364788       1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=5a83c47f1bf9650ed7307f8ced1192fe8dc14a0190d5650419dd9f78d9006d1e
I0703 22:00:30.364800       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0703 22:00:30.364813       1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=614b895d1b87ccf1b1bb14afb5adc21deda1ce06d02d7762f105cc9c83fa6995
I0703 22:00:30.364828       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=12eff8b06a2e87a754fc1d3ea99800bc0e66dc2981899364afe86f6b6dcf9052
I0703 22:00:30.364847       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=d1043453701376fe570623904cccb09a9ba47c298dc1b610b4a12f0ac6da7eaa
I0703 22:00:30.364868       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=18b6bae52411c92bfc66ea8d39724c1741aa2c97ae6cdea519551e266b0afcfb
I0703 22:00:30.364883       1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=bff2c8a89a332da17ac2bf0e9741c83e24744726ff7c5b89ab5cedb8ad0d7fd6
I0703 22:00:30.364914       1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=d8affdfa72e7a6c870a6553f97816fc74c2ea75ddeb719edcfa2d77e924c0882
I0703 22:00:30.364938       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0703 22:00:30.364949       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0703 22:00:30.364956       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.060764855s to process 34 records
I0703 22:00:30.513159       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:30.513227       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-79949bf6d6-7bc6d pod in namespace openshift-image-registry (previous: false).
I0703 22:00:30.710322       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-79949bf6d6-7bc6d pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-79949bf6d6-7bc6d\" is waiting to start: ContainerCreating"
I0703 22:00:30.710339       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-79949bf6d6-7bc6d\" is waiting to start: ContainerCreating"
I0703 22:00:30.710371       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-79949bf6d6-9d64k pod in namespace openshift-image-registry (previous: false).
I0703 22:00:30.910020       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-79949bf6d6-9d64k pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-79949bf6d6-9d64k\" is waiting to start: ContainerCreating"
I0703 22:00:30.910039       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-79949bf6d6-9d64k\" is waiting to start: ContainerCreating"
I0703 22:00:30.910083       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-98f948f6f-q9qlw pod in namespace openshift-image-registry (previous: false).
I0703 22:00:31.109158       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-98f948f6f-q9qlw pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-98f948f6f-q9qlw\" is waiting to start: ContainerCreating"
I0703 22:00:31.109178       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-98f948f6f-q9qlw\" is waiting to start: ContainerCreating"
I0703 22:00:31.109188       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5jrjz pod in namespace openshift-image-registry (previous: false).
W0703 22:00:31.299572       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0703 22:00:31.313659       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:31.313675       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gfp6j pod in namespace openshift-image-registry (previous: false).
I0703 22:00:31.510202       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:31.510220       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jjgng pod in namespace openshift-image-registry (previous: false).
I0703 22:00:31.715560       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0703 22:00:31.715580       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-c8bc8c5c-lrqbq pod in namespace openshift-ingress (previous: false).
I0703 22:00:31.909942       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-c8bc8c5c-lrqbq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-c8bc8c5c-lrqbq\" is waiting to start: ContainerCreating"
I0703 22:00:31.909961       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-c8bc8c5c-lrqbq\" is waiting to start: ContainerCreating"
I0703 22:00:31.909972       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f888f9f9b-7lf77 pod in namespace openshift-ingress (previous: false).
I0703 22:00:32.116001       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f888f9f9b-7lf77 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f888f9f9b-7lf77\" is waiting to start: ContainerCreating"
I0703 22:00:32.116018       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f888f9f9b-7lf77\" is waiting to start: ContainerCreating"
I0703 22:00:32.116028       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f888f9f9b-npfgv pod in namespace openshift-ingress (previous: false).
W0703 22:00:32.300328       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0703 22:00:32.315389       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f888f9f9b-npfgv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f888f9f9b-npfgv\" is waiting to start: ContainerCreating"
I0703 22:00:32.315406       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f888f9f9b-npfgv\" is waiting to start: ContainerCreating"
I0703 22:00:32.315437       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-9f7v8 pod in namespace openshift-ingress-canary (previous: false).
I0703 22:00:32.509869       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-9f7v8 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-9f7v8\" is waiting to start: ContainerCreating"
I0703 22:00:32.509888       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-9f7v8\" is waiting to start: ContainerCreating"
I0703 22:00:32.509919       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h5fn8 pod in namespace openshift-ingress-canary (previous: false).
I0703 22:00:32.712349       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-h5fn8 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h5fn8\" is waiting to start: ContainerCreating"
I0703 22:00:32.712370       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h5fn8\" is waiting to start: ContainerCreating"
I0703 22:00:32.712399       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mqqvb pod in namespace openshift-ingress-canary (previous: false).
I0703 22:00:32.911567       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mqqvb pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mqqvb\" is waiting to start: ContainerCreating"
I0703 22:00:32.911583       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mqqvb\" is waiting to start: ContainerCreating"
I0703 22:00:32.911601       1 tasks_processing.go:74] worker 15 stopped.
I0703 22:00:32.911683       1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=ea3c0cefb550b4a50722bf6a561b136cd6f87fe9690460fe9100c22a8f9f84db
I0703 22:00:32.911733       1 recorder.go:70] Recording events/openshift-dns with fingerprint=e7d2c803e420f96ebcb1486472f01df839bfbe770e2f0097418b072e47ef12b1
I0703 22:00:32.911844       1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=09014c94cfeb1fb4e1693d0fa24215d3fd18f55cf392c7c33392638320a570b0
I0703 22:00:32.911872       1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=1b040895b66eb100b984545a7314ac99e515d3b9da4dfefec9330608df7b4a00
I0703 22:00:32.911917       1 recorder.go:70] Recording events/openshift-ingress with fingerprint=bbdfdc28b7237aa09af715a772600164a50d67e03adc2e63b42ef79690d4ab71
I0703 22:00:32.911934       1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=6f240cec36ed449b32bac0cea22fc076af5890869ee8e9d84bab966ada72f637
I0703 22:00:32.912066       1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-2vgn7 with fingerprint=33da8fbfe3e1d7e66954d6ef3ac45af754cc92fa4a1659a488fbe55daad85548
I0703 22:00:32.912183       1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-9s89j with fingerprint=a1e33c6863dc05df564c037c1f5b88147d9ed1c1b3683b112a2eb37b0a54d10c
I0703 22:00:32.912257       1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-qp4xr with fingerprint=70308348039bb7589c33d8963d9ad28bee692094ab7f87460f77272dca90f1bd
I0703 22:00:32.912365       1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-79949bf6d6-7bc6d with fingerprint=c507f8e5635f1a4646e3b3e520226666b6a747c81ad147bf19a73262de7c48a3
I0703 22:00:32.912455       1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-79949bf6d6-9d64k with fingerprint=d96d9e3a88d2ff89b25d28b21a1db3b53bff5f3f667a1617d3bdb26015b9cb89
I0703 22:00:32.912540       1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-98f948f6f-q9qlw with fingerprint=301bcae240c27e7add99de78e0259f56274802620a7f08c80ec203f229127857
I0703 22:00:32.912598       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-9f7v8 with fingerprint=b963814690d07dbb972fdbc926b58e6f24c19727de34348779c0dfeb204606ab
I0703 22:00:32.912652       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-h5fn8 with fingerprint=c071a4c95ca9ae4581df9297083c6411eacbd6f409717e7e5d20bc55bac850fb
I0703 22:00:32.912705       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-mqqvb with fingerprint=8b5fa714d03401d0a4aad9740a51edd4d655ea4aa48783b47f34a7cab6139762
I0703 22:00:32.912714       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.639651091s to process 15 records
W0703 22:00:33.300267       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0703 22:00:33.300291       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0703 22:00:33.300305       1 tasks_processing.go:74] worker 11 stopped.
E0703 22:00:33.300316       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0703 22:00:33.300326       1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0703 22:00:33.300339       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0703 22:00:33.300349       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.029802094s to process 1 records
I0703 22:00:40.588198       1 configmapobserver.go:84] configmaps "insights-config" not found
I0703 22:00:40.904922       1 tasks_processing.go:74] worker 14 stopped.
I0703 22:00:40.904964       1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2
I0703 22:00:40.904980       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.633423501s to process 1 records
I0703 22:00:41.677806       1 tasks_processing.go:74] worker 28 stopped.
I0703 22:00:41.678081       1 recorder.go:70] Recording config/serviceaccounts with fingerprint=cf9c12fe8737f3a6d4cb9da132f43361fa8e8d22eb1cc0d002bd7e06234de064
I0703 22:00:41.678103       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.40676862s to process 1 records
E0703 22:00:41.678216       1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.408s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0703 22:00:41.679326       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0703 22:00:41.679343       1 periodic.go:212] Running workloads gatherer
I0703 22:00:41.679361       1 tasks_processing.go:45] number of workers: 2
I0703 22:00:41.679376       1 tasks_processing.go:69] worker 1 listening for tasks.
I0703 22:00:41.679385       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0703 22:00:41.679389       1 tasks_processing.go:69] worker 0 listening for tasks.
I0703 22:00:41.679458       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0703 22:00:41.704018       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data
I0703 22:00:41.708306       1 tasks_processing.go:74] worker 0 stopped.
I0703 22:00:41.708321       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 28.828189ms to process 0 records
I0703 22:00:41.713021       1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (10ms)
I0703 22:00:41.722518       1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (9ms)
I0703 22:00:41.730884       1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (8ms)
I0703 22:00:41.738837       1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (8ms)
I0703 22:00:41.746738       1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (8ms)
I0703 22:00:41.754681       1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (8ms)
I0703 22:00:41.762414       1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (8ms)
I0703 22:00:41.770865       1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (8ms)
I0703 22:00:41.779281       1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (8ms)
I0703 22:00:41.787406       1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (8ms)
I0703 22:00:41.811897       1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (24ms)
I0703 22:00:41.915411       1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (103ms)
I0703 22:00:42.014280       1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (99ms)
I0703 22:00:42.116499       1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (102ms)
I0703 22:00:42.209562       1 configmapobserver.go:84] configmaps "insights-config" not found
I0703 22:00:42.215116       1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms)
I0703 22:00:42.228763       1 configmapobserver.go:84] configmaps "insights-config" not found
I0703 22:00:42.313216       1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (98ms)
I0703 22:00:42.408097       1 configmapobserver.go:84] configmaps "insights-config" not found
I0703 22:00:42.413159       1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms)
I0703 22:00:42.512894       1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (100ms)
I0703 22:00:42.614092       1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (101ms)
I0703 22:00:42.712370       1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (98ms)
I0703 22:00:42.813288       1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (101ms)
I0703 22:00:42.912282       1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (99ms)
I0703 22:00:43.012693       1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms)
I0703 22:00:43.114382       1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (102ms)
I0703 22:00:43.213825       1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (99ms)
I0703 22:00:43.312655       1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (99ms)
I0703 22:00:43.412902       1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms)
I0703 22:00:43.513688       1 gather_workloads_info.go:387] No image sha256:cd74338580ef435dd66cf39f6252d20ff882f6af7bb1e8a7f17df49672d3d8d7 (101ms)
I0703 22:00:43.613802       1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (100ms)
I0703 22:00:43.713926       1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (100ms)
I0703 22:00:43.812861       1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (99ms)
I0703 22:00:43.913220       1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (100ms)
I0703 22:00:44.018773       1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (106ms)
I0703 22:00:44.114370       1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (96ms)
I0703 22:00:44.114407       1 tasks_processing.go:74] worker 1 stopped.
E0703 22:00:44.114419       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0703 22:00:44.114681       1 recorder.go:70] Recording config/workload_info with fingerprint=b306f863f73d454111e220cae1e954240aeaf7388a5b8c442efcb388de0930b8
I0703 22:00:44.114701       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.435012567s to process 1 records
E0703 22:00:44.114725       1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.435s with: function \"workload_info\" failed with an error"
I0703 22:00:44.115825       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0703 22:00:44.115839       1 periodic.go:212] Running conditional gatherer
I0703 22:00:44.125997       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules
I0703 22:00:44.133300       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:38980->172.30.0.10:53: read: connection refused
E0703 22:00:44.133564       1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0703 22:00:44.133622       1 conditional_gatherer.go:382] updating version cache for conditional gatherer
I0703 22:00:44.142419       1 conditional_gatherer.go:390] cluster version is '4.19.9'
E0703 22:00:44.142433       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142438       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142442       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142445       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142448       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142452       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142455       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142459       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0703 22:00:44.142461       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
I0703 22:00:44.142477       1 tasks_processing.go:45] number of workers: 3
I0703 22:00:44.142486       1 tasks_processing.go:69] worker 2 listening for tasks.
I0703 22:00:44.142490       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0703 22:00:44.142554       1 tasks_processing.go:69] worker 1 listening for tasks.
I0703 22:00:44.142569       1 tasks_processing.go:71] worker 1 working on remote_configuration task.
I0703 22:00:44.142572       1 tasks_processing.go:69] worker 0 listening for tasks.
I0703 22:00:44.142575       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0703 22:00:44.142579       1 tasks_processing.go:74] worker 0 stopped.
I0703 22:00:44.142592       1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0703 22:00:44.142609       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 884ns to process 1 records
I0703 22:00:44.142650       1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0703 22:00:44.142666       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.155µs to process 1 records
I0703 22:00:44.142674       1 tasks_processing.go:74] worker 1 stopped.
I0703 22:00:44.142860       1 tasks_processing.go:74] worker 2 stopped.
I0703 22:00:44.142872       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 277.92µs to process 0 records
I0703 22:00:44.142890       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:38980->172.30.0.10:53: read: connection refused
I0703 22:00:44.142908       1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0703 22:00:44.169069       1 recorder.go:70] Recording insights-operator/gathers with fingerprint=1c3bf84e4d39cc7bea9210543365845b72feeaa0313d1473c019b343abc7f26a
I0703 22:00:44.169228       1 diskrecorder.go:70] Writing 110 records to /var/lib/insights-operator/insights-2026-07-03-220044.tar.gz
I0703 22:00:44.176380       1 diskrecorder.go:51] Wrote 110 records to disk in 7ms
I0703 22:00:44.176411       1 periodic.go:281] Gathering cluster info every 2h0m0s
I0703 22:00:44.176426       1 periodic.go:282] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0703 22:01:47.880458       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="fb528e789c37c4ed63bfb861e2080bbc913c13b1e16a722425568379ab84bf06")
W0703 22:01:47.880498       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0703 22:01:47.880554       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="470e8648fc4a83bddbd95974450daf867499c70161559a8721b1d3c37586f845")
I0703 22:01:47.880569       1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"
I0703 22:01:47.880601       1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped"
I0703 22:01:47.880642       1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector
I0703 22:01:47.880661       1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController
I0703 22:01:47.880666       1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0703 22:01:47.880679       1 base_controller.go:181] Shutting down LoggingSyncer ...
I0703 22:01:47.880679       1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0703 22:01:47.880681       1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="41aa9443c86d1ec4dc2b1ee6938cbdfff4c19410766d92fbb8c54795996e7e97")
I0703 22:01:47.880699       1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"
I0703 22:01:47.880707       1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ...
I0703 22:01:47.880707       1 base_controller.go:123] Shutting down worker of ConfigController controller ...
I0703 22:01:47.880714       1 base_controller.go:113] All LoggingSyncer workers have been terminated
I0703 22:01:47.880723       1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"