W0707 14:59:22.931649 1 cmd.go:257] Using insecure, self-signed certificates I0707 14:59:23.389052 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:23.389397 1 observer_polling.go:159] Starting file observer W0707 14:59:23.413722 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0707 14:59:24.067579 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0707 14:59:24.067837 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0707 14:59:24.068359 1 secure_serving.go:57] Forcing use of http/1.1 only W0707 14:59:24.068383 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0707 14:59:24.068388 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0707 14:59:24.068392 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0707 14:59:24.068396 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0707 14:59:24.068400 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0707 14:59:24.068404 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0707 14:59:24.068578 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0707 14:59:24.073173 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0707 14:59:24.073189 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0707 14:59:24.073329 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0707 14:59:24.073346 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0707 14:59:24.073359 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0707 14:59:24.073371 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0707 14:59:24.073404 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0707 14:59:24.073404 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0707 14:59:24.073729 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1705953056/tls.crt::/tmp/serving-cert-1705953056/tls.key" I0707 14:59:24.073843 1 secure_serving.go:213] Serving securely on [::]:8443 I0707 14:59:24.073899 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E0707 14:59:24.076916 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18c009ec90180a2d openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-07 14:59:24.073142829 +0000 UTC m=+1.192932271,LastTimestamp:2026-07-07 14:59:24.073142829 +0000 UTC m=+1.192932271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0707 14:59:24.078641 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0707 14:59:24.078669 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0707 14:59:24.078754 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0707 14:59:24.085090 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0707 14:59:24.085112 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0707 14:59:24.089381 1 secretconfigobserver.go:119] support secret does not exist I0707 14:59:24.093613 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0707 14:59:24.097813 1 secretconfigobserver.go:119] support secret does not exist I0707 14:59:24.101463 1 recorder.go:156] Pruning old reports every 5h2m21s, max age is 288h0m0s I0707 14:59:24.108372 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0707 14:59:24.108392 1 periodic.go:212] Running clusterconfig gatherer I0707 14:59:24.108387 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0707 14:59:24.108402 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0707 14:59:24.108405 1 insightsreport.go:296] Starting report retriever I0707 14:59:24.108415 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0707 14:59:24.108457 1 tasks_processing.go:45] number of workers: 32 I0707 14:59:24.108482 1 tasks_processing.go:69] worker 0 listening for tasks. I0707 14:59:24.108495 1 tasks_processing.go:69] worker 6 listening for tasks. I0707 14:59:24.108506 1 tasks_processing.go:71] worker 6 working on sap_datahubs task. I0707 14:59:24.108506 1 tasks_processing.go:69] worker 2 listening for tasks. I0707 14:59:24.108510 1 tasks_processing.go:69] worker 1 listening for tasks. I0707 14:59:24.108514 1 tasks_processing.go:69] worker 8 listening for tasks. I0707 14:59:24.108518 1 tasks_processing.go:69] worker 4 listening for tasks. I0707 14:59:24.108523 1 tasks_processing.go:69] worker 20 listening for tasks. I0707 14:59:24.108525 1 tasks_processing.go:69] worker 21 listening for tasks. I0707 14:59:24.108527 1 tasks_processing.go:69] worker 26 listening for tasks. I0707 14:59:24.108498 1 tasks_processing.go:71] worker 0 working on metrics task. I0707 14:59:24.108529 1 tasks_processing.go:69] worker 5 listening for tasks. I0707 14:59:24.108548 1 tasks_processing.go:69] worker 11 listening for tasks. I0707 14:59:24.108552 1 tasks_processing.go:69] worker 29 listening for tasks. I0707 14:59:24.108532 1 tasks_processing.go:69] worker 9 listening for tasks. I0707 14:59:24.108535 1 tasks_processing.go:69] worker 27 listening for tasks. I0707 14:59:24.108562 1 tasks_processing.go:69] worker 30 listening for tasks. I0707 14:59:24.108544 1 tasks_processing.go:69] worker 28 listening for tasks. I0707 14:59:24.108565 1 tasks_processing.go:69] worker 23 listening for tasks. I0707 14:59:24.108571 1 tasks_processing.go:69] worker 22 listening for tasks. I0707 14:59:24.108574 1 tasks_processing.go:69] worker 31 listening for tasks. I0707 14:59:24.108540 1 tasks_processing.go:69] worker 10 listening for tasks. I0707 14:59:24.108579 1 tasks_processing.go:69] worker 14 listening for tasks. I0707 14:59:24.108581 1 tasks_processing.go:69] worker 17 listening for tasks. I0707 14:59:24.108564 1 tasks_processing.go:69] worker 12 listening for tasks. I0707 14:59:24.108587 1 tasks_processing.go:69] worker 15 listening for tasks. I0707 14:59:24.108589 1 tasks_processing.go:69] worker 25 listening for tasks. I0707 14:59:24.108593 1 tasks_processing.go:69] worker 19 listening for tasks. I0707 14:59:24.108595 1 tasks_processing.go:69] worker 16 listening for tasks. I0707 14:59:24.108571 1 tasks_processing.go:69] worker 13 listening for tasks. I0707 14:59:24.108598 1 tasks_processing.go:71] worker 1 working on proxies task. I0707 14:59:24.108601 1 tasks_processing.go:71] worker 2 working on olm_operators task. I0707 14:59:24.108605 1 tasks_processing.go:71] worker 13 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0707 14:59:24.108607 1 tasks_processing.go:71] worker 9 working on openstack_dataplanedeployments task. I0707 14:59:24.108610 1 tasks_processing.go:71] worker 4 working on image_registries task. I0707 14:59:24.108498 1 tasks_processing.go:69] worker 3 listening for tasks. I0707 14:59:24.108688 1 tasks_processing.go:71] worker 20 working on aggregated_monitoring_cr_names task. I0707 14:59:24.108712 1 tasks_processing.go:71] worker 3 working on crds task. I0707 14:59:24.108713 1 tasks_processing.go:71] worker 14 working on lokistack task. I0707 14:59:24.108721 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0707 14:59:24.108689 1 tasks_processing.go:71] worker 30 working on active_alerts task. W0707 14:59:24.108792 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:24.108808 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 26.389µs to process 0 records I0707 14:59:24.108819 1 tasks_processing.go:71] worker 30 working on validating_webhook_configurations task. I0707 14:59:24.108506 1 tasks_processing.go:69] worker 7 listening for tasks. I0707 14:59:24.108843 1 tasks_processing.go:71] worker 7 working on nodes task. I0707 14:59:24.108606 1 tasks_processing.go:71] worker 8 working on overlapping_namespace_uids task. I0707 14:59:24.108944 1 tasks_processing.go:71] worker 28 working on machine_configs task. I0707 14:59:24.109030 1 tasks_processing.go:71] worker 5 working on pdbs task. I0707 14:59:24.108587 1 tasks_processing.go:69] worker 18 listening for tasks. I0707 14:59:24.108601 1 tasks_processing.go:71] worker 11 working on openstack_controlplanes task. I0707 14:59:24.108589 1 tasks_processing.go:69] worker 24 listening for tasks. I0707 14:59:24.109387 1 tasks_processing.go:71] worker 24 working on feature_gates task. I0707 14:59:24.108716 1 tasks_processing.go:71] worker 17 working on certificate_signing_requests task. I0707 14:59:24.108603 1 tasks_processing.go:71] worker 16 working on monitoring_persistent_volumes task. I0707 14:59:24.108685 1 tasks_processing.go:71] worker 27 working on clusterroles task. I0707 14:59:24.108691 1 tasks_processing.go:71] worker 21 working on container_images task. I0707 14:59:24.109219 1 tasks_processing.go:71] worker 29 working on tsdb_status task. W0707 14:59:24.109779 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:24.109215 1 tasks_processing.go:71] worker 25 working on image task. I0707 14:59:24.109789 1 tasks_processing.go:71] worker 29 working on install_plans task. I0707 14:59:24.109227 1 tasks_processing.go:71] worker 19 working on machine_healthchecks task. I0707 14:59:24.109962 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 27.864µs to process 0 records I0707 14:59:24.109226 1 tasks_processing.go:71] worker 15 working on networks task. I0707 14:59:24.109235 1 tasks_processing.go:71] worker 31 working on machine_sets task. I0707 14:59:24.109238 1 tasks_processing.go:71] worker 23 working on cluster_apiserver task. I0707 14:59:24.109244 1 tasks_processing.go:71] worker 22 working on machines task. W0707 14:59:24.108578 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:24.110460 1 tasks_processing.go:71] worker 0 working on node_logs task. I0707 14:59:24.109251 1 tasks_processing.go:71] worker 10 working on operators task. I0707 14:59:24.110494 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.920078ms to process 0 records I0707 14:59:24.109259 1 tasks_processing.go:71] worker 18 working on version task. I0707 14:59:24.108687 1 tasks_processing.go:71] worker 26 working on support_secret task. I0707 14:59:24.111116 1 tasks_processing.go:71] worker 6 working on silenced_alerts task. I0707 14:59:24.111128 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 2.597804ms to process 0 records W0707 14:59:24.111139 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:24.111148 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 20.109µs to process 0 records I0707 14:59:24.111156 1 tasks_processing.go:71] worker 6 working on config_maps task. I0707 14:59:24.114454 1 tasks_processing.go:71] worker 14 working on infrastructures task. I0707 14:59:24.114468 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 5.729174ms to process 0 records I0707 14:59:24.114484 1 tasks_processing.go:71] worker 11 working on openstack_dataplanenodesets task. I0707 14:59:24.114487 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.203852ms to process 0 records I0707 14:59:24.114652 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0707 14:59:24.114676 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0707 14:59:24.114687 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0707 14:59:24.114706 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0707 14:59:24.114726 1 controller.go:458] The operator is still being initialized I0707 14:59:24.114734 1 controller.go:481] The operator is healthy I0707 14:59:24.129851 1 tasks_processing.go:71] worker 9 working on openshift_logging task. I0707 14:59:24.129900 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 21.230572ms to process 0 records I0707 14:59:24.130037 1 tasks_processing.go:71] worker 5 working on machine_autoscalers task. I0707 14:59:24.130227 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=a1eb885d21f8dc4d5120e1901341b0605a9a0004698b64ebb0f6d503f8700621 I0707 14:59:24.130279 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=f291b2f1161fac91970a529fb9fe8a3745ae0e92920b53dacce8324bf2abb17d I0707 14:59:24.130311 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=98629f8fc8cbd18557308a2005f621db4d3d64bd4f6f80c3b06640654f629a29 I0707 14:59:24.130328 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 20.987377ms to process 3 records I0707 14:59:24.130354 1 tasks_processing.go:71] worker 1 working on service_accounts task. I0707 14:59:24.130480 1 recorder.go:70] Recording config/proxy with fingerprint=1050764ebecccc23ab8055c8045d603d24441dc43832a1e1b513ea595a20cc14 I0707 14:59:24.130537 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 21.742664ms to process 1 records I0707 14:59:24.130753 1 tasks_processing.go:71] worker 25 working on storage_cluster task. I0707 14:59:24.130875 1 recorder.go:70] Recording config/image with fingerprint=80cbd2466540f43978c47f6dd50e2435448e5f204225f5e0f3a34453fe0ffa2e I0707 14:59:24.130920 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.949198ms to process 1 records I0707 14:59:24.132799 1 tasks_processing.go:71] worker 19 working on cost_management_metrics_configs task. E0707 14:59:24.133225 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0707 14:59:24.133297 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 22.862807ms to process 0 records I0707 14:59:24.133427 1 tasks_processing.go:71] worker 15 working on openshift_machine_api_events task. I0707 14:59:24.134808 1 recorder.go:70] Recording config/network with fingerprint=f74d893bc026bce6aa243fd3f66115e4bd39ca71c432fbbde9329df945c11bf7 I0707 14:59:24.134882 1 gather.go:177] gatherer "clusterconfig" function "networks" took 23.294849ms to process 1 records I0707 14:59:24.135193 1 recorder.go:70] Recording config/featuregate with fingerprint=09b3b4da54915d698f2539dc3f07e2ae3690abd452ff31226771a4afaed47351 I0707 14:59:24.135302 1 tasks_processing.go:71] worker 24 working on container_runtime_configs task. I0707 14:59:24.135245 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 24.17167ms to process 1 records I0707 14:59:24.135741 1 tasks_processing.go:71] worker 23 working on operators_pods_and_events task. I0707 14:59:24.136441 1 recorder.go:70] Recording config/apiserver with fingerprint=454da26057ee45d98058dfba6a51a9ada03dd004680c902efaebec32e2cffb10 I0707 14:59:24.136466 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 23.451682ms to process 1 records I0707 14:59:24.136478 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 23.91261ms to process 0 records E0707 14:59:24.136488 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0707 14:59:24.136577 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0707 14:59:24.136610 1 tasks_processing.go:71] worker 31 working on dvo_metrics task. I0707 14:59:24.136721 1 tasks_processing.go:71] worker 28 working on nodenetworkstates task. I0707 14:59:24.136617 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 25.231017ms to process 1 records E0707 14:59:24.137072 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0707 14:59:24.137086 1 gather.go:177] gatherer "clusterconfig" function "machines" took 23.92225ms to process 0 records I0707 14:59:24.137099 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 24.913818ms to process 0 records I0707 14:59:24.137110 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 24.192416ms to process 0 records E0707 14:59:24.137118 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0707 14:59:24.137123 1 tasks_processing.go:71] worker 16 working on openstack_version task. I0707 14:59:24.137126 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 24.121948ms to process 0 records I0707 14:59:24.137164 1 tasks_processing.go:71] worker 0 working on machine_config_pools task. I0707 14:59:24.137260 1 tasks_processing.go:71] worker 7 working on authentication task. I0707 14:59:24.137167 1 tasks_processing.go:71] worker 22 working on oauths task. I0707 14:59:24.137174 1 tasks_processing.go:71] worker 26 working on pod_network_connectivity_checks task. I0707 14:59:24.137640 1 recorder.go:70] Recording config/node/ip-10-0-0-131.ec2.internal with fingerprint=f50c394a4ac3944236562c3c70b4074bb604b5cd066a175f4b3a1f3027ea4833 I0707 14:59:24.137767 1 recorder.go:70] Recording config/node/ip-10-0-1-131.ec2.internal with fingerprint=0a420a016431f8cdc2643f6fdff29e5cce6470e53cfd55bbd01f6c3d10b965aa I0707 14:59:24.137870 1 recorder.go:70] Recording config/node/ip-10-0-2-146.ec2.internal with fingerprint=b7745af3b60dfe762de2f012326d8e6899e8795a957d496285a039c4cc5e876c I0707 14:59:24.137886 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 26.264482ms to process 3 records I0707 14:59:24.137899 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 21.5235ms to process 0 records I0707 14:59:24.138217 1 tasks_processing.go:71] worker 11 working on ceph_cluster task. I0707 14:59:24.138839 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f381401c58bf4b9fd31948a51719b52ca5bd479738f6d20616da5aae526706b9 I0707 14:59:24.138865 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 28.120086ms to process 1 records I0707 14:59:24.139280 1 tasks_processing.go:71] worker 4 working on storage_classes task. I0707 14:59:24.139373 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=e33d5b0170da93ada53e06c3a097bf8f2a3d6e91d782cc32a1dc216a28adde68 I0707 14:59:24.139593 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=7ad2828e796b69cee8c4599bc47a820397cf349e8c0e2149d248630ddb1a9ecc I0707 14:59:24.139636 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=d548dbe3f46f252dca921b28978b45b71ca6cfbc99c04cf9593a5d8b5211d0a7 I0707 14:59:24.139685 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a1a4610500ff84d4f073d259430d0d36c34b1e01af14a32ac1601ac5c8e44dff I0707 14:59:24.139762 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=949621085f77406b0296b0ab506981a5cddad790746b3f2ee58e8f2ca545e348 I0707 14:59:24.139810 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=5e7462ee5483260c7431fc80cf5d86bcbeb3e4bc1ad7621cf9875bf463f4eeac I0707 14:59:24.139864 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=f8ac2f96fb933f3ef1e7dc98d60246fdc840d0b181cda1b9b39b73c72c60ec06 I0707 14:59:24.139949 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=5f5fcc493b9b1f1b3720becc7272c9203c17cf3940975da9bd1da027b4ad1bae I0707 14:59:24.139994 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=019bb778fa69691bdee11d5a461765ffb93ae142a0a82ca49034dc79e4cb9e74 I0707 14:59:24.140034 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f0d125717008eab6c2ae4bd8a30a9d1db7c20f248f210ef9a4a866c9524804e9 I0707 14:59:24.140064 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=4ddd3b73d111bb4edacd5ce8ef3a0207a6beaa3ba2f663d4b7e5b923959152e6 I0707 14:59:24.140074 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 28.141497ms to process 11 records I0707 14:59:24.140095 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0707 14:59:24.140103 1 tasks_processing.go:71] worker 30 working on jaegers task. I0707 14:59:24.140117 1 tasks_processing.go:71] worker 8 working on schedulers task. I0707 14:59:24.140104 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 28.414225ms to process 1 records I0707 14:59:24.140255 1 tasks_processing.go:71] worker 14 working on image_pruners task. I0707 14:59:24.141093 1 recorder.go:70] Recording config/infrastructure with fingerprint=5158815ed6b396460017cf5476a0e241d1d98f008da16a539f78c9ef3dfe49da I0707 14:59:24.141112 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 23.191576ms to process 1 records I0707 14:59:24.141202 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7a3c228cc91e09a1f2616c2e2a20df1d8e930985659946b3b1a4e0b8035e7c2c I0707 14:59:24.141249 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=c314b6e94d57837b6787dbcba7dba22395f64b85c5b0a7a2f83344ea293a0c38 I0707 14:59:24.141202 1 tasks_processing.go:71] worker 12 working on ingress task. I0707 14:59:24.141293 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=2f227934b859f592ee9c199d6803186e47aa9a01a0e6ff9193458e0e20a790ea I0707 14:59:24.141307 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 29.482288ms to process 3 records I0707 14:59:24.141318 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 29.345242ms to process 0 records I0707 14:59:24.141326 1 tasks_processing.go:71] worker 17 working on sap_pods task. I0707 14:59:24.143945 1 tasks_processing.go:71] worker 19 working on sap_config task. I0707 14:59:24.144241 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 11.033615ms to process 0 records I0707 14:59:24.144956 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0707 14:59:24.145339 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s W0707 14:59:24.146590 1 operator.go:287] started I0707 14:59:24.146618 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0707 14:59:24.149745 1 tasks_processing.go:71] worker 21 working on ingress_certificates task. I0707 14:59:24.151941 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-gvzfz with fingerprint=787abfb8e3cabe8ac9c2821bb1585337f66c14736da0cf2017fae43d6698aab8 I0707 14:59:24.152199 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-w8kgf with fingerprint=7c06b47fb68d6818fb4dcb76ec98fab3d5fec8881b837196bede92aba407611a I0707 14:59:24.152283 1 recorder.go:70] Recording config/running_containers with fingerprint=006ada12949776f33c997553925814e2205f155ff4e85f3ca28bdef1217feb58 I0707 14:59:24.152299 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 39.996787ms to process 3 records I0707 14:59:24.152319 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 20.187341ms to process 0 records I0707 14:59:24.152331 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.708878ms to process 0 records I0707 14:59:24.152339 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 20.140512ms to process 0 records I0707 14:59:24.152348 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 16.736131ms to process 0 records I0707 14:59:24.152357 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 13.221394ms to process 0 records I0707 14:59:24.152366 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 19.549791ms to process 0 records I0707 14:59:24.152376 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 13.603746ms to process 0 records I0707 14:59:24.152383 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 41.872157ms to process 0 records I0707 14:59:24.152394 1 tasks_processing.go:71] worker 15 working on nodenetworkconfigurationpolicies task. I0707 14:59:24.152450 1 tasks_processing.go:74] worker 25 stopped. I0707 14:59:24.152455 1 tasks_processing.go:74] worker 28 stopped. I0707 14:59:24.152462 1 tasks_processing.go:74] worker 5 stopped. I0707 14:59:24.152469 1 tasks_processing.go:74] worker 20 stopped. I0707 14:59:24.152479 1 tasks_processing.go:74] worker 24 stopped. I0707 14:59:24.152483 1 tasks_processing.go:74] worker 9 stopped. I0707 14:59:24.152493 1 tasks_processing.go:74] worker 16 stopped. I0707 14:59:24.152514 1 tasks_processing.go:74] worker 3 stopped. I0707 14:59:24.153005 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=88226f4402a495ec75e31610e7eda9433942b4835daf7f6f1a06abca4773a334 I0707 14:59:24.153223 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=80b8fb85df872b29e2e998b4836063040538a5775c653116d19c4172d0e1f025 I0707 14:59:24.153240 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.964824ms to process 2 records I0707 14:59:24.153344 1 recorder.go:70] Recording config/olm_operators with fingerprint=ff7d1a4d73c4eb6b271e4545ad4e983f497a03d61144705cc6d4ef1f2d595712 I0707 14:59:24.153356 1 tasks_processing.go:74] worker 2 stopped. I0707 14:59:24.153361 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 42.601954ms to process 1 records I0707 14:59:24.153373 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.338764ms to process 0 records I0707 14:59:24.153388 1 tasks_processing.go:74] worker 30 stopped. I0707 14:59:24.153454 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=aef6fc3fde260b0f9f50296bdbf99471ff3d24400f839a67583d70d3d43a4c4a I0707 14:59:24.153458 1 tasks_processing.go:74] worker 14 stopped. I0707 14:59:24.153475 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 12.48476ms to process 1 records I0707 14:59:24.154427 1 tasks_processing.go:74] worker 0 stopped. I0707 14:59:24.154444 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 17.207298ms to process 0 records I0707 14:59:24.154883 1 tasks_processing.go:74] worker 7 stopped. I0707 14:59:24.155111 1 recorder.go:70] Recording config/authentication with fingerprint=a18a3f705b447069ebf41744b590f7229fa2ac27535c0e1e5390d4b99c6ca060 I0707 14:59:24.155139 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 17.597919ms to process 1 records I0707 14:59:24.155235 1 tasks_processing.go:74] worker 22 stopped. I0707 14:59:24.155497 1 recorder.go:70] Recording config/oauth with fingerprint=6a84cd050a4ac6601d7444bd5864cd6c8440cad36a529fd34021c08ebe7206cc I0707 14:59:24.155508 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 17.545662ms to process 1 records W0707 14:59:24.156927 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0707 14:59:24.157503 1 tasks_processing.go:74] worker 17 stopped. I0707 14:59:24.157520 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 16.160869ms to process 0 records I0707 14:59:24.158022 1 tasks_processing.go:74] worker 27 stopped. I0707 14:59:24.158719 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b1c553b74d9e9ac49e771bca1b9321fc4149997eca1f6c91e242e16151083b99 I0707 14:59:24.158963 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7e643ac3981b4664e1fe0ffab94f8c9e0bada839335d506ab14b367a362cc883 I0707 14:59:24.159003 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 48.336181ms to process 2 records I0707 14:59:24.162030 1 tasks_processing.go:74] worker 19 stopped. I0707 14:59:24.162048 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 18.048528ms to process 0 records I0707 14:59:24.162076 1 tasks_processing.go:74] worker 26 stopped. E0707 14:59:24.162083 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0707 14:59:24.162092 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 24.509297ms to process 0 records I0707 14:59:24.162192 1 tasks_processing.go:74] worker 8 stopped. I0707 14:59:24.162291 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0707 14:59:24.162300 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=19158c093c335bed7aaeb4eb40445858484ae5adc0a462fca007699caccead39 I0707 14:59:24.162305 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0707 14:59:24.162313 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0707 14:59:24.162313 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 22.063231ms to process 1 records I0707 14:59:24.162320 1 controller.go:203] Source scaController *sca.Controller is not ready I0707 14:59:24.162326 1 tasks_processing.go:74] worker 11 stopped. I0707 14:59:24.162328 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0707 14:59:24.162353 1 controller.go:458] The operator is still being initialized I0707 14:59:24.162365 1 controller.go:481] The operator is healthy I0707 14:59:24.162321 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 23.932977ms to process 0 records I0707 14:59:24.162407 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 53.664275ms to process 0 records I0707 14:59:24.162418 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 9.879103ms to process 0 records I0707 14:59:24.162425 1 tasks_processing.go:74] worker 15 stopped. I0707 14:59:24.162431 1 tasks_processing.go:74] worker 13 stopped. I0707 14:59:24.165986 1 prometheus_rules.go:88] Prometheus rules successfully created I0707 14:59:24.166031 1 tasks_processing.go:74] worker 12 stopped. I0707 14:59:24.166203 1 recorder.go:70] Recording config/ingress with fingerprint=d32896d973e452fba4a853c49a623a8fbaa0070e8f374e9e4438c79ede8d9de5 I0707 14:59:24.166217 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.74041ms to process 1 records I0707 14:59:24.166598 1 tasks_processing.go:74] worker 4 stopped. I0707 14:59:24.166728 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=d44ead83c270b3ad532dc313d1f0c331556e7515ba07ee231614d5496eee0d30 I0707 14:59:24.166750 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=acd68e84f801eaab9fa7fdddae24cd5a96a816b9d4f85ae56dc13879041f3635 I0707 14:59:24.166757 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 27.296717ms to process 2 records I0707 14:59:24.173533 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0707 14:59:24.173542 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0707 14:59:24.173618 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController E0707 14:59:24.173817 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%274efed137-6b40-425b-8858-4ecb9da33d78%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:37124->172.30.0.10:53: read: connection refused I0707 14:59:24.173829 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%274efed137-6b40-425b-8858-4ecb9da33d78%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:37124->172.30.0.10:53: read: connection refused I0707 14:59:24.178772 1 tasks_processing.go:74] worker 6 stopped. I0707 14:59:24.178798 1 base_controller.go:82] Caches are synced for ConfigController I0707 14:59:24.178806 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... E0707 14:59:24.178846 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0707 14:59:24.178862 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0707 14:59:24.178867 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0707 14:59:24.178878 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0707 14:59:24.178913 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0707 14:59:24.178921 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0707 14:59:24.178926 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0707 14:59:24.178931 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0707 14:59:24.178997 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0707 14:59:24.179007 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0707 14:59:24.179013 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 67.601111ms to process 7 records I0707 14:59:24.182824 1 configmapobserver.go:84] configmaps "insights-config" not found I0707 14:59:24.187361 1 tasks_processing.go:74] worker 21 stopped. E0707 14:59:24.187376 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0707 14:59:24.187383 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rdbtmo6s5pott3h9ari9f9vaelifotj-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rdbtmo6s5pott3h9ari9f9vaelifotj-primary-cert-bundle-secret" not found I0707 14:59:24.187447 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=967c86c4fcefa89ddb912a30f18bd248ff1ecb15f1d2d100ef9a409c13f79ba4 I0707 14:59:24.187460 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 37.591914ms to process 1 records I0707 14:59:24.219153 1 tasks_processing.go:74] worker 18 stopped. I0707 14:59:24.219762 1 recorder.go:70] Recording config/version with fingerprint=20ed8f2d515de84db3cda34db4a80a9f12b5c6e391f588b840c0b6651c73cce8 I0707 14:59:24.219789 1 recorder.go:70] Recording config/id with fingerprint=0a40f22f1b49abc40e7e73a4115dae9748e8257e9d0002975f3f2f7c1cc13c1c I0707 14:59:24.219802 1 gather.go:177] gatherer "clusterconfig" function "version" took 108.630782ms to process 2 records I0707 14:59:24.230909 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0707 14:59:24.234885 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:56846->172.30.0.10:53: read: connection refused I0707 14:59:24.234901 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:56846->172.30.0.10:53: read: connection refused I0707 14:59:24.247073 1 base_controller.go:82] Caches are synced for LoggingSyncer I0707 14:59:24.247097 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0707 14:59:24.574550 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0707 14:59:24.774376 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0707 14:59:25.156542 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0707 14:59:25.367515 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0707 14:59:25.367535 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0707 14:59:25.367759 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-h6rbc pod in namespace openshift-dns (previous: false). I0707 14:59:25.578002 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0707 14:59:25.594245 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-h6rbc pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-h6rbc\" is waiting to start: ContainerCreating" I0707 14:59:25.594266 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-h6rbc\" is waiting to start: ContainerCreating" I0707 14:59:25.594276 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-h6rbc pod in namespace openshift-dns (previous: false). I0707 14:59:25.771224 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-h6rbc pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-h6rbc\" is waiting to start: ContainerCreating" I0707 14:59:25.771245 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-h6rbc\" is waiting to start: ContainerCreating" I0707 14:59:25.771273 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hhmjt pod in namespace openshift-dns (previous: false). I0707 14:59:25.993606 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hhmjt pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hhmjt\" is waiting to start: ContainerCreating" I0707 14:59:25.993816 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hhmjt\" is waiting to start: ContainerCreating" I0707 14:59:25.993832 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hhmjt pod in namespace openshift-dns (previous: false). W0707 14:59:26.156721 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0707 14:59:26.172721 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hhmjt pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hhmjt\" is waiting to start: ContainerCreating" I0707 14:59:26.172741 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hhmjt\" is waiting to start: ContainerCreating" I0707 14:59:26.172798 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-ndh6v pod in namespace openshift-dns (previous: false). I0707 14:59:26.180221 1 tasks_processing.go:74] worker 10 stopped. I0707 14:59:26.180273 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=de8d3693ce53d5aff326d1cc3a122b01865cdec540e4c983d8183525de2129a5 I0707 14:59:26.180313 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=0e4af4a7b93ca905a0a9145fd4f54171cabf2f3e8043af8c7d240ad76723d666 I0707 14:59:26.180346 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0707 14:59:26.180377 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=d05ca9fbe349a0a1089a4e5a871ae52cf17e5ef6a7d83bf8d7f9814c7eab0155 I0707 14:59:26.180395 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0707 14:59:26.180418 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=6b10e66c86286c0d2ddb08a1228c845fed5e3d76532940394cb5a83cad03c8ea I0707 14:59:26.180449 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=53b356ae1a7f9e4ac5d1ed5e57d4581b714e4c52101e9a00e67af5b97ee0a378 I0707 14:59:26.180474 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=2ca43dc213b8fdc79cd6bb69015798e1ba77621d34aeadae419cf7561f7931ff I0707 14:59:26.180490 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=9f07cb94addd9e78ffa3d35c35a841f3567cb5c0c87b1b7b9390a079c6eb3e98 I0707 14:59:26.180508 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=fec6518e60eb56da317c8f66bb568914e5ca279eca05f6915c2952d5f7c26393 I0707 14:59:26.180518 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0707 14:59:26.180535 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=ebb9c0956f837c850cba43f3435d87d51c8e9e0263f20605b1ed13fb5f8be938 I0707 14:59:26.180547 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0707 14:59:26.180563 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=12d49b6c3596fae807f099197f3b69faef7b7e1322ddb92169df44430cd779fa I0707 14:59:26.180574 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0707 14:59:26.180594 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=cce8539c68b13cef8d916433eedcb12d543becabe6f1f9f61e8ab97b364db788 I0707 14:59:26.180605 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0707 14:59:26.180621 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=85685a6eecd29e3439ffb064bc6b89ee76ad86e417d7bcf02d5d7fdb60dacaff I0707 14:59:26.180758 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=3fda00f9c6905d306163f05a692ccc6206d810e63a3a0220b557d0fe1b35e884 I0707 14:59:26.180787 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0707 14:59:26.180811 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=ae05d3ffa4edd7d9a6bd3bb0f0db5495c09fdb0f5f693b1ce3a81cca78516c0d I0707 14:59:26.180836 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=3c0aa0650f5bf98a2259ff0887703066710483247e7326c734f79bb5da9efe47 I0707 14:59:26.180847 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0707 14:59:26.180863 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=6087f97b9ef4422ff4ae0a855e5feb350e006d6df7331c1823449c5a4b415072 I0707 14:59:26.180873 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0707 14:59:26.180889 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=f7956f3c85a3371325f9330db8dbd9bab2ec724d3576b04ba3aeea2e43b5a0c0 I0707 14:59:26.180906 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=ec3372c28268fa6284ba67b6ecf6c45f9319d7e9f29005c2d09d9641dd89f763 I0707 14:59:26.180922 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=d60037d09f8a07247646f674e05330e66365bc6ba31ed60114cb88841003655f I0707 14:59:26.180938 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=77a52113a09cfe0951ea97456066bbb899aecb3068a224bc370b7290203bb3a7 I0707 14:59:26.180963 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=18b567b1311900c0b457761e01a2188fa49a277e3f53b3c8dbad3320fff86062 I0707 14:59:26.180974 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0707 14:59:26.181001 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=7f3e28a85162c0763cb7d49f9eb33710692430d5b2d38aeadce814517aeced9f I0707 14:59:26.181019 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0707 14:59:26.181028 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0707 14:59:26.181035 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.069731151s to process 34 records I0707 14:59:26.395162 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ndh6v pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-ndh6v\" is waiting to start: ContainerCreating" I0707 14:59:26.395181 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-ndh6v\" is waiting to start: ContainerCreating" I0707 14:59:26.395190 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-ndh6v pod in namespace openshift-dns (previous: false). I0707 14:59:26.572377 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ndh6v pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-ndh6v\" is waiting to start: ContainerCreating" I0707 14:59:26.572397 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-ndh6v\" is waiting to start: ContainerCreating" I0707 14:59:26.572408 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-lf4wd pod in namespace openshift-dns (previous: false). I0707 14:59:26.772813 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:26.772837 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-q8v8f pod in namespace openshift-dns (previous: false). I0707 14:59:26.972594 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:26.972616 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-xw9ls pod in namespace openshift-dns (previous: false). W0707 14:59:27.157440 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0707 14:59:27.173012 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:27.173078 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7cf6b788d9-4sgjv pod in namespace openshift-image-registry (previous: false). I0707 14:59:27.371778 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7cf6b788d9-4sgjv pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7cf6b788d9-4sgjv\" is waiting to start: ContainerCreating" I0707 14:59:27.371802 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7cf6b788d9-4sgjv\" is waiting to start: ContainerCreating" I0707 14:59:27.371838 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7cf6b788d9-xz6ln pod in namespace openshift-image-registry (previous: false). I0707 14:59:27.583406 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7cf6b788d9-xz6ln pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7cf6b788d9-xz6ln\" is waiting to start: ContainerCreating" I0707 14:59:27.583522 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7cf6b788d9-xz6ln\" is waiting to start: ContainerCreating" I0707 14:59:27.583621 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-85d57c775d-br6j7 pod in namespace openshift-image-registry (previous: false). I0707 14:59:27.783946 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-85d57c775d-br6j7 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-85d57c775d-br6j7\" is waiting to start: ContainerCreating" I0707 14:59:27.783971 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-85d57c775d-br6j7\" is waiting to start: ContainerCreating" I0707 14:59:27.783985 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bswwr pod in namespace openshift-image-registry (previous: false). I0707 14:59:27.971962 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:27.971983 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-vss4x pod in namespace openshift-image-registry (previous: false). W0707 14:59:28.156677 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0707 14:59:28.172228 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:28.172252 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-zpn89 pod in namespace openshift-image-registry (previous: false). I0707 14:59:28.385201 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0707 14:59:28.385221 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58ccc88458-7hnmh pod in namespace openshift-ingress (previous: false). I0707 14:59:28.571916 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58ccc88458-7hnmh pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58ccc88458-7hnmh\" is waiting to start: ContainerCreating" I0707 14:59:28.571935 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58ccc88458-7hnmh\" is waiting to start: ContainerCreating" I0707 14:59:28.571946 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58ccc88458-9nntn pod in namespace openshift-ingress (previous: false). I0707 14:59:28.772104 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58ccc88458-9nntn pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58ccc88458-9nntn\" is waiting to start: ContainerCreating" I0707 14:59:28.772123 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58ccc88458-9nntn\" is waiting to start: ContainerCreating" I0707 14:59:28.772134 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5b75b647f9-5cd99 pod in namespace openshift-ingress (previous: false). I0707 14:59:28.971848 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5b75b647f9-5cd99 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5b75b647f9-5cd99\" is waiting to start: ContainerCreating" I0707 14:59:28.971869 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5b75b647f9-5cd99\" is waiting to start: ContainerCreating" I0707 14:59:28.971900 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2llzw pod in namespace openshift-ingress-canary (previous: false). W0707 14:59:29.157322 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0707 14:59:29.157348 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0707 14:59:29.157361 1 tasks_processing.go:74] worker 31 stopped. E0707 14:59:29.157371 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0707 14:59:29.157382 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0707 14:59:29.157396 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0707 14:59:29.157410 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.020710234s to process 1 records I0707 14:59:29.179803 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-2llzw pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2llzw\" is waiting to start: ContainerCreating" I0707 14:59:29.179825 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2llzw\" is waiting to start: ContainerCreating" I0707 14:59:29.179867 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-6n49l pod in namespace openshift-ingress-canary (previous: false). I0707 14:59:29.371406 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-6n49l pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-6n49l\" is waiting to start: ContainerCreating" I0707 14:59:29.371426 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-6n49l\" is waiting to start: ContainerCreating" I0707 14:59:29.371458 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-m57ct pod in namespace openshift-ingress-canary (previous: false). I0707 14:59:29.571655 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-m57ct pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m57ct\" is waiting to start: ContainerCreating" I0707 14:59:29.571672 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m57ct\" is waiting to start: ContainerCreating" I0707 14:59:29.571685 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-ctqs4 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0707 14:59:29.773267 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-ctqs4 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0707 14:59:29.972165 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-pgvxg pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0707 14:59:30.174085 1 tasks_processing.go:74] worker 23 stopped. I0707 14:59:30.174180 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=3aa337bd16c29a68f94d08890fe76ee43013d3f0f5aa712decfe08bc7185a902 I0707 14:59:30.174229 1 recorder.go:70] Recording events/openshift-dns with fingerprint=ebb165e60191ac85c0e495a919b9d0c108cf8ca40389d666ade6ca350c12bc58 I0707 14:59:30.174308 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=651064e824080bc1cffb0beae504405a01553a5ff299dce5fc59bf644e4e24c0 I0707 14:59:30.174336 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=f36d132c8d0ffa8b22dce757b9fa49593495b4edcc4e51f288f46271cb6000c9 I0707 14:59:30.174383 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=0dfdd46843556f65c0c6d46aee9765d60e8668de6c30b6568367bbd56a264d98 I0707 14:59:30.174402 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=62fa58b32e5d64cc69207d5f7f0ba26252d6cc2206540d9eef63ecf1c48ff294 I0707 14:59:30.174414 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=8d5b95a7225e95a5055d89e5aee17c773a15a12e67c113a3f7d864fa448630ed I0707 14:59:30.174465 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=16c82bb81430f62f3c56b3bb599b2e1c87f99c0c48cb8f49cdc4f74bb666a1ea I0707 14:59:30.174600 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-h6rbc with fingerprint=7cbd50524d29aa91ffc4789dd2027b5a3588fdba253924e0c9a39f70ad8a1bc0 I0707 14:59:30.174681 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-hhmjt with fingerprint=35572be522877696a409936fb17b09ca9a7f61172e5bb7b927695fe8b609936d I0707 14:59:30.174772 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-ndh6v with fingerprint=256684570be95b6e9eeeef8f9ed676dbc77207b828272ca39f317bd9ec44929d I0707 14:59:30.174886 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-7cf6b788d9-4sgjv with fingerprint=a656f23437b3f8428c3e8b15a48443fef060a1ac0268e3a3779f2ec3e7306cd1 I0707 14:59:30.174982 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-7cf6b788d9-xz6ln with fingerprint=b15b70bfe83350ade850c52a550ebca32c4701a9daf2c89432ac5fd4713d3b59 I0707 14:59:30.175072 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-85d57c775d-br6j7 with fingerprint=cb9262cd5ff7da1b1fa8333913337d3eeffe6cb69ebfed3eaee28ec321f2e1d8 I0707 14:59:30.175141 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-2llzw with fingerprint=fca866a5e24133df2051ebb1571a1373f709f2844aeaf0782bad745e53dc7b29 I0707 14:59:30.175200 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-6n49l with fingerprint=4c042b90d2cfa0b6607a8b2bdab04b9edea5e9ddc7b2e8aaf9513c29aab1de3d I0707 14:59:30.175259 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-m57ct with fingerprint=bb9c0915c940d93e4b48b5f77018876e1f5b9c844b7902e215e2e36b102546f8 I0707 14:59:30.175281 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-ctqs4/migrator_current.log with fingerprint=b77a80a0813bd3799ea866ccbaea143ded178fee5f0bbec1a7a2c4ba3f89ee48 I0707 14:59:30.175291 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-ctqs4/graceful-termination_current.log with fingerprint=a4e885ddc782a703784aa7f3e2db54db42b155911b74fb46678c9a33afbc6ea1 I0707 14:59:30.175359 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-pgvxg/kube-storage-version-migrator-operator_current.log with fingerprint=bc6a010b0f8722c25b8385380ed13cde5e9ec160f8578135d3cf3232ca49215b I0707 14:59:30.175372 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.038318328s to process 20 records I0707 14:59:34.761183 1 configmapobserver.go:84] configmaps "insights-config" not found I0707 14:59:36.862088 1 configmapobserver.go:84] configmaps "insights-config" not found I0707 14:59:36.945320 1 tasks_processing.go:74] worker 29 stopped. I0707 14:59:36.945373 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0707 14:59:36.945389 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.835509782s to process 1 records I0707 14:59:37.062034 1 configmapobserver.go:84] configmaps "insights-config" not found I0707 14:59:37.737153 1 tasks_processing.go:74] worker 1 stopped. I0707 14:59:37.737469 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=40a83a894d0cf5587650f76f2ccfab0c74acdbf62accc67d33c8bf68f5833b03 I0707 14:59:37.737496 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.606773429s to process 1 records E0707 14:59:37.737572 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.629s with: function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0707 14:59:37.738689 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0707 14:59:37.738720 1 periodic.go:212] Running workloads gatherer I0707 14:59:37.738736 1 tasks_processing.go:45] number of workers: 2 I0707 14:59:37.738744 1 tasks_processing.go:69] worker 1 listening for tasks. I0707 14:59:37.738750 1 tasks_processing.go:71] worker 1 working on workload_info task. I0707 14:59:37.738759 1 tasks_processing.go:69] worker 0 listening for tasks. I0707 14:59:37.738829 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0707 14:59:37.762405 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0707 14:59:37.767681 1 tasks_processing.go:74] worker 0 stopped. I0707 14:59:37.767729 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 28.83194ms to process 0 records I0707 14:59:37.771092 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms) I0707 14:59:37.779765 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (9ms) I0707 14:59:37.788388 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (9ms) I0707 14:59:37.796683 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (8ms) I0707 14:59:37.805468 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (9ms) I0707 14:59:37.814291 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (9ms) I0707 14:59:37.823472 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (9ms) I0707 14:59:37.831647 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (8ms) I0707 14:59:37.839754 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (8ms) I0707 14:59:37.848318 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (9ms) I0707 14:59:37.871059 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (23ms) I0707 14:59:37.972112 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (101ms) I0707 14:59:38.073731 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (102ms) I0707 14:59:38.171887 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (98ms) I0707 14:59:38.271601 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (100ms) I0707 14:59:38.371465 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (100ms) I0707 14:59:38.470996 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (100ms) I0707 14:59:38.572150 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (101ms) I0707 14:59:38.672820 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (101ms) I0707 14:59:38.771848 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (99ms) I0707 14:59:38.872173 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I0707 14:59:38.972282 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms) I0707 14:59:39.072061 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (100ms) I0707 14:59:39.172745 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (101ms) I0707 14:59:39.271483 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (99ms) I0707 14:59:39.377489 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (106ms) I0707 14:59:39.472842 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (95ms) I0707 14:59:39.572133 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (99ms) I0707 14:59:39.672059 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (100ms) I0707 14:59:39.771812 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (100ms) I0707 14:59:39.871207 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (99ms) I0707 14:59:39.971806 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (101ms) I0707 14:59:39.971842 1 tasks_processing.go:74] worker 1 stopped. E0707 14:59:39.971853 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0707 14:59:39.972167 1 recorder.go:70] Recording config/workload_info with fingerprint=8caaa28d23ee9d841757cc7ffdff336eec17fc564aa42331e9b35fa1531ac8b5 I0707 14:59:39.972188 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.233081792s to process 1 records E0707 14:59:39.972213 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.233s with: function \"workload_info\" failed with an error" I0707 14:59:39.973319 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0707 14:59:39.973333 1 periodic.go:212] Running conditional gatherer I0707 14:59:39.981476 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0707 14:59:39.988518 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:44053->172.30.0.10:53: read: connection refused E0707 14:59:39.988851 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0707 14:59:39.988912 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0707 14:59:39.997140 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0707 14:59:39.997156 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997161 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997165 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997168 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997171 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997175 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997178 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997181 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0707 14:59:39.997184 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0707 14:59:39.997201 1 tasks_processing.go:45] number of workers: 3 I0707 14:59:39.997210 1 tasks_processing.go:69] worker 2 listening for tasks. I0707 14:59:39.997215 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0707 14:59:39.997230 1 tasks_processing.go:69] worker 0 listening for tasks. I0707 14:59:39.997241 1 tasks_processing.go:69] worker 1 listening for tasks. I0707 14:59:39.997249 1 tasks_processing.go:74] worker 1 stopped. I0707 14:59:39.997251 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0707 14:59:39.997266 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0707 14:59:39.997323 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0707 14:59:39.997338 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 904ns to process 1 records I0707 14:59:39.997374 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0707 14:59:39.997384 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.791µs to process 1 records I0707 14:59:39.997390 1 tasks_processing.go:74] worker 0 stopped. I0707 14:59:39.997569 1 tasks_processing.go:74] worker 2 stopped. I0707 14:59:39.997582 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 291.234µs to process 0 records I0707 14:59:39.997605 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:44053->172.30.0.10:53: read: connection refused I0707 14:59:39.997623 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0707 14:59:40.020905 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=85671c7bd8d3c69dc8282b71fc9e0f757f6f0704ebc2b4280c861c4d5255f763 I0707 14:59:40.021062 1 diskrecorder.go:70] Writing 115 records to /var/lib/insights-operator/insights-2026-07-07-145940.tar.gz I0707 14:59:40.028690 1 diskrecorder.go:51] Wrote 115 records to disk in 7ms I0707 14:59:40.028753 1 periodic.go:281] Gathering cluster info every 2h0m0s I0707 14:59:40.028776 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0707 14:59:50.187736 1 configmapobserver.go:84] configmaps "insights-config" not found I0707 15:00:48.389844 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="e86de11d58f28e0d4e69d31a0d31d891f6be7236206f56167deb2e57cf1c05f0") W0707 15:00:48.389884 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0707 15:00:48.389943 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="78d8d83b1b7cf888d266fa2d052c624f9fd13cd7dcf35d0b108d7650f61da977") I0707 15:00:48.389971 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0707 15:00:48.390003 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0707 15:00:48.389983 1 base_controller.go:181] Shutting down LoggingSyncer ... I0707 15:00:48.390022 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0707 15:00:48.390029 1 periodic.go:173] Shutting down I0707 15:00:48.390038 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0707 15:00:48.390052 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0707 15:00:48.390071 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0707 15:00:48.390076 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="01cf2802f07af8b88a2c64f7e6d13e1a536756e3680b4b9497864304ba690981") I0707 15:00:48.390082 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" E0707 15:00:48.390087 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0707 15:00:48.390097 1 base_controller.go:181] Shutting down ConfigController ... I0707 15:00:48.390101 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0707 15:00:48.390110 1 base_controller.go:113] All ConfigController workers have been terminated I0707 15:00:48.390109 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0707 15:00:48.390101 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0707 15:00:48.390114 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1705953056/tls.crt::/tmp/serving-cert-1705953056/tls.key" E0707 15:00:48.390125 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled