I1006 06:39:46.088259 1 cmd.go:253] Using service-serving-cert provided certificates I1006 06:39:46.088592 1 observer_polling.go:159] Starting file observer W1006 06:39:46.113405 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1006 06:39:46.344908 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1006 06:39:46.345108 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1006 06:39:46.345638 1 secure_serving.go:57] Forcing use of http/1.1 only W1006 06:39:46.345665 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1006 06:39:46.345676 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1006 06:39:46.345681 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1006 06:39:46.345684 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1006 06:39:46.345686 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1006 06:39:46.345689 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1006 06:39:46.345760 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1006 06:39:46.350572 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1006 06:39:46.350591 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1006 06:39:46.352824 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1006 06:39:46.352807 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1006 06:39:46.352842 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1006 06:39:46.352845 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1006 06:39:46.352831 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1006 06:39:46.352880 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1006 06:39:46.353040 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I1006 06:39:46.353147 1 secure_serving.go:213] Serving securely on [::]:8443 I1006 06:39:46.353196 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1006 06:39:46.355050 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18dbdd787bab55a4 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-06 06:39:46.350544292 +0000 UTC m=+0.292323689,LastTimestamp:2026-10-06 06:39:46.350544292 +0000 UTC m=+0.292323689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1006 06:39:46.357713 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1006 06:39:46.357731 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1006 06:39:46.357870 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1006 06:39:46.362769 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:39:46.362801 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1006 06:39:46.368648 1 secretconfigobserver.go:119] support secret does not exist I1006 06:39:46.374120 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:39:46.383370 1 secretconfigobserver.go:119] support secret does not exist I1006 06:39:46.386556 1 recorder.go:156] Pruning old reports every 6h42m23s, max age is 288h0m0s I1006 06:39:46.392279 1 periodic.go:212] Running clusterconfig gatherer I1006 06:39:46.392290 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1006 06:39:46.392297 1 insightsreport.go:296] Starting report retriever I1006 06:39:46.392302 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1006 06:39:46.392328 1 tasks_processing.go:45] number of workers: 64 I1006 06:39:46.392279 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1006 06:39:46.392348 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1006 06:39:46.392363 1 tasks_processing.go:69] worker 63 listening for tasks. I1006 06:39:46.392367 1 tasks_processing.go:71] worker 63 working on ingress_certificates task. I1006 06:39:46.392378 1 tasks_processing.go:69] worker 31 listening for tasks. I1006 06:39:46.392381 1 tasks_processing.go:69] worker 15 listening for tasks. I1006 06:39:46.392386 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:39:46.392392 1 tasks_processing.go:69] worker 16 listening for tasks. I1006 06:39:46.392393 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:39:46.392399 1 tasks_processing.go:69] worker 17 listening for tasks. I1006 06:39:46.392399 1 tasks_processing.go:69] worker 2 listening for tasks. I1006 06:39:46.392399 1 tasks_processing.go:69] worker 47 listening for tasks. I1006 06:39:46.392404 1 tasks_processing.go:69] worker 3 listening for tasks. I1006 06:39:46.392403 1 tasks_processing.go:69] worker 18 listening for tasks. I1006 06:39:46.392409 1 tasks_processing.go:69] worker 4 listening for tasks. I1006 06:39:46.392407 1 tasks_processing.go:69] worker 19 listening for tasks. I1006 06:39:46.392411 1 tasks_processing.go:69] worker 20 listening for tasks. I1006 06:39:46.392410 1 tasks_processing.go:69] worker 39 listening for tasks. I1006 06:39:46.392416 1 tasks_processing.go:69] worker 21 listening for tasks. I1006 06:39:46.392416 1 tasks_processing.go:69] worker 44 listening for tasks. I1006 06:39:46.392417 1 tasks_processing.go:69] worker 5 listening for tasks. I1006 06:39:46.392421 1 tasks_processing.go:69] worker 6 listening for tasks. I1006 06:39:46.392422 1 tasks_processing.go:69] worker 32 listening for tasks. I1006 06:39:46.392424 1 tasks_processing.go:69] worker 45 listening for tasks. I1006 06:39:46.392421 1 tasks_processing.go:69] worker 43 listening for tasks. I1006 06:39:46.392428 1 tasks_processing.go:69] worker 7 listening for tasks. I1006 06:39:46.392425 1 tasks_processing.go:69] worker 22 listening for tasks. I1006 06:39:46.392432 1 tasks_processing.go:69] worker 28 listening for tasks. I1006 06:39:46.392433 1 tasks_processing.go:69] worker 8 listening for tasks. I1006 06:39:46.392432 1 tasks_processing.go:69] worker 34 listening for tasks. I1006 06:39:46.392428 1 tasks_processing.go:69] worker 23 listening for tasks. I1006 06:39:46.392433 1 tasks_processing.go:69] worker 27 listening for tasks. I1006 06:39:46.392426 1 tasks_processing.go:69] worker 33 listening for tasks. I1006 06:39:46.392439 1 tasks_processing.go:69] worker 40 listening for tasks. I1006 06:39:46.392441 1 tasks_processing.go:69] worker 35 listening for tasks. I1006 06:39:46.392435 1 tasks_processing.go:69] worker 46 listening for tasks. I1006 06:39:46.392446 1 tasks_processing.go:69] worker 36 listening for tasks. I1006 06:39:46.392446 1 tasks_processing.go:69] worker 30 listening for tasks. I1006 06:39:46.392448 1 tasks_processing.go:69] worker 41 listening for tasks. I1006 06:39:46.392440 1 tasks_processing.go:69] worker 29 listening for tasks. I1006 06:39:46.392443 1 tasks_processing.go:69] worker 9 listening for tasks. I1006 06:39:46.392454 1 tasks_processing.go:69] worker 51 listening for tasks. I1006 06:39:46.392454 1 tasks_processing.go:69] worker 38 listening for tasks. I1006 06:39:46.392446 1 tasks_processing.go:69] worker 25 listening for tasks. I1006 06:39:46.392456 1 tasks_processing.go:69] worker 42 listening for tasks. I1006 06:39:46.392455 1 tasks_processing.go:69] worker 26 listening for tasks. I1006 06:39:46.392460 1 tasks_processing.go:69] worker 48 listening for tasks. I1006 06:39:46.392461 1 tasks_processing.go:69] worker 52 listening for tasks. I1006 06:39:46.392450 1 tasks_processing.go:69] worker 37 listening for tasks. I1006 06:39:46.392465 1 tasks_processing.go:69] worker 53 listening for tasks. I1006 06:39:46.392467 1 tasks_processing.go:69] worker 60 listening for tasks. I1006 06:39:46.392469 1 tasks_processing.go:69] worker 54 listening for tasks. I1006 06:39:46.392468 1 tasks_processing.go:69] worker 59 listening for tasks. I1006 06:39:46.392440 1 tasks_processing.go:69] worker 24 listening for tasks. I1006 06:39:46.392474 1 tasks_processing.go:69] worker 56 listening for tasks. I1006 06:39:46.392452 1 tasks_processing.go:69] worker 11 listening for tasks. I1006 06:39:46.392474 1 tasks_processing.go:69] worker 58 listening for tasks. I1006 06:39:46.392450 1 tasks_processing.go:69] worker 55 listening for tasks. I1006 06:39:46.392457 1 tasks_processing.go:69] worker 12 listening for tasks. I1006 06:39:46.392447 1 tasks_processing.go:69] worker 10 listening for tasks. I1006 06:39:46.392461 1 tasks_processing.go:69] worker 61 listening for tasks. I1006 06:39:46.392461 1 tasks_processing.go:69] worker 13 listening for tasks. I1006 06:39:46.392463 1 tasks_processing.go:69] worker 49 listening for tasks. I1006 06:39:46.392466 1 tasks_processing.go:69] worker 50 listening for tasks. I1006 06:39:46.392467 1 tasks_processing.go:69] worker 14 listening for tasks. I1006 06:39:46.392472 1 tasks_processing.go:69] worker 62 listening for tasks. I1006 06:39:46.392471 1 tasks_processing.go:69] worker 57 listening for tasks. I1006 06:39:46.392537 1 tasks_processing.go:71] worker 0 working on storage_cluster task. I1006 06:39:46.392541 1 tasks_processing.go:71] worker 16 working on crds task. I1006 06:39:46.392540 1 tasks_processing.go:71] worker 31 working on machine_config_pools task. I1006 06:39:46.392539 1 tasks_processing.go:71] worker 19 working on machine_healthchecks task. I1006 06:39:46.392557 1 tasks_processing.go:71] worker 1 working on storage_classes task. I1006 06:39:46.392551 1 tasks_processing.go:71] worker 57 working on image_registries task. I1006 06:39:46.392564 1 tasks_processing.go:71] worker 21 working on machine_autoscalers task. I1006 06:39:46.392568 1 tasks_processing.go:71] worker 18 working on validating_webhook_configurations task. I1006 06:39:46.392581 1 tasks_processing.go:71] worker 38 working on monitoring_persistent_volumes task. I1006 06:39:46.392591 1 tasks_processing.go:71] worker 15 working on install_plans task. I1006 06:39:46.392604 1 tasks_processing.go:71] worker 23 working on container_runtime_configs task. I1006 06:39:46.392612 1 tasks_processing.go:71] worker 43 working on openstack_version task. I1006 06:39:46.392628 1 tasks_processing.go:71] worker 6 working on image task. I1006 06:39:46.392642 1 tasks_processing.go:71] worker 56 working on aggregated_monitoring_cr_names task. I1006 06:39:46.392657 1 tasks_processing.go:71] worker 4 working on schedulers task. I1006 06:39:46.392554 1 tasks_processing.go:71] worker 47 working on machine_configs task. I1006 06:39:46.392804 1 tasks_processing.go:71] worker 17 working on openshift_logging task. I1006 06:39:46.392557 1 tasks_processing.go:71] worker 20 working on nodenetworkstates task. I1006 06:39:46.392559 1 tasks_processing.go:71] worker 39 working on overlapping_namespace_uids task. I1006 06:39:46.392757 1 tasks_processing.go:71] worker 29 working on sap_config task. I1006 06:39:46.392761 1 tasks_processing.go:71] worker 30 working on silenced_alerts task. I1006 06:39:46.392764 1 tasks_processing.go:71] worker 41 working on ceph_cluster task. I1006 06:39:46.392767 1 tasks_processing.go:71] worker 11 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1006 06:39:46.392771 1 tasks_processing.go:71] worker 58 working on proxies task. I1006 06:39:46.392770 1 tasks_processing.go:71] worker 44 working on metrics task. I1006 06:39:46.392719 1 tasks_processing.go:71] worker 36 working on jaegers task. I1006 06:39:46.392791 1 tasks_processing.go:71] worker 9 working on pod_network_connectivity_checks task. I1006 06:39:46.392796 1 tasks_processing.go:71] worker 55 working on sap_pods task. I1006 06:39:46.392797 1 tasks_processing.go:71] worker 27 working on authentication task. I1006 06:39:46.392800 1 tasks_processing.go:71] worker 12 working on sap_datahubs task. I1006 06:39:46.392800 1 tasks_processing.go:71] worker 2 working on tsdb_status task. I1006 06:39:46.392802 1 tasks_processing.go:71] worker 32 working on service_accounts task. I1006 06:39:46.392802 1 tasks_processing.go:71] worker 33 working on openstack_dataplanedeployments task. I1006 06:39:46.392803 1 tasks_processing.go:71] worker 10 working on networks task. I1006 06:39:46.392806 1 tasks_processing.go:71] worker 61 working on oauths task. I1006 06:39:46.392806 1 tasks_processing.go:71] worker 40 working on machine_sets task. I1006 06:39:46.392806 1 tasks_processing.go:71] worker 45 working on version task. I1006 06:39:46.392809 1 tasks_processing.go:71] worker 13 working on clusterroles task. I1006 06:39:46.392809 1 tasks_processing.go:71] worker 35 working on cost_management_metrics_configs task. I1006 06:39:46.392812 1 tasks_processing.go:71] worker 49 working on pdbs task. I1006 06:39:46.392811 1 tasks_processing.go:71] worker 28 working on infrastructures task. I1006 06:39:46.392813 1 tasks_processing.go:71] worker 46 working on image_pruners task. I1006 06:39:46.392815 1 tasks_processing.go:71] worker 50 working on nodenetworkconfigurationpolicies task. I1006 06:39:46.392815 1 tasks_processing.go:71] worker 7 working on operators_pods_and_events task. I1006 06:39:46.392808 1 tasks_processing.go:71] worker 3 working on olm_operators task. I1006 06:39:46.392818 1 tasks_processing.go:71] worker 14 working on openshift_machine_api_events task. I1006 06:39:46.392818 1 tasks_processing.go:71] worker 37 working on feature_gates task. I1006 06:39:46.392818 1 tasks_processing.go:71] worker 22 working on cluster_apiserver task. I1006 06:39:46.392821 1 tasks_processing.go:71] worker 48 working on mutating_webhook_configurations task. I1006 06:39:46.392822 1 tasks_processing.go:71] worker 53 working on lokistack task. I1006 06:39:46.392820 1 tasks_processing.go:71] worker 62 working on ingress task. I1006 06:39:46.392822 1 tasks_processing.go:71] worker 26 working on certificate_signing_requests task. I1006 06:39:46.392823 1 tasks_processing.go:71] worker 54 working on openstack_controlplanes task. I1006 06:39:46.392824 1 tasks_processing.go:71] worker 52 working on nodes task. I1006 06:39:46.392826 1 tasks_processing.go:71] worker 59 working on config_maps task. I1006 06:39:46.392827 1 tasks_processing.go:71] worker 25 working on operators task. I1006 06:39:46.392827 1 tasks_processing.go:71] worker 60 working on node_logs task. I1006 06:39:46.392829 1 tasks_processing.go:71] worker 24 working on container_images task. I1006 06:39:46.392829 1 tasks_processing.go:71] worker 51 working on support_secret task. I1006 06:39:46.392831 1 tasks_processing.go:71] worker 42 working on machines task. I1006 06:39:46.392832 1 tasks_processing.go:71] worker 5 working on dvo_metrics task. I1006 06:39:46.392835 1 tasks_processing.go:71] worker 8 working on openstack_dataplanenodesets task. I1006 06:39:46.392836 1 tasks_processing.go:71] worker 34 working on active_alerts task. E1006 06:39:46.397796 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.67.104:9091: connect: connection refused E1006 06:39:46.397806 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.67.104:9091: connect: connection refused I1006 06:39:46.397818 1 tasks_processing.go:74] worker 2 stopped. E1006 06:39:46.397826 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.67.104:9091: connect: connection refused I1006 06:39:46.397838 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 4.145902ms to process 0 records E1006 06:39:46.397847 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.67.104:9091: connect: connection refused I1006 06:39:46.397868 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.571209ms to process 0 records I1006 06:39:46.397883 1 tasks_processing.go:74] worker 44 stopped. I1006 06:39:46.399678 1 tasks_processing.go:74] worker 21 stopped. I1006 06:39:46.399690 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 7.099878ms to process 0 records I1006 06:39:46.399695 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 7.063725ms to process 0 records I1006 06:39:46.399698 1 tasks_processing.go:74] worker 23 stopped. I1006 06:39:46.400076 1 tasks_processing.go:74] worker 43 stopped. I1006 06:39:46.400090 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 7.455303ms to process 0 records I1006 06:39:46.402506 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1006 06:39:46.402519 1 controller.go:317] The initial operator extension status is healthy I1006 06:39:46.402525 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1006 06:39:46.402528 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1006 06:39:46.402530 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1006 06:39:46.402542 1 controller.go:458] The operator is still being initialized I1006 06:39:46.402548 1 controller.go:481] The operator is healthy I1006 06:39:46.402596 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1006 06:39:46.402606 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W1006 06:39:46.402727 1 operator.go:287] started I1006 06:39:46.402744 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1006 06:39:46.403475 1 tasks_processing.go:74] worker 6 stopped. I1006 06:39:46.403570 1 recorder.go:70] Recording config/image with fingerprint=b1dcd364d70d49b838bc8ee8374420d22082efb80da5247b70747a90d50ad048 I1006 06:39:46.403582 1 gather.go:177] gatherer "clusterconfig" function "image" took 10.830321ms to process 1 records I1006 06:39:46.407628 1 tasks_processing.go:74] worker 20 stopped. I1006 06:39:46.407640 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 14.72776ms to process 0 records I1006 06:39:46.407723 1 tasks_processing.go:74] worker 1 stopped. I1006 06:39:46.407731 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=5ab73b8c24ba5e6600ac33b81c34c698dedce5ff51f4b97d635ecab66e18cd6b I1006 06:39:46.407743 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=d01127828228b77bc7b20ff699c72d8910ef24e86f450cc2a6639a3905b7c356 I1006 06:39:46.407749 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 15.074623ms to process 2 records I1006 06:39:46.407755 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.109483ms to process 0 records E1006 06:39:46.407762 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1006 06:39:46.407766 1 tasks_processing.go:74] worker 31 stopped. I1006 06:39:46.407771 1 tasks_processing.go:74] worker 19 stopped. I1006 06:39:46.407767 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 15.102002ms to process 0 records I1006 06:39:46.407820 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 15.120598ms to process 0 records I1006 06:39:46.407828 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 14.726261ms to process 0 records I1006 06:39:46.407829 1 tasks_processing.go:74] worker 0 stopped. I1006 06:39:46.407831 1 tasks_processing.go:74] worker 41 stopped. I1006 06:39:46.411717 1 tasks_processing.go:74] worker 9 stopped. E1006 06:39:46.411726 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1006 06:39:46.411731 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 18.2869ms to process 0 records I1006 06:39:46.431120 1 tasks_processing.go:74] worker 17 stopped. I1006 06:39:46.431130 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 38.26837ms to process 0 records I1006 06:39:46.431135 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 37.567542ms to process 0 records I1006 06:39:46.431139 1 tasks_processing.go:74] worker 12 stopped. I1006 06:39:46.435696 1 tasks_processing.go:74] worker 55 stopped. I1006 06:39:46.435704 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 42.174506ms to process 0 records I1006 06:39:46.435717 1 tasks_processing.go:74] worker 33 stopped. I1006 06:39:46.435723 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 41.91152ms to process 0 records I1006 06:39:46.435730 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 42.356267ms to process 0 records I1006 06:39:46.435733 1 tasks_processing.go:74] worker 36 stopped. I1006 06:39:46.435746 1 tasks_processing.go:74] worker 35 stopped. I1006 06:39:46.435754 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 41.545583ms to process 0 records I1006 06:39:46.435803 1 tasks_processing.go:74] worker 54 stopped. I1006 06:39:46.435822 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 40.28867ms to process 0 records I1006 06:39:46.435836 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 40.614427ms to process 0 records I1006 06:39:46.435844 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 42.776585ms to process 0 records I1006 06:39:46.435849 1 tasks_processing.go:74] worker 53 stopped. I1006 06:39:46.435852 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 41.312883ms to process 0 records I1006 06:39:46.435856 1 tasks_processing.go:74] worker 50 stopped. I1006 06:39:46.435858 1 tasks_processing.go:74] worker 29 stopped. I1006 06:39:46.435891 1 tasks_processing.go:74] worker 4 stopped. I1006 06:39:46.436055 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=09d005b27554a81dc11e7bcddef6b16fecface02ae88eb157723e2072c5955e4 I1006 06:39:46.436071 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 43.218853ms to process 1 records I1006 06:39:46.436109 1 tasks_processing.go:74] worker 14 stopped. I1006 06:39:46.436123 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 41.218342ms to process 0 records I1006 06:39:46.436229 1 tasks_processing.go:74] worker 58 stopped. I1006 06:39:46.436278 1 recorder.go:70] Recording config/proxy with fingerprint=7edbf0bf96df6f965935f62325e68d4d02253b04c8c02a2f628b10880ec259fb I1006 06:39:46.436286 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 43.049031ms to process 1 records I1006 06:39:46.436446 1 tasks_processing.go:74] worker 18 stopped. I1006 06:39:46.436580 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=ab230ddbf465d584ff034b722365e761052ea526eb0c959d2ee5a0f67b00de4f I1006 06:39:46.436656 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=2140008ce248e9d4f49a94d7a65645c29eade5f5ae2b2f001582e7bc852e4581 I1006 06:39:46.436705 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=d542da14d498b531ee5e7caa89e61eba3d53963bf9595a34569c3d6187aa98fa I1006 06:39:46.436724 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=94a2e59d3448e685551819bd28caaf35340b2b7ea220203bc5b595a67ff9ee74 I1006 06:39:46.436741 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=1cad69ff4c46917fbd03d2afbf05810f969716f1c44ea0453747da9049e7b4bc I1006 06:39:46.436757 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=60dc30d2518fc4c19c0fc6709303fa9ea41c66f8fda6cf586bbc5981a9374044 I1006 06:39:46.436792 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=b0619d45d9be7089363e40bdd3161e1b727797a21f941a96a2e88ddfcc3d1bfc I1006 06:39:46.436807 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=b20c32dc4b0a58f27e8338a1056c484aa0a6ff463ae73ed597ef1f4428a052f4 I1006 06:39:46.436822 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=2f3dcdb9a01f2347171490fe3d87af3ff1500c501125e90f4d10140236bafa48 I1006 06:39:46.436846 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=737e418f7bf6607b7c79d7998dd9b8fc39841e790ad8bd263c5a48535e1049aa I1006 06:39:46.436862 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=fe3b65e21fd1332245957803361ac03d9cf795af0631f8da358577fac5c14430 I1006 06:39:46.436880 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=b94c20a72ed720f200d596d1ae7493849d6b5bea8adfc7a8a6efd7d49bfb27ae I1006 06:39:46.436895 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=f264f8216c92d7fadc1315008897d04d4dba76257a9317cee3ae45e3f8b577a8 I1006 06:39:46.436902 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 43.864966ms to process 13 records I1006 06:39:46.437209 1 tasks_processing.go:74] worker 40 stopped. I1006 06:39:46.437220 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 43.128366ms to process 0 records I1006 06:39:46.437420 1 tasks_processing.go:74] worker 10 stopped. I1006 06:39:46.437601 1 recorder.go:70] Recording config/network with fingerprint=02ecbdbe7a384a9a0ebf516ab583f282efef1d4766c5faf41ee96135be9cd54e I1006 06:39:46.437611 1 gather.go:177] gatherer "clusterconfig" function "networks" took 43.482114ms to process 1 records E1006 06:39:46.437616 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1006 06:39:46.437620 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 41.368844ms to process 0 records I1006 06:39:46.437630 1 tasks_processing.go:74] worker 51 stopped. I1006 06:39:46.437808 1 tasks_processing.go:74] worker 42 stopped. E1006 06:39:46.437819 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1006 06:39:46.437826 1 gather.go:177] gatherer "clusterconfig" function "machines" took 41.560496ms to process 0 records I1006 06:39:46.437931 1 tasks_processing.go:74] worker 46 stopped. I1006 06:39:46.438078 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=14722d5744dd628cdaef2ef406030d4c0ecbeaafef14ebde2020e7ac35837b57 I1006 06:39:46.438097 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 43.403919ms to process 1 records I1006 06:39:46.438102 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 41.49419ms to process 0 records I1006 06:39:46.438107 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 41.771464ms to process 0 records I1006 06:39:46.438131 1 tasks_processing.go:74] worker 60 stopped. I1006 06:39:46.438138 1 tasks_processing.go:74] worker 8 stopped. I1006 06:39:46.438204 1 tasks_processing.go:74] worker 61 stopped. I1006 06:39:46.438483 1 recorder.go:70] Recording config/oauth with fingerprint=bd282c23b38245e90644584907b2068db563aaba5c10f6804b32df69e3a395f6 I1006 06:39:46.438500 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 44.080342ms to process 1 records I1006 06:39:46.438586 1 tasks_processing.go:74] worker 28 stopped. I1006 06:39:46.439955 1 recorder.go:70] Recording config/infrastructure with fingerprint=5235db8a315be4e88b6a21a78dcb1485d32d7ce3bc25d1ee8b3f7127f24b1c6e I1006 06:39:46.439971 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 43.790894ms to process 1 records I1006 06:39:46.441179 1 tasks_processing.go:74] worker 38 stopped. I1006 06:39:46.441193 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 48.585943ms to process 0 records I1006 06:39:46.441400 1 tasks_processing.go:74] worker 62 stopped. I1006 06:39:46.441512 1 recorder.go:70] Recording config/ingress with fingerprint=ecfc6d231b61eff067b97b9b645b499d70c8e1fbf36e324a1ca1963ec39cde5a I1006 06:39:46.441524 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 46.175068ms to process 1 records E1006 06:39:46.441529 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1006 06:39:46.441540 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1006 06:39:46.441550 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 48.677242ms to process 1 records I1006 06:39:46.441555 1 tasks_processing.go:74] worker 47 stopped. I1006 06:39:46.441613 1 tasks_processing.go:74] worker 49 stopped. I1006 06:39:46.441701 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=8605bcb134da3c43e0698fe733a82f6c6d82703be8ec100fe438e7f9f941471b I1006 06:39:46.441724 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=55fb2efd970ef4ee4c15e46b91060d23c68788e55ff1f517d5a4fee8a74d612c I1006 06:39:46.441742 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6326c8bd76f55ed59e0629ba68d86d904ea7ccdeda0ba0a9b15d648002bc6446 I1006 06:39:46.441756 1 controller.go:203] Source scaController *sca.Controller is not ready I1006 06:39:46.441761 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0a2c3c56f0a4dec57ea147facc6db43a88d319c550c017b02b02aee50989883a I1006 06:39:46.441766 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1006 06:39:46.441770 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1006 06:39:46.441772 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1006 06:39:46.441788 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1006 06:39:46.441797 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=9b465a428d7289a568c765355cadcb2e80c59e5b794c0150695ef2d33a6af71e I1006 06:39:46.441804 1 controller.go:458] The operator is still being initialized I1006 06:39:46.441809 1 controller.go:481] The operator is healthy I1006 06:39:46.441817 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=0cafc512dc2b7cd3c4c0ca8b9efb5a4a78507727e5cd5c60f05d8ee08fcd862a I1006 06:39:46.441833 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=293f473e817f7918b3c55f2685cd9b49a32455aa79df307b8319310ee50d1bbf I1006 06:39:46.441852 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=e5f4946a0a5523cda6207b010457530a66d7496cdb6d37c4f9602dc17e774a66 I1006 06:39:46.441870 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=eba8b1061a99b74835044013c95ebc7747b79cd1bdf4084782898214c4da7703 I1006 06:39:46.441891 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=f7aac4a99e683388bbbba7ba220b91f0956f4c6fe8443d210f2ae0363c614fb2 I1006 06:39:46.441910 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4e97e619c6235baf9bde696f049bcb87bc7dbfffcbac1a98f4d9e5456cbb06df I1006 06:39:46.441920 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 47.313404ms to process 11 records I1006 06:39:46.442156 1 tasks_processing.go:74] worker 22 stopped. I1006 06:39:46.442343 1 recorder.go:70] Recording config/apiserver with fingerprint=6860d22ec6dc3f86d5624c2359d808dc1674291e4e091cc2b07cfb2870fd8978 I1006 06:39:46.442360 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 47.040943ms to process 1 records I1006 06:39:46.442455 1 tasks_processing.go:74] worker 37 stopped. I1006 06:39:46.442471 1 recorder.go:70] Recording config/featuregate with fingerprint=1e67bb9a83025484a94755c781c3f58c3a18e9fc63aa6c14ad3f111d70e64f4b I1006 06:39:46.442478 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 47.168703ms to process 1 records I1006 06:39:46.442526 1 tasks_processing.go:74] worker 27 stopped. I1006 06:39:46.442804 1 recorder.go:70] Recording config/authentication with fingerprint=00b22b161118236c85f19a807c66111b956d4f4a741b9458e0177ce0fb97c971 I1006 06:39:46.442818 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 48.978633ms to process 1 records I1006 06:39:46.442943 1 tasks_processing.go:74] worker 57 stopped. I1006 06:39:46.443131 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=bfeefd6f5d83f49aa4a1981e731e7708cdc9908cb0112fc719e18fa7e4acd6c4 I1006 06:39:46.443141 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 50.26645ms to process 1 records I1006 06:39:46.443233 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7f018a4f8512cbe6305f1d2079d8d1da1e0295757618c1fa27e400f6d798a95d I1006 06:39:46.443264 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=6561a028f60ac8c34e2c516f40e6674cfc0b8bcf2133c89096a2c02080d440c4 I1006 06:39:46.443269 1 tasks_processing.go:74] worker 48 stopped. I1006 06:39:46.443286 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=5a4f8c8845b13a52d83b1db2844731f35a48d0e2cec33e89e68399f649f224df I1006 06:39:46.443318 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 47.896638ms to process 3 records I1006 06:39:46.443502 1 tasks_processing.go:74] worker 52 stopped. I1006 06:39:46.443741 1 recorder.go:70] Recording config/node/ip-10-0-135-222.ec2.internal with fingerprint=dd9dc40235f60e15680cbb49a5eb857dea4e3f7a057ffac0a5a11f784eb7b829 I1006 06:39:46.443806 1 recorder.go:70] Recording config/node/ip-10-0-150-36.ec2.internal with fingerprint=52d3ed75507034f158e4ea85b663154e59ee2bd334ded6b020b045ae6eb8337a I1006 06:39:46.443842 1 recorder.go:70] Recording config/node/ip-10-0-162-75.ec2.internal with fingerprint=1bfd01663e7071ef92e696d9bf9e80f4fe45acd1f32f96f7d6ecbcb3cac33023 I1006 06:39:46.443849 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 47.917636ms to process 3 records I1006 06:39:46.443859 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I1006 06:39:46.443873 1 tasks_processing.go:74] worker 5 stopped. I1006 06:39:46.443878 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 47.297754ms to process 1 records I1006 06:39:46.444856 1 tasks_processing.go:74] worker 26 stopped. I1006 06:39:46.444865 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 49.516832ms to process 0 records I1006 06:39:46.449845 1 tasks_processing.go:74] worker 39 stopped. I1006 06:39:46.449914 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1006 06:39:46.449930 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 56.861708ms to process 1 records I1006 06:39:46.451930 1 tasks_processing.go:74] worker 16 stopped. I1006 06:39:46.452371 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b292ca79e1757cbadd985b26aadbe691454c984af4310b94b65fbc6362ce1cd0 I1006 06:39:46.452506 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=80e71b7381d6362ea8e221a2523596e3c1ed75df303ce340432ab63c73b1ef04 I1006 06:39:46.452516 1 gather.go:177] gatherer "clusterconfig" function "crds" took 59.381814ms to process 2 records I1006 06:39:46.452919 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1006 06:39:46.452937 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1006 06:39:46.452960 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1006 06:39:46.454355 1 tasks_processing.go:74] worker 45 stopped. I1006 06:39:46.454666 1 recorder.go:70] Recording config/version with fingerprint=b49f7e810dbadb0f754abd0a64f3afe421fa23ce9b5a87fe32d52e7e891ac16f I1006 06:39:46.454677 1 recorder.go:70] Recording config/id with fingerprint=73bcbc8d0f1f49777bea089c865b728a00d14e62e9568b64ae39442805e5caf1 I1006 06:39:46.454682 1 gather.go:177] gatherer "clusterconfig" function "version" took 60.229964ms to process 2 records I1006 06:39:46.457401 1 tasks_processing.go:74] worker 56 stopped. I1006 06:39:46.457416 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.742233ms to process 0 records I1006 06:39:46.458052 1 base_controller.go:82] Caches are synced for ConfigController I1006 06:39:46.458061 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1006 06:39:46.467868 1 tasks_processing.go:74] worker 13 stopped. I1006 06:39:46.467999 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0acc05af1ce3c8703a6a64ac085e02b383fa5af389dfe59d261b36aa6e4dd54e I1006 06:39:46.468045 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8944af75c6ec832e4c9e364908bc342ad93d9522886ee4018c44d391378318a9 I1006 06:39:46.468055 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 73.689921ms to process 2 records I1006 06:39:46.471615 1 tasks_processing.go:74] worker 3 stopped. I1006 06:39:46.471725 1 recorder.go:70] Recording config/olm_operators with fingerprint=da0e1b49039d41909fc4e68f86c0e48da972d0bac584e8228b0accee1e4e02e7 I1006 06:39:46.471749 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 76.928369ms to process 1 records I1006 06:39:46.475321 1 tasks_processing.go:74] worker 24 stopped. I1006 06:39:46.476526 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-kscld with fingerprint=37c75d405ac18facb012bbdf5bc74a797a4bb8be786639ebc637e0307a68450d I1006 06:39:46.476599 1 recorder.go:70] Recording config/pod/openshift-multus/multus-s4tph with fingerprint=c18edb0372f30c7a702ff297b597798d555999ef35acceb612a69b4e5ccf67db I1006 06:39:46.476727 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-6vxl5 with fingerprint=473506c438e8147b9f7734780731a04c1c3d05bcc72ba9be6fd2721acbf40dc3 I1006 06:39:46.476802 1 recorder.go:70] Recording config/running_containers with fingerprint=d54eb9fe9ca5095599b0343e819f38282bd9d391212fe0bf2377cfc15daeb98c I1006 06:39:46.476810 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 79.14471ms to process 4 records I1006 06:39:46.481605 1 configmapobserver.go:84] configmaps "insights-config" not found W1006 06:39:46.482260 1 gather_cluster_operators.go:121] Can't read operator resource versions: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1 I1006 06:39:46.482289 1 tasks_processing.go:74] worker 25 stopped. I1006 06:39:46.482347 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=59d739baeb3113a7fffa11e647970bf13181e498aaf20b82b170086eb9c97d9d I1006 06:39:46.482362 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e6e21c0471266aab2ac6f394c9c5f9e9eb244d29aebafa5782bf53d975b4c12a I1006 06:39:46.482378 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=12fccf84620d4309ff6ec06df0b2ff7940060d48f399b045130131dd5565afe9 I1006 06:39:46.482394 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=d22cb6b6fadb6cb7567c017436a2bae42d61098b32be4a99f7b05239abe87bd8 I1006 06:39:46.482411 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=24e9ae6880d0b6663315f78320cb8584b4e56aaa80dc49102043ffe57308db13 I1006 06:39:46.482429 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=ca453dc758bfb50e5905a46da835b2cf04b2a4476ee1ea96d743f2a15ad09d0a I1006 06:39:46.482442 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=adf444612751f726208c7647b344aed2872cb69c58451acc8de6cd122aba2905 I1006 06:39:46.482455 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=8bf3b20ca748f82ff0d69f12b54b1e9e2b384508f59b57510451db7edccee430 I1006 06:39:46.482464 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=63da352aa190361cbbbeedb3de2a689e32eb999aba94d22ff8fe633658177552 I1006 06:39:46.482479 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=42a8361071c76063972fe0b3dbc13716661dfd51114475155cc11f90d061b316 I1006 06:39:46.482493 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=a70494c6d67b5e51ec3c3154976b96714e3236f5da076fc323eadb34d0b52867 I1006 06:39:46.482550 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=984e8356e54bc244c51530af29e7404d5bd8b5e4f1e1b72e76533312ca1f0e8e I1006 06:39:46.482564 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=fbd8b69b6346d6395b4f3cc5c4edb193f763b36d553f0f2493301b011d62056d I1006 06:39:46.482579 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=c346a3f886dd02cf5047582b52c5a66023709607e6de3f554df89ae3486b4da9 I1006 06:39:46.482591 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=df3ad361724f87acd27fe36a3b84c853c4bb706e0426a89d615540381ced6dc9 I1006 06:39:46.482603 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=22d4817cba9ce19e435e120fb84af4027cf0333adbab9fd14d5fb25c3afab4e2 I1006 06:39:46.482614 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=97284f8a83f955aa75596b192a8d3933030eca13efdd8573a917f3022d3ac91e I1006 06:39:46.482621 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6721b2f40e09d9f5e1aa8a1b8b613991ae07f1f0593a8b9d521c117921861fa4 I1006 06:39:46.482632 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=61d8ca7d026cf599627f31ac3d8cb8b33e64fc4cad9447ec079e3a904799e2d1 I1006 06:39:46.482643 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=3c33e2fec010891c90f248b1f2f169db8cd3e30e67d2055214c09883452c9313 I1006 06:39:46.482658 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=bb8ca808cca4449e6a378b7345bdfe01a341265fd3ccef50bb934aaf41893ff7 I1006 06:39:46.482665 1 gather.go:177] gatherer "clusterconfig" function "operators" took 86.359439ms to process 21 records I1006 06:39:46.485572 1 tasks_processing.go:74] worker 11 stopped. I1006 06:39:46.485582 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 92.451511ms to process 0 records I1006 06:39:46.488973 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I1006 06:39:46.489223 1 tasks_processing.go:74] worker 59 stopped. E1006 06:39:46.489233 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1006 06:39:46.489237 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1006 06:39:46.489240 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1006 06:39:46.489246 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1006 06:39:46.489272 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1006 06:39:46.489279 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1006 06:39:46.489285 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1006 06:39:46.489292 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I1006 06:39:46.489308 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1006 06:39:46.489315 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1006 06:39:46.489319 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 93.44393ms to process 7 records I1006 06:39:46.503743 1 base_controller.go:82] Caches are synced for LoggingSyncer I1006 06:39:46.503754 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1006 06:39:46.512411 1 cluster_transfer.go:102] no available accepted cluster transfer I1006 06:39:46.512423 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I1006 06:39:46.551253 1 tasks_processing.go:74] worker 63 stopped. E1006 06:39:46.551270 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1006 06:39:46.551279 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t948semrr27oassugbeauksaqani2ug-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t948semrr27oassugbeauksaqani2ug-primary-cert-bundle-secret" not found I1006 06:39:46.551335 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=4d15e664ac880145184cc03333cb66fd1ef812810059d6119b4d1d319be9b917 I1006 06:39:46.551347 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 158.876472ms to process 1 records I1006 06:39:46.613516 1 gather_cluster_operator_pods_and_events.go:121] Found 5 pods with 5 containers I1006 06:39:46.613527 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 5033164 bytes I1006 06:39:46.614212 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-54557bd86c-qnj8m pod in namespace openshift-ingress (previous: false). I1006 06:39:46.627796 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d4d76784c-gcqcf pod in namespace openshift-ingress (previous: false). I1006 06:39:46.641813 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d4d76784c-thrlc pod in namespace openshift-ingress (previous: false). I1006 06:39:46.657090 1 sca.go:266] etc-pki-entitlement secret successfully created I1006 06:39:46.657103 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I1006 06:39:46.665152 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-942v7 pod in namespace openshift-ingress-canary (previous: false). I1006 06:39:46.677316 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pqtqn pod in namespace openshift-ingress-canary (previous: false). I1006 06:39:46.691991 1 tasks_processing.go:74] worker 7 stopped. I1006 06:39:46.692072 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=8131a6a20ec1b9cc3b6fc5340a2d85275cdfe821a2c7a14be46ddceaa5ad91b8 I1006 06:39:46.692121 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=00b2821bbcb2537c990532fa8b29a746a714e548583812707b4212a819c57735 I1006 06:39:46.692141 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=a40d5273ab43c16d7de9848f02dbafc69cc3b75bf5b72d641f2e15319db01e9c I1006 06:39:46.692155 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-54557bd86c-qnj8m/router_current.log with fingerprint=15724124d77773c2acbbce3daf4f1c0062cb8efa8825a66c9741052f3e947fc0 I1006 06:39:46.692169 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5d4d76784c-gcqcf/router_current.log with fingerprint=9c98186ebe3a6a0d6f26612fc91015255636635acb69665d409da0a4ec9d5bdd I1006 06:39:46.692180 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5d4d76784c-thrlc/router_current.log with fingerprint=5d68cd556814041a44f8e44b6b3b8147898a48d7e92a1c884a7d6e39b982887a I1006 06:39:46.692186 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-942v7/serve-healthcheck-canary_current.log with fingerprint=56f5f788213fb894ff3409eb29f162af7334f38133336f24a2ed6c0f8f41d0f4 I1006 06:39:46.692190 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-pqtqn/serve-healthcheck-canary_current.log with fingerprint=d190e3d2d7c3b5bb43e7fc151b788e3a7c7aba2eaa545b8adfa959d8876a8a8d I1006 06:39:46.692195 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 297.379744ms to process 8 records I1006 06:39:47.452433 1 tasks_processing.go:74] worker 30 stopped. I1006 06:39:47.452451 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I1006 06:39:47.452464 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.059355859s to process 1 records I1006 06:39:47.452565 1 tasks_processing.go:74] worker 34 stopped. I1006 06:39:47.452602 1 recorder.go:70] Recording config/alerts with fingerprint=dd66f2d1687b6273843187a4677d0227c208325fa17abf8999614d2d613efb0a I1006 06:39:47.452618 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.056153074s to process 1 records I1006 06:39:59.443101 1 tasks_processing.go:74] worker 15 stopped. I1006 06:39:59.443137 1 recorder.go:70] Recording config/installplans with fingerprint=6f9781df213f917044fe07f29e6836f4c98c6ccf7740910e145b68b90ff5234d I1006 06:39:59.443146 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.050494501s to process 1 records I1006 06:40:00.205989 1 tasks_processing.go:74] worker 32 stopped. I1006 06:40:00.206235 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3 I1006 06:40:00.206250 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.812284401s to process 1 records E1006 06:40:00.206300 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.814s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I1006 06:40:00.207399 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I1006 06:40:00.207412 1 periodic.go:212] Running workloads gatherer I1006 06:40:00.207427 1 tasks_processing.go:45] number of workers: 2 I1006 06:40:00.207435 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:40:00.207439 1 tasks_processing.go:71] worker 1 working on workload_info task. I1006 06:40:00.207442 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:40:00.207510 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1006 06:40:00.216804 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-162-75.ec2.internal... I1006 06:40:00.216861 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-135-222.ec2.internal... I1006 06:40:00.246892 1 tasks_processing.go:74] worker 0 stopped. I1006 06:40:00.246907 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 39.366896ms to process 0 records I1006 06:40:03.898457 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I1006 06:40:03.921379 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I1006 06:40:03.932422 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (12ms) I1006 06:40:03.944280 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (12ms) I1006 06:40:03.956037 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (12ms) I1006 06:40:03.966443 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (10ms) I1006 06:40:03.979222 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (13ms) I1006 06:40:03.990318 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (11ms) I1006 06:40:04.001518 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (11ms) I1006 06:40:04.012513 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (11ms) I1006 06:40:04.023071 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (11ms) I1006 06:40:04.033598 1 gather_workloads_info.go:387] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (11ms) I1006 06:40:04.047921 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (14ms) I1006 06:40:04.142318 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (94ms) I1006 06:40:04.244341 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (102ms) I1006 06:40:04.342371 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (98ms) I1006 06:40:04.441372 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms) I1006 06:40:04.532856 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (91ms) I1006 06:40:04.633201 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (100ms) I1006 06:40:04.734355 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (101ms) I1006 06:40:04.833728 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (99ms) I1006 06:40:04.937383 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (104ms) I1006 06:40:05.035494 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (98ms) I1006 06:40:05.134962 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (99ms) I1006 06:40:05.234111 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (99ms) I1006 06:40:05.334126 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms) I1006 06:40:05.433412 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms) I1006 06:40:05.532988 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (100ms) I1006 06:40:05.633570 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (101ms) I1006 06:40:05.733595 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (100ms) I1006 06:40:05.833413 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I1006 06:40:05.934891 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (101ms) I1006 06:40:06.034751 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (100ms) I1006 06:40:06.133735 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (99ms) I1006 06:40:06.234637 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (101ms) I1006 06:40:06.332969 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (98ms) I1006 06:40:06.434036 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I1006 06:40:06.534185 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (100ms) I1006 06:40:06.633646 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (99ms) I1006 06:40:06.732941 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (99ms) I1006 06:40:06.832968 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (100ms) I1006 06:40:06.932312 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (99ms) I1006 06:40:07.033998 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (102ms) I1006 06:40:07.134044 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (100ms) I1006 06:40:07.235746 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (102ms) I1006 06:40:07.332952 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (97ms) I1006 06:40:07.433618 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (101ms) I1006 06:40:07.532984 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (99ms) I1006 06:40:07.633316 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I1006 06:40:07.733619 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (100ms) I1006 06:40:07.733656 1 tasks_processing.go:74] worker 1 stopped. I1006 06:40:07.733937 1 recorder.go:70] Recording config/workload_info with fingerprint=6c76aaadbdcf904c9dff40ba764aae2460d6838f6621f756ab269593b349f291 I1006 06:40:07.733956 1 gather.go:177] gatherer "workloads" function "workload_info" took 7.526210703s to process 1 records I1006 06:40:07.733983 1 periodic.go:259] Periodic gather workloads completed in 7.526s I1006 06:40:07.733997 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I1006 06:40:07.734003 1 periodic.go:212] Running conditional gatherer I1006 06:40:07.743881 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1006 06:40:07.892164 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer I1006 06:40:08.976672 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1006 06:40:08.986992 1 conditional_gatherer.go:390] cluster version is '4.19.9' I1006 06:40:08.987019 1 tasks_processing.go:45] number of workers: 3 I1006 06:40:08.987028 1 tasks_processing.go:69] worker 2 listening for tasks. I1006 06:40:08.987031 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1006 06:40:08.987040 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:40:08.987049 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:40:08.987056 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1006 06:40:08.987058 1 tasks_processing.go:74] worker 1 stopped. I1006 06:40:08.987065 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1006 06:40:08.987107 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I1006 06:40:08.987118 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 768ns to process 1 records I1006 06:40:08.987145 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I1006 06:40:08.987152 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.676µs to process 1 records I1006 06:40:08.987157 1 tasks_processing.go:74] worker 0 stopped. I1006 06:40:08.987303 1 tasks_processing.go:74] worker 2 stopped. I1006 06:40:08.987313 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 226.68µs to process 0 records I1006 06:40:08.987328 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I1006 06:40:08.987339 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I1006 06:40:09.017757 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=b4e8fc1c0edb8b810849cb938cf2f07466fff7e0bb064cb2cc3e9b7498777889 I1006 06:40:09.017884 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-10-06-064009.tar.gz I1006 06:40:09.024032 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I1006 06:40:09.024062 1 periodic.go:281] Gathering cluster info every 2h0m0s I1006 06:40:09.024076 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1006 06:41:16.392859 1 diskrecorder.go:223] Found files to send: insights-2026-10-06-064009.tar.gz I1006 06:41:16.392886 1 insightsuploader.go:150] Checking archives to upload periodically every 16m13.972415795s I1006 06:41:16.392895 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I1006 06:41:16.407241 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I1006 06:41:16.656354 1 requests.go:87] Successfully reported id=2026-10-06T06:41:16Z x-rh-insights-request-id=5d967396da394d5882816d25fb45e4aa, wrote=58969 I1006 06:41:16.656425 1 insightsuploader.go:187] Uploaded report successfully in 263.522676ms I1006 06:41:16.656447 1 controller.go:119] Initializing last reported time to 2026-10-06T06:41:16Z I1006 06:41:16.656462 1 insightsreport.go:304] Archive uploaded, starting pulling report... I1006 06:41:16.656475 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I1006 06:41:16.656492 1 insightsreport.go:221] Initial delay for pulling: 1m0s I1006 06:41:16.670517 1 controller.go:481] The operator is healthy I1006 06:41:46.411678 1 controller.go:481] The operator is healthy I1006 06:42:17.190773 1 insightsreport.go:137] Pulling report from smart-proxy I1006 06:42:17.190832 1 insightsreport.go:149] Retrieving report I1006 06:42:17.203188 1 requests.go:110] Retrieving report for cluster: 9c4b330e-98c9-4e29-b458-26c174f527aa I1006 06:42:17.203200 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/9c4b330e-98c9-4e29-b458-26c174f527aa/reports I1006 06:42:17.205109 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/9c4b330e-98c9-4e29-b458-26c174f527aa/reports I1006 06:42:17.436071 1 insightsreport.go:184] Report retrieved I1006 06:42:17.480157 1 insightsreport.go:239] Report retrieved correctly I1006 06:43:46.415045 1 controller.go:481] The operator is healthy I1006 06:44:46.383928 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1006 06:44:46.392575 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:44:46.392593 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1006 06:44:46.397657 1 secretconfigobserver.go:119] support secret does not exist I1006 06:45:46.410524 1 controller.go:481] The operator is healthy I1006 06:47:46.409366 1 controller.go:481] The operator is healthy I1006 06:49:46.377963 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:49:46.398006 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1006 06:49:46.403396 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:49:46.403416 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1006 06:49:46.408241 1 secretconfigobserver.go:119] support secret does not exist I1006 06:49:46.410436 1 controller.go:481] The operator is healthy I1006 06:51:46.413547 1 controller.go:481] The operator is healthy I1006 06:53:46.416219 1 controller.go:481] The operator is healthy I1006 06:54:46.408874 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1006 06:54:46.418513 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:54:46.418537 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1006 06:54:46.424570 1 secretconfigobserver.go:119] support secret does not exist I1006 06:55:46.411105 1 controller.go:481] The operator is healthy I1006 06:57:35.630488 1 insightsuploader.go:146] Nothing to report since 2026-10-06T06:41:16Z I1006 06:57:46.409693 1 controller.go:481] The operator is healthy I1006 06:59:46.375717 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:59:46.409072 1 controller.go:481] The operator is healthy I1006 06:59:46.424930 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1006 06:59:46.430588 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:59:46.430605 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1006 06:59:46.435600 1 secretconfigobserver.go:119] support secret does not exist I1006 07:01:46.410983 1 controller.go:481] The operator is healthy I1006 07:03:46.410047 1 controller.go:481] The operator is healthy I1006 07:04:46.435657 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1006 07:04:46.441699 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 07:04:46.441718 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1006 07:04:46.448446 1 secretconfigobserver.go:119] support secret does not exist I1006 07:05:46.410180 1 controller.go:481] The operator is healthy I1006 07:07:46.422245 1 controller.go:481] The operator is healthy