I0703 21:56:25.935824 1 cmd.go:253] Using service-serving-cert provided certificates I0703 21:56:25.936359 1 observer_polling.go:159] Starting file observer I0703 21:56:26.915547 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0703 21:56:26.915822 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0703 21:56:26.916764 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0703 21:56:26.916823 1 secure_serving.go:57] Forcing use of http/1.1 only W0703 21:56:26.916847 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0703 21:56:26.916853 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0703 21:56:26.916858 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0703 21:56:26.916862 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0703 21:56:26.916865 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0703 21:56:26.916869 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0703 21:56:26.921924 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0703 21:56:26.921992 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"0b4ab36a-e916-471f-9197-0b38bfac2bfe", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0703 21:56:26.922698 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0703 21:56:26.922724 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0703 21:56:26.922722 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0703 21:56:26.922721 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0703 21:56:26.922744 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 21:56:26.922744 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 21:56:26.923082 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0703 21:56:26.923381 1 secure_serving.go:213] Serving securely on [::]:8443 I0703 21:56:26.923410 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0703 21:56:26.932234 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0703 21:56:26.932256 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 21:56:26.932344 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0703 21:56:26.936775 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 21:56:26.936793 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 21:56:26.940992 1 secretconfigobserver.go:119] support secret does not exist I0703 21:56:26.945246 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 21:56:26.949403 1 secretconfigobserver.go:119] support secret does not exist I0703 21:56:26.951975 1 recorder.go:161] Pruning old reports every 6h40m14s, max age is 288h0m0s I0703 21:56:26.956004 1 operator.go:316] The last pod state is unhealthy I0703 21:56:27.023224 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0703 21:56:27.023236 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 21:56:27.023313 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 21:56:27.032437 1 base_controller.go:82] Caches are synced for ConfigController I0703 21:56:27.032452 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0703 21:56:27.036758 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 21:56:46.961038 1 operator.go:316] The last pod state is unhealthy I0703 21:57:06.968446 1 operator.go:316] The last pod state is unhealthy I0703 21:57:26.958371 1 operator.go:316] The last pod state is unhealthy I0703 21:57:46.959615 1 operator.go:316] The last pod state is unhealthy I0703 21:58:06.959821 1 operator.go:316] The last pod state is unhealthy I0703 21:58:26.959131 1 operator.go:316] The last pod state is unhealthy I0703 21:58:46.961086 1 operator.go:316] The last pod state is unhealthy I0703 21:59:06.959944 1 operator.go:316] The last pod state is unhealthy I0703 21:59:26.959823 1 operator.go:316] The last pod state is unhealthy I0703 21:59:46.958503 1 operator.go:316] The last pod state is unhealthy I0703 22:00:06.959629 1 operator.go:316] The last pod state is unhealthy I0703 22:00:26.958002 1 operator.go:316] The last pod state is unhealthy I0703 22:00:46.960376 1 operator.go:316] The last pod state is unhealthy I0703 22:01:06.959315 1 operator.go:316] The last pod state is unhealthy I0703 22:01:26.954963 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:01:26.957741 1 operator.go:316] The last pod state is unhealthy I0703 22:01:26.958857 1 secretconfigobserver.go:119] support secret does not exist I0703 22:01:29.350351 1 operator.go:248] Unable to check insights-operator pod status. Setting initial delay to 13m51.782109792s I0703 22:01:29.350487 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0703 22:01:29.350510 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 15m21s I0703 22:01:29.350492 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0703 22:01:29.350533 1 insightsreport.go:296] Starting report retriever I0703 22:01:29.350537 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0703 22:01:29.355858 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0703 22:01:29.355881 1 controller.go:326] The initial operator extension status is healthy I0703 22:01:29.355915 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:01:29.355921 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:01:29.355926 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:01:29.355949 1 controller.go:489] The operator is still being initialized I0703 22:01:29.355958 1 controller.go:512] The operator is healthy I0703 22:01:29.356040 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0703 22:01:29.356054 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0703 22:01:29.356214 1 operator.go:288] started I0703 22:01:29.356243 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0703 22:01:29.363518 1 controller.go:212] Source scaController *sca.Controller is not ready I0703 22:01:29.363529 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0703 22:01:29.363533 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:01:29.363536 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:01:29.363539 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:01:29.363552 1 controller.go:489] The operator is still being initialized I0703 22:01:29.363557 1 controller.go:512] The operator is healthy I0703 22:01:29.374693 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0703 22:01:29.449538 1 cluster_transfer.go:102] no available accepted cluster transfer I0703 22:01:29.449560 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0703 22:01:29.456686 1 base_controller.go:82] Caches are synced for LoggingSyncer I0703 22:01:29.456702 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0703 22:01:29.563228 1 sca.go:266] etc-pki-entitlement secret successfully created I0703 22:01:29.563248 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0703 22:03:29.363339 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:03:29.363357 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:03:29.363361 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:03:29.363380 1 controller.go:489] The operator is still being initialized I0703 22:03:29.363386 1 controller.go:512] The operator is healthy I0703 22:05:29.362786 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:05:29.362800 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:05:29.362804 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:05:29.362827 1 controller.go:512] The operator is healthy I0703 22:06:26.950148 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:06:26.954127 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:06:26.959248 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:06:26.963397 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:06:26.963414 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:06:26.967062 1 secretconfigobserver.go:119] support secret does not exist I0703 22:07:29.362846 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:07:29.362864 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:07:29.362869 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:07:29.362913 1 controller.go:512] The operator is healthy I0703 22:09:29.366371 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:09:29.366392 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:09:29.366397 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:09:29.366424 1 controller.go:512] The operator is healthy I0703 22:11:26.967831 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:11:26.976615 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:11:26.976641 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:11:26.980688 1 secretconfigobserver.go:119] support secret does not exist I0703 22:11:29.362403 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:11:29.362419 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:11:29.362422 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:11:29.362446 1 controller.go:512] The operator is healthy I0703 22:13:29.362415 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:13:29.362432 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:13:29.362436 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:13:29.362459 1 controller.go:512] The operator is healthy I0703 22:15:21.133225 1 periodic.go:209] Running clusterconfig gatherer I0703 22:15:21.133286 1 tasks_processing.go:45] number of workers: 32 I0703 22:15:21.133309 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 22:15:21.133320 1 tasks_processing.go:69] worker 13 listening for tasks. I0703 22:15:21.133326 1 tasks_processing.go:71] worker 13 working on ingress_certificates task. I0703 22:15:21.133330 1 tasks_processing.go:69] worker 14 listening for tasks. I0703 22:15:21.133337 1 tasks_processing.go:69] worker 15 listening for tasks. I0703 22:15:21.133331 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 22:15:21.133346 1 tasks_processing.go:69] worker 17 listening for tasks. I0703 22:15:21.133343 1 tasks_processing.go:69] worker 16 listening for tasks. I0703 22:15:21.133351 1 tasks_processing.go:69] worker 18 listening for tasks. I0703 22:15:21.133354 1 tasks_processing.go:69] worker 19 listening for tasks. I0703 22:15:21.133346 1 tasks_processing.go:69] worker 7 listening for tasks. I0703 22:15:21.133358 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 22:15:21.133364 1 tasks_processing.go:69] worker 25 listening for tasks. I0703 22:15:21.133370 1 tasks_processing.go:69] worker 21 listening for tasks. I0703 22:15:21.133366 1 tasks_processing.go:69] worker 26 listening for tasks. I0703 22:15:21.133375 1 tasks_processing.go:69] worker 5 listening for tasks. I0703 22:15:21.133367 1 tasks_processing.go:69] worker 20 listening for tasks. I0703 22:15:21.133372 1 tasks_processing.go:69] worker 27 listening for tasks. I0703 22:15:21.133379 1 tasks_processing.go:69] worker 22 listening for tasks. I0703 22:15:21.133385 1 tasks_processing.go:69] worker 28 listening for tasks. I0703 22:15:21.133386 1 tasks_processing.go:69] worker 4 listening for tasks. I0703 22:15:21.133386 1 tasks_processing.go:69] worker 23 listening for tasks. I0703 22:15:21.133395 1 tasks_processing.go:69] worker 9 listening for tasks. I0703 22:15:21.133393 1 tasks_processing.go:69] worker 8 listening for tasks. I0703 22:15:21.133404 1 tasks_processing.go:69] worker 11 listening for tasks. I0703 22:15:21.133397 1 tasks_processing.go:69] worker 31 listening for tasks. I0703 22:15:21.133408 1 tasks_processing.go:69] worker 29 listening for tasks. I0703 22:15:21.133409 1 tasks_processing.go:71] worker 0 working on node_logs task. I0703 22:15:21.133414 1 tasks_processing.go:71] worker 11 working on lokistack task. I0703 22:15:21.133415 1 tasks_processing.go:71] worker 14 working on operators task. I0703 22:15:21.133411 1 tasks_processing.go:69] worker 30 listening for tasks. I0703 22:15:21.133423 1 tasks_processing.go:71] worker 15 working on authentication task. I0703 22:15:21.133428 1 tasks_processing.go:71] worker 30 working on cost_management_metrics_configs task. I0703 22:15:21.133433 1 tasks_processing.go:71] worker 19 working on olm_operators task. I0703 22:15:21.133415 1 tasks_processing.go:71] worker 31 working on crds task. I0703 22:15:21.133411 1 tasks_processing.go:71] worker 16 working on mutating_webhook_configurations task. I0703 22:15:21.133505 1 tasks_processing.go:71] worker 7 working on schedulers task. I0703 22:15:21.133511 1 tasks_processing.go:71] worker 20 working on openstack_dataplanedeployments task. I0703 22:15:21.133542 1 tasks_processing.go:71] worker 2 working on silenced_alerts task. I0703 22:15:21.133393 1 tasks_processing.go:69] worker 24 listening for tasks. I0703 22:15:21.133400 1 tasks_processing.go:69] worker 12 listening for tasks. I0703 22:15:21.133401 1 tasks_processing.go:69] worker 3 listening for tasks. I0703 22:15:21.133416 1 tasks_processing.go:71] worker 17 working on openshift_logging task. I0703 22:15:21.133668 1 tasks_processing.go:71] worker 22 working on pdbs task. I0703 22:15:21.133683 1 tasks_processing.go:71] worker 3 working on sap_pods task. I0703 22:15:21.133688 1 tasks_processing.go:71] worker 25 working on monitoring_persistent_volumes task. I0703 22:15:21.133420 1 tasks_processing.go:71] worker 29 working on machine_configs task. I0703 22:15:21.133820 1 tasks_processing.go:71] worker 4 working on nodenetworkconfigurationpolicies task. I0703 22:15:21.133326 1 tasks_processing.go:71] worker 1 working on nodenetworkstates task. I0703 22:15:21.133379 1 tasks_processing.go:69] worker 10 listening for tasks. I0703 22:15:21.133972 1 tasks_processing.go:71] worker 10 working on certificate_signing_requests task. I0703 22:15:21.133991 1 tasks_processing.go:71] worker 23 working on image_pruners task. I0703 22:15:21.134006 1 tasks_processing.go:71] worker 26 working on tsdb_status task. I0703 22:15:21.133388 1 tasks_processing.go:69] worker 6 listening for tasks. I0703 22:15:21.134092 1 tasks_processing.go:71] worker 9 working on storage_cluster task. I0703 22:15:21.133663 1 tasks_processing.go:71] worker 27 working on service_accounts task. I0703 22:15:21.133815 1 tasks_processing.go:71] worker 28 working on image task. I0703 22:15:21.133428 1 tasks_processing.go:71] worker 18 working on infrastructures task. I0703 22:15:21.134258 1 tasks_processing.go:71] worker 24 working on operators_pods_and_events task. I0703 22:15:21.134356 1 tasks_processing.go:71] worker 12 working on machine_sets task. I0703 22:15:21.133683 1 tasks_processing.go:71] worker 21 working on openshift_machine_api_events task. I0703 22:15:21.134368 1 gather_lokistack.go:58] Start LokiStack gathering I0703 22:15:21.134385 1 tasks_processing.go:71] worker 6 working on container_images task. I0703 22:15:21.133424 1 tasks_processing.go:71] worker 5 working on metrics task. I0703 22:15:21.134135 1 tasks_processing.go:71] worker 8 working on config_maps task. I0703 22:15:21.146128 1 tasks_processing.go:71] worker 12 working on overlapping_namespace_uids task. I0703 22:15:21.146158 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 11.760356ms to process 0 records I0703 22:15:21.146173 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 12.035678ms to process 0 records I0703 22:15:21.146183 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 12.208465ms to process 0 records I0703 22:15:21.146191 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.476286ms to process 0 records I0703 22:15:21.146198 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 12.333541ms to process 0 records I0703 22:15:21.146245 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 12.54888ms to process 0 records I0703 22:15:21.146262 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 12.738781ms to process 0 records I0703 22:15:21.146274 1 tasks_processing.go:71] worker 1 working on container_runtime_configs task. I0703 22:15:21.146275 1 tasks_processing.go:71] worker 20 working on machine_config_pools task. I0703 22:15:21.146285 1 tasks_processing.go:71] worker 17 working on cluster_apiserver task. I0703 22:15:21.146285 1 tasks_processing.go:71] worker 4 working on feature_gates task. I0703 22:15:21.146350 1 tasks_processing.go:71] worker 3 working on image_registries task. I0703 22:15:21.146379 1 tasks_processing.go:71] worker 11 working on pod_network_connectivity_checks task. I0703 22:15:21.146489 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 12.954823ms to process 0 records I0703 22:15:21.146502 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.980691ms to process 0 records I0703 22:15:21.146512 1 tasks_processing.go:71] worker 30 working on version task. I0703 22:15:21.146382 1 tasks_processing.go:71] worker 9 working on nodes task. I0703 22:15:21.146906 1 tasks_processing.go:71] worker 23 working on machine_autoscalers task. I0703 22:15:21.147195 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=49c0aee55991002e59d6652a1de2d6c86cdba679c1d20a0d7cd7e4c4030dabf7 I0703 22:15:21.147211 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 12.881021ms to process 1 records I0703 22:15:21.148616 1 tasks_processing.go:71] worker 7 working on sap_config task. I0703 22:15:21.148706 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=366550bb1f18c7b895fbb3dc118b06e5e9601942744a41b29e6798d955fc888c I0703 22:15:21.148721 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 15.098309ms to process 1 records I0703 22:15:21.148794 1 recorder.go:75] Recording config/image with fingerprint=a94f6d28b0510f9ea19c0aa5548f48ecc0e9981b1bf8343c784f5ef950bc89fc I0703 22:15:21.148802 1 gather.go:177] gatherer "clusterconfig" function "image" took 14.426285ms to process 1 records I0703 22:15:21.148803 1 tasks_processing.go:71] worker 28 working on ingress task. I0703 22:15:21.151771 1 tasks_processing.go:71] worker 10 working on machine_healthchecks task. I0703 22:15:21.151786 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 17.784772ms to process 0 records I0703 22:15:21.156076 1 tasks_processing.go:71] worker 18 working on proxies task. I0703 22:15:21.156987 1 recorder.go:75] Recording config/infrastructure with fingerprint=917ffc1fe2f02e8e4d91d61316edd15747139f72fdabdff37d0411bb3cbcc2ed I0703 22:15:21.157008 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 21.831916ms to process 1 records I0703 22:15:21.157116 1 tasks_processing.go:71] worker 16 working on machines task. I0703 22:15:21.157292 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=88656ab8793b57c4227e10116aaf3005c264d3ffc5b5b9627aefb72af1b8652e I0703 22:15:21.157342 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=903c0f5f234d8a401adad34cc4d1d1a1105d1919546e45795b0df781253358a5 I0703 22:15:21.157413 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=2572b3d0b1df0232205791cc2c8115d28cb87540425a06dfc9c20ecec73b9c12 I0703 22:15:21.157422 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 22.938563ms to process 3 records I0703 22:15:21.159574 1 tasks_processing.go:71] worker 23 working on openstack_dataplanenodesets task. I0703 22:15:21.159636 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.654018ms to process 0 records I0703 22:15:21.159716 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 13.315368ms to process 0 records I0703 22:15:21.159725 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 26.207708ms to process 0 records I0703 22:15:21.159731 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 13.397509ms to process 0 records I0703 22:15:21.159759 1 tasks_processing.go:71] worker 1 working on aggregated_monitoring_cr_names task. I0703 22:15:21.159804 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 26.085815ms to process 0 records I0703 22:15:21.159858 1 tasks_processing.go:71] worker 20 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0703 22:15:21.159860 1 tasks_processing.go:71] worker 0 working on install_plans task. I0703 22:15:21.159867 1 tasks_processing.go:71] worker 25 working on qemu_kubevirt_launcher_logs task. I0703 22:15:21.161905 1 tasks_processing.go:71] worker 21 working on storage_classes task. I0703 22:15:21.163152 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 27.512412ms to process 0 records I0703 22:15:21.163225 1 tasks_processing.go:71] worker 4 working on support_secret task. I0703 22:15:21.164045 1 recorder.go:75] Recording config/featuregate with fingerprint=f53f40c8a320748ea9214e96564de0039222feca9ce44086a8981e4276f97d6b I0703 22:15:21.164111 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 15.758012ms to process 1 records I0703 22:15:21.164285 1 tasks_processing.go:71] worker 17 working on openstack_version task. I0703 22:15:21.164290 1 recorder.go:75] Recording config/apiserver with fingerprint=d4e7168e4db61c412b240294d8a4a98a780434188bb9725813e68de86e496a2d I0703 22:15:21.164509 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.253176ms to process 1 records I0703 22:15:21.164660 1 tasks_processing.go:71] worker 15 working on jaegers task. I0703 22:15:21.164777 1 recorder.go:75] Recording config/authentication with fingerprint=bc20f4bf0480e78c89545db571ab404d9798cd5c27bc29d96dc289ab5a4545bd I0703 22:15:21.164794 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 29.222342ms to process 1 records I0703 22:15:21.164802 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 14.641871ms to process 0 records E0703 22:15:21.164810 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0703 22:15:21.164819 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.022124ms to process 0 records I0703 22:15:21.164860 1 tasks_processing.go:71] worker 7 working on openstack_controlplanes task. I0703 22:15:21.164926 1 tasks_processing.go:71] worker 10 working on ceph_cluster task. I0703 22:15:21.164951 1 tasks_processing.go:71] worker 22 working on networks task. I0703 22:15:21.164939 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=9cb515299001264cb5284ec2840c7540a1964c01f8f3145ebe87759080b557e6 I0703 22:15:21.165096 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=00c71d7d6ca28c0df368bcbbab9ace9e568f39739ee3f1c433eaf7e3092b8081 I0703 22:15:21.165161 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=16c0a855bbda798b0f2f8af7d2db708c530234f1490a0acb7938e266d40dfb37 I0703 22:15:21.165190 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=5829a40c91dbfef3beaecf8e62f10f64fc9e9a42f54b6bd24a7986c1b545474e I0703 22:15:21.165213 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=d6991cf2358b5418a8cb07fbf54dfa6cbf813aaec7de2ef9dac73f3df75a34ae I0703 22:15:21.165287 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=b0310aeaf10f953edae7e6d6e033043a683b6b8c37f6dc2d3bd22a7fb271d575 I0703 22:15:21.165314 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=71709999087a4ffd69558520e17711eaeff4f82d8eb41f9e7ede98a52cd7f2e5 I0703 22:15:21.165338 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=06cac3c57b5eae3206d93974083e65ee5311d8bb714699cf5e6a38a234635bce I0703 22:15:21.165397 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=73459088dbf807167c941ebe6bb1301514c53cd7eae372dd0807d117a0eb01c6 I0703 22:15:21.165446 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=7ed82d12fe4815c22b434688152dfba41e8e45b6658bdb9388164ddbb9e5cf06 I0703 22:15:21.165495 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=065df0053450865d875571016c392119776e4192870c5ce6dcaf1c9573e24ac3 I0703 22:15:21.165529 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 30.420585ms to process 11 records I0703 22:15:21.165668 1 tasks_processing.go:71] worker 31 working on dvo_metrics task. I0703 22:15:21.166357 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=72965ecc5788ef86c558b072086c7c6873b47989a4adc282253176d10ea2a213 I0703 22:15:21.166596 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0703 22:15:21.166690 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=da541e96cabc1b7d061bc33dcc6606ce042dd6be83b3354c2464fc2b8b7e3617 I0703 22:15:21.166708 1 gather.go:177] gatherer "clusterconfig" function "crds" took 30.879911ms to process 2 records I0703 22:15:21.166720 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.94648ms to process 0 records I0703 22:15:21.166769 1 tasks_processing.go:71] worker 23 working on oauths task. I0703 22:15:21.166834 1 recorder.go:75] Recording config/ingress with fingerprint=9e582fff53759480a973eb65f6e1cda75ff81f981cf9e648f8b80ab3e8459566 I0703 22:15:21.166846 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 15.97871ms to process 1 records I0703 22:15:21.166913 1 tasks_processing.go:71] worker 28 working on sap_datahubs task. I0703 22:15:21.166922 1 tasks_processing.go:71] worker 3 working on active_alerts task. I0703 22:15:21.167286 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=930848d484ae265d0e9606a0124c9e621cdc8a135bb189bcb7ebf6106431238b I0703 22:15:21.167304 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 18.554013ms to process 1 records E0703 22:15:21.167320 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0703 22:15:21.167328 1 gather.go:177] gatherer "clusterconfig" function "machines" took 8.229846ms to process 0 records I0703 22:15:21.167370 1 tasks_processing.go:71] worker 16 working on clusterroles task. I0703 22:15:21.167387 1 recorder.go:75] Recording config/proxy with fingerprint=bb720cfd50d03f185759872ea67f1e15d4f7c9f330f67860dcb1a30500af8ff0 I0703 22:15:21.167394 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 9.412088ms to process 1 records I0703 22:15:21.167540 1 tasks_processing.go:71] worker 18 working on validating_webhook_configurations task. I0703 22:15:21.167665 1 tasks_processing.go:74] worker 9 stopped. I0703 22:15:21.167756 1 recorder.go:75] Recording config/node/ip-10-0-0-64.ec2.internal with fingerprint=f6b895650f4d152e13a018889d9d1fd7b7a2c45a28b1cb8728e53f19ded72c20 I0703 22:15:21.167850 1 recorder.go:75] Recording config/node/ip-10-0-1-249.ec2.internal with fingerprint=66faa2c1774b1c9139989f5607ba4b1d42c8b4535d4b5f001aa7922e0e4adcd2 I0703 22:15:21.167990 1 recorder.go:75] Recording config/node/ip-10-0-2-245.ec2.internal with fingerprint=e3e58f2b2e40d3f8d6b4108b207b73c2d1aeced09b450f3eab5e54725d84de7b I0703 22:15:21.168015 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 19.111851ms to process 3 records I0703 22:15:21.168051 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0703 22:15:21.168058 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 19.625927ms to process 1 records I0703 22:15:21.168065 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 32.347178ms to process 0 records I0703 22:15:21.168078 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0703 22:15:21.168085 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 20.534559ms to process 1 records I0703 22:15:21.168093 1 tasks_processing.go:74] worker 12 stopped. I0703 22:15:21.168099 1 tasks_processing.go:74] worker 24 stopped. I0703 22:15:21.168098 1 tasks_processing.go:74] worker 11 stopped. I0703 22:15:21.175515 1 tasks_processing.go:74] worker 10 stopped. I0703 22:15:21.175539 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 10.5563ms to process 0 records I0703 22:15:21.175550 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 10.642502ms to process 0 records I0703 22:15:21.175558 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 10.827172ms to process 0 records I0703 22:15:21.175564 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.218944ms to process 0 records I0703 22:15:21.175576 1 tasks_processing.go:74] worker 17 stopped. I0703 22:15:21.175581 1 tasks_processing.go:74] worker 7 stopped. I0703 22:15:21.175589 1 tasks_processing.go:74] worker 15 stopped. I0703 22:15:21.176133 1 tasks_processing.go:74] worker 21 stopped. I0703 22:15:21.176247 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=08148b09e8083d54672d51707d75edb2e2ccfc86bcf1ee8b64835a508a9e08a2 I0703 22:15:21.176273 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=4fc51a870ec70d1ccf604b923aaea48e0b189959362c73c1abcee627fe75e96b I0703 22:15:21.176284 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 14.19743ms to process 2 records I0703 22:15:21.176340 1 gather_logs.go:145] no pods in namespace were found I0703 22:15:21.176355 1 tasks_processing.go:74] worker 25 stopped. I0703 22:15:21.176365 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 16.00699ms to process 0 records I0703 22:15:21.176540 1 tasks_processing.go:74] worker 4 stopped. E0703 22:15:21.176552 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0703 22:15:21.176562 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 13.300398ms to process 0 records I0703 22:15:21.176851 1 tasks_processing.go:74] worker 22 stopped. I0703 22:15:21.177039 1 recorder.go:75] Recording config/network with fingerprint=684935459f441a426c4fbf1ab6fae91571072ec5fb978b46ee7571241eaa8d7d I0703 22:15:21.177054 1 gather.go:177] gatherer "clusterconfig" function "networks" took 11.883052ms to process 1 records I0703 22:15:21.181659 1 tasks_processing.go:74] worker 30 stopped. I0703 22:15:21.181987 1 recorder.go:75] Recording config/version with fingerprint=eb1aff2b64ff0873f179e593f0326c4af726537c5a60f40ecbf419008255249e I0703 22:15:21.182001 1 recorder.go:75] Recording config/id with fingerprint=92104eb2193a88a9856bcc3e486c291052946c335d1a4139917e77619ff393c0 I0703 22:15:21.182007 1 gather.go:177] gatherer "clusterconfig" function "version" took 35.139445ms to process 2 records I0703 22:15:21.182018 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.79668ms to process 0 records I0703 22:15:21.182032 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0703 22:15:21.182034 1 tasks_processing.go:74] worker 28 stopped. I0703 22:15:21.182039 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 47.997055ms to process 1 records I0703 22:15:21.182047 1 tasks_processing.go:74] worker 29 stopped. I0703 22:15:21.185020 1 tasks_processing.go:74] worker 31 stopped. I0703 22:15:21.185046 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0703 22:15:21.185064 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 19.324334ms to process 1 records I0703 22:15:21.185872 1 tasks_processing.go:74] worker 23 stopped. I0703 22:15:21.186440 1 recorder.go:75] Recording config/oauth with fingerprint=e8dde584bec59656e082d9f9e4eef4d3d5daaa8071d09f0f5ba174e09f0841ae I0703 22:15:21.186467 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 19.08677ms to process 1 records I0703 22:15:21.186552 1 recorder.go:75] Recording config/olm_operators with fingerprint=d7eaa8486e603d0b83ce1e0114ef22cea4d3d9e16c36a03bb1f6d0aced1608b3 I0703 22:15:21.186595 1 tasks_processing.go:74] worker 19 stopped. I0703 22:15:21.186610 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 52.501749ms to process 1 records I0703 22:15:21.188442 1 tasks_processing.go:74] worker 18 stopped. I0703 22:15:21.188597 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=3b404eddeb3fc546e376655855ff168f47902b426d0180898a7c4812ec675db4 I0703 22:15:21.188644 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=9fd6ffe307bdb0a65eb6880470c568f3f807c62b39f11f8f6ce54ba7220caa31 I0703 22:15:21.188706 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=21336d00a2b320995ca89acc989228da4de28cc08da6dc25e866bba49ff89b09 I0703 22:15:21.188802 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=244f9f4697d81eb6b3f09761a1a13bf6be47fa848f281f35a4e75d04e055e8cd I0703 22:15:21.188825 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ea2899de06e028e2aca42dec6ae5af4c0d6a0ba92d1475a5c23f2163205f0370 I0703 22:15:21.188846 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=8a63c93fff0607e5e00291f50db7854846c56ef2c4d5cfe52c9e95f701da13f8 I0703 22:15:21.188871 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=149d385aca6126b8eb78200b29a233a801d2c6b9a1b8975330968d28553cd5a8 I0703 22:15:21.188922 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=a086007fc2c64002f55bc4d11a592d55899000767df3ba8e384ec8c8673f49c7 I0703 22:15:21.188947 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e12a69d7c5af04645cf63e20c7c6eb64b1768ceb824340f20fd119c8c20b3481 I0703 22:15:21.188968 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=eae012f4ea53b5938dae9fea9471de9773b760ce93aae1e8ec2eb9d2a0a366e5 I0703 22:15:21.189000 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d5fe2b75522173153434d1fa209a733a1847b7e2acf93bef95a45d6ff8d1acbd I0703 22:15:21.189037 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=6cda765aeb7532add680a3b75a4213052f060b403d806476b63c3ae352920e0c I0703 22:15:21.189062 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=2c56535f064c103d64cdf90b75a1d6566d7c6f7c902812d5ad19b5df2e578a67 I0703 22:15:21.189086 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=f851d11bf375c3bce84ecb9729e0ee4340b5bb5ade349ed95ccb7f6591e53b7f I0703 22:15:21.189095 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 20.846955ms to process 14 records I0703 22:15:21.192591 1 tasks_processing.go:74] worker 1 stopped. I0703 22:15:21.192606 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 32.81633ms to process 0 records I0703 22:15:21.192690 1 tasks_processing.go:74] worker 6 stopped. I0703 22:15:21.194081 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-zd9bj with fingerprint=04877574e1f4a9be52ec98bfe02f108d384ed2ada28cb38949b73bbce8668b1a I0703 22:15:21.194603 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-6lf42 with fingerprint=b470a92ca6e4542b51c41393dc180e84da8b40951f827db7da048e02590ada32 I0703 22:15:21.194749 1 recorder.go:75] Recording config/running_containers with fingerprint=7ea15b7660d620b88868256205b8c0bd819f0a9adc12c54abcb4069e138eb3c2 I0703 22:15:21.194794 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 58.288388ms to process 3 records I0703 22:15:21.194900 1 tasks_processing.go:74] worker 16 stopped. I0703 22:15:21.195067 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=baaa98e2911eaf640a94c86e723ebb8d2b63a567759b65bfd7a46517c42d3460 I0703 22:15:21.195166 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b6f80ee531bb74322f62c296beb0e03b07db5866539c6c4e664e233c35d0fe53 I0703 22:15:21.195175 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 26.993802ms to process 2 records I0703 22:15:21.195971 1 tasks_processing.go:74] worker 13 stopped. E0703 22:15:21.195986 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0703 22:15:21.195992 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ratr4p5nca2n5fefteog437eh9b902m-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ratr4p5nca2n5fefteog437eh9b902m-primary-cert-bundle-secret" not found I0703 22:15:21.196033 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=84b7bc5ab8bfd0abbfb049eba5738bbcaced7227beb984fbc6d74f69b48205a8 I0703 22:15:21.196046 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 62.631067ms to process 1 records I0703 22:15:21.202322 1 tasks_processing.go:74] worker 8 stopped. E0703 22:15:21.202394 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0703 22:15:21.202425 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0703 22:15:21.202450 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0703 22:15:21.202483 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0703 22:15:21.202562 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0703 22:15:21.202596 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0703 22:15:21.202621 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0703 22:15:21.202654 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0703 22:15:21.202740 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0703 22:15:21.202767 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0703 22:15:21.202796 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 67.790735ms to process 7 records I0703 22:15:21.212405 1 tasks_processing.go:74] worker 20 stopped. I0703 22:15:21.212434 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 52.496238ms to process 0 records I0703 22:15:21.253054 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0703 22:15:21.256827 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0703 22:15:22.195270 1 tasks_processing.go:74] worker 2 stopped. I0703 22:15:22.195292 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0703 22:15:22.195303 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.061711539s to process 1 records I0703 22:15:22.195721 1 tasks_processing.go:74] worker 3 stopped. I0703 22:15:22.195807 1 recorder.go:75] Recording config/alerts with fingerprint=d1a456d7e661eca7bca57cb02dc5e73fea24e348172b37aabc0092bf8a80dad2 I0703 22:15:22.195860 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.028782222s to process 1 records I0703 22:15:22.196059 1 tasks_processing.go:74] worker 5 stopped. I0703 22:15:22.196110 1 recorder.go:75] Recording config/metrics with fingerprint=6c0875181ab5e883172ca8c3efab39fa030366d15a2144826729e0dcc104e9a2 I0703 22:15:22.196125 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.06163371s to process 1 records I0703 22:15:22.201559 1 tasks_processing.go:74] worker 26 stopped. I0703 22:15:22.201581 1 recorder.go:75] Recording config/tsdb.json with fingerprint=fba4b0b50cda13053265e8ce1d1621c6ef49f16a4c05a3db313d116ebd3ce553 I0703 22:15:22.201591 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.067541586s to process 1 records I0703 22:15:23.599123 1 tasks_processing.go:74] worker 14 stopped. I0703 22:15:23.599197 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=489032b5e07c4350fb8b269c9244b56d9ab202f27e6e84f3812fcb75bb4b7868 I0703 22:15:23.599249 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0703 22:15:23.599273 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=3745c98e3eaae5f178aeaeb709e4eb65d0ea2d8849af39120ebcea232b5a6d4e I0703 22:15:23.599283 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0703 22:15:23.599304 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=e63f6a7e672bcd92ec7af4c2937e78e870c49ea39c36db87340d20b399eb468a I0703 22:15:23.599321 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0703 22:15:23.599343 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=3dd5a78c5dbfee553b54f694c62d3a4fda187e74b72a703c596be897068a91bd I0703 22:15:23.599371 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=aaef5e341f2c2f7b8636b1ad03dff0eae8dae1f779063cb48b7f84870b4a840c I0703 22:15:23.599393 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=dc01632a6dd8da5550cb70dfa52ae1ad23bbb080296bce9afc5a8672eabc839f I0703 22:15:23.599424 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=8ba65e71ad542655be0a4c357035fadb2362877b5f6d62088413ffc0b02188d5 I0703 22:15:23.599688 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=050cc5f21c31d4c2a2ae55821c10d6eb851f57143d5a937935d89079e6e4accf I0703 22:15:23.599707 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=eac2cc2a9a49f9c134b94594c76108241016047737302f7423f31214e0d944cd I0703 22:15:23.599717 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0703 22:15:23.599733 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=5fa167506a96168323c9300b3a0cc2350d230d7a2fdb0ba31d995417b3eeabb2 I0703 22:15:23.599743 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0703 22:15:23.599760 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=1857a37a4b1e103d25d741dd10bc087f8fec789b80553394a76a68afa1589e2c I0703 22:15:23.599769 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0703 22:15:23.599788 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=a857359e33dbc7abd33fd9a64e1d76ad1db8c09a74a1d1ec8fa9027a7b997f89 I0703 22:15:23.599801 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0703 22:15:23.599825 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=f1c38bd53b460b8869c8b2d79556eb5fd07ed05a208c4b303d23d0cf85e1aa17 I0703 22:15:23.599967 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=13f4e631a31a439cecfc0ac6af6973613953bd958fb68b884a159fc328ffbc7c I0703 22:15:23.599980 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0703 22:15:23.599988 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0703 22:15:23.600009 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0703 22:15:23.600031 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=b3370dd2334e791102efcba0299269f0b2161df1989a5986e6380e54306c81b4 I0703 22:15:23.600056 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=c5310115dd253201e821b9e560f2bc5c60e36abb03b28688e14e8fd5f286070c I0703 22:15:23.600065 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0703 22:15:23.600080 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=13799307f1aa8cf78e86891995bf252dfef632762f976e10d97f553149ac89be I0703 22:15:23.600089 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0703 22:15:23.600110 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ed77658d546c1d0091b61b49bb0d365df494051d531fb146376e4b8d2c532f80 I0703 22:15:23.600120 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0703 22:15:23.600133 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=7ef542da518010a2fb82bd55a0a02377400fe5bede60acdbf592c8a9d563cf62 I0703 22:15:23.600148 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=39c85e0ccb69e716057380b0ba45416eea8b19665efa2d8bc5b8ea69e334c1ab I0703 22:15:23.600162 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=a96ab084537d42d2a071de49d11cdb0e17dfb7d9188598478c7983bb455e8c27 I0703 22:15:23.600183 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=09da7ba56c19e9884a3e1eb1b8e95ae9a3febfa4d6b90390e4fcb9eef14c6933 I0703 22:15:23.600192 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0703 22:15:23.600219 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=cbc70a9294d98ad99f680dcb3f451c600d423fd669c48536a50edfa8a2e451c0 I0703 22:15:23.600236 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0703 22:15:23.600246 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0703 22:15:23.600252 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.465691919s to process 39 records I0703 22:15:29.362902 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 22:15:29.362918 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0703 22:15:29.362921 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0703 22:15:29.362944 1 controller.go:512] The operator is healthy I0703 22:15:34.187505 1 tasks_processing.go:74] worker 0 stopped. I0703 22:15:34.187549 1 recorder.go:75] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0703 22:15:34.187562 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.027322127s to process 1 records I0703 22:15:34.940830 1 tasks_processing.go:74] worker 27 stopped. I0703 22:15:34.941123 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=ae29e7659fb4cd0f04bcc181913d3f8b69c20a612f3ed6bf2f2479314a8cc58f I0703 22:15:34.941139 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.806677579s to process 1 records E0703 22:15:34.941197 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.807s with: function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error" I0703 22:15:34.942305 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0703 22:15:34.942321 1 periodic.go:209] Running workloads gatherer I0703 22:15:34.942341 1 tasks_processing.go:45] number of workers: 2 I0703 22:15:34.942357 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 22:15:34.942364 1 tasks_processing.go:71] worker 1 working on workload_info task. I0703 22:15:34.942370 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 22:15:34.942391 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0703 22:15:34.950618 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-64.ec2.internal... I0703 22:15:34.950628 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-249.ec2.internal... I0703 22:15:34.950643 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-245.ec2.internal... I0703 22:15:34.967312 1 tasks_processing.go:74] worker 0 stopped. I0703 22:15:34.967328 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.901811ms to process 0 records I0703 22:15:40.926908 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 6s I0703 22:15:40.963880 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0703 22:15:40.972776 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (10ms) I0703 22:15:40.987229 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (14ms) I0703 22:15:40.999114 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (12ms) I0703 22:15:41.009641 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (10ms) I0703 22:15:41.019075 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (9ms) I0703 22:15:41.028870 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (10ms) I0703 22:15:41.036811 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (8ms) I0703 22:15:41.044709 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (8ms) I0703 22:15:41.053043 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (8ms) I0703 22:15:41.060968 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (8ms) I0703 22:15:41.071760 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (11ms) I0703 22:15:41.173034 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0703 22:15:41.273418 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0703 22:15:41.372035 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (99ms) I0703 22:15:41.471706 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0703 22:15:41.571942 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0703 22:15:41.672693 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms) I0703 22:15:41.772723 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0703 22:15:41.872628 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0703 22:15:41.973236 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (101ms) I0703 22:15:42.072461 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0703 22:15:42.172494 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (100ms) I0703 22:15:42.272607 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms) I0703 22:15:42.372290 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0703 22:15:42.471705 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (99ms) I0703 22:15:42.571942 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (100ms) I0703 22:15:42.671744 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (100ms) I0703 22:15:42.772560 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0703 22:15:42.871995 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms) I0703 22:15:42.972967 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (101ms) I0703 22:15:43.072404 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0703 22:15:43.172779 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0703 22:15:43.271322 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (99ms) I0703 22:15:43.372271 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0703 22:15:43.471608 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (99ms) I0703 22:15:43.572408 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0703 22:15:43.672632 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (100ms) I0703 22:15:43.771852 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (99ms) I0703 22:15:43.872227 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0703 22:15:43.971792 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (100ms) I0703 22:15:44.072124 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0703 22:15:44.172260 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0703 22:15:44.272702 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0703 22:15:44.371958 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0703 22:15:44.472496 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (101ms) I0703 22:15:44.572432 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (100ms) I0703 22:15:44.672866 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (100ms) I0703 22:15:44.772082 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (99ms) I0703 22:15:44.872959 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (101ms) I0703 22:15:44.872995 1 tasks_processing.go:74] worker 1 stopped. I0703 22:15:44.873298 1 recorder.go:75] Recording config/workload_info with fingerprint=1078ea3d02e769428b85d415ae38b0371bf0643a8443e0c6e094868a3c593b16 I0703 22:15:44.873344 1 gather.go:177] gatherer "workloads" function "workload_info" took 9.930623443s to process 1 records I0703 22:15:44.873361 1 periodic.go:256] Periodic gather workloads completed in 9.931s I0703 22:15:44.873369 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0703 22:15:44.873374 1 periodic.go:209] Running conditional gatherer I0703 22:15:44.880043 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0703 22:15:45.083733 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0703 22:15:45.086144 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0703 22:15:45.086160 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0703 22:15:45.086227 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0703 22:15:45.092361 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0703 22:15:45.092390 1 tasks_processing.go:45] number of workers: 3 I0703 22:15:45.092427 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 22:15:45.092434 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0703 22:15:45.092471 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 22:15:45.092479 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 22:15:45.092553 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0703 22:15:45.092561 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0703 22:15:45.092568 1 tasks_processing.go:74] worker 1 stopped. I0703 22:15:45.092647 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0703 22:15:45.092664 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.236µs to process 1 records I0703 22:15:45.092699 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0703 22:15:45.092707 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.097µs to process 1 records I0703 22:15:45.092713 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 255.205µs to process 0 records I0703 22:15:45.092718 1 tasks_processing.go:74] worker 2 stopped. I0703 22:15:45.092723 1 tasks_processing.go:74] worker 0 stopped. I0703 22:15:45.092737 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0703 22:15:45.092751 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0703 22:15:45.118772 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=3508482a4b9b4ead569c36e7f034b3ab71332e03e4f27cad0c02d4c83a619eb4 I0703 22:15:45.119140 1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-07-03-221545.tar.gz I0703 22:15:45.128344 1 diskrecorder.go:51] Wrote 116 records to disk in 9ms I0703 22:15:45.128389 1 periodic.go:278] Gathering cluster info every 2h0m0s I0703 22:15:45.128415 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0703 22:16:26.951330 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:16:26.955017 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:16:26.981264 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:16:26.985509 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:16:26.985528 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:16:26.990136 1 secretconfigobserver.go:119] support secret does not exist I0703 22:16:51.133143 1 diskrecorder.go:223] Found files to send: insights-2026-07-03-221545.tar.gz I0703 22:16:51.133172 1 insightsuploader.go:150] Checking archives to upload periodically every 15m5.831344726s I0703 22:16:51.133181 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0703 22:16:51.172087 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0703 22:16:51.406822 1 requests.go:87] Successfully reported id=2026-07-03T22:16:51Z x-rh-insights-request-id=e05951da691e4f979ed31e3cfb5bc7ef, wrote=55904 I0703 22:16:51.406881 1 insightsuploader.go:187] Uploaded report successfully in 273.690188ms I0703 22:16:51.406928 1 controller.go:128] Initializing last reported time to 2026-07-03T22:16:51Z I0703 22:16:51.406941 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0703 22:16:51.406947 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0703 22:16:51.406954 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0703 22:16:51.430099 1 controller.go:512] The operator is healthy I0703 22:17:29.362745 1 controller.go:512] The operator is healthy I0703 22:17:51.513606 1 insightsreport.go:137] Pulling report from smart-proxy I0703 22:17:51.513635 1 insightsreport.go:149] Retrieving report I0703 22:17:51.521196 1 requests.go:110] Retrieving report for cluster: 28d5101a-1947-48d1-8e2e-69647e9a3beb I0703 22:17:51.521210 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/28d5101a-1947-48d1-8e2e-69647e9a3beb/reports I0703 22:17:51.523991 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/28d5101a-1947-48d1-8e2e-69647e9a3beb/reports I0703 22:17:51.675760 1 insightsreport.go:184] Report retrieved I0703 22:17:51.713065 1 insightsreport.go:239] Report retrieved correctly I0703 22:19:29.362219 1 controller.go:512] The operator is healthy I0703 22:21:26.991195 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:21:27.000139 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:21:27.000160 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:21:27.003986 1 secretconfigobserver.go:119] support secret does not exist I0703 22:21:29.362696 1 controller.go:512] The operator is healthy I0703 22:23:29.366162 1 controller.go:512] The operator is healthy I0703 22:25:29.362536 1 controller.go:512] The operator is healthy I0703 22:26:26.949294 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:26:27.004536 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:26:27.009398 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:26:27.009417 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:26:27.013264 1 secretconfigobserver.go:119] support secret does not exist I0703 22:27:29.363189 1 controller.go:512] The operator is healthy I0703 22:29:29.362971 1 controller.go:512] The operator is healthy I0703 22:31:27.013922 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:31:27.019177 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:31:27.019204 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:31:27.023018 1 secretconfigobserver.go:119] support secret does not exist I0703 22:31:29.362139 1 controller.go:512] The operator is healthy I0703 22:32:02.240082 1 insightsuploader.go:146] Nothing to report since 2026-07-03T22:16:51Z I0703 22:33:29.363218 1 controller.go:512] The operator is healthy I0703 22:35:29.363151 1 controller.go:512] The operator is healthy I0703 22:36:26.949861 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:36:27.024055 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:36:27.028682 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:36:27.028702 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:36:27.032556 1 secretconfigobserver.go:119] support secret does not exist I0703 22:37:29.363354 1 controller.go:512] The operator is healthy I0703 22:39:29.362527 1 controller.go:512] The operator is healthy I0703 22:41:27.033065 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:41:27.038405 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:41:27.038427 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:41:27.042758 1 secretconfigobserver.go:119] support secret does not exist I0703 22:41:29.362310 1 controller.go:512] The operator is healthy I0703 22:43:29.362594 1 controller.go:512] The operator is healthy I0703 22:45:29.361988 1 controller.go:512] The operator is healthy I0703 22:46:26.950876 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:46:26.955118 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:46:27.043525 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:46:27.047918 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:46:27.047942 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:46:27.051773 1 secretconfigobserver.go:119] support secret does not exist I0703 22:47:12.490599 1 insightsuploader.go:146] Nothing to report since 2026-07-03T22:16:51Z I0703 22:47:29.370548 1 controller.go:512] The operator is healthy I0703 22:49:29.362486 1 controller.go:512] The operator is healthy I0703 22:51:27.052248 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:51:27.057634 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:51:27.057655 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:51:27.061598 1 secretconfigobserver.go:119] support secret does not exist I0703 22:51:29.362482 1 controller.go:512] The operator is healthy