I0331 03:53:14.185925 1 cmd.go:253] Using service-serving-cert provided certificates I0331 03:53:14.186315 1 observer_polling.go:159] Starting file observer I0331 03:53:15.046351 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0331 03:53:15.046597 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0331 03:53:15.047180 1 secure_serving.go:57] Forcing use of http/1.1 only W0331 03:53:15.047206 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. I0331 03:53:15.047203 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0331 03:53:15.047212 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0331 03:53:15.047232 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0331 03:53:15.047235 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0331 03:53:15.047237 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0331 03:53:15.047240 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0331 03:53:15.050847 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0331 03:53:15.050863 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"437efa7e-3963-4fbf-8753-bc2ac1458283", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0331 03:53:15.052528 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0331 03:53:15.052543 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0331 03:53:15.052546 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0331 03:53:15.052546 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0331 03:53:15.052560 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:53:15.052564 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:53:15.052950 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0331 03:53:15.054268 1 secure_serving.go:213] Serving securely on [::]:8443 I0331 03:53:15.054302 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0331 03:53:15.055929 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0331 03:53:15.055951 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:53:15.056025 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0331 03:53:15.063623 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:53:15.063640 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:53:15.068318 1 secretconfigobserver.go:119] support secret does not exist I0331 03:53:15.077613 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:53:15.081833 1 secretconfigobserver.go:119] support secret does not exist I0331 03:53:15.085377 1 recorder.go:161] Pruning old reports every 7h5m22s, max age is 288h0m0s I0331 03:53:15.090412 1 operator.go:316] The last pod state is unhealthy I0331 03:53:15.153463 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:53:15.153539 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:53:15.153576 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0331 03:53:15.156700 1 base_controller.go:82] Caches are synced for ConfigController I0331 03:53:15.156723 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0331 03:53:15.163469 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 03:53:35.092227 1 operator.go:316] The last pod state is unhealthy I0331 03:53:55.093855 1 operator.go:316] The last pod state is unhealthy I0331 03:54:15.092728 1 operator.go:316] The last pod state is unhealthy I0331 03:54:35.092786 1 operator.go:316] The last pod state is unhealthy I0331 03:54:55.093770 1 operator.go:316] The last pod state is unhealthy I0331 03:55:15.092003 1 operator.go:316] The last pod state is unhealthy I0331 03:55:35.092292 1 operator.go:316] The last pod state is unhealthy I0331 03:55:55.092276 1 operator.go:316] The last pod state is unhealthy I0331 03:56:15.092212 1 operator.go:316] The last pod state is unhealthy I0331 03:56:35.095543 1 operator.go:316] The last pod state is unhealthy I0331 03:56:55.096518 1 operator.go:316] The last pod state is unhealthy I0331 03:57:15.093367 1 operator.go:316] The last pod state is unhealthy I0331 03:57:35.092144 1 operator.go:316] The last pod state is unhealthy I0331 03:57:55.096609 1 operator.go:316] The last pod state is unhealthy I0331 03:58:15.089764 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:58:15.091078 1 operator.go:316] The last pod state is unhealthy I0331 03:58:15.093938 1 secretconfigobserver.go:119] support secret does not exist I0331 03:58:22.577501 1 operator.go:248] Unable to check insights-operator pod status. Setting initial delay to 11m48.278871985s I0331 03:58:22.577635 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0331 03:58:22.577660 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 13m18s I0331 03:58:22.577637 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0331 03:58:22.577681 1 insightsreport.go:296] Starting report retriever I0331 03:58:22.577689 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0331 03:58:22.583607 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0331 03:58:22.583624 1 controller.go:326] The initial operator extension status is healthy I0331 03:58:22.583632 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:58:22.583636 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:58:22.583639 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:58:22.583652 1 controller.go:489] The operator is still being initialized I0331 03:58:22.583658 1 controller.go:512] The operator is healthy I0331 03:58:22.583731 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0331 03:58:22.583754 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0331 03:58:22.583936 1 operator.go:288] started I0331 03:58:22.583957 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0331 03:58:22.591961 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:58:22.591973 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:58:22.591978 1 controller.go:212] Source scaController *sca.Controller is not ready I0331 03:58:22.591981 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0331 03:58:22.591984 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:58:22.591997 1 controller.go:489] The operator is still being initialized I0331 03:58:22.592002 1 controller.go:512] The operator is healthy I0331 03:58:22.600099 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0331 03:58:22.684961 1 base_controller.go:82] Caches are synced for LoggingSyncer I0331 03:58:22.684973 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0331 03:58:22.686703 1 cluster_transfer.go:102] no available accepted cluster transfer I0331 03:58:22.686718 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0331 03:58:22.758109 1 sca.go:266] etc-pki-entitlement secret successfully created I0331 03:58:22.758124 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0331 04:00:22.591343 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:00:22.591360 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:00:22.591363 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:00:22.591390 1 controller.go:489] The operator is still being initialized I0331 04:00:22.591395 1 controller.go:512] The operator is healthy I0331 04:02:22.590873 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:02:22.590890 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:02:22.590894 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:02:22.590917 1 controller.go:512] The operator is healthy I0331 04:03:15.073374 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:03:15.094514 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:03:15.100296 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:03:15.100321 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:03:15.104983 1 secretconfigobserver.go:119] support secret does not exist I0331 04:04:22.590918 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:04:22.590934 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:04:22.590937 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:04:22.590959 1 controller.go:512] The operator is healthy I0331 04:06:22.591080 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:06:22.591098 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:06:22.591104 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:06:22.591135 1 controller.go:512] The operator is healthy I0331 04:08:15.106028 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:08:15.112319 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:08:15.112338 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:08:15.116957 1 secretconfigobserver.go:119] support secret does not exist I0331 04:08:22.590401 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:08:22.590415 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:08:22.590419 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:08:22.590441 1 controller.go:512] The operator is healthy I0331 04:10:10.857139 1 periodic.go:209] Running clusterconfig gatherer I0331 04:10:10.857218 1 tasks_processing.go:45] number of workers: 64 I0331 04:10:10.857269 1 tasks_processing.go:69] worker 63 listening for tasks. I0331 04:10:10.857273 1 tasks_processing.go:71] worker 63 working on openstack_dataplanenodesets task. I0331 04:10:10.857306 1 tasks_processing.go:69] worker 31 listening for tasks. I0331 04:10:10.857317 1 tasks_processing.go:69] worker 47 listening for tasks. I0331 04:10:10.857323 1 tasks_processing.go:69] worker 16 listening for tasks. I0331 04:10:10.857333 1 tasks_processing.go:69] worker 17 listening for tasks. I0331 04:10:10.857337 1 tasks_processing.go:69] worker 32 listening for tasks. I0331 04:10:10.857340 1 tasks_processing.go:69] worker 18 listening for tasks. I0331 04:10:10.857343 1 tasks_processing.go:69] worker 33 listening for tasks. I0331 04:10:10.857345 1 tasks_processing.go:69] worker 19 listening for tasks. I0331 04:10:10.857338 1 tasks_processing.go:69] worker 15 listening for tasks. I0331 04:10:10.857349 1 tasks_processing.go:69] worker 34 listening for tasks. I0331 04:10:10.857352 1 tasks_processing.go:69] worker 7 listening for tasks. I0331 04:10:10.857362 1 tasks_processing.go:69] worker 36 listening for tasks. I0331 04:10:10.857359 1 tasks_processing.go:69] worker 21 listening for tasks. I0331 04:10:10.857369 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:10:10.857370 1 tasks_processing.go:69] worker 28 listening for tasks. I0331 04:10:10.857374 1 tasks_processing.go:69] worker 37 listening for tasks. I0331 04:10:10.857374 1 tasks_processing.go:69] worker 9 listening for tasks. I0331 04:10:10.857357 1 tasks_processing.go:69] worker 35 listening for tasks. I0331 04:10:10.857381 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:10:10.857382 1 tasks_processing.go:69] worker 29 listening for tasks. I0331 04:10:10.857377 1 tasks_processing.go:69] worker 55 listening for tasks. I0331 04:10:10.857382 1 tasks_processing.go:69] worker 26 listening for tasks. I0331 04:10:10.857392 1 tasks_processing.go:69] worker 6 listening for tasks. I0331 04:10:10.857392 1 tasks_processing.go:69] worker 30 listening for tasks. I0331 04:10:10.857396 1 tasks_processing.go:69] worker 11 listening for tasks. I0331 04:10:10.857351 1 tasks_processing.go:69] worker 20 listening for tasks. I0331 04:10:10.857364 1 tasks_processing.go:69] worker 27 listening for tasks. I0331 04:10:10.857367 1 tasks_processing.go:69] worker 8 listening for tasks. I0331 04:10:10.857380 1 tasks_processing.go:69] worker 38 listening for tasks. I0331 04:10:10.857408 1 tasks_processing.go:69] worker 12 listening for tasks. I0331 04:10:10.857409 1 tasks_processing.go:69] worker 49 listening for tasks. I0331 04:10:10.857403 1 tasks_processing.go:69] worker 4 listening for tasks. I0331 04:10:10.857415 1 tasks_processing.go:69] worker 14 listening for tasks. I0331 04:10:10.857418 1 tasks_processing.go:69] worker 42 listening for tasks. I0331 04:10:10.857420 1 tasks_processing.go:69] worker 54 listening for tasks. I0331 04:10:10.857421 1 tasks_processing.go:69] worker 58 listening for tasks. I0331 04:10:10.857423 1 tasks_processing.go:69] worker 50 listening for tasks. I0331 04:10:10.857427 1 tasks_processing.go:69] worker 43 listening for tasks. I0331 04:10:10.857429 1 tasks_processing.go:69] worker 56 listening for tasks. I0331 04:10:10.857428 1 tasks_processing.go:69] worker 3 listening for tasks. I0331 04:10:10.857425 1 tasks_processing.go:69] worker 44 listening for tasks. I0331 04:10:10.857435 1 tasks_processing.go:69] worker 25 listening for tasks. I0331 04:10:10.857441 1 tasks_processing.go:69] worker 60 listening for tasks. I0331 04:10:10.857388 1 tasks_processing.go:69] worker 5 listening for tasks. I0331 04:10:10.857440 1 tasks_processing.go:69] worker 57 listening for tasks. I0331 04:10:10.857387 1 tasks_processing.go:69] worker 10 listening for tasks. I0331 04:10:10.857390 1 tasks_processing.go:69] worker 40 listening for tasks. I0331 04:10:10.857395 1 tasks_processing.go:69] worker 41 listening for tasks. I0331 04:10:10.857397 1 tasks_processing.go:69] worker 48 listening for tasks. I0331 04:10:10.857400 1 tasks_processing.go:69] worker 22 listening for tasks. I0331 04:10:10.857402 1 tasks_processing.go:69] worker 45 listening for tasks. I0331 04:10:10.857403 1 tasks_processing.go:69] worker 13 listening for tasks. I0331 04:10:10.857404 1 tasks_processing.go:69] worker 51 listening for tasks. I0331 04:10:10.857403 1 tasks_processing.go:69] worker 52 listening for tasks. I0331 04:10:10.857405 1 tasks_processing.go:69] worker 23 listening for tasks. I0331 04:10:10.857408 1 tasks_processing.go:69] worker 53 listening for tasks. I0331 04:10:10.857410 1 tasks_processing.go:69] worker 24 listening for tasks. I0331 04:10:10.857408 1 tasks_processing.go:69] worker 46 listening for tasks. I0331 04:10:10.857385 1 tasks_processing.go:69] worker 39 listening for tasks. I0331 04:10:10.857417 1 tasks_processing.go:69] worker 59 listening for tasks. I0331 04:10:10.857419 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:10:10.857428 1 tasks_processing.go:69] worker 61 listening for tasks. I0331 04:10:10.857436 1 tasks_processing.go:69] worker 62 listening for tasks. I0331 04:10:10.857501 1 tasks_processing.go:71] worker 19 working on certificate_signing_requests task. I0331 04:10:10.857504 1 tasks_processing.go:71] worker 17 working on tsdb_status task. I0331 04:10:10.857509 1 tasks_processing.go:71] worker 33 working on pdbs task. I0331 04:10:10.857506 1 tasks_processing.go:71] worker 18 working on feature_gates task. I0331 04:10:10.857515 1 tasks_processing.go:71] worker 43 working on image task. I0331 04:10:10.857518 1 tasks_processing.go:71] worker 47 working on olm_operators task. I0331 04:10:10.857520 1 tasks_processing.go:71] worker 7 working on machine_autoscalers task. I0331 04:10:10.857526 1 tasks_processing.go:71] worker 31 working on config_maps task. I0331 04:10:10.857539 1 tasks_processing.go:71] worker 22 working on pod_network_connectivity_checks task. I0331 04:10:10.857553 1 tasks_processing.go:71] worker 53 working on machine_sets task. I0331 04:10:10.857566 1 tasks_processing.go:71] worker 51 working on nodenetworkstates task. I0331 04:10:10.857516 1 tasks_processing.go:71] worker 34 working on lokistack task. I0331 04:10:10.857581 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I0331 04:10:10.857510 1 tasks_processing.go:71] worker 15 working on storage_classes task. I0331 04:10:10.857596 1 tasks_processing.go:71] worker 3 working on openstack_controlplanes task. I0331 04:10:10.857597 1 tasks_processing.go:71] worker 12 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0331 04:10:10.857605 1 tasks_processing.go:71] worker 9 working on active_alerts task. I0331 04:10:10.857610 1 tasks_processing.go:71] worker 35 working on container_images task. I0331 04:10:10.857618 1 tasks_processing.go:71] worker 45 working on support_secret task. I0331 04:10:10.857623 1 tasks_processing.go:71] worker 27 working on openstack_dataplanedeployments task. I0331 04:10:10.857512 1 tasks_processing.go:71] worker 58 working on image_registries task. I0331 04:10:10.857628 1 tasks_processing.go:71] worker 13 working on sap_config task. I0331 04:10:10.857626 1 tasks_processing.go:71] worker 23 working on openstack_version task. I0331 04:10:10.857632 1 tasks_processing.go:71] worker 46 working on crds task. I0331 04:10:10.857636 1 tasks_processing.go:71] worker 42 working on ingress task. I0331 04:10:10.857638 1 tasks_processing.go:71] worker 61 working on operators task. I0331 04:10:10.857643 1 tasks_processing.go:71] worker 4 working on infrastructures task. I0331 04:10:10.857592 1 tasks_processing.go:71] worker 56 working on machine_configs task. I0331 04:10:10.857675 1 tasks_processing.go:71] worker 29 working on install_plans task. I0331 04:10:10.857616 1 tasks_processing.go:71] worker 11 working on container_runtime_configs task. I0331 04:10:10.857791 1 tasks_processing.go:71] worker 44 working on proxies task. I0331 04:10:10.857513 1 tasks_processing.go:71] worker 50 working on cost_management_metrics_configs task. I0331 04:10:10.857604 1 tasks_processing.go:71] worker 36 working on storage_cluster task. I0331 04:10:10.857861 1 tasks_processing.go:71] worker 37 working on aggregated_monitoring_cr_names task. I0331 04:10:10.857624 1 tasks_processing.go:71] worker 39 working on machine_config_pools task. I0331 04:10:10.857933 1 tasks_processing.go:71] worker 16 working on cluster_apiserver task. I0331 04:10:10.857946 1 tasks_processing.go:71] worker 25 working on nodenetworkconfigurationpolicies task. I0331 04:10:10.857619 1 tasks_processing.go:71] worker 20 working on sap_pods task. I0331 04:10:10.857637 1 tasks_processing.go:71] worker 49 working on openshift_machine_api_events task. I0331 04:10:10.857627 1 tasks_processing.go:71] worker 14 working on openshift_logging task. I0331 04:10:10.858065 1 tasks_processing.go:71] worker 40 working on sap_datahubs task. I0331 04:10:10.857610 1 tasks_processing.go:71] worker 30 working on monitoring_persistent_volumes task. I0331 04:10:10.858282 1 gather_lokistack.go:58] Start LokiStack gathering I0331 04:10:10.857588 1 tasks_processing.go:71] worker 6 working on validating_webhook_configurations task. I0331 04:10:10.857936 1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task. I0331 04:10:10.857601 1 tasks_processing.go:71] worker 38 working on nodes task. I0331 04:10:10.858083 1 tasks_processing.go:71] worker 26 working on ingress_certificates task. I0331 04:10:10.858010 1 tasks_processing.go:71] worker 21 working on oauths task. I0331 04:10:10.858017 1 tasks_processing.go:71] worker 0 working on operators_pods_and_events task. I0331 04:10:10.857505 1 tasks_processing.go:71] worker 32 working on service_accounts task. I0331 04:10:10.858024 1 tasks_processing.go:71] worker 54 working on machines task. I0331 04:10:10.858024 1 tasks_processing.go:71] worker 8 working on node_logs task. I0331 04:10:10.858030 1 tasks_processing.go:71] worker 55 working on ceph_cluster task. I0331 04:10:10.858032 1 tasks_processing.go:71] worker 1 working on clusterroles task. I0331 04:10:10.858038 1 tasks_processing.go:71] worker 10 working on dvo_metrics task. I0331 04:10:10.858042 1 tasks_processing.go:71] worker 60 working on networks task. I0331 04:10:10.858045 1 tasks_processing.go:71] worker 5 working on authentication task. I0331 04:10:10.857628 1 tasks_processing.go:71] worker 24 working on image_pruners task. I0331 04:10:10.858051 1 tasks_processing.go:71] worker 57 working on metrics task. I0331 04:10:10.858060 1 tasks_processing.go:71] worker 41 working on version task. I0331 04:10:10.857630 1 tasks_processing.go:71] worker 59 working on schedulers task. I0331 04:10:10.857507 1 tasks_processing.go:71] worker 62 working on jaegers task. I0331 04:10:10.858100 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0331 04:10:10.857634 1 tasks_processing.go:71] worker 2 working on qemu_kubevirt_launcher_logs task. I0331 04:10:10.873377 1 tasks_processing.go:71] worker 3 working on machine_healthchecks task. I0331 04:10:10.873392 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 15.769232ms to process 0 records I0331 04:10:10.873405 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 15.738582ms to process 0 records I0331 04:10:10.873412 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 15.569344ms to process 0 records I0331 04:10:10.873417 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 15.750116ms to process 0 records I0331 04:10:10.873422 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.671385ms to process 0 records I0331 04:10:10.873428 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.111905ms to process 0 records I0331 04:10:10.873434 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 15.55964ms to process 0 records I0331 04:10:10.873439 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.769007ms to process 0 records I0331 04:10:10.873448 1 tasks_processing.go:74] worker 13 stopped. I0331 04:10:10.873455 1 tasks_processing.go:74] worker 23 stopped. I0331 04:10:10.873460 1 tasks_processing.go:74] worker 50 stopped. I0331 04:10:10.873466 1 tasks_processing.go:74] worker 27 stopped. I0331 04:10:10.873471 1 tasks_processing.go:74] worker 36 stopped. I0331 04:10:10.873476 1 tasks_processing.go:74] worker 11 stopped. I0331 04:10:10.873478 1 tasks_processing.go:74] worker 63 stopped. I0331 04:10:10.879899 1 tasks_processing.go:74] worker 53 stopped. I0331 04:10:10.879918 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 22.334503ms to process 0 records I0331 04:10:10.879946 1 tasks_processing.go:74] worker 34 stopped. I0331 04:10:10.879952 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 22.363787ms to process 0 records I0331 04:10:10.880228 1 tasks_processing.go:74] worker 45 stopped. E0331 04:10:10.880357 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0331 04:10:10.880374 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 22.597165ms to process 0 records I0331 04:10:10.880384 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 22.195363ms to process 0 records I0331 04:10:10.880391 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 20.810009ms to process 0 records I0331 04:10:10.880408 1 tasks_processing.go:74] worker 62 stopped. I0331 04:10:10.880421 1 tasks_processing.go:74] worker 25 stopped. I0331 04:10:10.880436 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 22.463839ms to process 0 records I0331 04:10:10.880456 1 tasks_processing.go:74] worker 14 stopped. I0331 04:10:10.880458 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 22.278923ms to process 0 records I0331 04:10:10.880469 1 tasks_processing.go:74] worker 40 stopped. I0331 04:10:10.880480 1 tasks_processing.go:74] worker 54 stopped. E0331 04:10:10.880498 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0331 04:10:10.880513 1 gather.go:177] gatherer "clusterconfig" function "machines" took 21.659928ms to process 0 records I0331 04:10:10.880618 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 22.979961ms to process 0 records I0331 04:10:10.880636 1 tasks_processing.go:74] worker 7 stopped. I0331 04:10:10.880733 1 tasks_processing.go:74] worker 16 stopped. I0331 04:10:10.881120 1 recorder.go:75] Recording config/apiserver with fingerprint=fef7bcd6ec1c2e432dcb73cab518872e196c9d6d32d965f53fce5c50c03a6056 I0331 04:10:10.881145 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.782361ms to process 1 records I0331 04:10:10.881491 1 recorder.go:75] Recording config/ingress with fingerprint=eea365db3992c07d6869f31b3bd08b566cfc4c0649ee9f5f001f0402cf251c74 I0331 04:10:10.881506 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.283765ms to process 1 records I0331 04:10:10.881578 1 tasks_processing.go:74] worker 4 stopped. I0331 04:10:10.881624 1 tasks_processing.go:74] worker 42 stopped. I0331 04:10:10.882570 1 recorder.go:75] Recording config/infrastructure with fingerprint=9c76a82d3dc60076698b7a9ea931797e57c667c65eb187248ab9deaff2b459f3 I0331 04:10:10.882588 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 23.282054ms to process 1 records E0331 04:10:10.882599 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0331 04:10:10.882606 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 7.62935ms to process 0 records I0331 04:10:10.882613 1 tasks_processing.go:74] worker 3 stopped. I0331 04:10:10.885827 1 tasks_processing.go:74] worker 51 stopped. I0331 04:10:10.885842 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 28.252116ms to process 0 records I0331 04:10:10.885857 1 tasks_processing.go:74] worker 55 stopped. I0331 04:10:10.885869 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 26.834577ms to process 0 records I0331 04:10:10.885932 1 tasks_processing.go:74] worker 20 stopped. I0331 04:10:10.885947 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.96385ms to process 0 records I0331 04:10:10.886063 1 tasks_processing.go:74] worker 44 stopped. I0331 04:10:10.886124 1 recorder.go:75] Recording config/proxy with fingerprint=2c4ef8123e90f84f8a082e656b2f6b665eb4a87d94248b9557cce7f6b4c44372 I0331 04:10:10.886137 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.253349ms to process 1 records I0331 04:10:10.886193 1 tasks_processing.go:74] worker 43 stopped. I0331 04:10:10.886211 1 recorder.go:75] Recording config/image with fingerprint=e9314b46c3cd288bed0afadbc0949eb4fe9f823bdc16dbe8218241d70d782e80 I0331 04:10:10.886217 1 gather.go:177] gatherer "clusterconfig" function "image" took 28.545882ms to process 1 records I0331 04:10:10.886261 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=19fa7d4dd241a396c2ff2c45839294b116a4b5fbc385d791f3eb2e3e7bc19f05 I0331 04:10:10.886268 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 26.673046ms to process 1 records I0331 04:10:10.886292 1 tasks_processing.go:74] worker 59 stopped. I0331 04:10:10.886340 1 recorder.go:75] Recording config/featuregate with fingerprint=ace966eca666ec45f2108c17902b99aac0b2b350eca61b22abdfc44e97b9c9b6 I0331 04:10:10.886348 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 28.670807ms to process 1 records I0331 04:10:10.886354 1 tasks_processing.go:74] worker 18 stopped. I0331 04:10:10.890006 1 tasks_processing.go:74] worker 21 stopped. I0331 04:10:10.890221 1 recorder.go:75] Recording config/oauth with fingerprint=4af6c3df3c1125441933fb1a58a0737106bb4b878c9ff4eb179d3bb4cb22e2e1 I0331 04:10:10.890237 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 31.248598ms to process 1 records I0331 04:10:10.892754 1 tasks_processing.go:74] worker 30 stopped. I0331 04:10:10.892770 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 34.547016ms to process 0 records I0331 04:10:10.893278 1 tasks_processing.go:74] worker 49 stopped. I0331 04:10:10.893293 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 35.299476ms to process 0 records I0331 04:10:10.893396 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=c8a6ee09ee5c2ce3a0c2046f41d3828cfdb6c1383f75557ba7e41632df191262 I0331 04:10:10.893420 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=a7a89c465c3fe6b27b822ae03671ae844bed38869c6118356a5dcbb1c072aef0 I0331 04:10:10.893436 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=ecc86140f693c77042b213a02234f00f1a82ac8412313d154802f17b41ff9476 I0331 04:10:10.893448 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=7982741392a6ea0e62de746f938e3ecc99cd68d2744da43a5822a43ac8c5343b I0331 04:10:10.893471 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=2616278f300b84e91cc318729342e71a109392bc50cbdae3e197518c2e636bc1 I0331 04:10:10.893488 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=e4779f88a800112dcff2efae43a01fccb89ce8d43c043016baa73dc995a0d64b I0331 04:10:10.893420 1 tasks_processing.go:74] worker 33 stopped. I0331 04:10:10.893504 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=e114078d9d2bf71ef3b782bb4fe227489c696daade40bb7706a141a1c47f8642 I0331 04:10:10.893527 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=b6794914defa912d90d472f75e11d7898e9a3adb8664c12c7e65bc9dfe5c575c I0331 04:10:10.893543 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=f55ce6e3ffdab735836b05058f041e77b63a6ab45cc39a46b2f7af55b69dede3 I0331 04:10:10.893558 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=adbc44fba1a036e20cef6066a2d2d29e0f5a75e808bc0e3d2d229804d4b09ae7 I0331 04:10:10.893579 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=fe9cc210c47be5865cc343f93328902627b6b19a2a2e14cc2dbc4a53907b1229 I0331 04:10:10.893585 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 35.770977ms to process 11 records I0331 04:10:10.893669 1 tasks_processing.go:74] worker 24 stopped. I0331 04:10:10.893806 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=374d682db87e5b4abeff8c0be615c974ddd4652f5507f63d5d30655d6851ab40 I0331 04:10:10.893817 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 34.103825ms to process 1 records I0331 04:10:10.893907 1 tasks_processing.go:74] worker 60 stopped. I0331 04:10:10.893933 1 recorder.go:75] Recording config/network with fingerprint=5c217613529eb25138352baf1bfd58915b9d98f5168b704d88bad3fc15768019 I0331 04:10:10.893941 1 gather.go:177] gatherer "clusterconfig" function "networks" took 34.351826ms to process 1 records I0331 04:10:10.895561 1 tasks_processing.go:74] worker 28 stopped. I0331 04:10:10.895719 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=34a6a0d59081d2cb69fe2de494c7c3610d6ae713554eb328dd71d70890cfce0c I0331 04:10:10.895764 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=38b8933d3ee1772ccaa0efe7fe81e4e358a392e13a1b742cfd438e2cb18baf40 I0331 04:10:10.895791 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=2b3dc0640a9efcb5f9e7f645ce41486f0185f2a20f69b59a1fc2619d3b9b7097 I0331 04:10:10.895837 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=0000f95d7ea37a56552464057849f3b73571350722150b5231f2855fcd296e7f I0331 04:10:10.895861 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=4c1afe63d1b8441d5df873709965e56b1dfb1697cc5d5d587d17455afd4ea8b6 I0331 04:10:10.895949 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=6f7e1e55719c6828ddb6a1b00acdebb98bd83e2de6beed0b95597cedf0e25c83 I0331 04:10:10.895983 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a8d058a26d05754b38d1e3437875e135ba181e8dee2d84424abd4171275b4d01 I0331 04:10:10.896015 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=7c2382866f98dceaa8fe388355dc5c8230de64b01fac36bcf0b7e6285c55c7af I0331 04:10:10.896055 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=4b8f881243c5d8029229189471d15d62013f9267c818765d96419e82849e3762 I0331 04:10:10.896099 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=4672b9c6ec226a10e2bb86016daf16091bc8ce7ba24dde97852daf4beb5a7f96 I0331 04:10:10.896136 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=9ba61b40122d491cb403ae8348051553e47106927b384a8e4426ff7fc687f3d1 I0331 04:10:10.896144 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 36.977148ms to process 11 records I0331 04:10:10.896260 1 tasks_processing.go:74] worker 58 stopped. I0331 04:10:10.896533 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6702a737ac226e17497ecc8df8c8c08b4c544dc846395ba46e2ddd17a5414274 I0331 04:10:10.896552 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 38.07775ms to process 1 records I0331 04:10:10.896560 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 36.837972ms to process 0 records I0331 04:10:10.896568 1 tasks_processing.go:74] worker 8 stopped. I0331 04:10:10.896846 1 tasks_processing.go:74] worker 5 stopped. I0331 04:10:10.897087 1 recorder.go:75] Recording config/authentication with fingerprint=8653a0ad817806c99a6319fef720c98d04599867e822cd1b4b47a819758592fc I0331 04:10:10.897106 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 37.541667ms to process 1 records I0331 04:10:10.897190 1 tasks_processing.go:74] worker 6 stopped. I0331 04:10:10.897234 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=edf4a17ccf2467fb9d677b88f495e905365a47bb40577947076133b5c1eae393 I0331 04:10:10.897251 1 gather_logs.go:145] no pods in namespace were found I0331 04:10:10.897275 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=483fabb60954b7b838b7bd71a82eed558c049b7b86b22af47c38ea1817430a60 I0331 04:10:10.897309 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=8bfe65027d92f1ae05bf5eec695bd0d47dcdd65011aa742d2cb27c572c431881 I0331 04:10:10.897332 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=632ee03b05ea8bb80b7fbb50ddd43d17c83b042b7fd81b720152597bbebe1de8 I0331 04:10:10.897376 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=a8a56a04472ba40d68902cdfb80b2b7e97e95e3c1692d5cf906eeede2d91e096 I0331 04:10:10.897422 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=83b0ca8f2b35b82f9f5483004824f7592f9953d5456b2357ef27ca7fa363c459 I0331 04:10:10.897470 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=3e7413022dc7dda2320cb5b4ff979b3b4f0b8cd2a4aed76dbc605ab0a662e116 I0331 04:10:10.897522 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=d7f3b12951793c674acbfcd68e259312d9b7d008c3a6953962f40eba34d08b38 I0331 04:10:10.897559 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=6e6b48e4670dfe8f1e3663177ce2587b8317675f1f2a6c326854976892037a33 I0331 04:10:10.897653 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c8ea30c3966244307772b25f40649bfc6593b741c7409915e8146ffdd8fba6fe I0331 04:10:10.897696 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=759d63816057e5110ee07363f63a65ae45811bdf01e6c57a61035cd0c233f1fa I0331 04:10:10.897744 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=49c57935cce3afb33bf7fb8e5f0e77efb7013e51cd44185c0a4590ede85ad8ce I0331 04:10:10.898319 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=dd9b0892abb5b3bb662fb2470904d883b44aaf441c9ac36719dc3efc6aabd146 I0331 04:10:10.898498 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=0cd4706a66be7338283744150085f4c0a90ea5f00199cc518ab7c38b94dc5df0 I0331 04:10:10.898565 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=5f10923784b1300d1427f8b36282de17996bfea4577209f80d07a78c2b2cb5a7 I0331 04:10:10.898667 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=7f50085787ebcb9960241c4ed62841da869f2372ead4d39682bccb7143b2444c I0331 04:10:10.898800 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c96b09a790822dbe870b56cb71ace539540b194bf95fdec9a039c1f7bb677c3b I0331 04:10:10.898927 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=25eea9d856f826e10b133593738074416c2ca84b8dc532b234fef98ecc1bd2ef I0331 04:10:10.899008 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f3284003ed0963ef61e2e0d5393885e292738883a4e2a341c7f69fbee73fec41 I0331 04:10:10.899655 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=278fff0bca80fb2a1ca528b34e15c74ded4807e652bfc724c6751756e3c2cf4b I0331 04:10:10.899740 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=08a6536949032a35ddfa632946924ace692713e309f61748f8a8df6be53afda7 I0331 04:10:10.899831 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=9714c1996fedee02b626f7ebfe3bd326f19e140049695efc662747204194c7e9 I0331 04:10:10.899913 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=6925836ffa6af66652b4dae533cb0304879caf159f306d5dc27541a34165973c I0331 04:10:10.900041 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=e8c9d088d89f2f47ecfe491084874d9c3a1b9afe504b3cba81ff92e050165f61 I0331 04:10:10.900143 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=9c4d483a1234ada8bb8f6696f72015b05339c463d902ca42f46efc83d9000791 I0331 04:10:10.900195 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 38.610512ms to process 25 records I0331 04:10:10.900238 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 37.574176ms to process 0 records I0331 04:10:10.900303 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0331 04:10:10.900325 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 39.965665ms to process 1 records I0331 04:10:10.900523 1 tasks_processing.go:74] worker 22 stopped. I0331 04:10:10.900531 1 tasks_processing.go:74] worker 15 stopped. I0331 04:10:10.900869 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=0b536f92e2a92aff4b011db280f9a558286d2b501df4cfbc7944340392f301ea I0331 04:10:10.900983 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=fd72bdcb4d68d2d9d3241cd6bf2bf11eb553de0903e5972ed1667cecacec96ec I0331 04:10:10.901015 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 40.777583ms to process 2 records I0331 04:10:10.901040 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 41.287601ms to process 0 records I0331 04:10:10.901095 1 tasks_processing.go:74] worker 39 stopped. I0331 04:10:10.901556 1 tasks_processing.go:74] worker 2 stopped. I0331 04:10:10.901588 1 tasks_processing.go:74] worker 48 stopped. I0331 04:10:10.901612 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0331 04:10:10.901628 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 41.974311ms to process 1 records I0331 04:10:10.901961 1 tasks_processing.go:74] worker 38 stopped. I0331 04:10:10.902300 1 recorder.go:75] Recording config/node/ip-10-0-0-103.ec2.internal with fingerprint=fb17f1967a79be10356b4629c401f1e908b6c59d7156b3179f582e41cb29824f I0331 04:10:10.902370 1 recorder.go:75] Recording config/node/ip-10-0-1-107.ec2.internal with fingerprint=acd98dce994086305a1e2032fb30d15dbfa34a6b07a7cbd74243d2193748a44b I0331 04:10:10.902434 1 recorder.go:75] Recording config/node/ip-10-0-2-23.ec2.internal with fingerprint=b8865852298cbd2ac6728a17a8e6edb87b010994698e9ef91d4cc764a5529be5 I0331 04:10:10.902444 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 43.348161ms to process 3 records I0331 04:10:10.905127 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0331 04:10:10.905143 1 tasks_processing.go:74] worker 0 stopped. I0331 04:10:10.905153 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 46.359986ms to process 0 records I0331 04:10:10.905202 1 tasks_processing.go:74] worker 19 stopped. I0331 04:10:10.905220 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 47.657863ms to process 0 records I0331 04:10:10.909722 1 tasks_processing.go:74] worker 1 stopped. I0331 04:10:10.910240 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=a7c56ebf1accf946b2719d1e901d6fc56da8320524c7dbd2c38163d9b0b35eca I0331 04:10:10.910601 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c2dd7493713494c55c406a95a581f9b60987f30f162934228de8ac11d08cc626 I0331 04:10:10.910613 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 50.618729ms to process 2 records I0331 04:10:10.910711 1 tasks_processing.go:74] worker 46 stopped. I0331 04:10:10.911540 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=a69b50a34e387e18e0c9903dc1b6eed7ed2f2e44cc75b495f01261f328e08b73 I0331 04:10:10.912006 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=683b354c7e963cb8dc5fa7287c6638ee82bb6ffe9c159e1d49773753e2a23efd I0331 04:10:10.912025 1 gather.go:177] gatherer "clusterconfig" function "crds" took 52.098422ms to process 2 records I0331 04:10:10.912119 1 tasks_processing.go:74] worker 41 stopped. I0331 04:10:10.912366 1 recorder.go:75] Recording config/version with fingerprint=7777a755812a52f4f5e14b8239cec677f4ca86f4a06c340aa3adce277879881b I0331 04:10:10.912386 1 recorder.go:75] Recording config/id with fingerprint=248ca49c4be3d64130c8fffb701a542cc1750b5e3614f0e126e8fb8ffe964c05 I0331 04:10:10.912397 1 gather.go:177] gatherer "clusterconfig" function "version" took 50.464174ms to process 2 records I0331 04:10:10.912415 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.33551ms to process 0 records I0331 04:10:10.912429 1 tasks_processing.go:74] worker 37 stopped. I0331 04:10:10.913900 1 tasks_processing.go:74] worker 56 stopped. I0331 04:10:10.913926 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0331 04:10:10.913935 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 56.236568ms to process 1 records I0331 04:10:10.927529 1 tasks_processing.go:74] worker 31 stopped. E0331 04:10:10.927547 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0331 04:10:10.927555 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0331 04:10:10.927558 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0331 04:10:10.927568 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0331 04:10:10.927589 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=2b7e7d968c1ca0e033f2ae1514829fefa6008cf7d89addbe266d351cfb9cca19 I0331 04:10:10.927598 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0331 04:10:10.927603 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0331 04:10:10.927613 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0331 04:10:10.927652 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0331 04:10:10.927659 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0331 04:10:10.927664 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 69.984404ms to process 7 records I0331 04:10:10.932093 1 tasks_processing.go:74] worker 26 stopped. E0331 04:10:10.932110 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0331 04:10:10.932119 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pcf5093fb1dpqq37df3mvn2eh63vsdj-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pcf5093fb1dpqq37df3mvn2eh63vsdj-primary-cert-bundle-secret" not found I0331 04:10:10.932205 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=c5bb667fdb0382ad1fc25a8d0c49d2ba09d7e8f07fa7864dcc01c162073ffa9c I0331 04:10:10.932222 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 73.407479ms to process 1 records I0331 04:10:10.932720 1 tasks_processing.go:74] worker 12 stopped. I0331 04:10:10.932731 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 75.111158ms to process 0 records I0331 04:10:10.932958 1 tasks_processing.go:74] worker 35 stopped. I0331 04:10:10.934390 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-8q7xz with fingerprint=4813cdb4229e203440991f0b3895fe65f97c520e834aa3df37e79aea2e8f084a I0331 04:10:10.934536 1 recorder.go:75] Recording config/running_containers with fingerprint=c5ad732512740332c7bf119dea6fc8fe9006f3a0cbed355c122fc115776646fd I0331 04:10:10.934546 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 75.327444ms to process 2 records I0331 04:10:10.966255 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:10:10.969744 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:10:10.981162 1 tasks_processing.go:74] worker 47 stopped. I0331 04:10:10.981365 1 recorder.go:75] Recording config/olm_operators with fingerprint=45795b286ebcd54a4ca7be750add14edb73fec972217a99f83609bcac314f583 I0331 04:10:10.981381 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 123.630482ms to process 1 records I0331 04:10:11.923294 1 tasks_processing.go:74] worker 52 stopped. I0331 04:10:11.923313 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0331 04:10:11.923325 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.065700531s to process 1 records I0331 04:10:11.923434 1 tasks_processing.go:74] worker 9 stopped. I0331 04:10:11.923487 1 recorder.go:75] Recording config/alerts with fingerprint=7f066bb11b6d031f58353418f3aba239f7a8bf936d726230b30c4330795c6bf0 I0331 04:10:11.923500 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.065813659s to process 1 records I0331 04:10:11.932988 1 tasks_processing.go:74] worker 57 stopped. I0331 04:10:11.933060 1 recorder.go:75] Recording config/metrics with fingerprint=83724cf5a0ed13d43b737ebe519fd71b9bf3e039e59d3e785893600beae3f80e I0331 04:10:11.933073 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.073629965s to process 1 records I0331 04:10:11.939329 1 tasks_processing.go:74] worker 17 stopped. I0331 04:10:11.939348 1 recorder.go:75] Recording config/tsdb.json with fingerprint=0f8edcd4fcb93ff27b70d2d5b1797120cc7be8046e13404b89631e0f3d9e16e8 I0331 04:10:11.939356 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.081809932s to process 1 records I0331 04:10:13.294436 1 tasks_processing.go:74] worker 10 stopped. I0331 04:10:13.294799 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=925e4fec299360c1830ddb00ea881bc016c9c039083862bcbb9e0f7a00ab677d I0331 04:10:13.294813 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 2.435224542s to process 1 records I0331 04:10:13.325571 1 tasks_processing.go:74] worker 61 stopped. I0331 04:10:13.325637 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=542db5d23ba9ab418e784f05e5dffb343f74109277e04114ac7a14c8f98bfc0b I0331 04:10:13.325686 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0331 04:10:13.325710 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=dd6be1e34d56aea7a216bced03f3d2c1c7bcc46cb0bd8bd2cfeb32923249d50e I0331 04:10:13.325720 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0331 04:10:13.325742 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=89823444e7a048f5fef2ced64e8a9132459ed2ef8d7d702d4b139a3f35343aa9 I0331 04:10:13.325757 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0331 04:10:13.325777 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=2111d2ef367ca395714058fd562dd0216bc3558cdfc4b3603d8d2393313db56f I0331 04:10:13.325806 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=6c3fdcb187f6dd6b7cabf2c2a96396f84117d7372e88112638b45d035b568639 I0331 04:10:13.325829 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=5493ff81eb2fbb9d8b6c3f263f65b4687eed0a126f232b1aa14885593a30eb2c I0331 04:10:13.325859 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=7287326088880bcf2f75f1fb8f4dc41a3c4f4392c510299b654ddaf5763a1777 I0331 04:10:13.326131 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=356a936b906b10f2b1c9cba4f8ae79f0b0653d6ba70c025577d030c02e1e03b0 I0331 04:10:13.326150 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=0c0be9587b6128de224b6674c39a41e7dcdfa6afc25dda5ef8d4ab4b38458545 I0331 04:10:13.326158 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0331 04:10:13.326192 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=6d59d19c6367f4c221ff59c2ea27f01ec44568d409a71d5d8dfb467c746c1c1a I0331 04:10:13.326203 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0331 04:10:13.326219 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=740531e0130fb69fc4b9fe00900442a4a7cb6a4d8934f145538a9534cfb3e43b I0331 04:10:13.326228 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0331 04:10:13.326247 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=81b05554ffb197d66923c0e5084aa6143a5a536532ffc0219f59176852934a8a I0331 04:10:13.326256 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0331 04:10:13.326278 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=f2e9a8e5add052cec45c4e16fa2df46137cbd86626aa41760738e86741699f56 I0331 04:10:13.326386 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e65fc7d7b84a4c8bc3b02b3b787db3df6dfe900c7a3e2917686562ecda771eca I0331 04:10:13.326395 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0331 04:10:13.326401 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0331 04:10:13.326421 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0331 04:10:13.326471 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=b7e751035972cee26b82b2567290f2ac6e05bf968313e64b8ae3ffdc22b702c7 I0331 04:10:13.326495 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=59b6d9ea7c62e2d254c8d3ba771273b7dbea0bd15726aa8bf4004f6d5be7a9cd I0331 04:10:13.326504 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0331 04:10:13.326519 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=561ffe0fefb80f2854893a08fa1a7850ce97d466696ab12da72ca1d389ed5c8b I0331 04:10:13.326527 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0331 04:10:13.326545 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=6a2305c613803c51a596ed4f5e566ab44feed52d34582297d37b81b751c141e2 I0331 04:10:13.326554 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0331 04:10:13.326567 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4998a233c079ae299a8e771e65fae6e83bc246d856c73945591854aacfacf3ad I0331 04:10:13.326582 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=5a89a3096e80131dc8b541817cb83429c21fa11b3fd775c36d3f19b590847368 I0331 04:10:13.326597 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=2c4d49b1a329c503b782f9707684d1e104823f871e59f9ce8adc0e0030c8e3ca I0331 04:10:13.326617 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=aa625b70393fd460ae5c39e8784b8063e95cac75e4f63b03c01668ebbe630f4c I0331 04:10:13.326626 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0331 04:10:13.326653 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=7bf46f91f05c51a97a51dbdf317f356181fe0a3418e17fbad7487789169d2871 I0331 04:10:13.326668 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0331 04:10:13.326676 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0331 04:10:13.326683 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.467916145s to process 39 records I0331 04:10:22.589624 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:10:22.589639 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:10:22.589643 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:10:22.589666 1 controller.go:512] The operator is healthy I0331 04:10:23.907230 1 tasks_processing.go:74] worker 29 stopped. I0331 04:10:23.907280 1 recorder.go:75] Recording config/installplans with fingerprint=a5b6a5709edaa0451f27698816b5b95a2700db411a592b10d2f3fe3071ef5ef9 I0331 04:10:23.907293 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.049530811s to process 1 records I0331 04:10:24.664219 1 tasks_processing.go:74] worker 32 stopped. I0331 04:10:24.664574 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=83c19c77423a2fe16fa7e03dbb774dc709e24261efcedaa841c83e311ed4324b I0331 04:10:24.664597 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.805408597s to process 1 records E0331 04:10:24.664669 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.807s with: function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I0331 04:10:24.665777 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0331 04:10:24.665792 1 periodic.go:209] Running workloads gatherer I0331 04:10:24.665807 1 tasks_processing.go:45] number of workers: 2 I0331 04:10:24.665813 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:10:24.665817 1 tasks_processing.go:71] worker 1 working on workload_info task. I0331 04:10:24.665826 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:10:24.665840 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0331 04:10:24.672512 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-103.ec2.internal... I0331 04:10:24.672517 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-107.ec2.internal... I0331 04:10:24.672510 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-23.ec2.internal... I0331 04:10:24.684003 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0331 04:10:24.684016 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0331 04:10:24.684025 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0331 04:10:24.684030 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0331 04:10:24.690609 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0331 04:10:24.690625 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0331 04:10:24.690632 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0331 04:10:24.690638 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0331 04:10:24.690649 1 tasks_processing.go:74] worker 0 stopped. I0331 04:10:24.690661 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.79723ms to process 0 records I0331 04:10:31.577990 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 7s I0331 04:10:31.618520 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0331 04:10:31.624455 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (9ms) I0331 04:10:31.632885 1 gather_workloads_info.go:387] No image sha256:57a1aea49d7cc275b37b8f52d602a3a9d1601ec6a21a3268dd4903566cb2e335 (8ms) I0331 04:10:31.640700 1 gather_workloads_info.go:387] No image sha256:09c857f0c20721d6b447f5f567182befc1ca6157128225849117a5c830feab23 (8ms) I0331 04:10:31.648715 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (8ms) I0331 04:10:31.656557 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (8ms) I0331 04:10:31.664751 1 gather_workloads_info.go:387] No image sha256:6ca4eb17da6277b142a3353b675d735c106868f827243eaef70cd1ec01d36307 (8ms) I0331 04:10:31.672652 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (8ms) I0331 04:10:31.681002 1 gather_workloads_info.go:387] No image sha256:2c4ec0dfd62375ed45d5758798b1069e16a0a6d1986439d23c61591c4dfb9297 (8ms) I0331 04:10:31.689072 1 gather_workloads_info.go:387] No image sha256:865dd51e80034018400794d07edc0b546c6e4de7e2351dddc7f1f6378e1ffdd0 (8ms) I0331 04:10:31.697334 1 gather_workloads_info.go:387] No image sha256:54440fa6cb1b01a6b8952f700677832d7b7d3b1b58934957f504ca885730844a (8ms) I0331 04:10:31.724768 1 gather_workloads_info.go:387] No image sha256:ada1a963ce2c45d2bba08051c1e0e2db88b200e9d616fab8fde10b698101fc69 (27ms) I0331 04:10:31.824906 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (100ms) I0331 04:10:31.924993 1 gather_workloads_info.go:387] No image sha256:e4bb09dfe4513cdbe349507495c7f4044623a3c2aff866b7946d941e82a7a639 (100ms) I0331 04:10:32.028200 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (103ms) I0331 04:10:32.125635 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (97ms) I0331 04:10:32.225549 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0331 04:10:32.325907 1 gather_workloads_info.go:387] No image sha256:b8d380990acb0184ab685b005e22fb8369139dd8cd6550b4521bd4bc3ca23b40 (100ms) I0331 04:10:32.425070 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (99ms) I0331 04:10:32.525395 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0331 04:10:32.626780 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0331 04:10:32.725394 1 gather_workloads_info.go:387] No image sha256:4f86f5c692a497442b54c435e68b0cbf961591a00ebc3a73c364a19da673e34d (99ms) I0331 04:10:32.824757 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0331 04:10:32.925441 1 gather_workloads_info.go:387] No image sha256:2ba73aa991da589b1ee1fa6903abcdd56387007f3d650d345fbc8458bc2baeac (101ms) I0331 04:10:33.025026 1 gather_workloads_info.go:387] No image sha256:199df7c847c51c89b38ec42c4ac2b68156e1b24c02b60a01cfdfcbad6ea43489 (100ms) I0331 04:10:33.124423 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (99ms) I0331 04:10:33.224737 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (100ms) I0331 04:10:33.325051 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (100ms) I0331 04:10:33.425254 1 gather_workloads_info.go:387] No image sha256:4dcd0b18dea61968f20d49c4372eec43689eb52e823e1a6293e9b89c6e21e587 (100ms) I0331 04:10:33.525524 1 gather_workloads_info.go:387] No image sha256:61aeb8693f27b60dd35e3dd1961d14bd95988cae70d649b340045619e5de7acf (100ms) I0331 04:10:33.626535 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (101ms) I0331 04:10:33.724728 1 gather_workloads_info.go:387] No image sha256:b336f6e44314dd23a21236118a604411522baf5e63732463f1d08daccb417f39 (98ms) I0331 04:10:33.825420 1 gather_workloads_info.go:387] No image sha256:a18b7658b5cf078bcef30a1c752c42c46907714b589145c7c330cf7ba7db2715 (101ms) I0331 04:10:33.924765 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (99ms) I0331 04:10:34.025241 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (100ms) I0331 04:10:34.124422 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0331 04:10:34.225225 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (101ms) I0331 04:10:34.325069 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0331 04:10:34.424939 1 gather_workloads_info.go:387] No image sha256:1ca6fa787c621462fa2c67b9a42b1de67688883af90316475b0df35be3ed805d (100ms) I0331 04:10:34.524924 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0331 04:10:34.624898 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0331 04:10:34.724919 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0331 04:10:34.825010 1 gather_workloads_info.go:387] No image sha256:6d83c7e0e068178360998c815a3e0c729ca80a349954172aadafad5da5180d0c (100ms) I0331 04:10:34.925086 1 gather_workloads_info.go:387] No image sha256:d71caff0f67fe8d9665d39193d955fc9352224f647406a40e56428dd6cd24953 (100ms) I0331 04:10:35.024880 1 gather_workloads_info.go:387] No image sha256:120485f6d677cfeaae0509169f46df14f3ebfafd87b3d876dfa59b738f846c77 (100ms) I0331 04:10:35.124184 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (99ms) I0331 04:10:35.224554 1 gather_workloads_info.go:387] No image sha256:04156cd38c436fb6692930d18af59619b0669b2d80cd3590d0973c0e038c5d6d (100ms) I0331 04:10:35.324308 1 gather_workloads_info.go:387] No image sha256:5ffaf92fc557cb891a546ae2682d4e0259166ad6d935970dc958d255abc29a48 (100ms) I0331 04:10:35.425263 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0331 04:10:35.524371 1 gather_workloads_info.go:387] No image sha256:9db50052057ad4ec94099bc3c9ab476f5ac7b00954c99cb0b26fe729abba3387 (99ms) I0331 04:10:35.624831 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0331 04:10:35.724404 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0331 04:10:35.823794 1 gather_workloads_info.go:387] No image sha256:cc686a64f9ae83adecc7a0ffe8a6b82f0750dc39ad05654a8087cf780a1c3b3a (99ms) I0331 04:10:35.925797 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (102ms) I0331 04:10:36.025213 1 gather_workloads_info.go:387] No image sha256:384e639f2ce3e75712a5ee1cc5520161342e9dd1e94444d134d7ad4a39dde279 (99ms) I0331 04:10:36.123802 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (99ms) I0331 04:10:36.225545 1 gather_workloads_info.go:387] No image sha256:d88f384ee9cf4475b16d9589e88b28c9f2407247fbedfa3d9bfcaed95753514e (102ms) I0331 04:10:36.324370 1 gather_workloads_info.go:387] No image sha256:38d71a4cf177f39a2bbe745183009943dbbf404de02aa5f879694aa024a4e6ac (99ms) I0331 04:10:36.425379 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (101ms) I0331 04:10:36.523857 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (98ms) I0331 04:10:36.626706 1 gather_workloads_info.go:387] No image sha256:503831414ca09befa276fdffd836708f04d2d430b1fd428cb3b0e3cd5bd74eb3 (103ms) I0331 04:10:36.724604 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (98ms) I0331 04:10:36.825985 1 gather_workloads_info.go:387] No image sha256:0d70224d12e358b1a107a86e0a7e0845e1e8a4d30ce3a1423600f044e3fb28d2 (101ms) I0331 04:10:36.924402 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (98ms) I0331 04:10:37.024517 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0331 04:10:37.125351 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (101ms) I0331 04:10:37.224388 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (99ms) I0331 04:10:37.324603 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0331 04:10:37.424379 1 gather_workloads_info.go:387] No image sha256:07789f6e6e3c3a5a974c106b43c2e8bc60edb3321def1f0883f3fcd35a238ed0 (100ms) I0331 04:10:37.524498 1 gather_workloads_info.go:387] No image sha256:f02c58838bf882d9b5d82a1a96e8ab29ce6033ae1b64418118fba43eb9151b41 (100ms) I0331 04:10:37.624830 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0331 04:10:37.724729 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms) I0331 04:10:37.824508 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0331 04:10:37.924361 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (100ms) I0331 04:10:38.024418 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0331 04:10:38.124512 1 gather_workloads_info.go:387] No image sha256:8ef614441b76914f5727f5bec23a9d8dc2785ca7fd6a2516f393529b7801da53 (100ms) I0331 04:10:38.223859 1 gather_workloads_info.go:387] No image sha256:6a0d1f472283c686e438dbfbeec826db9d7d95f45f92842c4073f70704860d2f (99ms) I0331 04:10:38.324651 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (101ms) I0331 04:10:38.425318 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (101ms) I0331 04:10:38.525365 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (100ms) I0331 04:10:38.629396 1 gather_workloads_info.go:387] No image sha256:373050d2ded02b5acd0e5edf3ef9819fe65403b2f40b557e9077e4a57629cb97 (104ms) I0331 04:10:38.725005 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (96ms) I0331 04:10:38.825499 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0331 04:10:38.924917 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (99ms) I0331 04:10:39.025327 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (100ms) I0331 04:10:39.124942 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (100ms) I0331 04:10:39.226260 1 gather_workloads_info.go:387] No image sha256:43efa5a676666dd4ae039ad5518eaf636f5baf8d688d9a4b475822c32ad1ddfb (101ms) I0331 04:10:39.325349 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0331 04:10:39.425025 1 gather_workloads_info.go:387] No image sha256:59b844637eca688cc22c7841bc4480a26d1384444bf9b0161261a182f87a1262 (100ms) I0331 04:10:39.524827 1 gather_workloads_info.go:387] No image sha256:46e034f706fdcd5f84f35a1250a064495f5f68c90fef13be9c01936904b07ed6 (100ms) I0331 04:10:39.624675 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0331 04:10:39.724494 1 gather_workloads_info.go:387] No image sha256:27f3be442cf1d9f640657fb6d7cea6b133652226f9a80c3442df226b3cb3c2dc (100ms) I0331 04:10:39.824700 1 gather_workloads_info.go:387] No image sha256:72f9394f6f1b36ca9eb80961eac8f196e81f215632d14375845fbbe5970f0701 (100ms) I0331 04:10:39.924628 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0331 04:10:40.025392 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms) I0331 04:10:40.124805 1 gather_workloads_info.go:387] No image sha256:d339ecf788d1681ba9945a2ea63ca675caec863ec75f497ef916103f4c898003 (99ms) I0331 04:10:40.225033 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (100ms) I0331 04:10:40.325446 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (100ms) I0331 04:10:40.325483 1 tasks_processing.go:74] worker 1 stopped. I0331 04:10:40.325866 1 recorder.go:75] Recording config/workload_info with fingerprint=6f98742cc7e2cf59c520bec3ec4587d6974152045fe058e6c43194edaca88822 I0331 04:10:40.325880 1 gather.go:177] gatherer "workloads" function "workload_info" took 15.659658838s to process 1 records I0331 04:10:40.325895 1 periodic.go:256] Periodic gather workloads completed in 15.66s I0331 04:10:40.325903 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0331 04:10:40.325908 1 periodic.go:209] Running conditional gatherer I0331 04:10:40.331402 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0331 04:10:40.637720 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0331 04:10:40.639632 1 conditional_gatherer.go:374] alert "KubePodNotReady" has state "pending" I0331 04:10:40.639643 1 conditional_gatherer.go:374] alert "KubePodNotReady" has state "pending" I0331 04:10:40.639647 1 conditional_gatherer.go:374] alert "KubeContainerWaiting" has state "pending" I0331 04:10:40.639650 1 conditional_gatherer.go:374] alert "KubeContainerWaiting" has state "pending" I0331 04:10:40.639652 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0331 04:10:40.639655 1 conditional_gatherer.go:374] alert "KubeDeploymentRolloutStuck" has state "pending" I0331 04:10:40.639657 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0331 04:10:40.639710 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0331 04:10:40.644746 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0331 04:10:40.644772 1 tasks_processing.go:45] number of workers: 3 I0331 04:10:40.644780 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:10:40.644783 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0331 04:10:40.644796 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:10:40.644795 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:10:40.644813 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0331 04:10:40.644817 1 tasks_processing.go:74] worker 0 stopped. I0331 04:10:40.644827 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0331 04:10:40.644871 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0331 04:10:40.644883 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.202µs to process 1 records I0331 04:10:40.644913 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0331 04:10:40.644921 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.223µs to process 1 records I0331 04:10:40.644927 1 tasks_processing.go:74] worker 1 stopped. I0331 04:10:40.645104 1 tasks_processing.go:74] worker 2 stopped. I0331 04:10:40.645120 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 282.316µs to process 0 records I0331 04:10:40.645141 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0331 04:10:40.645186 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0331 04:10:40.668362 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=09fd31d848e8c9e3867ab1d1a484271ae342c632148316f46d212a444558b496 I0331 04:10:40.668492 1 diskrecorder.go:70] Writing 134 records to /var/lib/insights-operator/insights-2026-03-31-041040.tar.gz I0331 04:10:40.678156 1 diskrecorder.go:51] Wrote 134 records to disk in 9ms I0331 04:10:40.678198 1 periodic.go:278] Gathering cluster info every 2h0m0s I0331 04:10:40.678213 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0331 04:11:40.856717 1 diskrecorder.go:223] Found files to send: insights-2026-03-31-041040.tar.gz I0331 04:11:40.856744 1 insightsuploader.go:150] Checking archives to upload periodically every 15m0.601222656s I0331 04:11:40.856753 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0331 04:11:40.865556 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0331 04:11:41.045853 1 requests.go:87] Successfully reported id=2026-03-31T04:11:40Z x-rh-insights-request-id=ca1fbbbd343e4b21a023ced19d4aca97, wrote=70419 I0331 04:11:41.045904 1 insightsuploader.go:187] Uploaded report successfully in 189.143497ms I0331 04:11:41.045924 1 controller.go:128] Initializing last reported time to 2026-03-31T04:11:40Z I0331 04:11:41.045949 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0331 04:11:41.045963 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0331 04:11:41.045976 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0331 04:11:41.050822 1 controller.go:512] The operator is healthy I0331 04:12:22.589391 1 controller.go:512] The operator is healthy I0331 04:12:41.116043 1 insightsreport.go:137] Pulling report from smart-proxy I0331 04:12:41.116065 1 insightsreport.go:149] Retrieving report I0331 04:12:41.125671 1 requests.go:110] Retrieving report for cluster: ee0a9d92-1926-487c-908a-2ec17992f53d I0331 04:12:41.125683 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ee0a9d92-1926-487c-908a-2ec17992f53d/reports I0331 04:12:41.128658 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ee0a9d92-1926-487c-908a-2ec17992f53d/reports I0331 04:12:41.494139 1 insightsreport.go:184] Report retrieved I0331 04:12:41.533242 1 insightsreport.go:239] Report retrieved correctly I0331 04:13:15.070702 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:13:15.074544 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:13:15.117796 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:13:15.121936 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:13:15.121952 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:13:15.125527 1 secretconfigobserver.go:119] support secret does not exist I0331 04:14:22.591421 1 controller.go:512] The operator is healthy I0331 04:16:22.592229 1 controller.go:512] The operator is healthy I0331 04:18:15.126477 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:18:15.131788 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:18:15.131807 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:18:15.135480 1 secretconfigobserver.go:119] support secret does not exist I0331 04:18:22.590100 1 controller.go:512] The operator is healthy I0331 04:20:22.589155 1 controller.go:512] The operator is healthy