W0325 10:59:45.492536       1 cmd.go:257] Using insecure, self-signed certificates
I0325 10:59:46.102935       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 10:59:46.103257       1 observer_polling.go:159] Starting file observer
I0325 10:59:46.577064       1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$
I0325 10:59:46.577357       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0325 10:59:46.578401       1 secure_serving.go:57] Forcing use of http/1.1 only
W0325 10:59:46.578427       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0325 10:59:46.578435       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0325 10:59:46.578441       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0325 10:59:46.578444       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0325 10:59:46.578448       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0325 10:59:46.578451       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0325 10:59:46.578511       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0325 10:59:46.584371       1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot]
I0325 10:59:46.584406       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"254a5404-5787-4c1b-8391-a866dff122e8", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
I0325 10:59:46.590921       1 secure_serving.go:213] Serving securely on [::]:8443
I0325 10:59:46.591027       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0325 10:59:46.591060       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0325 10:59:46.591136       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-165912019/tls.crt::/tmp/serving-cert-165912019/tls.key"
I0325 10:59:46.591258       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I0325 10:59:46.591389       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0325 10:59:46.591420       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0325 10:59:46.591498       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0325 10:59:46.591565       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
W0325 10:59:46.603184       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0325 10:59:46.603208       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0325 10:59:46.603303       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0325 10:59:46.614375       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0325 10:59:46.614394       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0325 10:59:46.620477       1 secretconfigobserver.go:119] support secret does not exist
I0325 10:59:46.626571       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0325 10:59:46.632253       1 secretconfigobserver.go:119] support secret does not exist
I0325 10:59:46.637870       1 recorder.go:161] Pruning old reports every 7h36m14s, max age is 288h0m0s
I0325 10:59:46.648208       1 periodic.go:209] Running clusterconfig gatherer
I0325 10:59:46.648222       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0325 10:59:46.648235       1 insightsreport.go:296] Starting report retriever
I0325 10:59:46.648242       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0325 10:59:46.648272       1 tasks_processing.go:45] number of workers: 32
I0325 10:59:46.648296       1 tasks_processing.go:69] worker 1 listening for tasks.
I0325 10:59:46.648310       1 tasks_processing.go:69] worker 31 listening for tasks.
I0325 10:59:46.648312       1 tasks_processing.go:71] worker 1 working on machine_sets task.
I0325 10:59:46.648319       1 tasks_processing.go:69] worker 9 listening for tasks.
I0325 10:59:46.648322       1 tasks_processing.go:69] worker 2 listening for tasks.
I0325 10:59:46.648328       1 tasks_processing.go:69] worker 10 listening for tasks.
I0325 10:59:46.648333       1 tasks_processing.go:69] worker 3 listening for tasks.
I0325 10:59:46.648336       1 tasks_processing.go:69] worker 11 listening for tasks.
I0325 10:59:46.648341       1 tasks_processing.go:69] worker 4 listening for tasks.
I0325 10:59:46.648343       1 tasks_processing.go:69] worker 12 listening for tasks.
I0325 10:59:46.648349       1 tasks_processing.go:69] worker 5 listening for tasks.
I0325 10:59:46.648349       1 tasks_processing.go:69] worker 13 listening for tasks.
I0325 10:59:46.648354       1 tasks_processing.go:69] worker 14 listening for tasks.
I0325 10:59:46.648360       1 tasks_processing.go:69] worker 15 listening for tasks.
I0325 10:59:46.648360       1 tasks_processing.go:69] worker 6 listening for tasks.
I0325 10:59:46.648365       1 tasks_processing.go:69] worker 16 listening for tasks.
I0325 10:59:46.648368       1 tasks_processing.go:69] worker 7 listening for tasks.
I0325 10:59:46.648370       1 tasks_processing.go:69] worker 17 listening for tasks.
I0325 10:59:46.648374       1 tasks_processing.go:69] worker 18 listening for tasks.
I0325 10:59:46.648380       1 tasks_processing.go:69] worker 25 listening for tasks.
I0325 10:59:46.648381       1 tasks_processing.go:69] worker 24 listening for tasks.
I0325 10:59:46.648385       1 tasks_processing.go:69] worker 26 listening for tasks.
I0325 10:59:46.648389       1 tasks_processing.go:69] worker 19 listening for tasks.
I0325 10:59:46.648390       1 tasks_processing.go:69] worker 27 listening for tasks.
I0325 10:59:46.648394       1 tasks_processing.go:69] worker 28 listening for tasks.
I0325 10:59:46.648398       1 tasks_processing.go:69] worker 29 listening for tasks.
I0325 10:59:46.648403       1 tasks_processing.go:69] worker 30 listening for tasks.
I0325 10:59:46.648406       1 tasks_processing.go:69] worker 20 listening for tasks.
I0325 10:59:46.648408       1 tasks_processing.go:69] worker 22 listening for tasks.
I0325 10:59:46.648413       1 tasks_processing.go:69] worker 21 listening for tasks.
I0325 10:59:46.648414       1 tasks_processing.go:69] worker 23 listening for tasks.
I0325 10:59:46.648208       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0325 10:59:46.648418       1 tasks_processing.go:69] worker 0 listening for tasks.
I0325 10:59:46.648303       1 tasks_processing.go:69] worker 8 listening for tasks.
I0325 10:59:46.648427       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0325 10:59:46.648494       1 tasks_processing.go:71] worker 8 working on config_maps task.
I0325 10:59:46.648535       1 tasks_processing.go:71] worker 7 working on qemu_kubevirt_launcher_logs task.
I0325 10:59:46.648545       1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task.
I0325 10:59:46.648558       1 tasks_processing.go:71] worker 22 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0325 10:59:46.648580       1 tasks_processing.go:71] worker 23 working on nodes task.
I0325 10:59:46.648588       1 tasks_processing.go:71] worker 29 working on operators task.
I0325 10:59:46.648611       1 tasks_processing.go:71] worker 31 working on lokistack task.
I0325 10:59:46.648659       1 tasks_processing.go:71] worker 2 working on infrastructures task.
I0325 10:59:46.648872       1 tasks_processing.go:71] worker 10 working on cluster_apiserver task.
I0325 10:59:46.648903       1 tasks_processing.go:71] worker 19 working on sap_pods task.
I0325 10:59:46.648963       1 tasks_processing.go:71] worker 27 working on jaegers task.
I0325 10:59:46.649010       1 tasks_processing.go:71] worker 5 working on ingress_certificates task.
I0325 10:59:46.649005       1 tasks_processing.go:71] worker 16 working on support_secret task.
I0325 10:59:46.649243       1 tasks_processing.go:71] worker 30 working on operators_pods_and_events task.
I0325 10:59:46.648886       1 tasks_processing.go:71] worker 20 working on nodenetworkstates task.
I0325 10:59:46.649011       1 tasks_processing.go:71] worker 6 working on sap_config task.
I0325 10:59:46.648630       1 tasks_processing.go:71] worker 24 working on tsdb_status task.
W0325 10:59:46.650240       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 10:59:46.650253       1 tasks_processing.go:71] worker 24 working on pdbs task.
I0325 10:59:46.648634       1 tasks_processing.go:71] worker 17 working on active_alerts task.
I0325 10:59:46.650475       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 31.14µs to process 0 records
W0325 10:59:46.650517       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 10:59:46.648637       1 tasks_processing.go:71] worker 18 working on networks task.
I0325 10:59:46.648644       1 tasks_processing.go:71] worker 25 working on validating_webhook_configurations task.
I0325 10:59:46.648650       1 tasks_processing.go:71] worker 12 working on sap_datahubs task.
I0325 10:59:46.648655       1 tasks_processing.go:71] worker 9 working on openstack_dataplanenodesets task.
I0325 10:59:46.648896       1 tasks_processing.go:71] worker 0 working on certificate_signing_requests task.
I0325 10:59:46.649005       1 tasks_processing.go:71] worker 15 working on image task.
I0325 10:59:46.649020       1 tasks_processing.go:71] worker 26 working on pod_network_connectivity_checks task.
I0325 10:59:46.648620       1 tasks_processing.go:71] worker 21 working on image_pruners task.
I0325 10:59:46.649027       1 tasks_processing.go:71] worker 11 working on ingress task.
I0325 10:59:46.649030       1 tasks_processing.go:71] worker 3 working on service_accounts task.
I0325 10:59:46.649039       1 tasks_processing.go:71] worker 4 working on metrics task.
I0325 10:59:46.649045       1 tasks_processing.go:71] worker 13 working on container_runtime_configs task.
I0325 10:59:46.649051       1 tasks_processing.go:71] worker 14 working on dvo_metrics task.
I0325 10:59:46.650656       1 tasks_processing.go:71] worker 17 working on machine_configs task.
I0325 10:59:46.650998       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 220.317µs to process 0 records
W0325 10:59:46.651565       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 10:59:46.651619       1 tasks_processing.go:71] worker 4 working on machines task.
I0325 10:59:46.651684       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 146.961µs to process 0 records
I0325 10:59:46.665447       1 tasks_processing.go:71] worker 20 working on aggregated_monitoring_cr_names task.
I0325 10:59:46.665450       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 16.181937ms to process 0 records
I0325 10:59:46.665460       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.573323ms to process 0 records
I0325 10:59:46.665468       1 tasks_processing.go:71] worker 6 working on openstack_version task.
I0325 10:59:46.678329       1 tasks_processing.go:71] worker 27 working on schedulers task.
I0325 10:59:46.678354       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 29.309894ms to process 0 records
I0325 10:59:46.678505       1 tasks_processing.go:71] worker 31 working on cost_management_metrics_configs task.
I0325 10:59:46.678528       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 29.840753ms to process 0 records
I0325 10:59:46.678546       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 29.600124ms to process 0 records
I0325 10:59:46.678552       1 tasks_processing.go:71] worker 19 working on clusterroles task.
I0325 10:59:46.683426       1 tasks_processing.go:71] worker 6 working on crds task.
I0325 10:59:46.683434       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 17.947165ms to process 0 records
I0325 10:59:46.691261       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0325 10:59:46.692064       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0325 10:59:46.692064       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0325 10:59:46.692626       1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z
I0325 10:59:46.692645       1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0325 10:59:46.692651       1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready
I0325 10:59:46.692655       1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready
I0325 10:59:46.692659       1 tasks_processing.go:71] worker 2 working on container_images task.
I0325 10:59:46.692676       1 controller.go:489] The operator is still being initialized
I0325 10:59:46.692685       1 controller.go:512] The operator is healthy
I0325 10:59:46.693312       1 recorder.go:75] Recording config/infrastructure with fingerprint=8332308226e6b3326485d07012266bdf3a2acff35c52a24f549421672ae59fa8
I0325 10:59:46.693328       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 43.962596ms to process 1 records
I0325 10:59:46.700214       1 tasks_processing.go:71] worker 13 working on image_registries task.
I0325 10:59:46.700230       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 48.51405ms to process 0 records
E0325 10:59:46.700246       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0325 10:59:46.700254       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 48.907771ms to process 0 records
I0325 10:59:46.700260       1 tasks_processing.go:71] worker 26 working on nodenetworkconfigurationpolicies task.
I0325 10:59:46.700392       1 tasks_processing.go:71] worker 4 working on install_plans task.
E0325 10:59:46.700407       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0325 10:59:46.700418       1 gather.go:177] gatherer "clusterconfig" function "machines" took 48.739855ms to process 0 records
I0325 10:59:46.702926       1 tasks_processing.go:71] worker 9 working on storage_cluster task.
I0325 10:59:46.702939       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 51.855605ms to process 0 records
I0325 10:59:46.703713       1 base_controller.go:82] Caches are synced for ConfigController 
I0325 10:59:46.703728       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0325 10:59:46.703832       1 tasks_processing.go:71] worker 12 working on storage_classes task.
I0325 10:59:46.703840       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 52.997404ms to process 0 records
I0325 10:59:46.703855       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 55.516377ms to process 0 records
I0325 10:59:46.703865       1 tasks_processing.go:71] worker 1 working on feature_gates task.
I0325 10:59:46.711738       1 tasks_processing.go:71] worker 31 working on openstack_controlplanes task.
I0325 10:59:46.711777       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 33.201662ms to process 0 records
I0325 10:59:46.711794       1 tasks_processing.go:71] worker 24 working on machine_healthchecks task.
I0325 10:59:46.711982       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=a4ac0775d6623b6897500a22f85cecd0bd8717fdeb947990f59dcf77a1d843ba
I0325 10:59:46.712007       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=56988974623cce0f16cb698bdef35ec153d1e31924499b2542d096dfcb5fb99d
I0325 10:59:46.712029       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7739b1d1decf587888cc99f7b9e1d393584c4148b980f75c4a87f0ed84f15f86
I0325 10:59:46.712039       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 61.531838ms to process 3 records
I0325 10:59:46.748325       1 tasks_processing.go:71] worker 10 working on machine_config_pools task.
I0325 10:59:46.748853       1 recorder.go:75] Recording config/apiserver with fingerprint=aa9c82666e99d2e2bbddda26590a665231fb27bccfd1078ed4a8c6f764752cbb
I0325 10:59:46.748910       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 99.412124ms to process 1 records
I0325 10:59:46.749060       1 tasks_processing.go:71] worker 21 working on oauths task.
I0325 10:59:46.749299       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=2a2f6db830ccb33c05391778549ce2bd79afd6628b1e60ab450b907b0d3422c9
I0325 10:59:46.749318       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 97.55069ms to process 1 records
E0325 10:59:46.749328       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0325 10:59:46.749335       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 99.990468ms to process 0 records
I0325 10:59:46.749415       1 recorder.go:75] Recording config/image with fingerprint=e3960b53433555b5b56314e3d3e487c70858305bc02dc1c1a8bd4f2f3b69b871
I0325 10:59:46.749429       1 gather.go:177] gatherer "clusterconfig" function "image" took 98.684895ms to process 1 records
I0325 10:59:46.749438       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 46.377096ms to process 0 records
I0325 10:59:46.749443       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 37.581179ms to process 0 records
E0325 10:59:46.749452       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0325 10:59:46.749459       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 37.578799ms to process 0 records
I0325 10:59:46.749468       1 tasks_processing.go:71] worker 24 working on node_logs task.
I0325 10:59:46.749520       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 49.249582ms to process 0 records
I0325 10:59:46.749420       1 tasks_processing.go:71] worker 16 working on overlapping_namespace_uids task.
I0325 10:59:46.749836       1 tasks_processing.go:71] worker 31 working on openshift_machine_api_events task.
I0325 10:59:46.749909       1 tasks_processing.go:71] worker 15 working on version task.
I0325 10:59:46.749927       1 tasks_processing.go:71] worker 26 working on machine_autoscalers task.
I0325 10:59:46.749936       1 tasks_processing.go:71] worker 9 working on authentication task.
I0325 10:59:46.753668       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0325 10:59:46.753675       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
W0325 10:59:46.753772       1 operator.go:288] started
I0325 10:59:46.753836       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0325 10:59:46.758139       1 tasks_processing.go:71] worker 18 working on proxies task.
I0325 10:59:46.758457       1 recorder.go:75] Recording config/network with fingerprint=2a2da455cc9707e180e3074ee7ed681cb0a0ddeed1a41a25738eb4e2958fc472
I0325 10:59:46.758525       1 gather.go:177] gatherer "clusterconfig" function "networks" took 106.814852ms to process 1 records
I0325 10:59:46.758783       1 recorder.go:75] Recording config/ingress with fingerprint=69b8da89fdba4a25f77b8e611c5fbc95fe65ffe48fc1d311af791f7a17e0ad62
I0325 10:59:46.758825       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 107.147335ms to process 1 records
I0325 10:59:46.758856       1 tasks_processing.go:71] worker 11 working on olm_operators task.
W0325 10:59:46.759548       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0325 10:59:46.764336       1 tasks_processing.go:71] worker 23 working on openstack_dataplanedeployments task.
I0325 10:59:46.764629       1 recorder.go:75] Recording config/node/ip-10-0-2-29.ec2.internal with fingerprint=f7de31d9fddef087e591df2a9cc66f8a4dfdaecd3d07a454e83a2983fa11b9a8
I0325 10:59:46.764648       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 115.735823ms to process 1 records
I0325 10:59:46.765907       1 configmapobserver.go:84] configmaps "insights-config" not found
I0325 10:59:46.774629       1 tasks_processing.go:71] worker 27 working on openshift_logging task.
I0325 10:59:46.774728       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=c75b60c7cd9626360c4daf0a263f5998027551d96a8adb89643cc0d7c1922d51
I0325 10:59:46.774743       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 96.283128ms to process 1 records
I0325 10:59:46.783677       1 tasks_processing.go:71] worker 0 working on monitoring_persistent_volumes task.
I0325 10:59:46.783689       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 132.207186ms to process 0 records
I0325 10:59:46.786323       1 tasks_processing.go:71] worker 13 working on silenced_alerts task.
W0325 10:59:46.786354       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 10:59:46.786650       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f46d4b48881579751df72b5c4690c182b40642d44a1975052ea16533d401b9ad
I0325 10:59:46.786666       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 86.089735ms to process 1 records
I0325 10:59:46.786676       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 26.107µs to process 0 records
I0325 10:59:46.786682       1 tasks_processing.go:71] worker 13 working on ceph_cluster task.
I0325 10:59:46.787335       1 tasks_processing.go:74] worker 28 stopped.
I0325 10:59:46.787477       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f3034c8f911dba5d0617adf27a75e93e2e66783bb4d76d908a708f583d632b8d
I0325 10:59:46.787505       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a114a2eadaebebe8e9c3fae0fb5a51595c78e63fea25b459a6e49e66316c852a
I0325 10:59:46.787533       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=090ebfd57b2d86361e9a29deae4b1b00cfe7652655cc00fd47a800ed9f23bf5c
I0325 10:59:46.787543       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 138.777731ms to process 3 records
I0325 10:59:46.816961       1 tasks_processing.go:74] worker 26 stopped.
I0325 10:59:46.816979       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 66.62275ms to process 0 records
I0325 10:59:46.817512       1 gather_logs.go:145] no pods in  namespace were found
I0325 10:59:46.817528       1 tasks_processing.go:74] worker 7 stopped.
I0325 10:59:46.817537       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 168.980022ms to process 0 records
I0325 10:59:46.817623       1 tasks_processing.go:74] worker 21 stopped.
I0325 10:59:46.817800       1 recorder.go:75] Recording config/oauth with fingerprint=a1d74a932b399351a2bb6639df9a7d8acf54551c12f920f14350bb2e017f92a4
I0325 10:59:46.817819       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 68.464715ms to process 1 records
I0325 10:59:46.817835       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 67.818125ms to process 0 records
I0325 10:59:46.817854       1 tasks_processing.go:74] worker 31 stopped.
I0325 10:59:46.817960       1 recorder.go:75] Recording config/featuregate with fingerprint=7921807ca5dcfc3bd454eaa933414e065f11ab5e1781a1b1ef83a2f1afb85576
I0325 10:59:46.817971       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 113.819575ms to process 1 records
I0325 10:59:46.817986       1 tasks_processing.go:74] worker 1 stopped.
I0325 10:59:46.818035       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=d477e6ed8ac74bfc019a9c77515cf1f68fe0055cd07f68e77326af4f1dbc6779
I0325 10:59:46.818054       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=380524e2ba46d309b5b56f1ce782d656bc6c038fc2a00959c0acbad4090b4e1e
I0325 10:59:46.818065       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 113.899251ms to process 2 records
I0325 10:59:46.818067       1 tasks_processing.go:74] worker 12 stopped.
I0325 10:59:46.818143       1 tasks_processing.go:74] worker 27 stopped.
I0325 10:59:46.818200       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 43.500009ms to process 0 records
I0325 10:59:46.818232       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 53.7954ms to process 0 records
I0325 10:59:46.818244       1 tasks_processing.go:74] worker 23 stopped.
I0325 10:59:46.818496       1 tasks_processing.go:74] worker 9 stopped.
I0325 10:59:46.818726       1 recorder.go:75] Recording config/authentication with fingerprint=5a6d7d780d23b69966662c191b048f975ecc752f07b4e1d174dc35bcb26979b3
I0325 10:59:46.818744       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 68.051844ms to process 1 records
I0325 10:59:46.818844       1 tasks_processing.go:74] worker 25 stopped.
I0325 10:59:46.818859       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=6be0647745a375b24c1ec61ee5de89f6eb1232dd1142335dc4445cbece1c7dfd
I0325 10:59:46.818935       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=bf2a3e82915d5c7df3d24c148569934d66a664a862515f41e078484e718699e2
I0325 10:59:46.818955       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=7a16115e1e26a161c3cbefd93ff65d1d46e204e59c8713bd0e9db08fbfd4f528
I0325 10:59:46.818977       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=d41cd9932d6fcc47da701ab9e0e06bb1aea4ed470265bd4a9bb678cb40ab0b7a
I0325 10:59:46.819000       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7efbb3bd2a29d5707691f7f074bc2421208f6ffa038e8c4e93c01ec698854725
I0325 10:59:46.819023       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=db9d282e6c47323bae3208f0ff7b7a2c682cc62da0d3ea74ac968c82860e935b
I0325 10:59:46.819046       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a00cff2696a0308139178c39eaf63e62b2e0bbfacaa8f4e913544aeca78a76f3
I0325 10:59:46.819078       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=e09d44e9b27f641406b6c36de8891b3adba7246db58a35af9e1c60398d78c1fc
I0325 10:59:46.819116       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f7ce86fd88474cbda7dc9395b1539df856ba450feb64ae68b72bbc0a4e02875e
I0325 10:59:46.819147       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5392dc3561219b5dcf612a06462784b2112156a1ad506abf41d24d6239420d24
I0325 10:59:46.819169       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=9933ec444017b9ae35f5e63254bf0e96b4b92ac082e3c7875a4306bf21d2124c
I0325 10:59:46.819177       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 167.861027ms to process 11 records
I0325 10:59:46.819187       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 31.866116ms to process 0 records
I0325 10:59:46.819199       1 tasks_processing.go:74] worker 13 stopped.
I0325 10:59:46.819273       1 tasks_processing.go:74] worker 19 stopped.
I0325 10:59:46.819325       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=ac08be3c526fdf9a78b75f9614a31818814d5125dde8de990c1071a278cf8ff3
I0325 10:59:46.819403       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=21b85148366579950a1af7be40628e3f6d3afae1d3aff0b37a66b31cb45c41e2
I0325 10:59:46.819409       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 140.25139ms to process 2 records
I0325 10:59:46.823411       1 tasks_processing.go:74] worker 18 stopped.
I0325 10:59:46.823478       1 recorder.go:75] Recording config/proxy with fingerprint=1eda79ca2e0450f3cf59106be49563e6ba48b3534ec181b7033f51e4db95008c
I0325 10:59:46.823498       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 64.962197ms to process 1 records
I0325 10:59:46.825681       1 controller.go:212] Source scaController *sca.Controller is not ready
I0325 10:59:46.825694       1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready
I0325 10:59:46.825698       1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0325 10:59:46.825701       1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready
I0325 10:59:46.825704       1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready
I0325 10:59:46.825722       1 controller.go:489] The operator is still being initialized
I0325 10:59:46.825730       1 controller.go:512] The operator is healthy
E0325 10:59:46.828992       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2704077b84-4229-48f6-8321-d40a95220cf8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:54917->172.30.0.10:53: read: connection refused
I0325 10:59:46.829009       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2704077b84-4229-48f6-8321-d40a95220cf8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:54917->172.30.0.10:53: read: connection refused
I0325 10:59:46.837177       1 tasks_processing.go:74] worker 24 stopped.
I0325 10:59:46.837197       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 87.69958ms to process 0 records
I0325 10:59:46.837347       1 prometheus_rules.go:88] Prometheus rules successfully created
I0325 10:59:46.839785       1 tasks_processing.go:74] worker 0 stopped.
I0325 10:59:46.839801       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 56.088551ms to process 0 records
I0325 10:59:46.843762       1 tasks_processing.go:74] worker 6 stopped.
I0325 10:59:46.844552       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=50368f4b694eef8830655904898d0a3855f704cca10efe9a8a2165f601e5debe
I0325 10:59:46.844832       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f43306a72ab7e964d7c1b6d7433e7f1c196e059ae23d6ccd9abf0a350b6d4215
I0325 10:59:46.844854       1 gather.go:177] gatherer "clusterconfig" function "crds" took 160.321128ms to process 2 records
I0325 10:59:46.848306       1 tasks_processing.go:74] worker 15 stopped.
I0325 10:59:46.850763       1 recorder.go:75] Recording config/version with fingerprint=beafbd48d2f9b5299ae6522ada2235636b08f18947b35c25241d6535acf74e2f
I0325 10:59:46.850824       1 recorder.go:75] Recording config/id with fingerprint=9b22bb3a31d107e9555eddb220c3d6716cee2c597e4184df6690135d07bb4edc
I0325 10:59:46.850861       1 gather.go:177] gatherer "clusterconfig" function "version" took 98.339622ms to process 2 records
I0325 10:59:46.853041       1 tasks_processing.go:74] worker 2 stopped.
I0325 10:59:46.853140       1 recorder.go:75] Recording config/running_containers with fingerprint=995639adc2a13b6d03bb2ec6465c02fd9330a6670d5dbc3b4a09824ed294606a
I0325 10:59:46.853156       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 160.362219ms to process 1 records
I0325 10:59:46.854185       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0325 10:59:46.854196       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0325 10:59:46.863423       1 tasks_processing.go:74] worker 20 stopped.
I0325 10:59:46.863441       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 197.959911ms to process 0 records
I0325 10:59:46.864441       1 tasks_processing.go:74] worker 10 stopped.
I0325 10:59:46.864458       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 116.047408ms to process 0 records
I0325 10:59:46.864483       1 tasks_processing.go:74] worker 22 stopped.
I0325 10:59:46.864490       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 215.91612ms to process 0 records
I0325 10:59:46.865199       1 tasks_processing.go:74] worker 16 stopped.
I0325 10:59:46.865227       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0325 10:59:46.865265       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 115.652985ms to process 1 records
I0325 10:59:46.867614       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0325 10:59:46.870974       1 tasks_processing.go:74] worker 8 stopped.
E0325 10:59:46.870991       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0325 10:59:46.870999       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0325 10:59:46.871005       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0325 10:59:46.871018       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018
I0325 10:59:46.871054       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0325 10:59:46.871064       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0
I0325 10:59:46.871073       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0325 10:59:46.871079       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0325 10:59:46.871154       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0325 10:59:46.871167       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0325 10:59:46.871175       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 222.46008ms to process 7 records
W0325 10:59:46.871457       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:41382->172.30.0.10:53: read: connection refused
I0325 10:59:46.871484       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:41382->172.30.0.10:53: read: connection refused
I0325 10:59:46.878704       1 tasks_processing.go:74] worker 5 stopped.
E0325 10:59:46.878722       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0325 10:59:46.878731       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p8mq24lsf2m58q3itf4qvcrijjq5nr6-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p8mq24lsf2m58q3itf4qvcrijjq5nr6-primary-cert-bundle-secret" not found
I0325 10:59:46.878795       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=311dc42b88a78c3793bcf7cfd35011ea7d52b66fa983d20d2d98c70dfe36ec4b
I0325 10:59:46.878811       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 229.640022ms to process 1 records
I0325 10:59:46.880505       1 tasks_processing.go:74] worker 11 stopped.
I0325 10:59:46.880568       1 recorder.go:75] Recording config/olm_operators with fingerprint=51b90f4e47c71d16a296c7d1e55d1e2da5c38b402c12a0e86dc7cb28851d7761
I0325 10:59:46.880581       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 121.618392ms to process 1 records
I0325 10:59:46.931743       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0325 10:59:46.937930       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0325 10:59:47.418606       1 configmapobserver.go:84] configmaps "insights-config" not found
W0325 10:59:47.758421       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0325 10:59:47.879782       1 tasks_processing.go:74] worker 17 stopped.
I0325 10:59:47.879830       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0325 10:59:47.879844       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.229054646s to process 1 records
I0325 10:59:47.964244       1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 14 containers
I0325 10:59:47.964260       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1797558 bytes
I0325 10:59:47.964329       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-knvzq pod in namespace openshift-dns (previous: false).
I0325 10:59:48.187041       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-knvzq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-knvzq\" is waiting to start: ContainerCreating"
I0325 10:59:48.187064       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-knvzq\" is waiting to start: ContainerCreating"
I0325 10:59:48.187072       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-knvzq pod in namespace openshift-dns (previous: false).
I0325 10:59:48.256892       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0325 10:59:48.367306       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-knvzq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-knvzq\" is waiting to start: ContainerCreating"
I0325 10:59:48.367336       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-knvzq\" is waiting to start: ContainerCreating"
I0325 10:59:48.367346       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-frhk9 pod in namespace openshift-dns (previous: false).
I0325 10:59:48.567566       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0325 10:59:48.567613       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-669b496959-g6p49 pod in namespace openshift-image-registry (previous: false).
I0325 10:59:48.659184       1 tasks_processing.go:74] worker 29 stopped.
I0325 10:59:48.659233       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=47e7fcd31c7d654525c3570b201f927cbfefa9363fe373bd71deaa3825cad797
I0325 10:59:48.659263       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=da384aeb2eaba2b5190e12e5ce9d3b0da56ca0e3b9c57eeff390d4e205f1c24f
I0325 10:59:48.659290       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0325 10:59:48.659321       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=b316885e624a0592ac4472c59038bac3e964e1266d81e9aa3db13af0b5cb3426
I0325 10:59:48.659338       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0325 10:59:48.659360       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=64007a98d491325e45ffe6d27efca077bc87449cd9de0bb10dcf5b1ea5bce2ca
I0325 10:59:48.659391       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=5512e2c0d667b4e7e6fef3897660e7c43196814ee66643b2bf989ee5bf879693
I0325 10:59:48.659430       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=da18cd1ba4e5ef5896ddb33291981e862f19eb7ddb9c0aa2e228cec73dc220bf
I0325 10:59:48.659444       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=8295340b4ef8d931fa15f59beadbe66904fa0f368a4250cb2a944c04e95f3dec
I0325 10:59:48.659464       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=09ea89f79a61ede3a225cccec101e3679b85d9558ceb2647ed23a641ea5c2e0d
I0325 10:59:48.659473       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0325 10:59:48.659489       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=5f502f278912398197fb56397c88dcea7ab2d2c7a2fe8876271529b1b493f142
I0325 10:59:48.659500       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0325 10:59:48.659514       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=525ed72a8d631076fb74e155b6584cfadf9f538a5e566b0888f6cbb45072dee0
I0325 10:59:48.659523       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0325 10:59:48.659544       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=a0e8618ae113a4b1d8944d2038b621afe41917edc216d483d2ff2696c2235ce8
I0325 10:59:48.659554       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0325 10:59:48.659572       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=8be073f4fb77443062e9ebb7057c450b8498dac8c9cbae9b63ad9d8e64d2b58e
I0325 10:59:48.659693       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e96d9d27fbc92d2da25636c66d3fbed9017158721e7a94911db92bafe3b6c1e7
I0325 10:59:48.659702       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0325 10:59:48.659708       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0325 10:59:48.659740       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0325 10:59:48.659764       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=352e8360e79de01505e511afd74791cbfda115d682e524a18fda842495e8f90f
I0325 10:59:48.659787       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=228ed78cb39268852bf18bd52319200890ba3418cb77e0c24d29ef73cfba8864
I0325 10:59:48.659797       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0325 10:59:48.659812       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7c6f54ed98b2c12f30113336f9fb7672b88b156df06d41ea6a5dba6b6480c35d
I0325 10:59:48.659821       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0325 10:59:48.659840       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=336a097586e7767fd5a569772c4ce9067a03c3b85a9cb264bf8083e37ae21e9b
I0325 10:59:48.659855       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=081b990a080f2975471cd8b2750528e8ec382959647703ac1afc956dc2d5538f
I0325 10:59:48.659871       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=220d0da3d4222df6d27868787be5128be629102b00f082711c820da960843f36
I0325 10:59:48.659887       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=56040e4f7dd3fca7408c2970678f97559ee113fd07534ef1413aa22b84088871
I0325 10:59:48.659899       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=6ef5533b56016ba9f8d41c4ee2aa99f289b44098ead7423c8494657e83be3d2a
I0325 10:59:48.659922       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=2d32ff3ca2e2aa3b9ba28af5decdb0eeb9ea2f8a3e9197e30a4afa6af9b9314d
I0325 10:59:48.659939       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0325 10:59:48.659947       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0325 10:59:48.659954       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.010576145s to process 35 records
W0325 10:59:48.757314       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0325 10:59:48.759705       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0325 10:59:48.759755       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-669b496959-nqnbm pod in namespace openshift-image-registry (previous: false).
I0325 10:59:48.968312       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-669b496959-nqnbm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-669b496959-nqnbm\" is waiting to start: ContainerCreating"
I0325 10:59:48.968330       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-669b496959-nqnbm\" is waiting to start: ContainerCreating"
I0325 10:59:48.968366       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d79f5d996-m7x8d pod in namespace openshift-image-registry (previous: false).
I0325 10:59:49.159679       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0325 10:59:49.159698       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6kl8n pod in namespace openshift-image-registry (previous: false).
I0325 10:59:49.367758       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0325 10:59:49.367781       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5867d65d4f-9djh8 pod in namespace openshift-ingress (previous: false).
I0325 10:59:49.567568       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5867d65d4f-9djh8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5867d65d4f-9djh8\" is waiting to start: ContainerCreating"
I0325 10:59:49.567588       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5867d65d4f-9djh8\" is waiting to start: ContainerCreating"
I0325 10:59:49.567599       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c7f47974-2jk55 pod in namespace openshift-ingress (previous: false).
W0325 10:59:49.757504       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0325 10:59:49.767793       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6c7f47974-2jk55 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6c7f47974-2jk55\" is waiting to start: ContainerCreating"
I0325 10:59:49.767810       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6c7f47974-2jk55\" is waiting to start: ContainerCreating"
I0325 10:59:49.767820       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c7f47974-fffbx pod in namespace openshift-ingress (previous: false).
I0325 10:59:49.968154       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0325 10:59:49.968223       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xdq6k pod in namespace openshift-ingress-canary (previous: false).
I0325 10:59:50.165140       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-xdq6k pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xdq6k\" is waiting to start: ContainerCreating"
I0325 10:59:50.165171       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xdq6k\" is waiting to start: ContainerCreating"
I0325 10:59:50.165188       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-jt776 pod in namespace openshift-kube-storage-version-migrator (previous: false).
I0325 10:59:50.365993       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-jt776 pod in namespace openshift-kube-storage-version-migrator (previous: false).
I0325 10:59:50.564926       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-8znwm pod in namespace openshift-kube-storage-version-migrator-operator (previous: false).
W0325 10:59:50.757355       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0325 10:59:50.769272       1 tasks_processing.go:74] worker 30 stopped.
I0325 10:59:50.769356       1 recorder.go:75] Recording events/openshift-dns with fingerprint=bcc1e03efaebe817ed85f6f6b1786117f31faef7c1c2059b8f40e5c4c99798ec
I0325 10:59:50.769430       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=b7a635444d3197873d310f8b45eb298f83d02b15faf33be3d878b4358e0aeb88
I0325 10:59:50.769460       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=5883c3fdf104135266beadca02fdb80769331e1efb805ab8871aca82df27d5d0
I0325 10:59:50.769502       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=ad0c38596a5c3af8f1e1b75270db32a2534a2a82e8b423e80099e99c4550aa17
I0325 10:59:50.769513       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=28e6ed048285e8170f6c17392bb3a1011f3bb051926ade3056127d18794e9476
I0325 10:59:50.769525       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=e819d8d1d2d077c733006efd31fac21b73e89a897a474d20c6684a1772f52ef6
I0325 10:59:50.769572       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=852c4cfd03f4ad9987dc8680e9fc0cb3826af9d31c2c96557ad3ee4f3543f8aa
I0325 10:59:50.770889       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-knvzq with fingerprint=00903aa7f550d2af78c80633ff0b9bf960011c3e02f489af2b70c65373ec2148
I0325 10:59:50.770985       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-669b496959-g6p49 with fingerprint=04441c01344d3b6698f66991ce36f72f729e6d776fccd0a82878b95ffb55e20a
I0325 10:59:50.771082       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-669b496959-nqnbm with fingerprint=fbddfd6211badba36b23a9d37a7f61250a0a406c8b5d3862812d933237654657
I0325 10:59:50.771187       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7d79f5d996-m7x8d with fingerprint=002a5001476de7e9db28e8cce666c0440b65479fdd2e25c1fe6fe33835dd0df5
I0325 10:59:50.771248       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-xdq6k with fingerprint=05d80f892b4da64aa0615bda77b061c23d1464c7ae9cfeccf73ebbdf48c89219
I0325 10:59:50.771263       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-jt776/migrator_current.log with fingerprint=08500efc34c652178d025750d21d41dfbc2a13dd7f61e1343730a50bf0e11c2f
I0325 10:59:50.771268       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-jt776/graceful-termination_current.log with fingerprint=692b32666322908f1d0833916951bf6ba5e62bd1f0f86028090dd0b9cb833946
I0325 10:59:50.771338       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-8znwm/kube-storage-version-migrator-operator_current.log with fingerprint=7f5c5d7372064d7161d3d0767cda1c3429cd2bba33a06dcf810c38a923820a18
I0325 10:59:50.771347       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.120010473s to process 15 records
W0325 10:59:51.754067       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0325 10:59:51.754124       1 tasks_processing.go:74] worker 14 stopped.
E0325 10:59:51.754138       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0325 10:59:51.754152       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0325 10:59:51.754175       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0325 10:59:51.754190       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.10354624s to process 1 records
I0325 10:59:59.472346       1 tasks_processing.go:74] worker 4 stopped.
I0325 10:59:59.472396       1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539
I0325 10:59:59.472412       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.771928762s to process 1 records
I0325 11:00:00.059901       1 tasks_processing.go:74] worker 3 stopped.
I0325 11:00:00.060253       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=c89e48e19f2ee679cbbc8ca0a7fdb135e655b3c822496630920a7fdbed5c113c
I0325 11:00:00.060273       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.408692662s to process 1 records
E0325 11:00:00.060332       1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.412s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0325 11:00:00.061442       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0325 11:00:00.061461       1 periodic.go:209] Running workloads gatherer
I0325 11:00:00.061480       1 tasks_processing.go:45] number of workers: 2
I0325 11:00:00.061497       1 tasks_processing.go:69] worker 1 listening for tasks.
I0325 11:00:00.061505       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0325 11:00:00.061508       1 tasks_processing.go:69] worker 0 listening for tasks.
I0325 11:00:00.061574       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0325 11:00:00.083963       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 19s for image data
I0325 11:00:00.096161       1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (13ms)
I0325 11:00:00.099734       1 tasks_processing.go:74] worker 0 stopped.
I0325 11:00:00.099753       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 38.137675ms to process 0 records
I0325 11:00:00.105726       1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms)
I0325 11:00:00.114985       1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (9ms)
I0325 11:00:00.123933       1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (9ms)
I0325 11:00:00.133606       1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (10ms)
I0325 11:00:00.143188       1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (10ms)
I0325 11:00:00.152433       1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (9ms)
I0325 11:00:00.161959       1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (10ms)
I0325 11:00:00.171642       1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (10ms)
I0325 11:00:00.181455       1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (10ms)
I0325 11:00:00.194766       1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (13ms)
I0325 11:00:00.295903       1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms)
I0325 11:00:00.395400       1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms)
I0325 11:00:00.496086       1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (101ms)
I0325 11:00:00.593782       1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (98ms)
I0325 11:00:00.688406       1 configmapobserver.go:84] configmaps "insights-config" not found
I0325 11:00:00.693329       1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms)
I0325 11:00:00.795470       1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (102ms)
I0325 11:00:00.890907       1 configmapobserver.go:84] configmaps "insights-config" not found
I0325 11:00:00.895287       1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms)
I0325 11:00:00.993697       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (98ms)
I0325 11:00:01.093968       1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms)
I0325 11:00:01.194558       1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (101ms)
I0325 11:00:01.294007       1 gather_workloads_info.go:387] No image sha256:bffebf689df67af02a06b97d3d9bfcfdccd597350d132171ee68f3d0ed29a3f6 (99ms)
I0325 11:00:01.400880       1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (107ms)
I0325 11:00:01.495551       1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (95ms)
I0325 11:00:01.594743       1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms)
I0325 11:00:01.694970       1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (100ms)
I0325 11:00:01.798832       1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (104ms)
I0325 11:00:01.895383       1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (97ms)
I0325 11:00:01.999017       1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (104ms)
I0325 11:00:02.095141       1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (96ms)
I0325 11:00:02.194358       1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms)
I0325 11:00:02.293329       1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms)
I0325 11:00:02.393994       1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms)
I0325 11:00:02.394026       1 tasks_processing.go:74] worker 1 stopped.
E0325 11:00:02.394040       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0325 11:00:02.394362       1 recorder.go:75] Recording config/workload_info with fingerprint=cc7e347ec5461f47be7fff1fb197003f8967253a05794c38da81c952ca08a362
I0325 11:00:02.394378       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.332512181s to process 1 records
E0325 11:00:02.394402       1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.332s with: function \"workload_info\" failed with an error"
I0325 11:00:02.395502       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0325 11:00:02.395516       1 periodic.go:209] Running conditional gatherer
I0325 11:00:02.402212       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules
I0325 11:00:02.409285       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:54289->172.30.0.10:53: read: connection refused
E0325 11:00:02.409517       1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0325 11:00:02.409574       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0325 11:00:02.416458       1 conditional_gatherer.go:392] cluster version is '4.20.8'
E0325 11:00:02.416471       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416476       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416480       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416483       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416488       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416493       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416497       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416501       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0325 11:00:02.416504       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0325 11:00:02.416517       1 tasks_processing.go:45] number of workers: 3
I0325 11:00:02.416526       1 tasks_processing.go:69] worker 2 listening for tasks.
I0325 11:00:02.416530       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0325 11:00:02.416536       1 tasks_processing.go:69] worker 0 listening for tasks.
I0325 11:00:02.416546       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0325 11:00:02.416551       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0325 11:00:02.416550       1 tasks_processing.go:69] worker 1 listening for tasks.
I0325 11:00:02.416559       1 tasks_processing.go:74] worker 1 stopped.
I0325 11:00:02.416614       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0325 11:00:02.416627       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.044µs to process 1 records
I0325 11:00:02.416665       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0325 11:00:02.416674       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 950ns to process 1 records
I0325 11:00:02.416679       1 tasks_processing.go:74] worker 0 stopped.
I0325 11:00:02.416782       1 tasks_processing.go:74] worker 2 stopped.
I0325 11:00:02.416793       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 226.026µs to process 0 records
I0325 11:00:02.416811       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:54289->172.30.0.10:53: read: connection refused
I0325 11:00:02.416828       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0325 11:00:02.441547       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=0cdedcd1597847ac7ac25112d167975fa6d76b052568beaab8b2f55512e124e5
I0325 11:00:02.441720       1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-03-25-110002.tar.gz
I0325 11:00:02.448523       1 diskrecorder.go:51] Wrote 107 records to disk in 6ms
I0325 11:00:02.448549       1 periodic.go:278] Gathering cluster info every 2h0m0s
I0325 11:00:02.448564       1 periodic.go:279] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0325 11:00:17.719378       1 configmapobserver.go:84] configmaps "insights-config" not found
I0325 11:00:56.103667       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="2f9c90d6635560ec71f7b0205a5ccc56c85c8f8fda030a21576707c6469d0db5")
W0325 11:00:56.103707       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0325 11:00:56.103764       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="14a36fad550c04992aa2950f743bccc1979bafdeae13f0ebaee53a23d3986737")
I0325 11:00:56.103848       1 base_controller.go:181] Shutting down LoggingSyncer ...
I0325 11:00:56.103849       1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped"
I0325 11:00:56.103869       1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="300c597f99519b2b741d57c6ab38961c3d9d46b3a02bda3c3b1c69a3fd8fc62d")
I0325 11:00:56.103881       1 periodic.go:170] Shutting down
I0325 11:00:56.103884       1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector
I0325 11:00:56.103887       1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ...
I0325 11:00:56.103911       1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"
I0325 11:00:56.103918       1 base_controller.go:113] All LoggingSyncer workers have been terminated
I0325 11:00:56.103946       1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"