W0318 23:59:46.655532       1 cmd.go:257] Using insecure, self-signed certificates
I0318 23:59:46.942238       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0318 23:59:46.942578       1 observer_polling.go:159] Starting file observer
I0318 23:59:47.329589       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0318 23:59:47.329769       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0318 23:59:47.330346       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0318 23:59:47.330350       1 secure_serving.go:57] Forcing use of http/1.1 only
W0318 23:59:47.330404       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0318 23:59:47.330413       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0318 23:59:47.330420       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0318 23:59:47.330425       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0318 23:59:47.330430       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0318 23:59:47.330434       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0318 23:59:47.333864       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0318 23:59:47.333914       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"f5dce18e-82bf-4c3e-9824-c9a16cf81fc4", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0318 23:59:47.334822       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0318 23:59:47.334836       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0318 23:59:47.334844       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0318 23:59:47.334860       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0318 23:59:47.334868       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0318 23:59:47.334881       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0318 23:59:47.335195       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1063403173/tls.crt::/tmp/serving-cert-1063403173/tls.key"
I0318 23:59:47.335686       1 secure_serving.go:213] Serving securely on [::]:8443
I0318 23:59:47.335721       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0318 23:59:47.338077       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0318 23:59:47.338104       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0318 23:59:47.338214       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0318 23:59:47.342366       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0318 23:59:47.342387       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0318 23:59:47.346020       1 secretconfigobserver.go:119] support secret does not exist
I0318 23:59:47.349769       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0318 23:59:47.353060       1 secretconfigobserver.go:119] support secret does not exist
I0318 23:59:47.357474       1 recorder.go:176] Pruning old reports every 7h27m9s, max age is 288h0m0s
I0318 23:59:47.361750       1 periodic.go:216] Running clusterconfig gatherer
I0318 23:59:47.361755       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0318 23:59:47.361773       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0318 23:59:47.361797       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0318 23:59:47.361798       1 tasks_processing.go:45] number of workers: 32
I0318 23:59:47.361804       1 insightsreport.go:296] Starting report retriever
I0318 23:59:47.361810       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0318 23:59:47.361843       1 tasks_processing.go:69] worker 31 listening for tasks.
I0318 23:59:47.361837       1 tasks_processing.go:69] worker 2 listening for tasks.
I0318 23:59:47.361858       1 tasks_processing.go:69] worker 3 listening for tasks.
I0318 23:59:47.361859       1 tasks_processing.go:71] worker 2 working on openshift_logging task.
I0318 23:59:47.361864       1 tasks_processing.go:69] worker 4 listening for tasks.
I0318 23:59:47.361869       1 tasks_processing.go:69] worker 5 listening for tasks.
I0318 23:59:47.361874       1 tasks_processing.go:69] worker 19 listening for tasks.
I0318 23:59:47.361884       1 tasks_processing.go:69] worker 20 listening for tasks.
I0318 23:59:47.361883       1 tasks_processing.go:69] worker 18 listening for tasks.
I0318 23:59:47.361891       1 tasks_processing.go:69] worker 6 listening for tasks.
I0318 23:59:47.361895       1 tasks_processing.go:69] worker 21 listening for tasks.
I0318 23:59:47.361898       1 tasks_processing.go:69] worker 1 listening for tasks.
I0318 23:59:47.361902       1 tasks_processing.go:69] worker 7 listening for tasks.
I0318 23:59:47.361903       1 tasks_processing.go:69] worker 22 listening for tasks.
I0318 23:59:47.361908       1 tasks_processing.go:69] worker 0 listening for tasks.
I0318 23:59:47.361910       1 tasks_processing.go:69] worker 23 listening for tasks.
I0318 23:59:47.361851       1 tasks_processing.go:71] worker 31 working on install_plans task.
I0318 23:59:47.361918       1 tasks_processing.go:69] worker 24 listening for tasks.
I0318 23:59:47.361925       1 tasks_processing.go:69] worker 9 listening for tasks.
I0318 23:59:47.361926       1 tasks_processing.go:69] worker 30 listening for tasks.
I0318 23:59:47.361928       1 tasks_processing.go:69] worker 27 listening for tasks.
I0318 23:59:47.361934       1 tasks_processing.go:69] worker 10 listening for tasks.
I0318 23:59:47.361941       1 tasks_processing.go:69] worker 15 listening for tasks.
I0318 23:59:47.361947       1 tasks_processing.go:69] worker 26 listening for tasks.
I0318 23:59:47.361943       1 tasks_processing.go:69] worker 29 listening for tasks.
I0318 23:59:47.361956       1 tasks_processing.go:69] worker 11 listening for tasks.
I0318 23:59:47.361957       1 tasks_processing.go:69] worker 17 listening for tasks.
I0318 23:59:47.361954       1 tasks_processing.go:69] worker 12 listening for tasks.
I0318 23:59:47.361952       1 tasks_processing.go:69] worker 25 listening for tasks.
I0318 23:59:47.361965       1 tasks_processing.go:69] worker 13 listening for tasks.
I0318 23:59:47.361949       1 tasks_processing.go:69] worker 16 listening for tasks.
I0318 23:59:47.361915       1 tasks_processing.go:69] worker 8 listening for tasks.
I0318 23:59:47.361978       1 tasks_processing.go:69] worker 14 listening for tasks.
I0318 23:59:47.361983       1 tasks_processing.go:69] worker 28 listening for tasks.
I0318 23:59:47.362034       1 tasks_processing.go:71] worker 28 working on machine_autoscalers task.
I0318 23:59:47.362041       1 tasks_processing.go:71] worker 11 working on overlapping_namespace_uids task.
I0318 23:59:47.362047       1 tasks_processing.go:71] worker 5 working on crds task.
I0318 23:59:47.362055       1 tasks_processing.go:71] worker 10 working on node_features task.
I0318 23:59:47.362071       1 tasks_processing.go:71] worker 30 working on config_maps task.
I0318 23:59:47.362036       1 tasks_processing.go:71] worker 9 working on networks task.
I0318 23:59:47.362146       1 tasks_processing.go:71] worker 1 working on openshift_machine_api_events task.
I0318 23:59:47.362044       1 tasks_processing.go:71] worker 4 working on machine_sets task.
I0318 23:59:47.362160       1 tasks_processing.go:71] worker 0 working on nodenetworkstates task.
I0318 23:59:47.362166       1 tasks_processing.go:71] worker 7 working on authentication task.
I0318 23:59:47.362169       1 tasks_processing.go:71] worker 22 working on feature_gates task.
I0318 23:59:47.362180       1 tasks_processing.go:71] worker 27 working on sap_pods task.
I0318 23:59:47.362190       1 tasks_processing.go:71] worker 23 working on service_accounts task.
I0318 23:59:47.362200       1 tasks_processing.go:71] worker 26 working on image task.
I0318 23:59:47.362203       1 tasks_processing.go:71] worker 15 working on jaegers task.
I0318 23:59:47.362212       1 tasks_processing.go:71] worker 24 working on cost_management_metrics_configs task.
I0318 23:59:47.362040       1 tasks_processing.go:71] worker 3 working on machine_configs task.
I0318 23:59:47.362231       1 tasks_processing.go:71] worker 29 working on dvo_metrics task.
I0318 23:59:47.362239       1 tasks_processing.go:71] worker 18 working on openstack_dataplanedeployments task.
I0318 23:59:47.362239       1 tasks_processing.go:71] worker 17 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0318 23:59:47.362245       1 tasks_processing.go:71] worker 12 working on image_registries task.
I0318 23:59:47.362241       1 tasks_processing.go:71] worker 19 working on machines task.
I0318 23:59:47.362249       1 tasks_processing.go:71] worker 25 working on machine_config_pools task.
I0318 23:59:47.362245       1 tasks_processing.go:71] worker 20 working on image_pruners task.
I0318 23:59:47.362252       1 tasks_processing.go:71] worker 13 working on container_images task.
I0318 23:59:47.362255       1 tasks_processing.go:71] worker 16 working on cluster_apiserver task.
I0318 23:59:47.362250       1 tasks_processing.go:71] worker 6 working on openstack_dataplanenodesets task.
I0318 23:59:47.362257       1 tasks_processing.go:71] worker 8 working on monitoring_persistent_volumes task.
I0318 23:59:47.362258       1 tasks_processing.go:71] worker 21 working on version task.
I0318 23:59:47.362259       1 tasks_processing.go:71] worker 14 working on oauths task.
E0318 23:59:47.365611       1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed)
I0318 23:59:47.365612       1 tasks_processing.go:71] worker 2 working on active_alerts task.
I0318 23:59:47.365618       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 3.738479ms to process 0 records
I0318 23:59:47.365631       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 3.565776ms to process 0 records
I0318 23:59:47.365635       1 gather.go:177] gatherer "clusterconfig" function "node_features" took 3.561828ms to process 0 records
I0318 23:59:47.365640       1 tasks_processing.go:71] worker 10 working on pdbs task.
W0318 23:59:47.365641       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0318 23:59:47.365651       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 21.602µs to process 0 records
I0318 23:59:47.365660       1 tasks_processing.go:71] worker 28 working on operators task.
I0318 23:59:47.365682       1 tasks_processing.go:71] worker 2 working on openstack_controlplanes task.
I0318 23:59:47.370351       1 tasks_processing.go:71] worker 4 working on mutating_webhook_configurations task.
I0318 23:59:47.370366       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 7.850062ms to process 0 records
I0318 23:59:47.370524       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 7.602266ms to process 0 records
I0318 23:59:47.370537       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 6.75132ms to process 0 records
I0318 23:59:47.370547       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 7.432402ms to process 0 records
I0318 23:59:47.370558       1 tasks_processing.go:71] worker 15 working on validating_webhook_configurations task.
E0318 23:59:47.370598       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0318 23:59:47.370614       1 gather.go:177] gatherer "clusterconfig" function "machines" took 7.021557ms to process 0 records
I0318 23:59:47.370620       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 7.520995ms to process 0 records
I0318 23:59:47.370635       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0318 23:59:47.370658       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0318 23:59:47.370663       1 tasks_processing.go:71] worker 24 working on ingress task.
I0318 23:59:47.370667       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0318 23:59:47.370672       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0318 23:59:47.370694       1 controller.go:531] The operator is still being initialized
I0318 23:59:47.370697       1 tasks_processing.go:71] worker 27 working on schedulers task.
I0318 23:59:47.370705       1 controller.go:554] The operator is healthy
I0318 23:59:47.370820       1 tasks_processing.go:71] worker 19 working on qemu_kubevirt_launcher_logs task.
I0318 23:59:47.370866       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 7.527871ms to process 0 records
I0318 23:59:47.370900       1 tasks_processing.go:71] worker 25 working on ingress_certificates task.
I0318 23:59:47.370856       1 tasks_processing.go:71] worker 18 working on machine_healthchecks task.
I0318 23:59:47.380694       1 tasks_processing.go:71] worker 0 working on metrics task.
I0318 23:59:47.380712       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 18.155969ms to process 0 records
W0318 23:59:47.380733       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0318 23:59:47.380745       1 tasks_processing.go:71] worker 0 working on sap_datahubs task.
I0318 23:59:47.380762       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 32.548µs to process 0 records
I0318 23:59:47.381472       1 tasks_processing.go:71] worker 6 working on olm_operators task.
I0318 23:59:47.381588       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 17.591649ms to process 0 records
I0318 23:59:47.382177       1 tasks_processing.go:71] worker 16 working on proxies task.
I0318 23:59:47.382569       1 recorder.go:75] Recording config/apiserver with fingerprint=38fd28fcd2518511711bfad192f2841cd0346f0218b3d0764c929084d236358d
I0318 23:59:47.383268       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 18.308396ms to process 1 records
I0318 23:59:47.383408       1 tasks_processing.go:71] worker 14 working on aggregated_monitoring_cr_names task.
I0318 23:59:47.383797       1 recorder.go:75] Recording config/oauth with fingerprint=511fa50df0e2a015ca2041b0f1cfd300544e75c8d78dc865ce994af16f4a73f2
I0318 23:59:47.383852       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 19.053629ms to process 1 records
I0318 23:59:47.383868       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 21.171818ms to process 0 records
I0318 23:59:47.383887       1 tasks_processing.go:71] worker 1 working on node_logs task.
I0318 23:59:47.383937       1 tasks_processing.go:71] worker 9 working on infrastructures task.
I0318 23:59:47.384658       1 recorder.go:75] Recording config/network with fingerprint=65ebb19389bd2b8a8272db7103500b59a2cbb2eb7e047a1f97321640d01ac428
I0318 23:59:47.384679       1 gather.go:177] gatherer "clusterconfig" function "networks" took 21.795308ms to process 1 records
I0318 23:59:47.384762       1 recorder.go:75] Recording config/image with fingerprint=924d0afb2b9978dcb4f5f91f95ce9aa00fd92e941c68553f533fc5190829db21
I0318 23:59:47.384775       1 gather.go:177] gatherer "clusterconfig" function "image" took 21.694853ms to process 1 records
I0318 23:59:47.384805       1 tasks_processing.go:71] worker 26 working on lokistack task.
I0318 23:59:47.384931       1 recorder.go:75] Recording config/featuregate with fingerprint=803778ee30058e635cc16125af10163c886a3fa7fa22401acfb3fe308c1edb8c
I0318 23:59:47.384971       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 22.06677ms to process 1 records
I0318 23:59:47.384952       1 tasks_processing.go:71] worker 22 working on openstack_version task.
I0318 23:59:47.385126       1 tasks_processing.go:71] worker 7 working on sap_config task.
I0318 23:59:47.385226       1 recorder.go:75] Recording config/authentication with fingerprint=3a7cf6b37d4006fd08ecbe9f9337b0a25bedc79df21e44f0f03f82bc348b5aa4
I0318 23:59:47.385244       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 22.102123ms to process 1 records
I0318 23:59:47.385259       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 19.060317ms to process 0 records
I0318 23:59:47.385273       1 tasks_processing.go:71] worker 2 working on storage_classes task.
I0318 23:59:47.385276       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0318 23:59:47.385284       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 22.944789ms to process 1 records
I0318 23:59:47.385326       1 tasks_processing.go:71] worker 11 working on nodenetworkconfigurationpolicies task.
I0318 23:59:47.385460       1 tasks_processing.go:71] worker 20 working on clusterroles task.
I0318 23:59:47.385598       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1a95cb9cd47c47fc9b9f5afe6af70a8ad280c9793837e7fb83c4197d7a1d234f
I0318 23:59:47.385618       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 21.377151ms to process 1 records
I0318 23:59:47.389998       1 tasks_processing.go:71] worker 8 working on operators_pods_and_events task.
I0318 23:59:47.390008       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 26.071301ms to process 0 records
I0318 23:59:47.390253       1 tasks_processing.go:71] worker 10 working on support_secret task.
I0318 23:59:47.390450       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=670bbead040b05f1fe6ab1997441a9ed043331fd9a3193f544fe82279a00da96
I0318 23:59:47.390491       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e95bbd944a6408669676d689a729790994c409d66f4f4ed854043d99752f145e
I0318 23:59:47.390515       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=052e4faafd356db9cd192bfa59136377ef072a44003cd7ac0fd164c541027340
I0318 23:59:47.390530       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 24.604591ms to process 3 records
I0318 23:59:47.390725       1 tasks_processing.go:71] worker 3 working on container_runtime_configs task.
E0318 23:59:47.390755       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0318 23:59:47.390828       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0318 23:59:47.390862       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 27.572092ms to process 1 records
I0318 23:59:47.391030       1 tasks_processing.go:71] worker 18 working on certificate_signing_requests task.
E0318 23:59:47.391047       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0318 23:59:47.391104       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 20.043652ms to process 0 records
I0318 23:59:47.391193       1 tasks_processing.go:71] worker 12 working on ceph_cluster task.
I0318 23:59:47.391530       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=0037e7b03aae480eee0449057fb6b4293354248d30b54340fa7e5125c87503e1
I0318 23:59:47.391548       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 27.594441ms to process 1 records
I0318 23:59:47.395289       1 tasks_processing.go:71] worker 0 working on silenced_alerts task.
I0318 23:59:47.395292       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.487251ms to process 0 records
W0318 23:59:47.395987       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0318 23:59:47.395997       1 tasks_processing.go:71] worker 0 working on storage_cluster task.
I0318 23:59:47.396153       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 628.586µs to process 0 records
I0318 23:59:47.396555       1 tasks_processing.go:71] worker 27 working on pod_network_connectivity_checks task.
I0318 23:59:47.397049       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=0ed4ff3dba4a7af4233664ef946da8701a04d8a862e313701113c821e30cb2a8
I0318 23:59:47.397068       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 25.846311ms to process 1 records
I0318 23:59:47.397219       1 tasks_processing.go:71] worker 24 working on nodes task.
I0318 23:59:47.397261       1 recorder.go:75] Recording config/ingress with fingerprint=10e62f3fa4654ab27f47eebcc34e91ffe511e56ccebdc3cf4bea5ac818a4bc42
I0318 23:59:47.397281       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 26.003596ms to process 1 records
I0318 23:59:47.397421       1 tasks_processing.go:71] worker 15 working on tsdb_status task.
W0318 23:59:47.397461       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0318 23:59:47.397571       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=02214ea3d1f49581510a64fe93e8eeaaa89e3be050cab7bf989a1abd1120261d
I0318 23:59:47.397709       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=400cdd8f9862d70d782f4e7d81530f3a8c753d4f481d74d5997e97cbc0389fc6
I0318 23:59:47.397737       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ecd1cd50d0418bab67200e1f63ac7c3cdf5711575800c8a653379dd861571d2d
I0318 23:59:47.397773       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=3b4f77496233e40374ac8b53f35b2d250f806ee814efc6b62458351840ed73de
I0318 23:59:47.397812       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=ea12b895d05dfb567cca515b4a964bbbe2e45414ea559e9689db34d779665cfe
W0318 23:59:47.397813       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0318 23:59:47.397849       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=bb43ed18242a961d57f9145c7fc8efc19a6a84a43cdd8616bdd33293630f0514
I0318 23:59:47.397888       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=dcf113f220213f4dd86bb8e0ccef02c9f8a4ff46f444da5dd4180eb1a466b2b1
I0318 23:59:47.397910       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=c09ceb029a222d430a2c048991557fb8c00726a4123448fc6c0cad39f0f0f57a
I0318 23:59:47.397933       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=aae7b8b1fcecd271a58a8b2d426eac8eba042389656d896430da9037ac586cda
I0318 23:59:47.397960       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=822e009c1b2e7b3ffbff7b8d9ad42e8790bb78138189d86b041112e3dd76da53
I0318 23:59:47.397985       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 26.268144ms to process 10 records
I0318 23:59:47.398073       1 tasks_processing.go:74] worker 4 stopped.
I0318 23:59:47.398086       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=10407e5b2418d87cb12fbe541e08c1307c6c65f801826f7e7490067bcd1aecff
I0318 23:59:47.398107       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=6de5cc07bfea944a17a7949d059e716129a5c7c3cea17305f33922550315c4b6
I0318 23:59:47.398131       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=3eac00748071dbd84eac48e361ddf92e73439a6ed565f71a17b4bad10b653f81
I0318 23:59:47.398138       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.545367ms to process 3 records
I0318 23:59:47.398148       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 38.414µs to process 0 records
I0318 23:59:47.398215       1 tasks_processing.go:74] worker 15 stopped.
I0318 23:59:47.398283       1 tasks_processing.go:74] worker 5 stopped.
I0318 23:59:47.398586       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=432cf7cb4fc802e35105d3076b702e3db30d4bdcef26c26dcc6617a907a3dbcb
I0318 23:59:47.398828       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5b47d3586ce5b92c07baba4c330ddec768b33c06557fef7097429443b8578a18
I0318 23:59:47.398837       1 gather.go:177] gatherer "clusterconfig" function "crds" took 35.599251ms to process 2 records
I0318 23:59:47.399213       1 tasks_processing.go:74] worker 7 stopped.
I0318 23:59:47.399223       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 14.068337ms to process 0 records
I0318 23:59:47.399258       1 tasks_processing.go:74] worker 22 stopped.
I0318 23:59:47.399264       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 14.247545ms to process 0 records
I0318 23:59:47.399271       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 14.454781ms to process 0 records
I0318 23:59:47.399278       1 tasks_processing.go:74] worker 26 stopped.
I0318 23:59:47.399335       1 tasks_processing.go:74] worker 12 stopped.
I0318 23:59:47.399345       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 8.124782ms to process 0 records
I0318 23:59:47.402668       1 tasks_processing.go:74] worker 3 stopped.
I0318 23:59:47.403135       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 11.926899ms to process 0 records
I0318 23:59:47.403210       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 17.81503ms to process 0 records
I0318 23:59:47.403231       1 tasks_processing.go:74] worker 11 stopped.
I0318 23:59:47.403333       1 tasks_processing.go:74] worker 9 stopped.
I0318 23:59:47.403549       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
W0318 23:59:47.403609       1 operator.go:328] started
I0318 23:59:47.403676       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0318 23:59:47.403959       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0318 23:59:47.404117       1 recorder.go:75] Recording config/infrastructure with fingerprint=0eed4c6866521ba354c2e4954585624e8f48a930451ccfa06d6650557e0949b8
I0318 23:59:47.404144       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.377826ms to process 1 records
I0318 23:59:47.404441       1 tasks_processing.go:74] worker 2 stopped.
I0318 23:59:47.404631       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a0b26ca8eca3b88ba24cb2f08f02b566083102039d711f995f1ffe8c0650247b
I0318 23:59:47.404673       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=76c99df1b78e87295099204b2085a1520fe0a464f2eb7ec28cd5edd990c98c23
I0318 23:59:47.404703       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 19.15802ms to process 2 records
I0318 23:59:47.404722       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 20.57792ms to process 0 records
I0318 23:59:47.404729       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 8.49227ms to process 0 records
E0318 23:59:47.404736       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0318 23:59:47.404765       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 14.245469ms to process 0 records
I0318 23:59:47.404798       1 tasks_processing.go:74] worker 0 stopped.
E0318 23:59:47.404802       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0318 23:59:47.404809       1 tasks_processing.go:74] worker 10 stopped.
I0318 23:59:47.404785       1 tasks_processing.go:74] worker 1 stopped.
I0318 23:59:47.404818       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 7.912494ms to process 0 records
I0318 23:59:47.404849       1 tasks_processing.go:74] worker 27 stopped.
I0318 23:59:47.405700       1 tasks_processing.go:74] worker 16 stopped.
I0318 23:59:47.405831       1 recorder.go:75] Recording config/proxy with fingerprint=f2c9e70f44f9a231ee1e68b8d833fdb8201e435ca5db4947357444fad1e3365e
I0318 23:59:47.405874       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 22.567749ms to process 1 records
I0318 23:59:47.406363       1 tasks_processing.go:74] worker 24 stopped.
I0318 23:59:47.406746       1 recorder.go:75] Recording config/node/ip-10-0-0-44.ec2.internal with fingerprint=986d4c68d0a40a357a81784375acb9eba9fcb70c8735d47cacdcd54f7c759a3a
I0318 23:59:47.406834       1 recorder.go:75] Recording config/node/ip-10-0-1-147.ec2.internal with fingerprint=915623a75ae43ba5cca92de7fa4fb937541c8335082466e71d442ed75fe08236
I0318 23:59:47.406890       1 recorder.go:75] Recording config/node/ip-10-0-2-48.ec2.internal with fingerprint=21b070492caa99bab97d761f9d246873afdf9f49595fc808fee6ac59e1c1701c
I0318 23:59:47.406899       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 9.118061ms to process 3 records
I0318 23:59:47.406962       1 tasks_processing.go:74] worker 13 stopped.
I0318 23:59:47.408916       1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-bn4jw with fingerprint=3245fc185cd5ef6312714097f8943d938702305ccdb41013ce46d63d1eb0bbea
I0318 23:59:47.409349       1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-kdw55 with fingerprint=2a159aabae4df48340f2ae56ce68357012f5f3dcc0d5ac5b3f0b9934f6d12b57
I0318 23:59:47.409418       1 recorder.go:75] Recording config/running_containers with fingerprint=5a2730e17818ec8d41864fde9db71a48d719b71841d6db680cac35d703fb9d80
I0318 23:59:47.409429       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 42.608073ms to process 3 records
I0318 23:59:47.409448       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 26.103143ms to process 0 records
I0318 23:59:47.409457       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 17.1255ms to process 0 records
I0318 23:59:47.409463       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 45.1577ms to process 0 records
I0318 23:59:47.409463       1 tasks_processing.go:74] worker 6 stopped.
I0318 23:59:47.409471       1 tasks_processing.go:74] worker 17 stopped.
I0318 23:59:47.409480       1 tasks_processing.go:74] worker 18 stopped.
I0318 23:59:47.414223       1 tasks_processing.go:74] worker 20 stopped.
I0318 23:59:47.414661       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=af04e9e8356e9d8d87ae3ab3ba9af1ae80a1506aebba620deae48930d54a4c25
I0318 23:59:47.415520       1 prometheus_rules.go:88] Prometheus rules successfully created
I0318 23:59:47.415956       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0318 23:59:47.415996       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0318 23:59:47.416020       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0318 23:59:47.416049       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0318 23:59:47.416073       1 controller.go:254] Source scaController *sca.Controller is not ready
I0318 23:59:47.416133       1 controller.go:531] The operator is still being initialized
I0318 23:59:47.416161       1 controller.go:554] The operator is healthy
I0318 23:59:47.417547       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8676814a8d365644dfb8fa52fd9966737b11ad8ed42d3523df00efeeed93c453
I0318 23:59:47.417570       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 28.726362ms to process 2 records
I0318 23:59:47.417579       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 33.230895ms to process 0 records
I0318 23:59:47.417588       1 tasks_processing.go:74] worker 14 stopped.
I0318 23:59:47.424295       1 tasks_processing.go:74] worker 30 stopped.
E0318 23:59:47.424342       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0318 23:59:47.424354       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0318 23:59:47.424360       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0318 23:59:47.424374       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=c8a9805405aae7d04b7f03c09c51097942070877009b6daebd5573ef8127446e
I0318 23:59:47.424417       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0318 23:59:47.424428       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0318 23:59:47.424434       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=3b70b9787487b548204d806ebebf90b0c2d460145e34cb33c0d8d3a7a011d907
I0318 23:59:47.424440       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0318 23:59:47.424489       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0318 23:59:47.424499       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0318 23:59:47.424509       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 62.21225ms to process 7 records
E0318 23:59:47.424526       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0318 23:59:47.424536       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p4edbd77kh91d8r4j9ge6pj0rtaaqm8-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p4edbd77kh91d8r4j9ge6pj0rtaaqm8-primary-cert-bundle-secret" not found
I0318 23:59:47.424587       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=4d2c428297f27827b2f3acddba397625f6d57c0c803cb6f8aa518c95dadfb29f
I0318 23:59:47.424599       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 53.472161ms to process 1 records
I0318 23:59:47.424600       1 tasks_processing.go:74] worker 25 stopped.
E0318 23:59:47.425492       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a825f29b-bc27-44dc-b7ff-20a9fc17d835%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:46515->172.30.0.10:53: read: connection refused
I0318 23:59:47.425505       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a825f29b-bc27-44dc-b7ff-20a9fc17d835%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:46515->172.30.0.10:53: read: connection refused
I0318 23:59:47.435600       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0318 23:59:47.435608       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0318 23:59:47.435621       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0318 23:59:47.438924       1 base_controller.go:82] Caches are synced for ConfigController 
I0318 23:59:47.438936       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0318 23:59:47.444164       1 configmapobserver.go:84] configmaps "insights-config" not found
I0318 23:59:47.474426       1 gather_logs.go:145] no pods in  namespace were found
I0318 23:59:47.474446       1 tasks_processing.go:74] worker 19 stopped.
I0318 23:59:47.474458       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 103.570904ms to process 0 records
I0318 23:59:47.474500       1 tasks_processing.go:74] worker 21 stopped.
I0318 23:59:47.474740       1 recorder.go:75] Recording config/version with fingerprint=359c76b9f72c7429dd62bc806616d9e11a5fe3561c8aad07e22775698f00a56a
I0318 23:59:47.474753       1 recorder.go:75] Recording config/id with fingerprint=6397314395ce133e75a991d70b7b67ebb2402ce579a37ddb1f578aea56edf82e
I0318 23:59:47.474759       1 gather.go:177] gatherer "clusterconfig" function "version" took 110.557483ms to process 2 records
I0318 23:59:47.503757       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0318 23:59:47.503775       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0318 23:59:47.509774       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0318 23:59:47.513582       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:36104->172.30.0.10:53: read: connection refused
I0318 23:59:47.513597       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:36104->172.30.0.10:53: read: connection refused
I0318 23:59:47.889538       1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers
I0318 23:59:47.889555       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes
I0318 23:59:47.890190       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-gjvms pod in namespace openshift-dns (previous: false).
I0318 23:59:48.121625       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gjvms pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-gjvms\" is waiting to start: ContainerCreating"
I0318 23:59:48.121645       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-gjvms\" is waiting to start: ContainerCreating"
I0318 23:59:48.121656       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-gjvms pod in namespace openshift-dns (previous: false).
I0318 23:59:48.294332       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gjvms pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-gjvms\" is waiting to start: ContainerCreating"
I0318 23:59:48.294355       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-gjvms\" is waiting to start: ContainerCreating"
I0318 23:59:48.294369       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pgj4m pod in namespace openshift-dns (previous: false).
W0318 23:59:48.394728       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0318 23:59:48.513664       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pgj4m pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pgj4m\" is waiting to start: ContainerCreating"
I0318 23:59:48.513684       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pgj4m\" is waiting to start: ContainerCreating"
I0318 23:59:48.513692       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pgj4m pod in namespace openshift-dns (previous: false).
I0318 23:59:48.708072       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pgj4m pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-pgj4m\" is waiting to start: ContainerCreating"
I0318 23:59:48.708092       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-pgj4m\" is waiting to start: ContainerCreating"
I0318 23:59:48.708102       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-rrjk6 pod in namespace openshift-dns (previous: false).
I0318 23:59:48.817602       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0318 23:59:48.891642       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rrjk6 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-rrjk6\" is waiting to start: ContainerCreating"
I0318 23:59:48.891657       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-rrjk6\" is waiting to start: ContainerCreating"
I0318 23:59:48.891665       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-rrjk6 pod in namespace openshift-dns (previous: false).
I0318 23:59:49.091965       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rrjk6 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-rrjk6\" is waiting to start: ContainerCreating"
I0318 23:59:49.091981       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-rrjk6\" is waiting to start: ContainerCreating"
I0318 23:59:49.091992       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-54bsf pod in namespace openshift-dns (previous: false).
I0318 23:59:49.220358       1 tasks_processing.go:74] worker 28 stopped.
I0318 23:59:49.220409       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=c460969759b91f03f67624b78bf16f7a352c6ce8f2c7a87b94d6776786e17a34
I0318 23:59:49.220460       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=dba4286ad669583cd11625c0ad8f76e8f21d632558c55bda8b232b13b5250d50
I0318 23:59:49.220491       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0318 23:59:49.220516       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=9267e97b431aecc4dc5c39a1da0e6cb7a8e392b35d656cee0e7f167210574514
I0318 23:59:49.220533       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0318 23:59:49.220573       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=276a8f9c1b4f87a67238415d2eec6f13f34b3c93eccd7bf817b8d08ac83037bc
I0318 23:59:49.220603       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=d04276795b59294723ab2c752cb64c24fe7fea63414357c6a71d95d05ab7398e
I0318 23:59:49.220628       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=8c675d38f8e8198e68c8b5e25b2acc1d1d7916a03e63c278d175b5f1f3f9d97f
I0318 23:59:49.220643       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=92b6e13b208cab0ca193defe8e12aa1d99e045c707744238f04730c19da0f739
I0318 23:59:49.220660       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=2984e658b9af693770548c26d5dbf5947aa26c5b2270567776920dbcfa0c6f37
I0318 23:59:49.220669       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0318 23:59:49.220684       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=3b5ccd0121d1d736fde49d784b1935366265e0eec867fd385ec891988fb33cf0
I0318 23:59:49.220695       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0318 23:59:49.220712       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=da7b9e9ecd936acc35da0a233ae261ceab18aff1dc04ad1520cc085d83ef8389
I0318 23:59:49.220721       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0318 23:59:49.220733       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=df7593ce61f7340ab2cc3d24ab0f04be7845e83b3ac079a19bfec7f3826b55e5
I0318 23:59:49.220740       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0318 23:59:49.220756       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=c1b2a705d6b3fbcafba0cbf06949e45d44dc0038a7ed7a28819e65bcac4f127d
I0318 23:59:49.220878       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=2f0bcd58da8acccc6e18081bec9979afbd357af7958e02935d9e6b5abc54b3a6
I0318 23:59:49.220887       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0318 23:59:49.220893       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0318 23:59:49.220936       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0318 23:59:49.220962       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=6767d6db8da8c698695d2e7f4085aa721512326817024d0c4c07f53e182aa793
I0318 23:59:49.220987       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=17758d86866022d22259206b22a08416db17c8bcb74bc872a067b13ed0a03d96
I0318 23:59:49.220996       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0318 23:59:49.221011       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=32ed25c03bd78b73513e6bd57053abdef19e677a30ba8e6b2ad31b4ad6504dc7
I0318 23:59:49.221020       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0318 23:59:49.221033       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=29d1ee511515d992e7a9ebdaa97356dc1e5a19faa1f3ff3b59bc97c54edc5c47
I0318 23:59:49.221053       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=08b1fc49cf9db8a6f1e2f4eaa5b7633e27ccf527fde32365f51b6a3e4ba46030
I0318 23:59:49.221067       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=be5b71e3aae9c30270c95b0fb1ac650a5dd18bf340b9c4f5c120b050b549259d
I0318 23:59:49.221080       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=592feda3459031e49db19dcf40cea4bd5b9b20d83df07eea417c14e8f1d28711
I0318 23:59:49.221093       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=2b5ec1c37e42f91bd8dc236e46686ca5d6108a95c3a7b241681f6e343e1aaf02
I0318 23:59:49.221119       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=9de7ae93248aaf85e01eae4768142c9223b8de60615d3f5e9c440b18d2836f09
I0318 23:59:49.221136       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0318 23:59:49.221142       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0318 23:59:49.221148       1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.854681675s to process 35 records
I0318 23:59:49.292173       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:49.292191       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5jsrw pod in namespace openshift-dns (previous: false).
W0318 23:59:49.394423       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0318 23:59:49.504843       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:49.504864       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mj2pm pod in namespace openshift-dns (previous: false).
I0318 23:59:49.696553       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:49.696620       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-657d5444b-7786v pod in namespace openshift-image-registry (previous: false).
I0318 23:59:49.895587       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-657d5444b-7786v pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-657d5444b-7786v\" is waiting to start: ContainerCreating"
I0318 23:59:49.895604       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-657d5444b-7786v\" is waiting to start: ContainerCreating"
I0318 23:59:49.895649       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86dcfbb497-f9rpj pod in namespace openshift-image-registry (previous: false).
I0318 23:59:50.094745       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86dcfbb497-f9rpj pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86dcfbb497-f9rpj\" is waiting to start: ContainerCreating"
I0318 23:59:50.094761       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86dcfbb497-f9rpj\" is waiting to start: ContainerCreating"
I0318 23:59:50.094799       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86dcfbb497-hshwl pod in namespace openshift-image-registry (previous: false).
I0318 23:59:50.293707       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86dcfbb497-hshwl pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86dcfbb497-hshwl\" is waiting to start: ContainerCreating"
I0318 23:59:50.293724       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86dcfbb497-hshwl\" is waiting to start: ContainerCreating"
I0318 23:59:50.293735       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6pslh pod in namespace openshift-image-registry (previous: false).
W0318 23:59:50.394180       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0318 23:59:50.493832       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:50.493851       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jlmb6 pod in namespace openshift-image-registry (previous: false).
I0318 23:59:50.697188       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:50.697207       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-qxv72 pod in namespace openshift-image-registry (previous: false).
I0318 23:59:50.892476       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0318 23:59:50.892498       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-77c7bcb4f-tv9cc pod in namespace openshift-ingress (previous: false).
I0318 23:59:51.092460       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-77c7bcb4f-tv9cc pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-77c7bcb4f-tv9cc\" is waiting to start: ContainerCreating"
I0318 23:59:51.092480       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-77c7bcb4f-tv9cc\" is waiting to start: ContainerCreating"
I0318 23:59:51.092494       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7d4d6444f6-hp62z pod in namespace openshift-ingress (previous: false).
I0318 23:59:51.295500       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7d4d6444f6-hp62z pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7d4d6444f6-hp62z\" is waiting to start: ContainerCreating"
I0318 23:59:51.295519       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7d4d6444f6-hp62z\" is waiting to start: ContainerCreating"
I0318 23:59:51.295531       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7d4d6444f6-z6k5x pod in namespace openshift-ingress (previous: false).
W0318 23:59:51.394753       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0318 23:59:51.491878       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7d4d6444f6-z6k5x pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7d4d6444f6-z6k5x\" is waiting to start: ContainerCreating"
I0318 23:59:51.491896       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7d4d6444f6-z6k5x\" is waiting to start: ContainerCreating"
I0318 23:59:51.491906       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2prfd pod in namespace openshift-ingress-canary (previous: false).
I0318 23:59:51.693204       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-94d4b pod in namespace openshift-ingress-canary (previous: false).
I0318 23:59:51.897645       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jfdh7 pod in namespace openshift-ingress-canary (previous: false).
I0318 23:59:52.094249       1 tasks_processing.go:74] worker 8 stopped.
I0318 23:59:52.094378       1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=6aea665e1dcd0736a100d6c2b1f03fc288667d79ea35c5fc195f8f8443fce2b0
I0318 23:59:52.094437       1 recorder.go:75] Recording events/openshift-dns with fingerprint=1d2f910508b07d5141c125c0d0ec8a57d881a168b117d98528677c485541f2ba
I0318 23:59:52.094540       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0512bfb63719d2b09fa5d020f52b8b51708c484740295e75d0a902aefa6e1158
I0318 23:59:52.094579       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=0da8b0652c13c5f603efaecf91b5d16be1743060b13c61dc43a3dbdee1f5baba
I0318 23:59:52.094636       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=059957ac6b282465dfcc024c99958928d372be7bd5ab2026bd073164f1d3aaf0
I0318 23:59:52.094682       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=962c2485895e38287a5ca9d840e21eddc144d246a19c210f7ad1c9322a78b8c3
I0318 23:59:52.094843       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-657d5444b-7786v with fingerprint=a603c57f2580e276365d091627847a07d9bdf8bfd7ddc7175961b2f3d1d1b44f
I0318 23:59:52.094956       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-86dcfbb497-f9rpj with fingerprint=1a01621f00bcb82aaeb43376c25d3230c493d9f03f5028dd79b19f648b758890
I0318 23:59:52.095056       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-86dcfbb497-hshwl with fingerprint=a261ce10b679549621015640e16a79fdeca14aa6bef456958103e87a9963932d
I0318 23:59:52.095068       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-2prfd/serve-healthcheck-canary_current.log with fingerprint=6519d1f1bcde6cf2cfed893535fb5d2fdfb5115f78d41922df4e74b21cfa76d3
I0318 23:59:52.095078       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-94d4b/serve-healthcheck-canary_current.log with fingerprint=62c0da4e8b13bd47365c9ea2055f1d38eed4e1a3e47c954c03d22907ee55421a
I0318 23:59:52.095085       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-jfdh7/serve-healthcheck-canary_current.log with fingerprint=cda4554125345a166e3c67ba0c1fff9d4fdba5fcd99718f958e105425a8fc913
I0318 23:59:52.095095       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.704227824s to process 12 records
W0318 23:59:52.390547       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0318 23:59:52.390571       1 tasks_processing.go:74] worker 29 stopped.
E0318 23:59:52.390588       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0318 23:59:52.390607       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0318 23:59:52.390624       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0318 23:59:52.390647       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.027342115s to process 1 records
I0318 23:59:59.434712       1 configmapobserver.go:84] configmaps "insights-config" not found
I0318 23:59:59.791747       1 tasks_processing.go:74] worker 31 stopped.
I0318 23:59:59.791785       1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b
I0318 23:59:59.791798       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.429815879s to process 1 records
I0319 00:00:00.569104       1 tasks_processing.go:74] worker 23 stopped.
I0319 00:00:00.569555       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7c1a3e3c431de69ce4ee6fb33aad2158a3d38446a91ec5899ca71ceaf725097e
I0319 00:00:00.569588       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.206219099s to process 1 records
E0319 00:00:00.569671       1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.207s with: function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0319 00:00:00.570803       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0319 00:00:00.570822       1 periodic.go:216] Running workloads gatherer
I0319 00:00:00.570841       1 tasks_processing.go:45] number of workers: 2
I0319 00:00:00.570859       1 tasks_processing.go:69] worker 1 listening for tasks.
I0319 00:00:00.570864       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0319 00:00:00.571018       1 tasks_processing.go:69] worker 0 listening for tasks.
I0319 00:00:00.571086       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0319 00:00:00.598235       1 tasks_processing.go:74] worker 0 stopped.
I0319 00:00:00.598351       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.123597ms to process 0 records
I0319 00:00:00.598383       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data
I0319 00:00:00.608558       1 gather_workloads_info.go:387] No image sha256:7dd9584d291967387f2a1ade991ad3bf8565bb59f49b013217951399e8273498 (10ms)
I0319 00:00:00.616712       1 gather_workloads_info.go:387] No image sha256:5efa227ddac82e56eddc03761e220af1f2d6a4b22ee00b2baf426523f26c0319 (8ms)
I0319 00:00:00.624484       1 gather_workloads_info.go:387] No image sha256:ff8a8892f37210c582b3e526cbd2652b02ef9007d57be12b404434374dd0116a (8ms)
I0319 00:00:00.637521       1 gather_workloads_info.go:387] No image sha256:05376e7e2304d22dd866d8e25dd1e5ff8988b2232059fadfd12cb440af785635 (13ms)
I0319 00:00:00.645770       1 gather_workloads_info.go:387] No image sha256:17e68da37c74bdc95a4eb43b51ce671027807ee610a4ee5237324a8c0dc9d044 (8ms)
I0319 00:00:00.656037       1 gather_workloads_info.go:387] No image sha256:317131706dcce9c87eb4e1efb8446bdbf5e0726e120a8f6c655e2acd89d60e2d (10ms)
I0319 00:00:00.664401       1 gather_workloads_info.go:387] No image sha256:dd6a017092d57ab3a6663f3822a0fa0e3bce4365859d9522dd173405276cd49a (8ms)
I0319 00:00:00.672588       1 gather_workloads_info.go:387] No image sha256:862d5befeba504d5058264cf65f16fc307eea4eb3914fbbbf40fbe61714b0958 (8ms)
I0319 00:00:00.680572       1 gather_workloads_info.go:387] No image sha256:41e0dcd2f91df9234249f168b3fbe6d55cfdb3ebd2e598d5edfa47f905c046cb (8ms)
I0319 00:00:00.688036       1 gather_workloads_info.go:387] No image sha256:25d9148ea34149935323231c64952679727b6f7f235febc3be1df63e0bf18c5e (7ms)
I0319 00:00:00.707278       1 gather_workloads_info.go:387] No image sha256:50b7c5185c4a6e63145753415c92723c59136d14b951ea0f4f06739b00893329 (19ms)
I0319 00:00:00.807751       1 gather_workloads_info.go:387] No image sha256:ab32e70fb149ae7470c941ca73bcfe9eba540bd5058a3d697a3ddf96597d0132 (100ms)
I0319 00:00:00.919657       1 gather_workloads_info.go:387] No image sha256:3e889ea85c9c4748c548b84ae135a8adc88f42026ce8073538ca2fe7d89b8004 (112ms)
I0319 00:00:01.009093       1 gather_workloads_info.go:387] No image sha256:1bf773bc4ec02bf6d68c82f32175366b01fb24f6da8c724b7621748692aec7dc (89ms)
I0319 00:00:01.107545       1 gather_workloads_info.go:387] No image sha256:0b2cc6aadb1abc1d35a55da0c9884eb9426d7ff7a97174daeb09bb1e1a23cfae (98ms)
I0319 00:00:01.208221       1 gather_workloads_info.go:387] No image sha256:77d8ddf2957025a39616328b5cf2b012de6cedce63fb79eebc5270d7b3401574 (101ms)
I0319 00:00:01.307208       1 gather_workloads_info.go:387] No image sha256:04ee35aa6f87e954d386228808017cf2938c5a96a052059c6767078d5f3ad8d6 (99ms)
I0319 00:00:01.409402       1 gather_workloads_info.go:387] No image sha256:11a864539ae77a94afcf8d2e1abf9168081c5081a1bc06088f4be5206cdc02df (102ms)
I0319 00:00:01.510479       1 gather_workloads_info.go:387] No image sha256:5dc767cd6267e006720af8cef541e23bc64d94ef9b1bf3a8b44b1fda5d9d8871 (101ms)
I0319 00:00:01.608589       1 gather_workloads_info.go:387] No image sha256:07f14370b57046dc2ac49be933bb2248aaf5943e8fb56ce9703eaa7c673b999f (98ms)
I0319 00:00:01.711633       1 gather_workloads_info.go:387] No image sha256:bbb5af28bbed69e8189825fdc6665f4e8dbcd0c0c83fa479943ea102fe9452d6 (103ms)
I0319 00:00:01.808921       1 gather_workloads_info.go:387] No image sha256:1c325fa866a794c56a7b30ca9d4fe225606566651bb12a2ecce8f60cbddb2809 (97ms)
I0319 00:00:01.910730       1 gather_workloads_info.go:387] No image sha256:188e4e2d697e2ca3c7c16772c0ab12253f00bd8433d8691ed7058fe7bafbbbf4 (102ms)
I0319 00:00:02.009501       1 gather_workloads_info.go:387] No image sha256:db40a3d4e50016c645fdb4a1f389dfcdbc9febc10c174816d681abe5c14153cd (99ms)
I0319 00:00:02.108221       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms)
I0319 00:00:02.208002       1 gather_workloads_info.go:387] No image sha256:f9b87244518245c63d1982182abe22775a2e207511cb328bc5c7b48e435b8da7 (100ms)
I0319 00:00:02.308040       1 gather_workloads_info.go:387] No image sha256:04c7a2673571e9069c934d86b4308c0f57b2715b45db500837b7708ae1f20ae7 (100ms)
I0319 00:00:02.408470       1 gather_workloads_info.go:387] No image sha256:1aabd00f813e1afccdab16a845e6346288f5cf7e320fa5bb97c683702191c575 (100ms)
I0319 00:00:02.508049       1 gather_workloads_info.go:387] No image sha256:bd202c6a40d89b2766a77a53ab1d84feb452d9f5d01066e3b7318ed2a13f8d54 (100ms)
I0319 00:00:02.607448       1 gather_workloads_info.go:387] No image sha256:7ea1ff613255c1ee67b34ec82b68ec6f5a4a6d283620a8e0ad142d4a31eb9211 (99ms)
I0319 00:00:02.707528       1 gather_workloads_info.go:387] No image sha256:60648d27017709a420e43353f9a83d7c466017b3b771200672a4dbc3c3f7a3ae (100ms)
I0319 00:00:02.808490       1 gather_workloads_info.go:387] No image sha256:c85dd52f4140690eef0d762834ab8b9af2faedbbd3bd9dd5616d4cd0bebd4740 (101ms)
I0319 00:00:02.907920       1 gather_workloads_info.go:387] No image sha256:3e262d5207d5e2077e4a14f4fbddc70d4d2651dbaaf955147013feb58a18cddd (99ms)
I0319 00:00:03.008150       1 gather_workloads_info.go:387] No image sha256:b2d76c5a5fca4f9ef200178f0c8d63557a6b351fd55f4be46ca1793de5a83400 (100ms)
I0319 00:00:03.107377       1 gather_workloads_info.go:387] No image sha256:0c90ca6acbe2f4fdbd253ae22f5b3286247c6940321f7d2b9801aea21ef5269f (99ms)
I0319 00:00:03.107412       1 tasks_processing.go:74] worker 1 stopped.
E0319 00:00:03.107422       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0319 00:00:03.107710       1 recorder.go:75] Recording config/workload_info with fingerprint=bdb20bbddc252f93a07ec86b22f7b3620621bdeb7796e92b7810424e60196970
I0319 00:00:03.107728       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.536540136s to process 1 records
E0319 00:00:03.107754       1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.536s with: function \"workload_info\" failed with an error"
I0319 00:00:03.108862       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0319 00:00:03.108876       1 periodic.go:216] Running conditional gatherer
I0319 00:00:03.113968       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules
I0319 00:00:03.121200       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:49035->172.30.0.10:53: read: connection refused
E0319 00:00:03.121559       1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0319 00:00:03.121619       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0319 00:00:03.126719       1 conditional_gatherer.go:392] cluster version is '4.21.5'
E0319 00:00:03.126733       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126738       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126742       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126745       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126747       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126750       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126755       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126758       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0319 00:00:03.126761       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0319 00:00:03.126783       1 tasks_processing.go:45] number of workers: 3
I0319 00:00:03.126802       1 tasks_processing.go:69] worker 2 listening for tasks.
I0319 00:00:03.126806       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0319 00:00:03.126806       1 tasks_processing.go:69] worker 0 listening for tasks.
I0319 00:00:03.126816       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0319 00:00:03.126821       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0319 00:00:03.126820       1 tasks_processing.go:69] worker 1 listening for tasks.
I0319 00:00:03.126831       1 tasks_processing.go:74] worker 1 stopped.
I0319 00:00:03.126893       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0319 00:00:03.126907       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.296µs to process 1 records
I0319 00:00:03.126948       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0319 00:00:03.126956       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.207µs to process 1 records
I0319 00:00:03.126962       1 tasks_processing.go:74] worker 0 stopped.
I0319 00:00:03.127048       1 tasks_processing.go:74] worker 2 stopped.
I0319 00:00:03.127060       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 222.411µs to process 0 records
I0319 00:00:03.127080       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:49035->172.30.0.10:53: read: connection refused
I0319 00:00:03.127098       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0319 00:00:03.147680       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=b6d7801825d4fe2feb7d4418a1583405c5860fa617dc1aa62d827a971f660f19
I0319 00:00:03.147819       1 diskrecorder.go:70] Writing 106 records to /var/lib/insights-operator/insights-2026-03-19-000003.tar.gz
I0319 00:00:03.154620       1 diskrecorder.go:51] Wrote 106 records to disk in 6ms
I0319 00:00:03.154656       1 periodic.go:285] Gathering cluster info every 2h0m0s
I0319 00:00:03.154672       1 periodic.go:286] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0319 00:00:21.543194       1 configmapobserver.go:84] configmaps "insights-config" not found
I0319 00:00:21.746102       1 configmapobserver.go:84] configmaps "insights-config" not found
I0319 00:00:33.908526       1 configmapobserver.go:84] configmaps "insights-config" not found
I0319 00:01:06.943509       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="9bdb1e4e577246e94c8d9bc7466ea98135e3c6873512a29bc01ba06c3779c966")
W0319 00:01:06.943553       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created