W0512 06:07:15.566571 1 cmd.go:257] Using insecure, self-signed certificates I0512 06:07:16.262020 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:16.262334 1 observer_polling.go:159] Starting file observer I0512 06:07:17.009435 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0512 06:07:17.009669 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0512 06:07:17.010187 1 secure_serving.go:57] Forcing use of http/1.1 only W0512 06:07:17.010208 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0512 06:07:17.010215 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0512 06:07:17.010219 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0512 06:07:17.010223 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0512 06:07:17.010225 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0512 06:07:17.010228 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0512 06:07:17.010232 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0512 06:07:17.018959 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0512 06:07:17.018993 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"8d7eecdd-4f84-4610-adf4-cd9e1fe7a1e2", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0512 06:07:17.025645 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0512 06:07:17.025659 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0512 06:07:17.025677 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0512 06:07:17.025679 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0512 06:07:17.025697 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0512 06:07:17.025703 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0512 06:07:17.026003 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4063652235/tls.crt::/tmp/serving-cert-4063652235/tls.key" I0512 06:07:17.026213 1 secure_serving.go:213] Serving securely on [::]:8443 I0512 06:07:17.026250 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0512 06:07:17.039921 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0512 06:07:17.039947 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0512 06:07:17.040012 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0512 06:07:17.065285 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0512 06:07:17.065318 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0512 06:07:17.081773 1 secretconfigobserver.go:119] support secret does not exist I0512 06:07:17.099552 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0512 06:07:17.107456 1 secretconfigobserver.go:119] support secret does not exist I0512 06:07:17.109874 1 recorder.go:176] Pruning old reports every 4h23m42s, max age is 288h0m0s I0512 06:07:17.120445 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0512 06:07:17.120450 1 periodic.go:216] Running clusterconfig gatherer I0512 06:07:17.120463 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0512 06:07:17.120497 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0512 06:07:17.120498 1 tasks_processing.go:45] number of workers: 64 I0512 06:07:17.120502 1 insightsreport.go:296] Starting report retriever I0512 06:07:17.120508 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0512 06:07:17.120521 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 06:07:17.120531 1 tasks_processing.go:69] worker 3 listening for tasks. I0512 06:07:17.120534 1 tasks_processing.go:69] worker 2 listening for tasks. I0512 06:07:17.120528 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 06:07:17.120541 1 tasks_processing.go:69] worker 4 listening for tasks. I0512 06:07:17.120545 1 tasks_processing.go:69] worker 18 listening for tasks. I0512 06:07:17.120543 1 tasks_processing.go:69] worker 5 listening for tasks. I0512 06:07:17.120571 1 tasks_processing.go:69] worker 28 listening for tasks. I0512 06:07:17.120593 1 tasks_processing.go:69] worker 19 listening for tasks. I0512 06:07:17.120596 1 tasks_processing.go:69] worker 54 listening for tasks. I0512 06:07:17.120588 1 tasks_processing.go:69] worker 45 listening for tasks. I0512 06:07:17.120596 1 tasks_processing.go:69] worker 36 listening for tasks. I0512 06:07:17.120606 1 tasks_processing.go:71] worker 54 working on nodenetworkconfigurationpolicies task. I0512 06:07:17.120607 1 tasks_processing.go:69] worker 37 listening for tasks. I0512 06:07:17.120613 1 tasks_processing.go:71] worker 5 working on dvo_metrics task. I0512 06:07:17.120618 1 tasks_processing.go:69] worker 47 listening for tasks. I0512 06:07:17.120617 1 tasks_processing.go:69] worker 34 listening for tasks. I0512 06:07:17.120624 1 tasks_processing.go:69] worker 38 listening for tasks. I0512 06:07:17.120626 1 tasks_processing.go:69] worker 48 listening for tasks. I0512 06:07:17.120627 1 tasks_processing.go:69] worker 26 listening for tasks. I0512 06:07:17.120630 1 tasks_processing.go:69] worker 35 listening for tasks. I0512 06:07:17.120611 1 tasks_processing.go:69] worker 21 listening for tasks. I0512 06:07:17.120638 1 tasks_processing.go:69] worker 49 listening for tasks. I0512 06:07:17.120610 1 tasks_processing.go:69] worker 33 listening for tasks. I0512 06:07:17.120639 1 tasks_processing.go:69] worker 27 listening for tasks. I0512 06:07:17.120643 1 tasks_processing.go:69] worker 8 listening for tasks. I0512 06:07:17.120643 1 tasks_processing.go:69] worker 30 listening for tasks. I0512 06:07:17.120651 1 tasks_processing.go:69] worker 52 listening for tasks. I0512 06:07:17.120645 1 tasks_processing.go:69] worker 25 listening for tasks. I0512 06:07:17.120659 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I0512 06:07:17.120660 1 tasks_processing.go:69] worker 42 listening for tasks. I0512 06:07:17.120661 1 tasks_processing.go:71] worker 45 working on machines task. I0512 06:07:17.120669 1 tasks_processing.go:69] worker 24 listening for tasks. I0512 06:07:17.120667 1 tasks_processing.go:69] worker 23 listening for tasks. I0512 06:07:17.120674 1 tasks_processing.go:71] worker 18 working on cluster_apiserver task. I0512 06:07:17.120670 1 tasks_processing.go:69] worker 31 listening for tasks. I0512 06:07:17.120680 1 tasks_processing.go:69] worker 51 listening for tasks. I0512 06:07:17.120686 1 tasks_processing.go:71] worker 23 working on machine_configs task. I0512 06:07:17.120688 1 tasks_processing.go:69] worker 13 listening for tasks. I0512 06:07:17.120689 1 tasks_processing.go:71] worker 31 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0512 06:07:17.120686 1 tasks_processing.go:69] worker 16 listening for tasks. I0512 06:07:17.120694 1 tasks_processing.go:71] worker 24 working on mutating_webhook_configurations task. I0512 06:07:17.120703 1 tasks_processing.go:71] worker 2 working on clusterroles task. I0512 06:07:17.120704 1 tasks_processing.go:69] worker 43 listening for tasks. I0512 06:07:17.120708 1 tasks_processing.go:71] worker 1 working on openstack_controlplanes task. I0512 06:07:17.120644 1 tasks_processing.go:69] worker 40 listening for tasks. I0512 06:07:17.120707 1 tasks_processing.go:69] worker 62 listening for tasks. I0512 06:07:17.120718 1 tasks_processing.go:69] worker 58 listening for tasks. I0512 06:07:17.120703 1 tasks_processing.go:71] worker 28 working on container_runtime_configs task. I0512 06:07:17.120724 1 tasks_processing.go:71] worker 47 working on ceph_cluster task. I0512 06:07:17.120733 1 tasks_processing.go:69] worker 60 listening for tasks. I0512 06:07:17.120742 1 tasks_processing.go:69] worker 61 listening for tasks. I0512 06:07:17.120749 1 tasks_processing.go:71] worker 33 working on openstack_dataplanenodesets task. I0512 06:07:17.120687 1 tasks_processing.go:71] worker 42 working on monitoring_persistent_volumes task. I0512 06:07:17.120619 1 tasks_processing.go:69] worker 32 listening for tasks. I0512 06:07:17.120633 1 tasks_processing.go:69] worker 7 listening for tasks. I0512 06:07:17.120635 1 tasks_processing.go:69] worker 29 listening for tasks. I0512 06:07:17.120637 1 tasks_processing.go:69] worker 39 listening for tasks. I0512 06:07:17.120646 1 tasks_processing.go:69] worker 50 listening for tasks. I0512 06:07:17.120653 1 tasks_processing.go:69] worker 9 listening for tasks. I0512 06:07:17.120654 1 tasks_processing.go:69] worker 41 listening for tasks. I0512 06:07:17.120657 1 tasks_processing.go:71] worker 30 working on validating_webhook_configurations task. I0512 06:07:17.120856 1 tasks_processing.go:71] worker 27 working on support_secret task. I0512 06:07:17.120934 1 tasks_processing.go:71] worker 19 working on image_pruners task. I0512 06:07:17.120603 1 tasks_processing.go:69] worker 20 listening for tasks. I0512 06:07:17.120659 1 tasks_processing.go:69] worker 10 listening for tasks. I0512 06:07:17.120666 1 tasks_processing.go:69] worker 14 listening for tasks. I0512 06:07:17.120665 1 tasks_processing.go:71] worker 36 working on aggregated_monitoring_cr_names task. I0512 06:07:17.121235 1 tasks_processing.go:71] worker 38 working on proxies task. I0512 06:07:17.120626 1 tasks_processing.go:69] worker 6 listening for tasks. I0512 06:07:17.120670 1 tasks_processing.go:71] worker 37 working on version task. I0512 06:07:17.121405 1 tasks_processing.go:69] worker 44 listening for tasks. I0512 06:07:17.121419 1 tasks_processing.go:71] worker 44 working on qemu_kubevirt_launcher_logs task. I0512 06:07:17.121638 1 tasks_processing.go:71] worker 21 working on service_accounts task. I0512 06:07:17.121653 1 tasks_processing.go:71] worker 0 working on node_features task. I0512 06:07:17.121661 1 tasks_processing.go:71] worker 3 working on operators_pods_and_events task. I0512 06:07:17.121695 1 tasks_processing.go:71] worker 34 working on crds task. I0512 06:07:17.121751 1 tasks_processing.go:71] worker 49 working on feature_gates task. I0512 06:07:17.121798 1 tasks_processing.go:71] worker 50 working on install_plans task. I0512 06:07:17.121813 1 tasks_processing.go:71] worker 4 working on storage_classes task. I0512 06:07:17.121819 1 tasks_processing.go:69] worker 55 listening for tasks. I0512 06:07:17.121829 1 tasks_processing.go:71] worker 55 working on operators task. I0512 06:07:17.120673 1 tasks_processing.go:69] worker 11 listening for tasks. I0512 06:07:17.120726 1 tasks_processing.go:69] worker 59 listening for tasks. I0512 06:07:17.121702 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0512 06:07:17.121975 1 tasks_processing.go:71] worker 59 working on machine_sets task. I0512 06:07:17.122073 1 tasks_processing.go:69] worker 56 listening for tasks. I0512 06:07:17.122075 1 tasks_processing.go:71] worker 11 working on machine_healthchecks task. I0512 06:07:17.122086 1 tasks_processing.go:71] worker 56 working on active_alerts task. I0512 06:07:17.120667 1 tasks_processing.go:69] worker 15 listening for tasks. I0512 06:07:17.120674 1 tasks_processing.go:69] worker 17 listening for tasks. I0512 06:07:17.120693 1 tasks_processing.go:71] worker 25 working on pdbs task. W0512 06:07:17.122113 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:17.122132 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 30.9µs to process 0 records I0512 06:07:17.122142 1 tasks_processing.go:71] worker 56 working on metrics task. I0512 06:07:17.122153 1 tasks_processing.go:71] worker 15 working on infrastructures task. I0512 06:07:17.122173 1 tasks_processing.go:71] worker 17 working on lokistack task. W0512 06:07:17.122229 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:17.122242 1 tasks_processing.go:71] worker 56 working on machine_autoscalers task. I0512 06:07:17.120680 1 tasks_processing.go:69] worker 12 listening for tasks. I0512 06:07:17.120720 1 tasks_processing.go:71] worker 35 working on container_images task. I0512 06:07:17.122259 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 94.107µs to process 0 records W0512 06:07:17.120702 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:17.121715 1 tasks_processing.go:71] worker 32 working on oauths task. I0512 06:07:17.122463 1 tasks_processing.go:71] worker 52 working on storage_cluster task. I0512 06:07:17.121409 1 tasks_processing.go:71] worker 6 working on openshift_logging task. I0512 06:07:17.120613 1 tasks_processing.go:69] worker 46 listening for tasks. I0512 06:07:17.121721 1 tasks_processing.go:71] worker 13 working on config_maps task. I0512 06:07:17.121718 1 tasks_processing.go:71] worker 51 working on jaegers task. I0512 06:07:17.121724 1 tasks_processing.go:71] worker 16 working on sap_pods task. I0512 06:07:17.121727 1 tasks_processing.go:71] worker 43 working on sap_datahubs task. I0512 06:07:17.121730 1 tasks_processing.go:71] worker 40 working on sap_config task. I0512 06:07:17.121733 1 tasks_processing.go:71] worker 62 working on tsdb_status task. I0512 06:07:17.121740 1 tasks_processing.go:71] worker 58 working on ingress task. I0512 06:07:17.121735 1 tasks_processing.go:71] worker 8 working on openstack_version task. I0512 06:07:17.121746 1 tasks_processing.go:71] worker 61 working on image task. I0512 06:07:17.121731 1 tasks_processing.go:69] worker 63 listening for tasks. I0512 06:07:17.123124 1 tasks_processing.go:71] worker 63 working on machine_config_pools task. I0512 06:07:17.121764 1 tasks_processing.go:69] worker 57 listening for tasks. I0512 06:07:17.121779 1 tasks_processing.go:71] worker 9 working on ingress_certificates task. I0512 06:07:17.123157 1 tasks_processing.go:71] worker 57 working on node_logs task. I0512 06:07:17.121784 1 tasks_processing.go:71] worker 7 working on authentication task. I0512 06:07:17.121788 1 tasks_processing.go:71] worker 29 working on pod_network_connectivity_checks task. I0512 06:07:17.121791 1 tasks_processing.go:71] worker 41 working on schedulers task. I0512 06:07:17.121794 1 tasks_processing.go:71] worker 39 working on nodes task. I0512 06:07:17.121797 1 tasks_processing.go:71] worker 20 working on nodenetworkstates task. I0512 06:07:17.121802 1 tasks_processing.go:71] worker 10 working on cost_management_metrics_configs task. I0512 06:07:17.121807 1 tasks_processing.go:71] worker 14 working on openstack_dataplanedeployments task. I0512 06:07:17.120653 1 tasks_processing.go:69] worker 53 listening for tasks. I0512 06:07:17.120620 1 tasks_processing.go:69] worker 22 listening for tasks. I0512 06:07:17.123611 1 tasks_processing.go:71] worker 53 working on olm_operators task. I0512 06:07:17.121709 1 tasks_processing.go:71] worker 26 working on certificate_signing_requests task. I0512 06:07:17.122329 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.621036ms to process 0 records I0512 06:07:17.122507 1 tasks_processing.go:71] worker 12 working on image_registries task. I0512 06:07:17.122591 1 tasks_processing.go:71] worker 46 working on networks task. W0512 06:07:17.122852 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:17.124109 1 tasks_processing.go:74] worker 22 stopped. I0512 06:07:17.121743 1 tasks_processing.go:71] worker 60 working on openshift_machine_api_events task. I0512 06:07:17.124202 1 tasks_processing.go:74] worker 62 stopped. I0512 06:07:17.124218 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.278734ms to process 0 records I0512 06:07:17.125161 1 tasks_processing.go:74] worker 45 stopped. E0512 06:07:17.125175 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0512 06:07:17.125183 1 gather.go:177] gatherer "clusterconfig" function "machines" took 4.484304ms to process 0 records I0512 06:07:17.125697 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0512 06:07:17.125782 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0512 06:07:17.125785 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0512 06:07:17.127365 1 tasks_processing.go:74] worker 1 stopped. I0512 06:07:17.127377 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 6.648411ms to process 0 records I0512 06:07:17.127387 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.759583ms to process 0 records I0512 06:07:17.127393 1 tasks_processing.go:74] worker 54 stopped. I0512 06:07:17.128079 1 tasks_processing.go:74] worker 33 stopped. I0512 06:07:17.128091 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 7.318335ms to process 0 records I0512 06:07:17.128250 1 tasks_processing.go:74] worker 47 stopped. I0512 06:07:17.128260 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 7.514546ms to process 0 records I0512 06:07:17.130323 1 tasks_processing.go:74] worker 59 stopped. I0512 06:07:17.130336 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 8.309299ms to process 0 records I0512 06:07:17.130494 1 tasks_processing.go:74] worker 11 stopped. E0512 06:07:17.130508 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0512 06:07:17.130519 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 8.398755ms to process 0 records I0512 06:07:17.130691 1 tasks_processing.go:74] worker 19 stopped. I0512 06:07:17.130922 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=5e3b755226797a1f42482ad6f9f0facf3c1097bc56ebfe06e564f4051d2b413d I0512 06:07:17.130937 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 9.624405ms to process 1 records I0512 06:07:17.131136 1 tasks_processing.go:74] worker 18 stopped. I0512 06:07:17.131231 1 recorder.go:75] Recording config/apiserver with fingerprint=a901710606207239393c4bd44064e5b2dab706164aaef2bc4e96fde974c88f2f I0512 06:07:17.131241 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 10.448842ms to process 1 records I0512 06:07:17.134420 1 tasks_processing.go:74] worker 27 stopped. E0512 06:07:17.134436 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0512 06:07:17.134446 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 13.548917ms to process 0 records I0512 06:07:17.136657 1 tasks_processing.go:74] worker 56 stopped. I0512 06:07:17.136669 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 14.405183ms to process 0 records I0512 06:07:17.136812 1 tasks_processing.go:74] worker 51 stopped. I0512 06:07:17.136821 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 14.206605ms to process 0 records I0512 06:07:17.136828 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 14.624893ms to process 0 records I0512 06:07:17.136832 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 14.255046ms to process 0 records I0512 06:07:17.136837 1 tasks_processing.go:74] worker 52 stopped. I0512 06:07:17.136840 1 tasks_processing.go:74] worker 17 stopped. I0512 06:07:17.140672 1 base_controller.go:82] Caches are synced for ConfigController I0512 06:07:17.140683 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0512 06:07:17.146501 1 tasks_processing.go:74] worker 16 stopped. I0512 06:07:17.146516 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 23.827298ms to process 0 records I0512 06:07:17.146528 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 23.3724ms to process 0 records I0512 06:07:17.146534 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 23.579772ms to process 0 records I0512 06:07:17.146541 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 23.777773ms to process 0 records I0512 06:07:17.146549 1 tasks_processing.go:74] worker 43 stopped. I0512 06:07:17.146552 1 tasks_processing.go:74] worker 8 stopped. I0512 06:07:17.146559 1 tasks_processing.go:74] worker 63 stopped. I0512 06:07:17.146599 1 tasks_processing.go:74] worker 6 stopped. I0512 06:07:17.146612 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 24.035784ms to process 0 records I0512 06:07:17.146665 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0512 06:07:17.146681 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0512 06:07:17.146685 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0512 06:07:17.146688 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0512 06:07:17.146702 1 controller.go:531] The operator is still being initialized I0512 06:07:17.146710 1 controller.go:554] The operator is healthy I0512 06:07:17.146728 1 tasks_processing.go:74] worker 20 stopped. I0512 06:07:17.146739 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.295508ms to process 0 records I0512 06:07:17.146745 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.286152ms to process 0 records I0512 06:07:17.146752 1 tasks_processing.go:74] worker 10 stopped. I0512 06:07:17.146874 1 tasks_processing.go:74] worker 38 stopped. I0512 06:07:17.146966 1 recorder.go:75] Recording config/proxy with fingerprint=c2190ead777eff22329569093a546edd8fb3986b7b3ea408118e41df0f7aef0e I0512 06:07:17.146989 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 25.62975ms to process 1 records I0512 06:07:17.163675 1 tasks_processing.go:74] worker 42 stopped. I0512 06:07:17.163696 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 42.903578ms to process 0 records I0512 06:07:17.164044 1 tasks_processing.go:74] worker 29 stopped. E0512 06:07:17.164056 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0512 06:07:17.164063 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 40.776414ms to process 0 records I0512 06:07:17.164071 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 43.321172ms to process 0 records I0512 06:07:17.164075 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 40.565458ms to process 0 records I0512 06:07:17.164080 1 tasks_processing.go:74] worker 14 stopped. I0512 06:07:17.164083 1 tasks_processing.go:74] worker 28 stopped. E0512 06:07:17.164090 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0512 06:07:17.164101 1 tasks_processing.go:74] worker 0 stopped. I0512 06:07:17.164112 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 42.431638ms to process 0 records I0512 06:07:17.164274 1 tasks_processing.go:74] worker 30 stopped. I0512 06:07:17.164508 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=99b707c60118a540533c7413c101b7159567533a162415a5a82bbce6588bfd2b I0512 06:07:17.164610 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=eaa1850665cc3a77e96885f3c7c9cc7fdc07af2fa9727394cb2319d614586f5b I0512 06:07:17.164634 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e0b705ee8385432f67b72e321dd630e61f041d81c42384da0a7771cfd2da928a I0512 06:07:17.164674 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=01ae63f6fd4008d67ce0a53c5f76757a80d2a682f576336432c7a8a471fab5d9 I0512 06:07:17.164727 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7d086a533463126c2862dd2701612a10219b2613a442907dc23ff07497f53752 I0512 06:07:17.164770 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=d258d09d14a331c1dcec7a05de7f38e4968f220ce80ee36968cfb4f2a0af0ed8 I0512 06:07:17.164840 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c9812902ed4f9d7c8f6083f417da082baac4b7b33850463a71f6dc5f4b33c3bd I0512 06:07:17.164909 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=66c370ad2e87c3cd4aa0588fe1e072a3992fa4eb8d61e1f6494744089c7240de I0512 06:07:17.164953 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d1e08bf670bfa34231c03ec7231cf7d9ad6635148c3c2ac64e38397e252850be I0512 06:07:17.165009 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f279d8460544c5914f7c3340313937f50dbc81c273ae72a2a81aa0a50bf15f13 I0512 06:07:17.165058 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=91110d0b0ba312c5029b9bbab4ae225ccadd715695d02960e3e60644e578a770 I0512 06:07:17.165072 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 43.469572ms to process 11 records I0512 06:07:17.165161 1 tasks_processing.go:74] worker 49 stopped. I0512 06:07:17.165246 1 recorder.go:75] Recording config/featuregate with fingerprint=eb063c7ababf54528021f747335d7ca0aab59aac9f40956c99de0c5652a787b0 I0512 06:07:17.165262 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 42.665168ms to process 1 records I0512 06:07:17.165364 1 tasks_processing.go:74] worker 4 stopped. I0512 06:07:17.165365 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=9e151c5928cb0ebeff483a03d26dab0ae170607186ccf9beb1068cbe54c38fdc I0512 06:07:17.165393 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=653d20820322a55c4d00e11b55633647554be374d1f775cdb6038c3191506c1d I0512 06:07:17.165400 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 43.20138ms to process 2 records I0512 06:07:17.166046 1 tasks_processing.go:74] worker 15 stopped. I0512 06:07:17.166817 1 recorder.go:75] Recording config/infrastructure with fingerprint=def7ca108f7607d620b3dd5f1e111a479a208548af8923d7e9525bea0ae85c4c I0512 06:07:17.166838 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 43.870116ms to process 1 records I0512 06:07:17.166888 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=538a3ba2b855df8544f78102a17f81d0b41b65f2f4b551cc84526735e80d87b0 I0512 06:07:17.166899 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 43.338204ms to process 1 records I0512 06:07:17.166924 1 tasks_processing.go:74] worker 41 stopped. I0512 06:07:17.166992 1 tasks_processing.go:74] worker 58 stopped. I0512 06:07:17.167002 1 recorder.go:75] Recording config/ingress with fingerprint=ebe94be054d6d316077a89d024ef6ba0be423255c1f8014c75e1f39af713a9c0 I0512 06:07:17.167009 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 43.876785ms to process 1 records I0512 06:07:17.167023 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 43.823155ms to process 0 records I0512 06:07:17.167030 1 tasks_processing.go:74] worker 57 stopped. I0512 06:07:17.167187 1 tasks_processing.go:74] worker 61 stopped. I0512 06:07:17.167263 1 recorder.go:75] Recording config/image with fingerprint=7fbc273dbb0f821a1f1ba5e10a0a1f467c10bfad97e60b6e721623b2710397b6 I0512 06:07:17.167276 1 gather.go:177] gatherer "clusterconfig" function "image" took 44.217548ms to process 1 records I0512 06:07:17.167320 1 tasks_processing.go:74] worker 7 stopped. I0512 06:07:17.167469 1 recorder.go:75] Recording config/authentication with fingerprint=8589d42233cebb1e340eadbd976b30f2efa11b851930f11837667f3edcff0136 I0512 06:07:17.167482 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 44.139355ms to process 1 records I0512 06:07:17.167572 1 tasks_processing.go:74] worker 32 stopped. I0512 06:07:17.167653 1 recorder.go:75] Recording config/oauth with fingerprint=6bd238eef1c8a5a9316d2a52e524383866a0b6c68ca5be13d33f6a5ef4153f2e I0512 06:07:17.167662 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 45.028691ms to process 1 records I0512 06:07:17.167668 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 44.85028ms to process 0 records I0512 06:07:17.167679 1 tasks_processing.go:74] worker 40 stopped. I0512 06:07:17.170775 1 tasks_processing.go:74] worker 24 stopped. I0512 06:07:17.170935 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=cc119a5701cfa343c63df24b954ec78ded7bbecbed019fb03076f439f442af7c I0512 06:07:17.171012 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=2f55a1d0486d57c9f7f5217d461016b7c5116946e3778cb6315d27b30c2b0f28 I0512 06:07:17.171070 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ca55e272e8f46618c110c249f7328057f192eba0b02bfb0cb536e366a6efbdb6 I0512 06:07:17.171080 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 50.067281ms to process 3 records I0512 06:07:17.171102 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0512 06:07:17.171109 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 49.018499ms to process 1 records I0512 06:07:17.171116 1 tasks_processing.go:74] worker 48 stopped. W0512 06:07:17.174209 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 06:07:17.175372 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 06:07:17.177369 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0512 06:07:17.177434 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0512 06:07:17.177555 1 operator.go:328] started I0512 06:07:17.177583 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0512 06:07:17.181118 1 gather_logs.go:145] no pods in namespace were found I0512 06:07:17.181138 1 tasks_processing.go:74] worker 44 stopped. I0512 06:07:17.181147 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 59.707334ms to process 0 records I0512 06:07:17.185161 1 tasks_processing.go:74] worker 2 stopped. I0512 06:07:17.185374 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=9884bffda5dea5c6d600e60811f38bf8be4e21647ecbf202c53e1b2fc2ae0cdd I0512 06:07:17.185470 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7b4beaac52dc7595170220f4287f9bf1cc5ac7207241265d179c7585bcc7af42 I0512 06:07:17.185486 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 64.445481ms to process 2 records I0512 06:07:17.185500 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.036604ms to process 0 records I0512 06:07:17.185506 1 tasks_processing.go:74] worker 36 stopped. I0512 06:07:17.188640 1 tasks_processing.go:74] worker 35 stopped. I0512 06:07:17.190071 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-pvsbz with fingerprint=980e10aa5c11c05e7292d3af6f0f143d1027c752794e13ea5169e50718553cdb I0512 06:07:17.190137 1 recorder.go:75] Recording config/running_containers with fingerprint=0952b523774e8f61482aadd283cc21667069c52d923b1b7772c851c864126610 I0512 06:07:17.190147 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 66.379244ms to process 2 records E0512 06:07:17.190159 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0512 06:07:17.190175 1 tasks_processing.go:74] worker 23 stopped. I0512 06:07:17.190195 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0512 06:07:17.190202 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 68.664538ms to process 1 records I0512 06:07:17.190213 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 69.226629ms to process 0 records I0512 06:07:17.190219 1 tasks_processing.go:74] worker 31 stopped. I0512 06:07:17.190352 1 tasks_processing.go:74] worker 60 stopped. I0512 06:07:17.190365 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 66.214056ms to process 0 records I0512 06:07:17.192232 1 tasks_processing.go:74] worker 25 stopped. I0512 06:07:17.192340 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5cc473a17c82595041070ad79e4db85c9cd8834e4bd49b6e2839e31f6c75ad95 I0512 06:07:17.192364 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=a1f60b4d103aaf0ea72dd8a6c98d24408b302d38c943c3d36bc57664d176a612 I0512 06:07:17.192382 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4afd6d3f177eeecaeffe1656c41afbbc246231ea21d2af1fe05c6b122f476fb4 I0512 06:07:17.192388 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 70.112772ms to process 3 records I0512 06:07:17.197962 1 tasks_processing.go:74] worker 53 stopped. I0512 06:07:17.198022 1 recorder.go:75] Recording config/olm_operators with fingerprint=b5d5408325b774baa9e01e0bba5b4754dc522406f7efc83c3bc9b7e81dd682aa I0512 06:07:17.198033 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 74.336816ms to process 1 records I0512 06:07:17.202716 1 tasks_processing.go:74] worker 12 stopped. I0512 06:07:17.203016 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=43ed5599891510e5524430ab687317da6b6e675ba90a8b3b27a176e101885b1b I0512 06:07:17.203031 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 78.762083ms to process 1 records I0512 06:07:17.204346 1 prometheus_rules.go:88] Prometheus rules successfully created I0512 06:07:17.204462 1 tasks_processing.go:74] worker 34 stopped. I0512 06:07:17.204902 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b8649c86d1ae64fdc1bd90aaede4661fade46e035c5435071929c83f8d1fb830 I0512 06:07:17.205088 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=3cd36cf0b9fcdbb43e3f1dbbd5f5a1b2b6d8e70579bfa14c119760f990384399 I0512 06:07:17.205097 1 gather.go:177] gatherer "clusterconfig" function "crds" took 82.697179ms to process 2 records I0512 06:07:17.208900 1 tasks_processing.go:74] worker 46 stopped. I0512 06:07:17.209008 1 recorder.go:75] Recording config/network with fingerprint=957adfda2b4066df8b32b31341628c7d28649d9724639dd9492963afe58baa2d I0512 06:07:17.209020 1 gather.go:177] gatherer "clusterconfig" function "networks" took 84.911889ms to process 1 records I0512 06:07:17.209177 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0512 06:07:17.209189 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0512 06:07:17.209193 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0512 06:07:17.209196 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0512 06:07:17.209200 1 controller.go:254] Source scaController *sca.Controller is not ready I0512 06:07:17.209216 1 controller.go:531] The operator is still being initialized I0512 06:07:17.209224 1 controller.go:554] The operator is healthy I0512 06:07:17.211296 1 tasks_processing.go:74] worker 26 stopped. I0512 06:07:17.211330 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 87.667502ms to process 0 records E0512 06:07:17.216132 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277adc7012-f0ab-4fea-8e7f-37abdf3bf40f%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:33886->172.30.0.10:53: read: connection refused I0512 06:07:17.216144 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277adc7012-f0ab-4fea-8e7f-37abdf3bf40f%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:33886->172.30.0.10:53: read: connection refused I0512 06:07:17.230935 1 tasks_processing.go:74] worker 13 stopped. E0512 06:07:17.230950 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0512 06:07:17.230961 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0512 06:07:17.230966 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0512 06:07:17.230982 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0512 06:07:17.231021 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0512 06:07:17.231028 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0512 06:07:17.231032 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0512 06:07:17.231036 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0512 06:07:17.231082 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0512 06:07:17.231091 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0512 06:07:17.231096 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 108.383245ms to process 7 records I0512 06:07:17.253842 1 tasks_processing.go:74] worker 39 stopped. I0512 06:07:17.254132 1 recorder.go:75] Recording config/node/ip-10-0-0-49.ec2.internal with fingerprint=b22047b76171d9ddd2977567dc0de413ffd78ca4b767a61e2b537d9f85b01985 I0512 06:07:17.254189 1 recorder.go:75] Recording config/node/ip-10-0-1-78.ec2.internal with fingerprint=82839260d8118a9803db16c6405bfc4cbac7e59e521c6823c650341204075dfc I0512 06:07:17.254238 1 recorder.go:75] Recording config/node/ip-10-0-2-90.ec2.internal with fingerprint=514aa469b890c6ec0c618d5c7a037cb3dedce92891fb70bae65eb984502dc850 I0512 06:07:17.254255 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 130.418917ms to process 3 records I0512 06:07:17.264729 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0512 06:07:17.266609 1 tasks_processing.go:74] worker 37 stopped. I0512 06:07:17.266881 1 recorder.go:75] Recording config/version with fingerprint=87e27d57b135fa598e492c038ca8a74d10bd6b1805a4e71c56e8f8193698b477 I0512 06:07:17.266895 1 recorder.go:75] Recording config/id with fingerprint=e665c8d066c6bb46912f7ecab6b93c3f8060b4501662b5774ad62322b9dad841 I0512 06:07:17.266901 1 gather.go:177] gatherer "clusterconfig" function "version" took 145.199004ms to process 2 records W0512 06:07:17.268288 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:46722->172.30.0.10:53: read: connection refused I0512 06:07:17.268325 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:46722->172.30.0.10:53: read: connection refused I0512 06:07:17.278036 1 base_controller.go:82] Caches are synced for LoggingSyncer I0512 06:07:17.278050 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0512 06:07:17.303244 1 tasks_processing.go:74] worker 9 stopped. E0512 06:07:17.303264 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0512 06:07:17.303279 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q872io3uiq7esbm3hhjuvp7rk4i6vns-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q872io3uiq7esbm3hhjuvp7rk4i6vns-primary-cert-bundle-secret" not found I0512 06:07:17.303380 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=870553fa58287e22b4dd6023758a3a25b7ac4f4d7ab5f343e38ab71a0e9b8db8 I0512 06:07:17.303398 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 180.087395ms to process 1 records W0512 06:07:18.171657 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 06:07:18.377684 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0512 06:07:18.377700 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0512 06:07:18.378324 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-g7f2t pod in namespace openshift-dns (previous: false). I0512 06:07:18.601418 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-g7f2t pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-g7f2t\" is waiting to start: ContainerCreating" I0512 06:07:18.601440 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-g7f2t\" is waiting to start: ContainerCreating" I0512 06:07:18.601450 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-g7f2t pod in namespace openshift-dns (previous: false). I0512 06:07:18.605886 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0512 06:07:18.783959 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-g7f2t pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-g7f2t\" is waiting to start: ContainerCreating" I0512 06:07:18.783978 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-g7f2t\" is waiting to start: ContainerCreating" I0512 06:07:18.784011 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hh4fp pod in namespace openshift-dns (previous: false). I0512 06:07:19.009454 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hh4fp pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hh4fp\" is waiting to start: ContainerCreating" I0512 06:07:19.009476 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hh4fp\" is waiting to start: ContainerCreating" I0512 06:07:19.009482 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hh4fp pod in namespace openshift-dns (previous: false). W0512 06:07:19.171325 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 06:07:19.184440 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hh4fp pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hh4fp\" is waiting to start: ContainerCreating" I0512 06:07:19.184454 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hh4fp\" is waiting to start: ContainerCreating" I0512 06:07:19.184483 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-ktlgb pod in namespace openshift-dns (previous: false). I0512 06:07:19.208597 1 tasks_processing.go:74] worker 55 stopped. I0512 06:07:19.208657 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=50561c6cbd1224a909c1e922c6dc34dd380faf5769a233ddd0b95bd706e9c1a3 I0512 06:07:19.208714 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=45a0fbb95ce38c9ab0d748fe9c3609760b4eeb662972daab91954ddf8ae41577 I0512 06:07:19.208748 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0512 06:07:19.208781 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=774239be8bdd55832483e76e80b927e41e043f579fe204504748424cb316c034 I0512 06:07:19.208814 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0512 06:07:19.208842 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=b57e69cd1b7a7b21f4b1030678d5e1a6bc52978038b6b1749a9aeb278d75e09e I0512 06:07:19.208875 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=1e0ef326b33b9dca602b3e67a12d776019fbb1a0fb427d29a7bb2d41a6b61ba2 I0512 06:07:19.208899 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=d547351b850e632dc601ec5235461484811faac9608da3af02da521bcb4d5949 I0512 06:07:19.208915 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=44d04626ffd13a8e6c44676ff02247540cd34285783b3a52c7a57bdb2bb00e1b I0512 06:07:19.208940 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=58bd1589bb989818f92bf8273d8d2c215ddea8cf55329255a452db641844609b I0512 06:07:19.208952 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0512 06:07:19.208968 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=b565c49cbd3cec7372ec0ebbb5ebc1309188e0aaf78656fa5922774607acd001 I0512 06:07:19.208979 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0512 06:07:19.208995 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=094951cd1511529f73231598bf134b41a14fffbdcb0b6e419b2aa1887573c830 I0512 06:07:19.209010 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0512 06:07:19.209031 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=54a288432c383b99ecbbb16151733980c8b56d41dfa0beaedfb69c030df50958 I0512 06:07:19.209041 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0512 06:07:19.209056 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=9f6a5690e6ebcce203f577cdcb33756ddf6b026662316dfaabd3a0ad96fda0e9 I0512 06:07:19.209195 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=1fbc028d0a69c93127ff8ac1f9e1704784fa8b84852e37507e402b9bbeb7a021 I0512 06:07:19.209206 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0512 06:07:19.209212 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0512 06:07:19.209233 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0512 06:07:19.209264 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=648efdfd2c48d88ccf2a107506bed60f99828dbbe1e3291742181f51ef586619 I0512 06:07:19.209289 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=52a5c757a63ac1e321b82b08f9d570def0af3f59c9e537e207042da83401a82f I0512 06:07:19.209313 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0512 06:07:19.209338 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=341103723782fdf9958f1876e722a7778bc53fb1527670995cb558f14ca6f5a6 I0512 06:07:19.209348 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0512 06:07:19.209362 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=9c328baf4697011b1f2323c2261c98c7b82d47a6129770a9d30990de29d832f7 I0512 06:07:19.209377 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4069286668d249d82d304a6ef64abb49c899611120879a1e5ed74fe895649a39 I0512 06:07:19.209391 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=bc514b481b6a09cd990b8e1db140606b67b29e2da06eb5a3876e93ab24273712 I0512 06:07:19.209414 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=bd4fbd646bf49a7b4d14afdabcc9675b37dc77ddff74ce1792767aa878567c84 I0512 06:07:19.209439 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ea89a6f96f7a7d65336f3101bb82d63f38c42315db344c032bdaa538f50b9aae I0512 06:07:19.209448 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0512 06:07:19.209475 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=b3c7a9ccbbf9f02bc700ea8eb409873d10465a9dd4f3123164fdac534dcabc79 I0512 06:07:19.209499 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0512 06:07:19.209510 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0512 06:07:19.209517 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.086754422s to process 36 records I0512 06:07:19.410201 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ktlgb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-ktlgb\" is waiting to start: ContainerCreating" I0512 06:07:19.410221 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-ktlgb\" is waiting to start: ContainerCreating" I0512 06:07:19.410229 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-ktlgb pod in namespace openshift-dns (previous: false). I0512 06:07:19.607571 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ktlgb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-ktlgb\" is waiting to start: ContainerCreating" I0512 06:07:19.607591 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-ktlgb\" is waiting to start: ContainerCreating" I0512 06:07:19.607602 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-b5tm4 pod in namespace openshift-dns (previous: false). I0512 06:07:19.786121 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:19.786141 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-m5hr8 pod in namespace openshift-dns (previous: false). I0512 06:07:19.983835 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:19.983852 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-txt69 pod in namespace openshift-dns (previous: false). W0512 06:07:20.171932 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 06:07:20.184190 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:20.184241 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-585fb6b4b9-hhxxg pod in namespace openshift-image-registry (previous: false). I0512 06:07:20.387899 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-585fb6b4b9-hhxxg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-585fb6b4b9-hhxxg\" is waiting to start: ContainerCreating" I0512 06:07:20.387917 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-585fb6b4b9-hhxxg\" is waiting to start: ContainerCreating" I0512 06:07:20.387952 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-585fb6b4b9-zp8p5 pod in namespace openshift-image-registry (previous: false). I0512 06:07:20.584417 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-585fb6b4b9-zp8p5 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-585fb6b4b9-zp8p5\" is waiting to start: ContainerCreating" I0512 06:07:20.584435 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-585fb6b4b9-zp8p5\" is waiting to start: ContainerCreating" I0512 06:07:20.584483 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-77d8dfb878-chr4s pod in namespace openshift-image-registry (previous: false). I0512 06:07:20.784012 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-77d8dfb878-chr4s pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-77d8dfb878-chr4s\" is waiting to start: ContainerCreating" I0512 06:07:20.784031 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-77d8dfb878-chr4s\" is waiting to start: ContainerCreating" I0512 06:07:20.784041 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5v264 pod in namespace openshift-image-registry (previous: false). I0512 06:07:20.985189 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:20.985206 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-drhmk pod in namespace openshift-image-registry (previous: false). W0512 06:07:21.172097 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 06:07:21.183082 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:21.183096 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rkb4q pod in namespace openshift-image-registry (previous: false). I0512 06:07:21.383555 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 06:07:21.383576 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58558bbf97-7mnjq pod in namespace openshift-ingress (previous: false). I0512 06:07:21.583794 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58558bbf97-7mnjq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58558bbf97-7mnjq\" is waiting to start: ContainerCreating" I0512 06:07:21.583814 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58558bbf97-7mnjq\" is waiting to start: ContainerCreating" I0512 06:07:21.583828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58558bbf97-nv5p2 pod in namespace openshift-ingress (previous: false). I0512 06:07:21.783840 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58558bbf97-nv5p2 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58558bbf97-nv5p2\" is waiting to start: ContainerCreating" I0512 06:07:21.783858 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58558bbf97-nv5p2\" is waiting to start: ContainerCreating" I0512 06:07:21.783870 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7b4c79f6ff-kr7pt pod in namespace openshift-ingress (previous: false). I0512 06:07:21.986764 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7b4c79f6ff-kr7pt pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7b4c79f6ff-kr7pt\" is waiting to start: ContainerCreating" I0512 06:07:21.986781 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7b4c79f6ff-kr7pt\" is waiting to start: ContainerCreating" I0512 06:07:21.986790 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-9hwfm pod in namespace openshift-ingress-canary (previous: false). W0512 06:07:22.168718 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0512 06:07:22.168747 1 tasks_processing.go:74] worker 5 stopped. E0512 06:07:22.168759 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0512 06:07:22.168771 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0512 06:07:22.168786 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0512 06:07:22.168796 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.048118109s to process 1 records I0512 06:07:22.183783 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hnjzt pod in namespace openshift-ingress-canary (previous: false). I0512 06:07:22.384389 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xlb6d pod in namespace openshift-ingress-canary (previous: false). I0512 06:07:22.590280 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-jvhpn pod in namespace openshift-kube-storage-version-migrator (previous: false). I0512 06:07:22.790514 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-jvhpn pod in namespace openshift-kube-storage-version-migrator (previous: false). I0512 06:07:23.015559 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-zj6x5 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0512 06:07:23.185379 1 tasks_processing.go:74] worker 3 stopped. I0512 06:07:23.185523 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=ea240fc1d55d90a9e2184452d9754f6387587d368bdc7698b580715c8764399b I0512 06:07:23.185586 1 recorder.go:75] Recording events/openshift-dns with fingerprint=745c2b69a62fd8b8a4d408a202773e0eb6c35cb548930bcba6c03081aeab41c6 I0512 06:07:23.185745 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=6519dfd4ef0c179127605f700ca0fb0106978139a90c867c28c64ca77889a9f7 I0512 06:07:23.185789 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=96fd9656613c6f58f330dfcd2ce93660c5dda5db1d6311ef20f3039f6ba65f74 I0512 06:07:23.185848 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=1636870dc11e9ca96e1a7534afd7f6c38a88c3a32611f48e79180b71508b5dd9 I0512 06:07:23.185899 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=de9da471e9538928fe0a521b0b2569327217267227be0b499419ceff07d3b94a I0512 06:07:23.185923 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=b785a9dbf1ddbcd248bf08a2a9120e9023d5674c27370ec8c78824518b18fdd4 I0512 06:07:23.185983 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=0b163adb86e654ce47a5f54d2108574102fdf9f7a7e4d3f948cd86c8a5f4e6d1 I0512 06:07:23.186127 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-g7f2t with fingerprint=0f9c3e0852a14d57280b3f452e213e579ffa90c4a5681188c1ce99c7feff80ad I0512 06:07:23.186225 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-hh4fp with fingerprint=fdeae2cdb2e03f148ee52c3bfa75b4951c117a3f10157e90276899aa2696b651 I0512 06:07:23.186329 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-ktlgb with fingerprint=1c29ade104e24f21fbfb6974e3db249d48ff3a127a84329e4727476ea4ad1cfe I0512 06:07:23.186454 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-585fb6b4b9-hhxxg with fingerprint=7b8ec84e331509d3b5e249a85097577d296f0c3ccd1b11c53437516b81c42d77 I0512 06:07:23.186561 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-585fb6b4b9-zp8p5 with fingerprint=f77fad1723fa1d27fbce6e742c1e1edb8d74db95770f7c98d1bf5b8309de8dda I0512 06:07:23.186663 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-77d8dfb878-chr4s with fingerprint=fdb76c4ab558cfd0fdcaf51299acd6a0c2e298e62cebe31c9cfe0debc345e73a I0512 06:07:23.186676 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-9hwfm/serve-healthcheck-canary_current.log with fingerprint=43db73e9761e67f2ac78260f1bb6522ed883e38a0c1cbda1bc82f2d593d34531 I0512 06:07:23.186684 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-hnjzt/serve-healthcheck-canary_current.log with fingerprint=5a154b4bab20e516264e668fec07042486f08002e634345a0c93b4049ff563e7 I0512 06:07:23.186691 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-xlb6d/serve-healthcheck-canary_current.log with fingerprint=809a9cac692f18b2779c9026fb8de85f0834684a847be3d2195231b3de05f077 I0512 06:07:23.186712 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-jvhpn/migrator_current.log with fingerprint=c83e787bba3f5689bf11e4a82ad2291d4b052b9242c4f239b46b0e8614c477bf I0512 06:07:23.186721 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-jvhpn/graceful-termination_current.log with fingerprint=c610236ee5a4ea935ad79c9f553f0a80f07cfdf815d437979b841234122802e0 I0512 06:07:23.186801 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-zj6x5/kube-storage-version-migrator-operator_current.log with fingerprint=fae63ac9cc13e316fcbddd8c01db07af84700ae395c97d507ca0cfae65ef6b56 I0512 06:07:23.186816 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.063699355s to process 20 records I0512 06:07:29.906495 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 06:07:29.979506 1 tasks_processing.go:74] worker 50 stopped. I0512 06:07:29.979552 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0512 06:07:29.979570 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.857674472s to process 1 records I0512 06:07:30.729392 1 tasks_processing.go:74] worker 21 stopped. I0512 06:07:30.729667 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=abad430d926c1d3d5eed17564e2d611ee65b1314fbbacf28703295c7f6604dfb I0512 06:07:30.729685 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.607728098s to process 1 records E0512 06:07:30.729751 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0512 06:07:30.730861 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0512 06:07:30.730877 1 periodic.go:216] Running workloads gatherer I0512 06:07:30.730894 1 tasks_processing.go:45] number of workers: 2 I0512 06:07:30.730904 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 06:07:30.730908 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0512 06:07:30.730916 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 06:07:30.730991 1 tasks_processing.go:71] worker 0 working on workload_info task. I0512 06:07:30.756863 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0512 06:07:30.762745 1 tasks_processing.go:74] worker 1 stopped. I0512 06:07:30.762760 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 31.825732ms to process 0 records I0512 06:07:30.765480 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0512 06:07:30.773773 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (8ms) I0512 06:07:30.781804 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (8ms) I0512 06:07:30.789839 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (8ms) I0512 06:07:30.800274 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (10ms) I0512 06:07:30.811275 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (11ms) I0512 06:07:30.821453 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (10ms) I0512 06:07:30.829849 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (8ms) I0512 06:07:30.837973 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (8ms) I0512 06:07:30.846182 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (8ms) I0512 06:07:30.865487 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (19ms) I0512 06:07:30.966054 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (101ms) I0512 06:07:31.066626 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0512 06:07:31.168321 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (102ms) I0512 06:07:31.266454 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (98ms) I0512 06:07:31.367435 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms) I0512 06:07:31.467037 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0512 06:07:31.565758 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (99ms) I0512 06:07:31.665899 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (100ms) I0512 06:07:31.766173 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0512 06:07:31.865804 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0512 06:07:31.965960 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0512 06:07:32.004175 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 06:07:32.065599 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0512 06:07:32.165933 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0512 06:07:32.207629 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 06:07:32.265483 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0512 06:07:32.366296 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (101ms) I0512 06:07:32.465954 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0512 06:07:32.565410 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0512 06:07:32.666236 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (101ms) I0512 06:07:32.766502 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (100ms) I0512 06:07:32.865494 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (99ms) I0512 06:07:32.965805 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (100ms) I0512 06:07:33.066255 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0512 06:07:33.166907 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (101ms) I0512 06:07:33.267813 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (101ms) I0512 06:07:33.267846 1 tasks_processing.go:74] worker 0 stopped. E0512 06:07:33.267858 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0512 06:07:33.268108 1 recorder.go:75] Recording config/workload_info with fingerprint=bf45c840cc36a28831c32a8b64895460d2548e308bd3dd753fc316d71bfd6edb I0512 06:07:33.268144 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.536843338s to process 1 records E0512 06:07:33.268170 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.537s with: function \"workload_info\" failed with an error" I0512 06:07:33.269279 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0512 06:07:33.269293 1 periodic.go:216] Running conditional gatherer I0512 06:07:33.275338 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0512 06:07:33.282258 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:48453->172.30.0.10:53: read: connection refused E0512 06:07:33.282565 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 06:07:33.282621 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0512 06:07:33.288381 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0512 06:07:33.288394 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288399 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288402 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288406 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288409 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288412 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288415 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288418 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 06:07:33.288420 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0512 06:07:33.288434 1 tasks_processing.go:45] number of workers: 3 I0512 06:07:33.288440 1 tasks_processing.go:69] worker 2 listening for tasks. I0512 06:07:33.288445 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0512 06:07:33.288452 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 06:07:33.288464 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 06:07:33.288474 1 tasks_processing.go:74] worker 1 stopped. I0512 06:07:33.288471 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0512 06:07:33.288466 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0512 06:07:33.288524 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0512 06:07:33.288552 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 811ns to process 1 records I0512 06:07:33.288584 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0512 06:07:33.288595 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.055µs to process 1 records I0512 06:07:33.288600 1 tasks_processing.go:74] worker 0 stopped. I0512 06:07:33.288767 1 tasks_processing.go:74] worker 2 stopped. I0512 06:07:33.288786 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 281.367µs to process 0 records I0512 06:07:33.288813 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:48453->172.30.0.10:53: read: connection refused I0512 06:07:33.288832 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0512 06:07:33.311240 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=655d2eb850bebfa0024b90a55ba55cb7358cc45792c6401a486c5c09cfbb7c78 I0512 06:07:33.311381 1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-05-12-060733.tar.gz I0512 06:07:33.318982 1 diskrecorder.go:51] Wrote 116 records to disk in 7ms I0512 06:07:33.319228 1 periodic.go:285] Gathering cluster info every 2h0m0s I0512 06:07:33.319251 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0512 06:07:44.505745 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 06:08:26.263195 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="0d723512494e689805415ad1f9d74db27184d80c41a2a8cd40365084f933524e") W0512 06:08:26.263235 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0512 06:08:26.263279 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="16e622d5c8d5cd06781947dd5fd280ea4813ea054a9b1ea5677ee1650bb4cb0b") I0512 06:08:26.263321 1 base_controller.go:181] Shutting down ConfigController ... I0512 06:08:26.263328 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0512 06:08:26.263355 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0512 06:08:26.263359 1 periodic.go:177] Shutting down I0512 06:08:26.263373 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0512 06:08:26.263383 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="1e5496b69a5aa916e1246b6ce2b351c7729afcb59cb95d0b776580eb5d2cebfe") I0512 06:08:26.263407 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"