W0507 14:38:53.940126 1 cmd.go:257] Using insecure, self-signed certificates I0507 14:38:54.613939 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:38:54.614257 1 observer_polling.go:159] Starting file observer I0507 14:38:55.318938 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 14:38:55.319120 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 14:38:55.319656 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 14:38:55.319676 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 14:38:55.319680 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 14:38:55.319685 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 14:38:55.319688 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 14:38:55.319691 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 14:38:55.319693 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 14:38:55.319739 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 14:38:55.326565 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0507 14:38:55.326571 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"d9e67393-e007-4cb4-a4d4-9e7b39ccaa28", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0507 14:38:55.329007 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 14:38:55.329020 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 14:38:55.329032 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 14:38:55.329045 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 14:38:55.329029 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 14:38:55.329062 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 14:38:55.329289 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1770656941/tls.crt::/tmp/serving-cert-1770656941/tls.key" I0507 14:38:55.329541 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 14:38:55.329567 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 14:38:55.341908 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 14:38:55.341930 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 14:38:55.342025 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 14:38:55.351256 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:38:55.351278 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 14:38:55.365618 1 secretconfigobserver.go:119] support secret does not exist I0507 14:38:55.372057 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:38:55.383393 1 secretconfigobserver.go:119] support secret does not exist I0507 14:38:55.386931 1 recorder.go:176] Pruning old reports every 4h11m6s, max age is 288h0m0s I0507 14:38:55.400380 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 14:38:55.400396 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 14:38:55.400407 1 insightsreport.go:296] Starting report retriever I0507 14:38:55.400413 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 14:38:55.400398 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 14:38:55.400384 1 periodic.go:216] Running clusterconfig gatherer I0507 14:38:55.400469 1 tasks_processing.go:45] number of workers: 64 I0507 14:38:55.400494 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:38:55.400516 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 14:38:55.400517 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 14:38:55.400523 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 14:38:55.400526 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:38:55.400530 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 14:38:55.400532 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 14:38:55.400532 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 14:38:55.400539 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 14:38:55.400536 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 14:38:55.400541 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 14:38:55.400546 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 14:38:55.400544 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 14:38:55.400548 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 14:38:55.400553 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 14:38:55.400554 1 tasks_processing.go:71] worker 7 working on nodenetworkconfigurationpolicies task. I0507 14:38:55.400556 1 tasks_processing.go:71] worker 17 working on nodes task. I0507 14:38:55.400559 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 14:38:55.400557 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 14:38:55.400564 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 14:38:55.400564 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 14:38:55.400574 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 14:38:55.400575 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 14:38:55.400569 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 14:38:55.400570 1 tasks_processing.go:71] worker 0 working on sap_datahubs task. I0507 14:38:55.400575 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 14:38:55.400584 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 14:38:55.400584 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 14:38:55.400592 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 14:38:55.400600 1 tasks_processing.go:71] worker 9 working on crds task. I0507 14:38:55.400604 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 14:38:55.400607 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 14:38:55.400608 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 14:38:55.400614 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 14:38:55.400611 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 14:38:55.400614 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 14:38:55.400624 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 14:38:55.400592 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 14:38:55.400628 1 tasks_processing.go:71] worker 13 working on qemu_kubevirt_launcher_logs task. I0507 14:38:55.400594 1 tasks_processing.go:71] worker 14 working on service_accounts task. I0507 14:38:55.400630 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 14:38:55.400639 1 tasks_processing.go:71] worker 8 working on validating_webhook_configurations task. I0507 14:38:55.400642 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 14:38:55.400643 1 tasks_processing.go:71] worker 29 working on machine_healthchecks task. I0507 14:38:55.400644 1 tasks_processing.go:71] worker 12 working on install_plans task. I0507 14:38:55.400648 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 14:38:55.400644 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 14:38:55.400656 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 14:38:55.400618 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 14:38:55.400661 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 14:38:55.400619 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 14:38:55.400626 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 14:38:55.400630 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 14:38:55.400634 1 tasks_processing.go:71] worker 6 working on active_alerts task. I0507 14:38:55.400677 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 14:38:55.400679 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 14:38:55.400686 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 14:38:55.400635 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 14:38:55.400692 1 tasks_processing.go:71] worker 32 working on infrastructures task. I0507 14:38:55.400598 1 tasks_processing.go:71] worker 15 working on openstack_controlplanes task. I0507 14:38:55.400701 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 14:38:55.400698 1 tasks_processing.go:71] worker 28 working on tsdb_status task. I0507 14:38:55.400636 1 tasks_processing.go:71] worker 23 working on ingress task. I0507 14:38:55.400711 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 14:38:55.400719 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 14:38:55.400553 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 14:38:55.400694 1 tasks_processing.go:69] worker 40 listening for tasks. W0507 14:38:55.400755 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:38:55.400762 1 tasks_processing.go:71] worker 19 working on dvo_metrics task. I0507 14:38:55.400758 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 14:38:55.400683 1 tasks_processing.go:71] worker 16 working on machine_configs task. I0507 14:38:55.400666 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 14:38:55.400773 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 14:38:55.400777 1 tasks_processing.go:71] worker 1 working on support_secret task. I0507 14:38:55.400783 1 tasks_processing.go:71] worker 25 working on image_pruners task. I0507 14:38:55.400786 1 tasks_processing.go:71] worker 55 working on operators task. I0507 14:38:55.400788 1 tasks_processing.go:71] worker 54 working on networks task. I0507 14:38:55.400589 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 14:38:55.400757 1 tasks_processing.go:71] worker 18 working on ceph_cluster task. I0507 14:38:55.400783 1 tasks_processing.go:71] worker 21 working on storage_cluster task. I0507 14:38:55.400903 1 tasks_processing.go:71] worker 37 working on sap_pods task. I0507 14:38:55.400947 1 tasks_processing.go:71] worker 35 working on image task. I0507 14:38:55.400954 1 tasks_processing.go:71] worker 4 working on aggregated_monitoring_cr_names task. I0507 14:38:55.400961 1 tasks_processing.go:71] worker 41 working on openstack_dataplanenodesets task. I0507 14:38:55.401011 1 tasks_processing.go:71] worker 44 working on lokistack task. I0507 14:38:55.400716 1 tasks_processing.go:71] worker 3 working on oauths task. I0507 14:38:55.401037 1 tasks_processing.go:71] worker 28 working on openshift_machine_api_events task. I0507 14:38:55.401627 1 tasks_processing.go:71] worker 42 working on jaegers task. I0507 14:38:55.401663 1 tasks_processing.go:71] worker 49 working on node_features task. I0507 14:38:55.401677 1 tasks_processing.go:71] worker 5 working on container_images task. I0507 14:38:55.400764 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 14:38:55.401830 1 tasks_processing.go:71] worker 61 working on image_registries task. I0507 14:38:55.400956 1 tasks_processing.go:71] worker 40 working on authentication task. W0507 14:38:55.400700 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:38:55.401099 1 tasks_processing.go:71] worker 43 working on clusterroles task. I0507 14:38:55.400639 1 tasks_processing.go:71] worker 2 working on machine_autoscalers task. I0507 14:38:55.400861 1 tasks_processing.go:71] worker 53 working on proxies task. I0507 14:38:55.400905 1 tasks_processing.go:71] worker 58 working on monitoring_persistent_volumes task. I0507 14:38:55.400865 1 tasks_processing.go:71] worker 27 working on certificate_signing_requests task. I0507 14:38:55.400871 1 tasks_processing.go:71] worker 10 working on machine_config_pools task. I0507 14:38:55.400877 1 tasks_processing.go:71] worker 20 working on openshift_logging task. I0507 14:38:55.400890 1 tasks_processing.go:71] worker 31 working on node_logs task. I0507 14:38:55.400889 1 tasks_processing.go:71] worker 11 working on version task. I0507 14:38:55.400895 1 tasks_processing.go:71] worker 38 working on feature_gates task. I0507 14:38:55.400898 1 tasks_processing.go:71] worker 52 working on metrics task. I0507 14:38:55.400883 1 tasks_processing.go:71] worker 59 working on storage_classes task. W0507 14:38:55.402950 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:38:55.400902 1 tasks_processing.go:71] worker 46 working on nodenetworkstates task. I0507 14:38:55.400909 1 tasks_processing.go:71] worker 47 working on container_runtime_configs task. I0507 14:38:55.400919 1 tasks_processing.go:71] worker 26 working on openstack_version task. I0507 14:38:55.400923 1 tasks_processing.go:71] worker 57 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 14:38:55.400667 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 14:38:55.403291 1 tasks_processing.go:71] worker 45 working on operators_pods_and_events task. I0507 14:38:55.400929 1 tasks_processing.go:71] worker 36 working on sap_config task. I0507 14:38:55.400671 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 14:38:55.400933 1 tasks_processing.go:71] worker 39 working on mutating_webhook_configurations task. I0507 14:38:55.400938 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 14:38:55.400938 1 tasks_processing.go:71] worker 30 working on pod_network_connectivity_checks task. I0507 14:38:55.400938 1 tasks_processing.go:71] worker 51 working on pdbs task. I0507 14:38:55.400579 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 14:38:55.400775 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 55.441µs to process 0 records I0507 14:38:55.400946 1 tasks_processing.go:71] worker 33 working on olm_operators task. I0507 14:38:55.400945 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 14:38:55.400600 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 14:38:55.400855 1 tasks_processing.go:71] worker 34 working on cluster_apiserver task. I0507 14:38:55.401940 1 tasks_processing.go:71] worker 60 working on cost_management_metrics_configs task. I0507 14:38:55.400912 1 tasks_processing.go:71] worker 56 working on silenced_alerts task. I0507 14:38:55.400916 1 tasks_processing.go:71] worker 48 working on ingress_certificates task. I0507 14:38:55.403448 1 tasks_processing.go:71] worker 50 working on machines task. I0507 14:38:55.403689 1 tasks_processing.go:71] worker 6 working on openstack_dataplanedeployments task. I0507 14:38:55.403536 1 tasks_processing.go:71] worker 63 working on overlapping_namespace_uids task. I0507 14:38:55.403649 1 tasks_processing.go:71] worker 22 working on config_maps task. W0507 14:38:55.404265 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:38:55.403657 1 tasks_processing.go:71] worker 62 working on machine_sets task. I0507 14:38:55.403654 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.349653ms to process 0 records I0507 14:38:55.404357 1 tasks_processing.go:71] worker 24 working on schedulers task. I0507 14:38:55.404374 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 39.345µs to process 0 records I0507 14:38:55.404384 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 600.902µs to process 0 records I0507 14:38:55.404392 1 tasks_processing.go:74] worker 56 stopped. I0507 14:38:55.404400 1 tasks_processing.go:74] worker 52 stopped. I0507 14:38:55.406398 1 tasks_processing.go:74] worker 0 stopped. I0507 14:38:55.406414 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.803724ms to process 0 records I0507 14:38:55.410428 1 tasks_processing.go:74] worker 29 stopped. E0507 14:38:55.410440 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 14:38:55.410447 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 9.772266ms to process 0 records I0507 14:38:55.414304 1 tasks_processing.go:74] worker 15 stopped. I0507 14:38:55.414316 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 13.598098ms to process 0 records E0507 14:38:55.414543 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0507 14:38:55.414555 1 tasks_processing.go:74] worker 49 stopped. I0507 14:38:55.414564 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 12.88186ms to process 0 records I0507 14:38:55.414571 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 13.651222ms to process 0 records I0507 14:38:55.414576 1 tasks_processing.go:74] worker 21 stopped. I0507 14:38:55.414797 1 tasks_processing.go:74] worker 2 stopped. I0507 14:38:55.414809 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.695581ms to process 0 records I0507 14:38:55.414815 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 13.844941ms to process 0 records I0507 14:38:55.414820 1 tasks_processing.go:74] worker 37 stopped. I0507 14:38:55.415104 1 tasks_processing.go:74] worker 18 stopped. I0507 14:38:55.415120 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 14.296489ms to process 0 records I0507 14:38:55.415138 1 tasks_processing.go:74] worker 7 stopped. I0507 14:38:55.415148 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 14.574861ms to process 0 records I0507 14:38:55.416009 1 tasks_processing.go:74] worker 23 stopped. I0507 14:38:55.416219 1 recorder.go:75] Recording config/ingress with fingerprint=97b2066d52359c8efbe5dbcd09c924ec8bd270a073e579dd87ff0e6c3ab35516 I0507 14:38:55.416232 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 15.288567ms to process 1 records I0507 14:38:55.416969 1 tasks_processing.go:74] worker 41 stopped. I0507 14:38:55.416983 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 15.99859ms to process 0 records I0507 14:38:55.419329 1 tasks_processing.go:74] worker 10 stopped. I0507 14:38:55.419340 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 16.868862ms to process 0 records I0507 14:38:55.419351 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 18.309168ms to process 0 records I0507 14:38:55.419357 1 tasks_processing.go:74] worker 44 stopped. I0507 14:38:55.420178 1 tasks_processing.go:74] worker 42 stopped. I0507 14:38:55.420188 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 18.53326ms to process 0 records I0507 14:38:55.423403 1 tasks_processing.go:74] worker 20 stopped. I0507 14:38:55.423415 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 20.826402ms to process 0 records I0507 14:38:55.423630 1 tasks_processing.go:74] worker 32 stopped. I0507 14:38:55.424151 1 recorder.go:75] Recording config/infrastructure with fingerprint=cc9f4e5a4d7c65e4207d6b3d2efba43b483d689e41b4f0d43541cdd92e68defa I0507 14:38:55.424166 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 22.922985ms to process 1 records I0507 14:38:55.424254 1 tasks_processing.go:74] worker 54 stopped. I0507 14:38:55.424273 1 recorder.go:75] Recording config/network with fingerprint=f3c7f6fe380a239ecd5a1eff60dbc7c2db0938b343bdeed2abd190facca0fc23 I0507 14:38:55.424282 1 gather.go:177] gatherer "clusterconfig" function "networks" took 22.958072ms to process 1 records I0507 14:38:55.424360 1 tasks_processing.go:74] worker 3 stopped. I0507 14:38:55.424434 1 recorder.go:75] Recording config/oauth with fingerprint=aa6a5ae27a9736703b671554db9cb8b8105d1fb777cbf73acc3b9c0589217f64 I0507 14:38:55.424442 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 22.774388ms to process 1 records I0507 14:38:55.425859 1 tasks_processing.go:74] worker 16 stopped. E0507 14:38:55.425874 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0507 14:38:55.425901 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 14:38:55.425914 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 25.076331ms to process 1 records E0507 14:38:55.425923 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 14:38:55.425929 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 25.089775ms to process 0 records I0507 14:38:55.425934 1 tasks_processing.go:74] worker 1 stopped. I0507 14:38:55.426087 1 tasks_processing.go:74] worker 46 stopped. I0507 14:38:55.426095 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.064285ms to process 0 records I0507 14:38:55.429618 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 14:38:55.429624 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 14:38:55.429680 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 14:38:55.430587 1 gather_logs.go:145] no pods in namespace were found I0507 14:38:55.430601 1 tasks_processing.go:74] worker 13 stopped. I0507 14:38:55.430608 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 29.962478ms to process 0 records I0507 14:38:55.431300 1 tasks_processing.go:74] worker 61 stopped. I0507 14:38:55.431710 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3b4d183d94c9eecec9b995807148091787a8e59284aa62bcb062f2f3c473c6af I0507 14:38:55.431740 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 29.430367ms to process 1 records I0507 14:38:55.433480 1 tasks_processing.go:74] worker 17 stopped. I0507 14:38:55.433792 1 recorder.go:75] Recording config/node/ip-10-0-0-60.ec2.internal with fingerprint=64c713f2a87489b18605fa1058c4b93673fe82ff668728abbf7d18008f99b458 I0507 14:38:55.433848 1 recorder.go:75] Recording config/node/ip-10-0-1-137.ec2.internal with fingerprint=5e6ab19d89a35a3b04c2225d37f2cf17c0461f159a4e2505ba8e5f29ce9342eb I0507 14:38:55.433898 1 recorder.go:75] Recording config/node/ip-10-0-2-231.ec2.internal with fingerprint=cc7a7717846d849d0ffa695db33f4077f292c99b47a8cd5f51dc49c550144080 I0507 14:38:55.433909 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 32.913199ms to process 3 records I0507 14:38:55.433919 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 30.085556ms to process 0 records I0507 14:38:55.433923 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 32.345226ms to process 0 records I0507 14:38:55.433930 1 tasks_processing.go:74] worker 28 stopped. I0507 14:38:55.433936 1 tasks_processing.go:74] worker 60 stopped. I0507 14:38:55.433991 1 tasks_processing.go:74] worker 8 stopped. I0507 14:38:55.434174 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=63c007e18da1c1911aa760d03379a8bf3445b782dcd6fe9402753a32c5da9bbd I0507 14:38:55.434253 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=ef35bd81f48139bb68cb065de0322a9ddd2ce2ed0a36f1346570e34415a59041 I0507 14:38:55.434272 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=d200e15ed79135e30cf4f4c64c6c6957609000cdfe7e21aabe6c8e9c83ccfc6b I0507 14:38:55.434301 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e15c0b1db32e10d66539bf217dfd86a4ed54f286ec8e2b5939bf586aec146f88 I0507 14:38:55.434331 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=ebbc34cc0e30d13a8a17afc4d725d35a45435e150c6bacb39e0b38088d4aca01 I0507 14:38:55.434360 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=630750c1ccbbddf3b7e8d2077b3fc934d40528e1fbb036cd1f32c49c223a5d90 I0507 14:38:55.434394 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=93dcfdb49a455957aed5eefb0ef492600ebddd7e108254490c9dba42b2930ca4 I0507 14:38:55.434637 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=710070f0afbfa8bf41717e4242f87101699f9ce1b097b2847cc3db3114875793 I0507 14:38:55.434711 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=774547c3b22efe6ec1ca7dd7b9635587e7890a1955a13f86906846743b151980 I0507 14:38:55.434814 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=d1cb858a21a5d53fb3bd3c434229b02450b097c8fe7b44676d5845355d44657e I0507 14:38:55.434867 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=3596e8175ac33de06e2db71bfc7ce09b93010b7dbd2463770fdcbc83bd9ddf96 I0507 14:38:55.434879 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 33.335629ms to process 11 records I0507 14:38:55.435585 1 tasks_processing.go:74] worker 9 stopped. I0507 14:38:55.435912 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=bdf8c5f1439762f0775b3601a1c1f3198dc8edd97356242da30f970fb93926a9 I0507 14:38:55.436482 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=cb7f9d0450c34ab7af242201429436ac6c225b426fe04f0a58273af46ea3e214 I0507 14:38:55.436496 1 gather.go:177] gatherer "clusterconfig" function "crds" took 33.452374ms to process 2 records I0507 14:38:55.436844 1 tasks_processing.go:74] worker 35 stopped. I0507 14:38:55.436991 1 recorder.go:75] Recording config/image with fingerprint=cb617f42d1683f54bdf80e0a09949b85354fd09eb9a5baa36f1cae2c48b52fe1 I0507 14:38:55.437012 1 gather.go:177] gatherer "clusterconfig" function "image" took 35.88096ms to process 1 records I0507 14:38:55.437854 1 tasks_processing.go:74] worker 47 stopped. I0507 14:38:55.437867 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 34.720748ms to process 0 records I0507 14:38:55.437885 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 34.627476ms to process 0 records I0507 14:38:55.437893 1 tasks_processing.go:74] worker 26 stopped. I0507 14:38:55.438022 1 tasks_processing.go:74] worker 25 stopped. I0507 14:38:55.438148 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1ea4381ed72b5e1f5f2227e5517e659c95886be0470655d2e7d7f3f2e8263e37 I0507 14:38:55.438166 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 37.225998ms to process 1 records I0507 14:38:55.441927 1 tasks_processing.go:74] worker 6 stopped. I0507 14:38:55.441941 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 38.060445ms to process 0 records I0507 14:38:55.442064 1 base_controller.go:82] Caches are synced for ConfigController I0507 14:38:55.442080 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 14:38:55.442223 1 tasks_processing.go:74] worker 53 stopped. I0507 14:38:55.442311 1 recorder.go:75] Recording config/proxy with fingerprint=d311faa604beab10e6fa4f1777d9f146594a3dca5190a05e130b712f21a65955 I0507 14:38:55.442327 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 40.095533ms to process 1 records I0507 14:38:55.442351 1 tasks_processing.go:74] worker 40 stopped. I0507 14:38:55.442535 1 recorder.go:75] Recording config/authentication with fingerprint=a1d3b76c31676b234d9a71587038cb6384b17065c050e4d377e4ca34eeda56c3 I0507 14:38:55.442555 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 40.354229ms to process 1 records I0507 14:38:55.443571 1 tasks_processing.go:74] worker 62 stopped. I0507 14:38:55.443589 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 39.243006ms to process 0 records I0507 14:38:55.443624 1 tasks_processing.go:74] worker 50 stopped. E0507 14:38:55.443633 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 14:38:55.443646 1 gather.go:177] gatherer "clusterconfig" function "machines" took 39.949581ms to process 0 records W0507 14:38:55.444229 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:38:55.451121 1 tasks_processing.go:74] worker 36 stopped. I0507 14:38:55.451134 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 47.799342ms to process 0 records I0507 14:38:55.451585 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0507 14:38:55.451605 1 tasks_processing.go:74] worker 58 stopped. I0507 14:38:55.451606 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 14:38:55.451615 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 14:38:55.451617 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 49.388915ms to process 0 records I0507 14:38:55.451620 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 14:38:55.451641 1 controller.go:531] The operator is still being initialized I0507 14:38:55.451649 1 controller.go:554] The operator is healthy I0507 14:38:55.452275 1 tasks_processing.go:74] worker 30 stopped. E0507 14:38:55.452290 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 14:38:55.452298 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 48.645613ms to process 0 records I0507 14:38:55.452401 1 tasks_processing.go:74] worker 51 stopped. I0507 14:38:55.452496 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=c5b480b30cb311592a0e1f10588bcab8bfeef2b45ced1a56f1e66eb1e1a633aa I0507 14:38:55.452523 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=5a2b4c3f9d857d1e371aee351de8d1fdbbfeef4337a1a97b72681df7275c31d7 I0507 14:38:55.452538 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=94405b4fefcf57e71149da6570ad41c36a2736841df1060261db8b02e6099d2d I0507 14:38:55.452552 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 48.765558ms to process 3 records I0507 14:38:55.452614 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5efbac2a116ef562f4fe04ddc03f7f4f8e21747bf089411a131cae583da98e41 I0507 14:38:55.452620 1 tasks_processing.go:74] worker 59 stopped. I0507 14:38:55.452627 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=c970dd5b880c3871dc8f4b29d612497f96da168e8585d760d10b095e330e6af6 I0507 14:38:55.452633 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 49.490683ms to process 2 records I0507 14:38:55.452718 1 recorder.go:75] Recording config/featuregate with fingerprint=21646047e5d33473435647848adfb78562c05c9526912e6e8c1c26359e47454a I0507 14:38:55.452746 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 49.747713ms to process 1 records I0507 14:38:55.452755 1 tasks_processing.go:74] worker 38 stopped. I0507 14:38:55.456031 1 tasks_processing.go:74] worker 4 stopped. I0507 14:38:55.456094 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 55.063302ms to process 0 records I0507 14:38:55.457804 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:38:55.458068 1 tasks_processing.go:74] worker 43 stopped. I0507 14:38:55.458267 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=884097592f073656abcb14e1ed6a1b5702f99d0e7b074d590c29ea7d9392f18d I0507 14:38:55.458361 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=f3744c1136935d37ea60f3cd94fc7a479abfd431c154e40d75cafe981bd66b22 I0507 14:38:55.458372 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 56.03202ms to process 2 records I0507 14:38:55.460655 1 tasks_processing.go:74] worker 5 stopped. I0507 14:38:55.461938 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-m9pnt with fingerprint=122606d046c48d34fd22c541998245eb02476cb1721604a27fd906bee86c3848 I0507 14:38:55.462212 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-tml4k with fingerprint=4442cf697453ccc660f942b9ca27a004ef20dfcff71c56fb9151d0b57fe60259 I0507 14:38:55.462257 1 recorder.go:75] Recording config/running_containers with fingerprint=ebe697c74ce8625f816b9f41f010460a4d52ee3429a540478f475bc7e1ddd0d1 I0507 14:38:55.462266 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 58.955497ms to process 3 records I0507 14:38:55.468855 1 tasks_processing.go:74] worker 24 stopped. I0507 14:38:55.468939 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=78bc487172840979eba2633319948c1214c1caf837b91d79d70ec58d66dcb2b8 I0507 14:38:55.468973 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 64.472998ms to process 1 records I0507 14:38:55.468987 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 65.251095ms to process 0 records I0507 14:38:55.468997 1 tasks_processing.go:74] worker 33 stopped. I0507 14:38:55.469333 1 tasks_processing.go:74] worker 34 stopped. I0507 14:38:55.469442 1 recorder.go:75] Recording config/apiserver with fingerprint=1eeb5a76783aa6143aa0a4d3809542e06adce2b9eb4c6ff844489a8405b18404 I0507 14:38:55.469458 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 65.653044ms to process 1 records I0507 14:38:55.469550 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7192d87da4d04658ed03c431228a94cc363ae4d66a2cd62eb215f95312c77905 I0507 14:38:55.469549 1 tasks_processing.go:74] worker 39 stopped. I0507 14:38:55.469584 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ac4c741dcc0f20ae0f737bacde60d03546ebd5951d142be12365d53fb9d548d1 I0507 14:38:55.469615 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ae50c7e1b1a4a2c0fdd3e0a13af0b08b113868687ff6e950008b2f7b4f6fe868 I0507 14:38:55.469621 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 65.849796ms to process 3 records I0507 14:38:55.472118 1 tasks_processing.go:74] worker 27 stopped. I0507 14:38:55.472153 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 69.709503ms to process 0 records I0507 14:38:55.482638 1 tasks_processing.go:74] worker 57 stopped. I0507 14:38:55.482650 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 79.360933ms to process 0 records I0507 14:38:55.484117 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 14:38:55.484193 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0507 14:38:55.484251 1 operator.go:328] started I0507 14:38:55.484266 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 14:38:55.492722 1 tasks_processing.go:74] worker 11 stopped. I0507 14:38:55.493005 1 recorder.go:75] Recording config/version with fingerprint=2f6c1540c39c7d74926680cea57205a34a29635d66f4a4662e1e5a95bcf5e6e7 I0507 14:38:55.493017 1 recorder.go:75] Recording config/id with fingerprint=e398fc34e75682b693f5deaa88af9d1945f4df3550c210f810bb23dd1a0eec66 I0507 14:38:55.493023 1 gather.go:177] gatherer "clusterconfig" function "version" took 89.954105ms to process 2 records E0507 14:38:55.503773 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c2120eb4-c5a9-42fa-b5b5-7b1facb44b28%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:56480->172.30.0.10:53: read: connection refused I0507 14:38:55.503789 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c2120eb4-c5a9-42fa-b5b5-7b1facb44b28%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:56480->172.30.0.10:53: read: connection refused I0507 14:38:55.507751 1 prometheus_rules.go:88] Prometheus rules successfully created I0507 14:38:55.507897 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 14:38:55.507915 1 controller.go:254] Source scaController *sca.Controller is not ready I0507 14:38:55.507921 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 14:38:55.507925 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 14:38:55.507946 1 controller.go:531] The operator is still being initialized I0507 14:38:55.507957 1 controller.go:554] The operator is healthy I0507 14:38:55.521281 1 tasks_processing.go:74] worker 22 stopped. E0507 14:38:55.521297 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 14:38:55.521304 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 14:38:55.521307 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 14:38:55.521316 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0507 14:38:55.521355 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 14:38:55.521363 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 14:38:55.521367 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0507 14:38:55.521371 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 14:38:55.521421 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 14:38:55.521429 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 14:38:55.521435 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 117.070987ms to process 7 records I0507 14:38:55.525945 1 tasks_processing.go:74] worker 31 stopped. I0507 14:38:55.525962 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 123.237929ms to process 0 records I0507 14:38:55.533524 1 tasks_processing.go:74] worker 63 stopped. I0507 14:38:55.533546 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 14:38:55.533554 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 129.622444ms to process 1 records I0507 14:38:55.537179 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0507 14:38:55.540502 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:44380->172.30.0.10:53: read: connection refused I0507 14:38:55.540524 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:44380->172.30.0.10:53: read: connection refused I0507 14:38:55.584939 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 14:38:55.584954 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 14:38:55.594509 1 tasks_processing.go:74] worker 48 stopped. E0507 14:38:55.594524 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 14:38:55.594530 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q552nne5p4mvs6dsntuvoi35hamtftd-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q552nne5p4mvs6dsntuvoi35hamtftd-primary-cert-bundle-secret" not found I0507 14:38:55.594590 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=af0c76b41e56da9b2c176a07940789214836f103ea6ca876d3836b4f7a1e9be8 I0507 14:38:55.594605 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 190.818596ms to process 1 records W0507 14:38:56.443696 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:38:56.704059 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0507 14:38:56.704074 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0507 14:38:56.704266 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dgj97 pod in namespace openshift-dns (previous: false). I0507 14:38:56.880487 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0507 14:38:56.908749 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dgj97 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dgj97\" is waiting to start: ContainerCreating" I0507 14:38:56.908768 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dgj97\" is waiting to start: ContainerCreating" I0507 14:38:56.908779 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dgj97 pod in namespace openshift-dns (previous: false). I0507 14:38:57.108327 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dgj97 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dgj97\" is waiting to start: ContainerCreating" I0507 14:38:57.108347 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dgj97\" is waiting to start: ContainerCreating" I0507 14:38:57.108373 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vfq56 pod in namespace openshift-dns (previous: false). I0507 14:38:57.329980 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vfq56 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vfq56\" is waiting to start: ContainerCreating" I0507 14:38:57.329998 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vfq56\" is waiting to start: ContainerCreating" I0507 14:38:57.330006 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vfq56 pod in namespace openshift-dns (previous: false). W0507 14:38:57.443369 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:38:57.482189 1 tasks_processing.go:74] worker 55 stopped. I0507 14:38:57.482237 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=ef43748b8504084558f8ced729aeb55b6e31393f509bb193e3083615d3863997 I0507 14:38:57.482279 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=48a559274e09f28bd65df0aa18b197257882db83fbd8fcdd6a029a03181097c7 I0507 14:38:57.482308 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 14:38:57.482334 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=ebc6cedff08ef66af55d6e606adff88525e02c52a46138b891138405a441b997 I0507 14:38:57.482367 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 14:38:57.482389 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=276379fd3957494f8e48faa46056c5d4b1dcc4b3072b5c5bcd72b62c4faa55e2 I0507 14:38:57.482418 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=ed792c9977640edf993230f2e821633861c6d04640c9a4fce8785ab5f3464e97 I0507 14:38:57.482442 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=3883a9d4bc281b36db56705f8b6d86b7c416b9b874b3381d675476c39e44e7c1 I0507 14:38:57.482457 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=223fec1930a4d5e602cd8c47fe15eb7d32d731357acb18c138b404cce20a90d5 I0507 14:38:57.482474 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a9575809a2e21eac9dcfe36be6cee52de711eacddef9add0f73fdaccf06e7239 I0507 14:38:57.482483 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 14:38:57.482499 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=78119a37f22fd676e1eede75d9afac30b1d848539b0b4862cc76b8a9c64f7144 I0507 14:38:57.482509 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 14:38:57.482537 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=9e4352f6968cf3e346fb93ae10ae5cdfcf580809db7b86926c8f8fe533550767 I0507 14:38:57.482546 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 14:38:57.482566 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=e654ca0f8c32904bd554edd8ce81b71585c2aeb9a27e15b78bad264deae7bad4 I0507 14:38:57.482575 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 14:38:57.482592 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3dc3f1ed9f68d8c356a9d401573856c670cb5a40584ffa469aae3f0c8822bb36 I0507 14:38:57.482712 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=4c1248ff0f8d99d1aa5a555b382a52a61971c32de29bed1456e31c10176e732c I0507 14:38:57.482721 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 14:38:57.482750 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 14:38:57.482772 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 14:38:57.482795 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=0d3e2be73265475a10d94201d59067ddfbed123706b2dca4ccc94aaab7482c53 I0507 14:38:57.482823 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=41c1b9ab4e8f4422be4796e3e3fcefbbfcb7b260f7d770e87ab0974e227c8107 I0507 14:38:57.482833 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 14:38:57.482848 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=4494683ab2ba3e55277c85dd89b32e890ed6830056e86726181115d2a439abfa I0507 14:38:57.482857 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 14:38:57.482871 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c58196921e31b31952c9bceeb174ebcce137840b5a5b8d9c9343c00f67a33f72 I0507 14:38:57.482885 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=d48e0abea04e7ade99ceeb51703abc6013deb7c09b89ebf13ec0bff84bff9eba I0507 14:38:57.482898 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=422b9d5a208a2ee18653590329844f08fef17379d9ede54ef8391dfcf8e510cd I0507 14:38:57.482913 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=76c428d2e133d677d778accb318b5f8e108d73bf37ab1d6c765a8700f2b52df4 I0507 14:38:57.482932 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f4e18b78d1ccf4ece6d22996945b64b656818096af15cde7da57f0292dd5b51a I0507 14:38:57.482941 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0507 14:38:57.482967 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=77c44b72082e49137eba67b103051a1fdb37ccbd5de89e42738dbca76e505b93 I0507 14:38:57.482983 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 14:38:57.482989 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 14:38:57.482996 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.08138756s to process 36 records I0507 14:38:57.511267 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vfq56 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vfq56\" is waiting to start: ContainerCreating" I0507 14:38:57.511281 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vfq56\" is waiting to start: ContainerCreating" I0507 14:38:57.511291 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vng7m pod in namespace openshift-dns (previous: false). I0507 14:38:57.728642 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vng7m pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vng7m\" is waiting to start: ContainerCreating" I0507 14:38:57.728659 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vng7m\" is waiting to start: ContainerCreating" I0507 14:38:57.728667 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vng7m pod in namespace openshift-dns (previous: false). I0507 14:38:57.909310 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vng7m pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vng7m\" is waiting to start: ContainerCreating" I0507 14:38:57.909332 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vng7m\" is waiting to start: ContainerCreating" I0507 14:38:57.909342 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-24f6n pod in namespace openshift-dns (previous: false). I0507 14:38:58.108721 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:58.108756 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fbqbg pod in namespace openshift-dns (previous: false). I0507 14:38:58.310201 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:58.310219 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-htbg8 pod in namespace openshift-dns (previous: false). W0507 14:38:58.444161 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:38:58.507640 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:58.507657 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-59d88bf758-nn9f7 pod in namespace openshift-image-registry (previous: false). I0507 14:38:58.708549 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-59d88bf758-nn9f7 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-59d88bf758-nn9f7\" is waiting to start: ContainerCreating" I0507 14:38:58.708568 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-59d88bf758-nn9f7\" is waiting to start: ContainerCreating" I0507 14:38:58.708581 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86d94697cc-gvtjf pod in namespace openshift-image-registry (previous: false). I0507 14:38:58.911415 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86d94697cc-gvtjf pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86d94697cc-gvtjf\" is waiting to start: ContainerCreating" I0507 14:38:58.911433 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86d94697cc-gvtjf\" is waiting to start: ContainerCreating" I0507 14:38:58.911444 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86d94697cc-qsrlw pod in namespace openshift-image-registry (previous: false). I0507 14:38:59.108216 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86d94697cc-qsrlw pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86d94697cc-qsrlw\" is waiting to start: ContainerCreating" I0507 14:38:59.108235 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86d94697cc-qsrlw\" is waiting to start: ContainerCreating" I0507 14:38:59.108246 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6cn74 pod in namespace openshift-image-registry (previous: false). I0507 14:38:59.307945 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:59.307963 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-q596b pod in namespace openshift-image-registry (previous: false). W0507 14:38:59.443948 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:38:59.509450 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:59.509467 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sfxxs pod in namespace openshift-image-registry (previous: false). I0507 14:38:59.709565 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 14:38:59.709582 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57f57cbbf5-2s5dj pod in namespace openshift-ingress (previous: false). I0507 14:38:59.908453 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-57f57cbbf5-2s5dj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-57f57cbbf5-2s5dj\" is waiting to start: ContainerCreating" I0507 14:38:59.908470 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-57f57cbbf5-2s5dj\" is waiting to start: ContainerCreating" I0507 14:38:59.908481 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-844d74d666-cjxgz pod in namespace openshift-ingress (previous: false). I0507 14:39:00.108667 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-844d74d666-cjxgz pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-844d74d666-cjxgz\" is waiting to start: ContainerCreating" I0507 14:39:00.108685 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-844d74d666-cjxgz\" is waiting to start: ContainerCreating" I0507 14:39:00.108696 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-844d74d666-gq5tz pod in namespace openshift-ingress (previous: false). I0507 14:39:00.308884 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-844d74d666-gq5tz pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-844d74d666-gq5tz\" is waiting to start: ContainerCreating" I0507 14:39:00.308902 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-844d74d666-gq5tz\" is waiting to start: ContainerCreating" I0507 14:39:00.308912 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-l2dwm pod in namespace openshift-ingress-canary (previous: false). W0507 14:39:00.439914 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 14:39:00.439938 1 tasks_processing.go:74] worker 19 stopped. E0507 14:39:00.439956 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 14:39:00.439974 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0507 14:39:00.439991 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0507 14:39:00.440002 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.039162378s to process 1 records I0507 14:39:00.509315 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mwscd pod in namespace openshift-ingress-canary (previous: false). I0507 14:39:00.712840 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mz65w pod in namespace openshift-ingress-canary (previous: false). I0507 14:39:00.908675 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-f8mzp pod in namespace openshift-kube-storage-version-migrator (previous: false). I0507 14:39:01.108949 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-f8mzp pod in namespace openshift-kube-storage-version-migrator (previous: false). I0507 14:39:01.309020 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-tj7wr pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0507 14:39:01.512325 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=584ec2df3485109596590b7ca98c2b8460c1d7186e878936e908ac15648f0e39 I0507 14:39:01.512350 1 tasks_processing.go:74] worker 45 stopped. I0507 14:39:01.512427 1 recorder.go:75] Recording events/openshift-dns with fingerprint=8041a539b7b7c80b57e349af78ae4bda5f261397801512b2337249bae2df8b5a I0507 14:39:01.512587 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=9942356c8e89d2c9e74067eda5331dd6f21cc6ef7e2d2850065e0fa36da75a86 I0507 14:39:01.512634 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=677610c37707c9471fa19e56ad50ca33aeede5672fc543fb728a83cfa4b06b76 I0507 14:39:01.512709 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=15b31b83076bf3d31613f872c58871adb7da34c55c4813ba22d3786854363af1 I0507 14:39:01.512782 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=ebc61d1b93cad37e67009bf309e77157c3567d4396ec2c0dcc4617ec50f0b158 I0507 14:39:01.512809 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=1473ebca3a6875d8e33edc3fb155482681cff7fe0a8eabb11868c39e6218cbb6 I0507 14:39:01.512888 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=3ef8c0c8f794b4457593023b079e489d852ad9d95e5f957cf7bfa9632f7508d4 I0507 14:39:01.512899 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-l2dwm/serve-healthcheck-canary_current.log with fingerprint=bbeb0b42c336a41bb41e4b8f66c4115622423d19cd1d846aae4a29456c0a640b I0507 14:39:01.512911 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-mwscd/serve-healthcheck-canary_current.log with fingerprint=0aa5a9b1c58bcd9599887d23ef8c2d933a6331b709083699ef3b44ee3e82a549 I0507 14:39:01.512922 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-mz65w/serve-healthcheck-canary_current.log with fingerprint=b06417e3b3986857968c2b5517ef2d635cf50fa54803f849b4b3e9ddc8dfc1ad I0507 14:39:01.512943 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-f8mzp/migrator_current.log with fingerprint=4d73ed00ab5df2e065c94f192985ee8951194e7628ea3b0cfdb7caa094ca2e44 I0507 14:39:01.512952 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-f8mzp/graceful-termination_current.log with fingerprint=386168eebf50960bb59bda427f89575504102de269598eab9a49eef664314862 I0507 14:39:01.513073 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-tj7wr/kube-storage-version-migrator-operator_current.log with fingerprint=4dbf2ce2a36202f60fc8971e2e871c7651f6e18a6e87e00718d04a2695dfe39d I0507 14:39:01.513085 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.108575317s to process 14 records I0507 14:39:08.048561 1 tasks_processing.go:74] worker 12 stopped. I0507 14:39:08.048599 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0507 14:39:08.048613 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.647897352s to process 1 records I0507 14:39:08.273967 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:39:08.809876 1 tasks_processing.go:74] worker 14 stopped. I0507 14:39:08.810140 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0507 14:39:08.810157 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.409226535s to process 1 records E0507 14:39:08.810236 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.409s with: function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 14:39:08.811345 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 14:39:08.811359 1 periodic.go:216] Running workloads gatherer I0507 14:39:08.811373 1 tasks_processing.go:45] number of workers: 2 I0507 14:39:08.811382 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:39:08.811386 1 tasks_processing.go:71] worker 1 working on workload_info task. I0507 14:39:08.811400 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:39:08.811418 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0507 14:39:08.836839 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0507 14:39:08.839535 1 tasks_processing.go:74] worker 0 stopped. I0507 14:39:08.839548 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 28.104068ms to process 0 records I0507 14:39:08.845879 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (10ms) I0507 14:39:08.854826 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (9ms) I0507 14:39:08.863495 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0507 14:39:08.871800 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (8ms) I0507 14:39:08.880389 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (9ms) I0507 14:39:08.888819 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (8ms) I0507 14:39:08.897163 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (8ms) I0507 14:39:08.905303 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (8ms) I0507 14:39:08.913473 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (8ms) I0507 14:39:08.922152 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (9ms) I0507 14:39:08.945071 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (23ms) I0507 14:39:09.045673 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (101ms) I0507 14:39:09.146299 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0507 14:39:09.245687 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (99ms) I0507 14:39:09.345849 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (100ms) I0507 14:39:09.445593 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0507 14:39:09.546632 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (101ms) I0507 14:39:09.646870 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0507 14:39:09.746509 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0507 14:39:09.846558 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (100ms) I0507 14:39:09.946348 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0507 14:39:10.046204 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0507 14:39:10.146059 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0507 14:39:10.245881 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0507 14:39:10.346031 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0507 14:39:10.377670 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:39:10.447371 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (101ms) I0507 14:39:10.545523 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (98ms) I0507 14:39:10.565466 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:39:10.645658 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0507 14:39:10.745850 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0507 14:39:10.845314 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (99ms) I0507 14:39:10.945537 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0507 14:39:11.045844 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0507 14:39:11.147397 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (102ms) I0507 14:39:11.245418 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (98ms) I0507 14:39:11.245449 1 tasks_processing.go:74] worker 1 stopped. E0507 14:39:11.245459 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0507 14:39:11.245702 1 recorder.go:75] Recording config/workload_info with fingerprint=c741a930b3699ff7f1129f1c3c173810248a8e5236edc6a0cb975062ff581462 I0507 14:39:11.245717 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.434056237s to process 1 records E0507 14:39:11.245755 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.434s with: function \"workload_info\" failed with an error" I0507 14:39:11.246854 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 14:39:11.246866 1 periodic.go:216] Running conditional gatherer I0507 14:39:11.252125 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0507 14:39:11.258663 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:54086->172.30.0.10:53: read: connection refused E0507 14:39:11.259006 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 14:39:11.259063 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 14:39:11.264719 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0507 14:39:11.264744 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264749 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264752 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264755 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264758 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264761 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264764 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264767 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:39:11.264769 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 14:39:11.264783 1 tasks_processing.go:45] number of workers: 3 I0507 14:39:11.264794 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 14:39:11.264798 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 14:39:11.264804 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:39:11.264815 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 14:39:11.264818 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:39:11.264827 1 tasks_processing.go:74] worker 1 stopped. I0507 14:39:11.264820 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 14:39:11.264898 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0507 14:39:11.264916 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 878ns to process 1 records I0507 14:39:11.264963 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0507 14:39:11.264974 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.08µs to process 1 records I0507 14:39:11.264982 1 tasks_processing.go:74] worker 0 stopped. I0507 14:39:11.265127 1 tasks_processing.go:74] worker 2 stopped. I0507 14:39:11.265138 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 289.783µs to process 0 records I0507 14:39:11.265156 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:54086->172.30.0.10:53: read: connection refused I0507 14:39:11.265171 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0507 14:39:11.290032 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=40bca32560fe079b0c41948f84f10b10263e0eb45f38924006be6d6c6dbb391f I0507 14:39:11.290148 1 diskrecorder.go:70] Writing 110 records to /var/lib/insights-operator/insights-2026-05-07-143911.tar.gz I0507 14:39:11.297163 1 diskrecorder.go:51] Wrote 110 records to disk in 7ms I0507 14:39:11.297192 1 periodic.go:285] Gathering cluster info every 2h0m0s I0507 14:39:11.297207 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 14:39:23.017919 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:39:59.615085 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="56be018eb34c15921e364e01db6cc84b961a66b5de5ae46b7907cabf3737f02e") W0507 14:39:59.615115 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0507 14:39:59.615158 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="e9fe7cf8ed09f25d22365974b96f412b14f64fbf10afe6167ada5a6bc73dd1bd") I0507 14:39:59.615177 1 base_controller.go:181] Shutting down ConfigController ... I0507 14:39:59.615190 1 base_controller.go:181] Shutting down LoggingSyncer ... I0507 14:39:59.615195 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0507 14:39:59.615182 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0507 14:39:59.615232 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="7298ab1b14b13a48504ee220d6c6f8b44d208afa6ad9e6cb8e764cdeb415e8b9") I0507 14:39:59.615243 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 14:39:59.615259 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0507 14:39:59.615276 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1770656941/tls.crt::/tmp/serving-cert-1770656941/tls.key"