W0512 07:31:37.394927 1 cmd.go:257] Using insecure, self-signed certificates I0512 07:31:37.687461 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:37.687776 1 observer_polling.go:159] Starting file observer I0512 07:31:38.043127 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0512 07:31:38.043389 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0512 07:31:38.043858 1 secure_serving.go:57] Forcing use of http/1.1 only W0512 07:31:38.043882 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0512 07:31:38.043888 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0512 07:31:38.043892 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0512 07:31:38.043895 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0512 07:31:38.043897 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0512 07:31:38.043899 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0512 07:31:38.044069 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0512 07:31:38.048220 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0512 07:31:38.048227 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"be15bbe0-e407-4431-bb26-a5149d0ad521", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0512 07:31:38.050270 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0512 07:31:38.050287 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0512 07:31:38.050287 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0512 07:31:38.050298 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0512 07:31:38.050314 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0512 07:31:38.050306 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0512 07:31:38.050596 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3362049890/tls.crt::/tmp/serving-cert-3362049890/tls.key" I0512 07:31:38.050930 1 secure_serving.go:213] Serving securely on [::]:8443 I0512 07:31:38.050957 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0512 07:31:38.055483 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0512 07:31:38.055509 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0512 07:31:38.055578 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0512 07:31:38.062326 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0512 07:31:38.062364 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0512 07:31:38.068698 1 secretconfigobserver.go:119] support secret does not exist I0512 07:31:38.074541 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0512 07:31:38.080150 1 secretconfigobserver.go:119] support secret does not exist I0512 07:31:38.084370 1 recorder.go:161] Pruning old reports every 6h17m54s, max age is 288h0m0s I0512 07:31:38.090709 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0512 07:31:38.090736 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0512 07:31:38.090740 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0512 07:31:38.090756 1 insightsreport.go:296] Starting report retriever I0512 07:31:38.090764 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0512 07:31:38.090765 1 periodic.go:209] Running clusterconfig gatherer I0512 07:31:38.090805 1 tasks_processing.go:45] number of workers: 64 I0512 07:31:38.090834 1 tasks_processing.go:69] worker 5 listening for tasks. I0512 07:31:38.090847 1 tasks_processing.go:69] worker 2 listening for tasks. I0512 07:31:38.090849 1 tasks_processing.go:69] worker 3 listening for tasks. I0512 07:31:38.090856 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 07:31:38.090858 1 tasks_processing.go:69] worker 4 listening for tasks. I0512 07:31:38.090866 1 tasks_processing.go:69] worker 13 listening for tasks. I0512 07:31:38.090868 1 tasks_processing.go:69] worker 17 listening for tasks. I0512 07:31:38.090865 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 07:31:38.090867 1 tasks_processing.go:69] worker 21 listening for tasks. I0512 07:31:38.090876 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0512 07:31:38.090880 1 tasks_processing.go:69] worker 14 listening for tasks. I0512 07:31:38.090884 1 tasks_processing.go:71] worker 21 working on openshift_logging task. I0512 07:31:38.090892 1 tasks_processing.go:69] worker 16 listening for tasks. I0512 07:31:38.090894 1 tasks_processing.go:69] worker 24 listening for tasks. I0512 07:31:38.090898 1 tasks_processing.go:71] worker 16 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0512 07:31:38.090900 1 tasks_processing.go:69] worker 6 listening for tasks. I0512 07:31:38.090901 1 tasks_processing.go:69] worker 20 listening for tasks. I0512 07:31:38.090875 1 tasks_processing.go:69] worker 15 listening for tasks. I0512 07:31:38.090887 1 tasks_processing.go:69] worker 9 listening for tasks. I0512 07:31:38.090879 1 tasks_processing.go:71] worker 1 working on lokistack task. I0512 07:31:38.090914 1 tasks_processing.go:69] worker 11 listening for tasks. I0512 07:31:38.090920 1 tasks_processing.go:69] worker 12 listening for tasks. I0512 07:31:38.090925 1 tasks_processing.go:69] worker 28 listening for tasks. I0512 07:31:38.090924 1 tasks_processing.go:69] worker 7 listening for tasks. I0512 07:31:38.090933 1 tasks_processing.go:69] worker 10 listening for tasks. I0512 07:31:38.090936 1 tasks_processing.go:69] worker 49 listening for tasks. I0512 07:31:38.090938 1 tasks_processing.go:71] worker 7 working on openstack_controlplanes task. I0512 07:31:38.090940 1 tasks_processing.go:71] worker 24 working on mutating_webhook_configurations task. I0512 07:31:38.090945 1 tasks_processing.go:69] worker 59 listening for tasks. I0512 07:31:38.090946 1 tasks_processing.go:69] worker 58 listening for tasks. I0512 07:31:38.090893 1 tasks_processing.go:69] worker 19 listening for tasks. I0512 07:31:38.090904 1 tasks_processing.go:69] worker 25 listening for tasks. I0512 07:31:38.090956 1 tasks_processing.go:69] worker 51 listening for tasks. I0512 07:31:38.090910 1 tasks_processing.go:69] worker 26 listening for tasks. I0512 07:31:38.090962 1 tasks_processing.go:69] worker 60 listening for tasks. I0512 07:31:38.090963 1 tasks_processing.go:69] worker 29 listening for tasks. I0512 07:31:38.090916 1 tasks_processing.go:69] worker 27 listening for tasks. I0512 07:31:38.090973 1 tasks_processing.go:69] worker 50 listening for tasks. I0512 07:31:38.090969 1 tasks_processing.go:69] worker 53 listening for tasks. I0512 07:31:38.090980 1 tasks_processing.go:69] worker 30 listening for tasks. I0512 07:31:38.090953 1 tasks_processing.go:69] worker 48 listening for tasks. I0512 07:31:38.090983 1 tasks_processing.go:71] worker 6 working on machine_config_pools task. I0512 07:31:38.090984 1 tasks_processing.go:69] worker 57 listening for tasks. I0512 07:31:38.090983 1 tasks_processing.go:71] worker 15 working on infrastructures task. I0512 07:31:38.090992 1 tasks_processing.go:71] worker 5 working on oauths task. I0512 07:31:38.091001 1 tasks_processing.go:69] worker 44 listening for tasks. I0512 07:31:38.091000 1 tasks_processing.go:69] worker 40 listening for tasks. I0512 07:31:38.091003 1 tasks_processing.go:71] worker 57 working on operators task. I0512 07:31:38.091008 1 tasks_processing.go:71] worker 10 working on silenced_alerts task. I0512 07:31:38.091011 1 tasks_processing.go:69] worker 41 listening for tasks. I0512 07:31:38.091016 1 tasks_processing.go:71] worker 40 working on sap_config task. I0512 07:31:38.091022 1 tasks_processing.go:71] worker 0 working on certificate_signing_requests task. I0512 07:31:38.091026 1 tasks_processing.go:71] worker 3 working on machines task. I0512 07:31:38.091029 1 tasks_processing.go:69] worker 39 listening for tasks. I0512 07:31:38.091047 1 tasks_processing.go:71] worker 39 working on container_runtime_configs task. W0512 07:31:38.091045 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:38.091057 1 tasks_processing.go:69] worker 43 listening for tasks. I0512 07:31:38.091071 1 tasks_processing.go:71] worker 49 working on nodenetworkconfigurationpolicies task. I0512 07:31:38.091064 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 42.111µs to process 0 records I0512 07:31:38.090910 1 tasks_processing.go:69] worker 8 listening for tasks. I0512 07:31:38.090876 1 tasks_processing.go:69] worker 22 listening for tasks. I0512 07:31:38.090964 1 tasks_processing.go:69] worker 55 listening for tasks. I0512 07:31:38.090974 1 tasks_processing.go:69] worker 61 listening for tasks. I0512 07:31:38.091106 1 tasks_processing.go:71] worker 26 working on active_alerts task. I0512 07:31:38.091108 1 tasks_processing.go:71] worker 2 working on container_images task. I0512 07:31:38.091114 1 tasks_processing.go:71] worker 50 working on ingress task. W0512 07:31:38.091156 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:38.091232 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 110.939µs to process 0 records I0512 07:31:38.090871 1 tasks_processing.go:71] worker 13 working on node_logs task. I0512 07:31:38.091261 1 tasks_processing.go:71] worker 26 working on openshift_machine_api_events task. I0512 07:31:38.091275 1 tasks_processing.go:71] worker 8 working on service_accounts task. I0512 07:31:38.091279 1 tasks_processing.go:71] worker 55 working on sap_datahubs task. I0512 07:31:38.091303 1 tasks_processing.go:71] worker 22 working on openstack_dataplanenodesets task. I0512 07:31:38.091421 1 tasks_processing.go:71] worker 10 working on feature_gates task. I0512 07:31:38.091430 1 tasks_processing.go:71] worker 61 working on ingress_certificates task. I0512 07:31:38.091446 1 tasks_processing.go:71] worker 43 working on image task. I0512 07:31:38.090980 1 tasks_processing.go:69] worker 62 listening for tasks. I0512 07:31:38.090886 1 tasks_processing.go:69] worker 18 listening for tasks. I0512 07:31:38.091576 1 tasks_processing.go:71] worker 18 working on nodes task. I0512 07:31:38.090886 1 tasks_processing.go:69] worker 23 listening for tasks. I0512 07:31:38.090936 1 tasks_processing.go:71] worker 28 working on install_plans task. I0512 07:31:38.091607 1 tasks_processing.go:71] worker 23 working on dvo_metrics task. I0512 07:31:38.091003 1 tasks_processing.go:69] worker 42 listening for tasks. I0512 07:31:38.091017 1 tasks_processing.go:71] worker 41 working on storage_cluster task. I0512 07:31:38.091680 1 tasks_processing.go:71] worker 42 working on validating_webhook_configurations task. I0512 07:31:38.090972 1 tasks_processing.go:69] worker 56 listening for tasks. I0512 07:31:38.090983 1 tasks_processing.go:71] worker 9 working on metrics task. W0512 07:31:38.091749 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:38.091773 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 39.238µs to process 0 records I0512 07:31:38.090987 1 tasks_processing.go:69] worker 63 listening for tasks. I0512 07:31:38.090867 1 tasks_processing.go:71] worker 4 working on pdbs task. I0512 07:31:38.090987 1 tasks_processing.go:71] worker 11 working on cost_management_metrics_configs task. I0512 07:31:38.091864 1 tasks_processing.go:71] worker 63 working on operators_pods_and_events task. I0512 07:31:38.091920 1 tasks_processing.go:71] worker 56 working on jaegers task. I0512 07:31:38.091942 1 tasks_processing.go:71] worker 9 working on qemu_kubevirt_launcher_logs task. I0512 07:31:38.090886 1 tasks_processing.go:71] worker 14 working on sap_pods task. I0512 07:31:38.090987 1 tasks_processing.go:69] worker 52 listening for tasks. I0512 07:31:38.092058 1 tasks_processing.go:71] worker 52 working on overlapping_namespace_uids task. I0512 07:31:38.090991 1 tasks_processing.go:69] worker 31 listening for tasks. I0512 07:31:38.090992 1 tasks_processing.go:71] worker 12 working on ceph_cluster task. I0512 07:31:38.092078 1 tasks_processing.go:71] worker 31 working on pod_network_connectivity_checks task. I0512 07:31:38.091010 1 tasks_processing.go:71] worker 44 working on machine_sets task. I0512 07:31:38.090954 1 tasks_processing.go:69] worker 54 listening for tasks. I0512 07:31:38.092185 1 tasks_processing.go:71] worker 54 working on tsdb_status task. W0512 07:31:38.092222 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:38.091066 1 tasks_processing.go:71] worker 20 working on machine_autoscalers task. I0512 07:31:38.092236 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 38.543µs to process 0 records I0512 07:31:38.092245 1 tasks_processing.go:71] worker 54 working on crds task. I0512 07:31:38.091080 1 tasks_processing.go:71] worker 60 working on cluster_apiserver task. I0512 07:31:38.091084 1 tasks_processing.go:71] worker 59 working on machine_configs task. I0512 07:31:38.091091 1 tasks_processing.go:71] worker 58 working on machine_healthchecks task. I0512 07:31:38.091094 1 tasks_processing.go:71] worker 19 working on monitoring_persistent_volumes task. I0512 07:31:38.091098 1 tasks_processing.go:71] worker 25 working on nodenetworkstates task. I0512 07:31:38.091102 1 tasks_processing.go:71] worker 51 working on storage_classes task. I0512 07:31:38.091173 1 tasks_processing.go:69] worker 45 listening for tasks. I0512 07:31:38.091180 1 tasks_processing.go:69] worker 46 listening for tasks. I0512 07:31:38.091181 1 tasks_processing.go:69] worker 47 listening for tasks. I0512 07:31:38.091185 1 tasks_processing.go:71] worker 27 working on support_secret task. I0512 07:31:38.093288 1 tasks_processing.go:71] worker 45 working on openstack_dataplanedeployments task. I0512 07:31:38.091188 1 tasks_processing.go:71] worker 30 working on openstack_version task. I0512 07:31:38.091191 1 tasks_processing.go:69] worker 35 listening for tasks. I0512 07:31:38.091192 1 tasks_processing.go:71] worker 48 working on image_pruners task. I0512 07:31:38.091193 1 tasks_processing.go:71] worker 53 working on config_maps task. I0512 07:31:38.091199 1 tasks_processing.go:69] worker 37 listening for tasks. I0512 07:31:38.093849 1 tasks_processing.go:71] worker 37 working on image_registries task. I0512 07:31:38.091191 1 tasks_processing.go:71] worker 29 working on authentication task. I0512 07:31:38.091199 1 tasks_processing.go:69] worker 32 listening for tasks. I0512 07:31:38.091202 1 tasks_processing.go:69] worker 33 listening for tasks. I0512 07:31:38.091203 1 tasks_processing.go:69] worker 34 listening for tasks. I0512 07:31:38.091208 1 tasks_processing.go:69] worker 36 listening for tasks. I0512 07:31:38.091211 1 tasks_processing.go:69] worker 38 listening for tasks. I0512 07:31:38.091565 1 tasks_processing.go:71] worker 62 working on proxies task. I0512 07:31:38.093340 1 tasks_processing.go:71] worker 47 working on aggregated_monitoring_cr_names task. I0512 07:31:38.093358 1 tasks_processing.go:71] worker 46 working on olm_operators task. I0512 07:31:38.093620 1 tasks_processing.go:71] worker 35 working on networks task. I0512 07:31:38.094001 1 tasks_processing.go:71] worker 32 working on version task. I0512 07:31:38.094011 1 tasks_processing.go:74] worker 33 stopped. I0512 07:31:38.094014 1 tasks_processing.go:71] worker 34 working on schedulers task. I0512 07:31:38.094016 1 tasks_processing.go:74] worker 36 stopped. I0512 07:31:38.094022 1 tasks_processing.go:74] worker 38 stopped. I0512 07:31:38.096062 1 tasks_processing.go:74] worker 21 stopped. I0512 07:31:38.096086 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 5.159406ms to process 0 records I0512 07:31:38.096387 1 tasks_processing.go:74] worker 49 stopped. I0512 07:31:38.096401 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 5.307589ms to process 0 records I0512 07:31:38.096422 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 5.469345ms to process 0 records I0512 07:31:38.096430 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.458616ms to process 0 records I0512 07:31:38.096439 1 tasks_processing.go:74] worker 7 stopped. I0512 07:31:38.096445 1 tasks_processing.go:74] worker 1 stopped. I0512 07:31:38.096515 1 tasks_processing.go:74] worker 3 stopped. E0512 07:31:38.096526 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0512 07:31:38.096534 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.469633ms to process 0 records I0512 07:31:38.098983 1 tasks_processing.go:74] worker 22 stopped. I0512 07:31:38.098996 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 7.661949ms to process 0 records I0512 07:31:38.107567 1 tasks_processing.go:74] worker 40 stopped. I0512 07:31:38.107582 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 16.53684ms to process 0 records I0512 07:31:38.107757 1 tasks_processing.go:74] worker 6 stopped. I0512 07:31:38.107768 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 16.758682ms to process 0 records I0512 07:31:38.107831 1 tasks_processing.go:74] worker 15 stopped. I0512 07:31:38.108365 1 recorder.go:75] Recording config/infrastructure with fingerprint=5100d0b84e642457ed36f9e320c37ac088771d4d607472328f579bcea654afce I0512 07:31:38.108383 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 16.826284ms to process 1 records I0512 07:31:38.110708 1 tasks_processing.go:74] worker 41 stopped. I0512 07:31:38.110723 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 19.020563ms to process 0 records I0512 07:31:38.110779 1 tasks_processing.go:74] worker 39 stopped. I0512 07:31:38.110795 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 19.718544ms to process 0 records I0512 07:31:38.110849 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0512 07:31:38.110864 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0512 07:31:38.110869 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0512 07:31:38.110873 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0512 07:31:38.110894 1 controller.go:489] The operator is still being initialized I0512 07:31:38.110903 1 controller.go:512] The operator is healthy I0512 07:31:38.111005 1 tasks_processing.go:74] worker 5 stopped. I0512 07:31:38.111255 1 recorder.go:75] Recording config/oauth with fingerprint=80b3c53412f0b64793e3daedb7441214055ae3fdcc3af9158bdb22767289076e I0512 07:31:38.111271 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 20.000104ms to process 1 records I0512 07:31:38.111357 1 tasks_processing.go:74] worker 50 stopped. I0512 07:31:38.111398 1 recorder.go:75] Recording config/ingress with fingerprint=614e92c8d5c776d531da3716602b523ef4b8f634b0adcf91f631bd1e86c6b9ed I0512 07:31:38.111407 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 19.899927ms to process 1 records I0512 07:31:38.117991 1 tasks_processing.go:74] worker 11 stopped. I0512 07:31:38.118006 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.16033ms to process 0 records E0512 07:31:38.118021 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0512 07:31:38.118031 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 25.90392ms to process 0 records I0512 07:31:38.118041 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 25.922663ms to process 0 records I0512 07:31:38.118045 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 26.068854ms to process 0 records I0512 07:31:38.118049 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 25.875711ms to process 0 records I0512 07:31:38.118052 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 26.740692ms to process 0 records I0512 07:31:38.118057 1 tasks_processing.go:74] worker 55 stopped. I0512 07:31:38.118060 1 tasks_processing.go:74] worker 12 stopped. I0512 07:31:38.118062 1 tasks_processing.go:74] worker 56 stopped. I0512 07:31:38.118066 1 tasks_processing.go:74] worker 44 stopped. I0512 07:31:38.118070 1 tasks_processing.go:74] worker 31 stopped. I0512 07:31:38.133812 1 tasks_processing.go:74] worker 45 stopped. I0512 07:31:38.133833 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 40.500413ms to process 0 records I0512 07:31:38.134018 1 tasks_processing.go:74] worker 43 stopped. I0512 07:31:38.134121 1 recorder.go:75] Recording config/image with fingerprint=c8194fda5935f7632a04bc8fcdf0dd54d7e44a8131feb3d27a03af3fd6bc022a I0512 07:31:38.134155 1 gather.go:177] gatherer "clusterconfig" function "image" took 42.560623ms to process 1 records E0512 07:31:38.134166 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0512 07:31:38.134175 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 41.667936ms to process 0 records I0512 07:31:38.134182 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 42.776297ms to process 0 records I0512 07:31:38.134196 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 42.12731ms to process 0 records I0512 07:31:38.134203 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 41.101864ms to process 0 records I0512 07:31:38.134206 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 41.887026ms to process 0 records I0512 07:31:38.134210 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 40.747622ms to process 0 records I0512 07:31:38.134216 1 tasks_processing.go:74] worker 30 stopped. I0512 07:31:38.134221 1 tasks_processing.go:74] worker 58 stopped. I0512 07:31:38.134224 1 tasks_processing.go:74] worker 26 stopped. I0512 07:31:38.134228 1 tasks_processing.go:74] worker 14 stopped. I0512 07:31:38.134231 1 tasks_processing.go:74] worker 25 stopped. I0512 07:31:38.134235 1 tasks_processing.go:74] worker 20 stopped. I0512 07:31:38.134584 1 tasks_processing.go:74] worker 4 stopped. I0512 07:31:38.134719 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=7f66aab9e8796152e41754864d3ed0fbae70c8549c1376290c3599337aec22b3 I0512 07:31:38.134753 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=b7972c77bfaf0fe56d726ccf265bb763aafd87a7454388c9db15098fb0f9f183 I0512 07:31:38.134785 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=a62c0f52d195e1f5185d8d29ff12fd83989dd6231f7f1bb1059a76b1b3feee23 I0512 07:31:38.134803 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 42.781ms to process 3 records I0512 07:31:38.134818 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 43.455157ms to process 0 records I0512 07:31:38.134828 1 tasks_processing.go:74] worker 13 stopped. I0512 07:31:38.135383 1 tasks_processing.go:74] worker 51 stopped. I0512 07:31:38.135464 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=349e0084bb37e720dd6e8c9107d7643bb0ffdd70270489995245145003bfde4d I0512 07:31:38.135480 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=c1b99a2fcf95db164fe3d8ff8e4ce63663f09937f348ccd7ea99f09572dac99c I0512 07:31:38.135491 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 42.30171ms to process 2 records I0512 07:31:38.135569 1 tasks_processing.go:74] worker 29 stopped. I0512 07:31:38.135679 1 recorder.go:75] Recording config/authentication with fingerprint=48981d51ca4955ff6799ba75a2b0b61076a4ac0f9ec666eae0c0a587d6080f7d I0512 07:31:38.135694 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 41.490735ms to process 1 records I0512 07:31:38.135767 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=dd1ad7a2959dbe40389e6dc14c9b36998afb468aa00ca6aeb5259776275e0d96 I0512 07:31:38.135779 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 41.165619ms to process 1 records E0512 07:31:38.135788 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0512 07:31:38.135795 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 42.340279ms to process 0 records I0512 07:31:38.135813 1 tasks_processing.go:74] worker 34 stopped. I0512 07:31:38.135831 1 tasks_processing.go:74] worker 27 stopped. I0512 07:31:38.135926 1 tasks_processing.go:74] worker 60 stopped. I0512 07:31:38.135999 1 recorder.go:75] Recording config/apiserver with fingerprint=62050bcae4ccab7513156ea744602be41074423c68670a49a0b1eb038e16065d I0512 07:31:38.136014 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 43.372861ms to process 1 records I0512 07:31:38.136125 1 tasks_processing.go:74] worker 35 stopped. I0512 07:31:38.136207 1 recorder.go:75] Recording config/network with fingerprint=36e7c207f473e18d18dd341cbaa4016cbc16339eb2f1a2bc17add0efa0c074fa I0512 07:31:38.136221 1 gather.go:177] gatherer "clusterconfig" function "networks" took 41.474808ms to process 1 records I0512 07:31:38.136226 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 43.433768ms to process 0 records I0512 07:31:38.136236 1 tasks_processing.go:74] worker 19 stopped. I0512 07:31:38.136305 1 tasks_processing.go:74] worker 48 stopped. I0512 07:31:38.136427 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=0968e8fffd9f8f09d47cdc367e07eb6434162f5139632f1ad431f6395f115867 I0512 07:31:38.136437 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 42.535488ms to process 1 records I0512 07:31:38.136622 1 gather_logs.go:145] no pods in namespace were found I0512 07:31:38.136638 1 tasks_processing.go:74] worker 9 stopped. I0512 07:31:38.136645 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 44.677749ms to process 0 records I0512 07:31:38.136923 1 tasks_processing.go:74] worker 24 stopped. I0512 07:31:38.137243 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=1fb821b9d54a37a4391cd9a7ff530e9462b9fd4512ee3108909958ad57c8b924 I0512 07:31:38.137335 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=850819ab4be43fb1972baa0f496914653505002bbe788c228c254b25b78f78f4 I0512 07:31:38.137389 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=74e970eb62bb55420278ccaf80ab6bd97fe56b099aee26761a471bbbb4ce9b56 I0512 07:31:38.137402 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 45.97423ms to process 3 records I0512 07:31:38.137918 1 tasks_processing.go:74] worker 62 stopped. I0512 07:31:38.138770 1 recorder.go:75] Recording config/proxy with fingerprint=b3bcd3d0dccc32d0062b304f1cd75898a6f0a67370024cea817b244fa41249b5 I0512 07:31:38.138962 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 43.023922ms to process 1 records I0512 07:31:38.139229 1 tasks_processing.go:74] worker 10 stopped. I0512 07:31:38.139289 1 recorder.go:75] Recording config/featuregate with fingerprint=e9da5e2f566dab830b71b8297dbb20181f3c31a33eb33b7842dc649763384c82 I0512 07:31:38.139307 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 45.706338ms to process 1 records I0512 07:31:38.141285 1 tasks_processing.go:74] worker 18 stopped. I0512 07:31:38.141708 1 recorder.go:75] Recording config/node/ip-10-0-0-217.ec2.internal with fingerprint=200973685855a49ecd02edb20fe906a7ab44473a075542020d3f16a45e5f3bd1 I0512 07:31:38.141792 1 recorder.go:75] Recording config/node/ip-10-0-1-174.ec2.internal with fingerprint=f854085d48ae58fa07d23d4f4b96cc2bfabc2656262cf0d4ea3e81ebd0a06d07 I0512 07:31:38.141871 1 recorder.go:75] Recording config/node/ip-10-0-2-237.ec2.internal with fingerprint=03978fad8bb75361793908a14ce4e847b6609317c86c0c3178252f3851c90869 I0512 07:31:38.141884 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 49.694125ms to process 3 records I0512 07:31:38.141976 1 tasks_processing.go:74] worker 42 stopped. I0512 07:31:38.142023 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=73dd0ca695986283e5af51ed4cb8139dfbb4b860de3bf4ea07c6dc64b0556d40 I0512 07:31:38.142134 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=26409663b0d6440bab543bd4201b92a673233582d08af6a918f9c243b8a696df I0512 07:31:38.142180 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=baff39d3a7175e378fa300d5fe77bf36a9ac796486f6d728c9c9245c45d15ff6 I0512 07:31:38.142226 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=066e6a77df37c399e8831323ef5f31bf0951b836142a41fd3ed097bd2bcf2297 I0512 07:31:38.142274 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9339b2efbf1e820b3678751664c9a6bf3a5f81b6e2c09ac26a7a1a4b5ab5e019 I0512 07:31:38.142317 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=c07da2b85d07746dee4803ad41919b0e9f48ec7ea25a14f7bf412c9265a873b1 I0512 07:31:38.142366 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=5b7c02a4a9c7cf52555d7d27dafd5f614802f27b90dceaf680269b1374a1f206 I0512 07:31:38.142436 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=5c0049e9475a4556b9637be3a486bc90396cf8de1786b883846fd5694cf185a2 I0512 07:31:38.142478 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=1034f7f6e4567d89a932062bc25686ea6247729fb8231287f6ddc74e021ed9d5 I0512 07:31:38.142526 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=651a54916b1dbb7aa834488d338697445aea2659516c183d2792be8dd0b7477c I0512 07:31:38.142572 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=ccf2cc039ce7b41d3dac3208b38e81943e294e4b9103683251db35abca589c39 I0512 07:31:38.142582 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 49.89049ms to process 11 records I0512 07:31:38.142682 1 tasks_processing.go:74] worker 37 stopped. I0512 07:31:38.143215 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=11ffa3bd953fc07650828b953c022f82a7539ef7015bc0db99a96164fdd7638a I0512 07:31:38.143233 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 48.280928ms to process 1 records I0512 07:31:38.143279 1 tasks_processing.go:74] worker 0 stopped. I0512 07:31:38.143297 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 52.242037ms to process 0 records W0512 07:31:38.144306 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 07:31:38.144775 1 tasks_processing.go:74] worker 52 stopped. I0512 07:31:38.144815 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0512 07:31:38.144829 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 52.70519ms to process 1 records I0512 07:31:38.150788 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0512 07:31:38.150800 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0512 07:31:38.150811 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0512 07:31:38.151453 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0512 07:31:38.151460 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0512 07:31:38.152081 1 operator.go:288] started I0512 07:31:38.152112 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0512 07:31:38.153063 1 tasks_processing.go:74] worker 2 stopped. I0512 07:31:38.153219 1 recorder.go:75] Recording config/running_containers with fingerprint=265d75e981e133c6118dda65c3a86dada0ba2fea661820efd7be3a8feb466ac6 I0512 07:31:38.153240 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 61.939254ms to process 1 records I0512 07:31:38.153956 1 tasks_processing.go:74] worker 46 stopped. I0512 07:31:38.153984 1 recorder.go:75] Recording config/olm_operators with fingerprint=6da91abe86ed380d2050dfb47f1259e100a92b626c0f0e48e4e9a416491b42c6 I0512 07:31:38.154003 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 59.54641ms to process 1 records I0512 07:31:38.156440 1 base_controller.go:82] Caches are synced for ConfigController I0512 07:31:38.156454 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0512 07:31:38.160929 1 tasks_processing.go:74] worker 16 stopped. I0512 07:31:38.160944 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 70.018737ms to process 0 records I0512 07:31:38.170338 1 tasks_processing.go:74] worker 17 stopped. I0512 07:31:38.170598 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=a987bf98e92277036054c8ca7807aa30a98416720c905eea7a79c70b7d7fa04f I0512 07:31:38.170708 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b38679c78de234221be5bf230a43979e0419614ac37bd1915dad23cc98cc9227 I0512 07:31:38.170720 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 79.450315ms to process 2 records I0512 07:31:38.170728 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 76.431851ms to process 0 records I0512 07:31:38.170759 1 tasks_processing.go:74] worker 47 stopped. I0512 07:31:38.170831 1 tasks_processing.go:74] worker 54 stopped. I0512 07:31:38.171243 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=9e24329cb47c66144f1b62d2709ef0037638e4b2ff7f5a899f1f101cb3d0f9d6 I0512 07:31:38.171436 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=053e738053b093b90da261dcb80496d149d863544b7a4cfa3269ee7fb2ecdf43 I0512 07:31:38.171444 1 gather.go:177] gatherer "clusterconfig" function "crds" took 78.45516ms to process 2 records I0512 07:31:38.174032 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 07:31:38.174105 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0512 07:31:38.174115 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0512 07:31:38.174118 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0512 07:31:38.174122 1 controller.go:212] Source scaController *sca.Controller is not ready I0512 07:31:38.174126 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0512 07:31:38.174163 1 controller.go:489] The operator is still being initialized I0512 07:31:38.174172 1 controller.go:512] The operator is healthy I0512 07:31:38.177651 1 prometheus_rules.go:88] Prometheus rules successfully created E0512 07:31:38.180613 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2743f07b72-52b7-4062-838b-fff9d92ad5e4%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:46864->172.30.0.10:53: read: connection refused I0512 07:31:38.180628 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2743f07b72-52b7-4062-838b-fff9d92ad5e4%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:46864->172.30.0.10:53: read: connection refused I0512 07:31:38.196271 1 tasks_processing.go:74] worker 53 stopped. E0512 07:31:38.196291 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0512 07:31:38.196298 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0512 07:31:38.196307 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0512 07:31:38.196319 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0512 07:31:38.196346 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0512 07:31:38.196351 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0512 07:31:38.196355 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0512 07:31:38.196359 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0512 07:31:38.196396 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0512 07:31:38.196406 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0512 07:31:38.196411 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 102.467289ms to process 7 records I0512 07:31:38.216941 1 tasks_processing.go:74] worker 32 stopped. I0512 07:31:38.217228 1 recorder.go:75] Recording config/version with fingerprint=f894dd6ec57371a57be135f10882a94828a11059c35caa1c1e5d841658de0441 I0512 07:31:38.217241 1 recorder.go:75] Recording config/id with fingerprint=844ee72361d6b2bce58133e4fd14c8171a313c205d9de3a62c29294a48956270 I0512 07:31:38.217248 1 gather.go:177] gatherer "clusterconfig" function "version" took 122.565442ms to process 2 records I0512 07:31:38.218131 1 tasks_processing.go:74] worker 59 stopped. I0512 07:31:38.218163 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0512 07:31:38.218173 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 125.851292ms to process 1 records I0512 07:31:38.225854 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0512 07:31:38.229426 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:53557->172.30.0.10:53: read: connection refused I0512 07:31:38.229441 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:53557->172.30.0.10:53: read: connection refused I0512 07:31:38.252481 1 base_controller.go:82] Caches are synced for LoggingSyncer I0512 07:31:38.252499 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0512 07:31:38.260529 1 tasks_processing.go:74] worker 61 stopped. E0512 07:31:38.260547 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0512 07:31:38.260553 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q88aiaja78vnur343bhp1h2inmshtq3-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q88aiaja78vnur343bhp1h2inmshtq3-primary-cert-bundle-secret" not found I0512 07:31:38.260614 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=3b59639bc7e15d701e8e43af67def635d15fd6f9c3f7c046bec792b0965b53e3 I0512 07:31:38.260631 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 169.082861ms to process 1 records I0512 07:31:38.552231 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0512 07:31:38.552252 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0512 07:31:38.553026 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-f28np pod in namespace openshift-dns (previous: false). I0512 07:31:38.787815 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f28np pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-f28np\" is waiting to start: ContainerCreating" I0512 07:31:38.787837 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-f28np\" is waiting to start: ContainerCreating" I0512 07:31:38.787845 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-f28np pod in namespace openshift-dns (previous: false). I0512 07:31:38.959497 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f28np pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-f28np\" is waiting to start: ContainerCreating" I0512 07:31:38.959517 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-f28np\" is waiting to start: ContainerCreating" I0512 07:31:38.959528 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pc94r pod in namespace openshift-dns (previous: false). W0512 07:31:39.140312 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 07:31:39.189066 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pc94r pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pc94r\" is waiting to start: ContainerCreating" I0512 07:31:39.189085 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pc94r\" is waiting to start: ContainerCreating" I0512 07:31:39.189094 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pc94r pod in namespace openshift-dns (previous: false). I0512 07:31:39.362153 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pc94r pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-pc94r\" is waiting to start: ContainerCreating" I0512 07:31:39.362172 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-pc94r\" is waiting to start: ContainerCreating" I0512 07:31:39.362186 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xf9t5 pod in namespace openshift-dns (previous: false). I0512 07:31:39.580382 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0512 07:31:39.586569 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xf9t5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xf9t5\" is waiting to start: ContainerCreating" I0512 07:31:39.586586 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xf9t5\" is waiting to start: ContainerCreating" I0512 07:31:39.586595 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xf9t5 pod in namespace openshift-dns (previous: false). I0512 07:31:39.759641 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xf9t5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xf9t5\" is waiting to start: ContainerCreating" I0512 07:31:39.759661 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xf9t5\" is waiting to start: ContainerCreating" I0512 07:31:39.759672 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-564pn pod in namespace openshift-dns (previous: false). I0512 07:31:39.960784 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:39.960803 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-lgtbp pod in namespace openshift-dns (previous: false). I0512 07:31:39.983242 1 tasks_processing.go:74] worker 57 stopped. I0512 07:31:39.983301 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=a76a6a56074d148ec9b4443f9693583f08e9ec48e2fb0ad7be5f96831e3640ba I0512 07:31:39.983338 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=72419f3cb3bec8dec7de7f7c413792b6f66b1c41b8b53f574437e2861250d501 I0512 07:31:39.983371 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0512 07:31:39.983397 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=bdb6c7ee5e56736591a9e9947283394caf711ca3a8a9835b9d470ff226480e57 I0512 07:31:39.983414 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0512 07:31:39.983455 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=ebeb63c07aeadedbe1796cdbe44c473f564d081b313f583dc8cb573dcb990de4 I0512 07:31:39.983486 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=2d389c3830109935d8628e1f7035f0aa15444eb1067e83dff99bf67cfb677ddd I0512 07:31:39.983510 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=cccf6f4771b3fcf36818280020eff97f7425d49ca09d2d0ade756d00049f8c65 I0512 07:31:39.983524 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=7fa09398cc56108282a9a75d7bd6eb90e6aca0a5245c1a044ca110fcf353db5a I0512 07:31:39.983546 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=0e0622f9ac07a74dbdf95d8e7eb3ea20fe892266aa958dc00e7a55450b0f692c I0512 07:31:39.983556 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0512 07:31:39.983589 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=1856b0777f6df0f97408e1d6f3bdf0e9c838c414670668a7399bcf4655d297d3 I0512 07:31:39.983600 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0512 07:31:39.983616 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=9a8986c078a921593dfd5b1d0811d5739faf902135c3a96ed39304bbb9470a7e I0512 07:31:39.983626 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0512 07:31:39.983644 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=73dfa354959d61aea78be50dac3d55ea56a3336f4313b7958f09926523b921d6 I0512 07:31:39.983654 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0512 07:31:39.983670 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=e04d716f697217d7d2bffa4387b8799439435e64214090ca0f3d38a4f813a0b4 I0512 07:31:39.983779 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e4e6faa8ab11add9a685ecfad591b0c4a117170c2d73b7ee8fa79dae3bd13aa3 I0512 07:31:39.983789 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0512 07:31:39.983796 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0512 07:31:39.983818 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0512 07:31:39.983839 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=e44e4c2e0804f4f7aa424c9275c9555ba9d28f068211c1a3ca871764402e44e5 I0512 07:31:39.983864 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=9db7063c505ad28c8e929de8be22fc026e448587ad796f64adc39bd38ce7c68d I0512 07:31:39.983873 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0512 07:31:39.983896 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f2641ceb3591c0b20b9c7c721eaa902c7b366b00301010e376131ba4713a2165 I0512 07:31:39.983907 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0512 07:31:39.983921 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=95fc8d3ce4d66dcad6151e7de1508a64db189894899d86c00727e9d478748f20 I0512 07:31:39.983936 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=947b5771cddb08dd98e276e2f7be544c22ada3f3bf2515ec32369969e96b6796 I0512 07:31:39.983951 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=d59460177bc354bd23a4c7bf5d625231d593543d81a31a96ee4de00a6a230dd5 I0512 07:31:39.983965 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1ccc2d9dd9b82960345053c12b07cf9155d6e69c6df8ce10070ba8e068925c0c I0512 07:31:39.983978 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=90287cf4d653c3e70160b72f7c291d173010b6c4cf6feb207c95bf52ecbf89ce I0512 07:31:39.984007 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=b2a681248f99779c7f84ced0ac5c34b5259bbcf8e563605d28bf7d5467307d1a I0512 07:31:39.984023 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0512 07:31:39.984032 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0512 07:31:39.984040 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.892215008s to process 35 records W0512 07:31:40.140831 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 07:31:40.160365 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:40.160383 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-slgh4 pod in namespace openshift-dns (previous: false). I0512 07:31:40.363359 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:40.363419 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8c66b755f-nxrrl pod in namespace openshift-image-registry (previous: false). I0512 07:31:40.559029 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8c66b755f-nxrrl pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8c66b755f-nxrrl\" is waiting to start: ContainerCreating" I0512 07:31:40.559049 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8c66b755f-nxrrl\" is waiting to start: ContainerCreating" I0512 07:31:40.559096 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8c66b755f-qcv7b pod in namespace openshift-image-registry (previous: false). I0512 07:31:40.769421 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8c66b755f-qcv7b pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8c66b755f-qcv7b\" is waiting to start: ContainerCreating" I0512 07:31:40.769441 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8c66b755f-qcv7b\" is waiting to start: ContainerCreating" I0512 07:31:40.769488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-c4749f7fb-cnmhc pod in namespace openshift-image-registry (previous: false). I0512 07:31:40.959296 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-c4749f7fb-cnmhc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-c4749f7fb-cnmhc\" is waiting to start: ContainerCreating" I0512 07:31:40.959316 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-c4749f7fb-cnmhc\" is waiting to start: ContainerCreating" I0512 07:31:40.959327 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ckk7z pod in namespace openshift-image-registry (previous: false). W0512 07:31:41.140692 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 07:31:41.163197 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:41.163215 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-f55hl pod in namespace openshift-image-registry (previous: false). I0512 07:31:41.366920 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:41.367047 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-vs4t4 pod in namespace openshift-image-registry (previous: false). I0512 07:31:41.561073 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0512 07:31:41.561093 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-77d68f77-8xwjn pod in namespace openshift-ingress (previous: false). I0512 07:31:41.762446 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-77d68f77-8xwjn pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-77d68f77-8xwjn\" is waiting to start: ContainerCreating" I0512 07:31:41.762462 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-77d68f77-8xwjn\" is waiting to start: ContainerCreating" I0512 07:31:41.762473 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f87fb5c7b-7v6cj pod in namespace openshift-ingress (previous: false). I0512 07:31:41.959835 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f87fb5c7b-7v6cj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f87fb5c7b-7v6cj\" is waiting to start: ContainerCreating" I0512 07:31:41.959855 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f87fb5c7b-7v6cj\" is waiting to start: ContainerCreating" I0512 07:31:41.959864 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f87fb5c7b-bgm9k pod in namespace openshift-ingress (previous: false). W0512 07:31:42.140892 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0512 07:31:42.158161 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f87fb5c7b-bgm9k pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f87fb5c7b-bgm9k\" is waiting to start: ContainerCreating" I0512 07:31:42.158178 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f87fb5c7b-bgm9k\" is waiting to start: ContainerCreating" I0512 07:31:42.158204 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8skr6 pod in namespace openshift-ingress-canary (previous: false). I0512 07:31:42.369768 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-8skr6 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8skr6\" is waiting to start: ContainerCreating" I0512 07:31:42.369788 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8skr6\" is waiting to start: ContainerCreating" I0512 07:31:42.369808 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hpf6v pod in namespace openshift-ingress-canary (previous: false). I0512 07:31:42.579694 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-hpf6v pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hpf6v\" is waiting to start: ContainerCreating" I0512 07:31:42.579710 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hpf6v\" is waiting to start: ContainerCreating" I0512 07:31:42.579745 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-m6ztm pod in namespace openshift-ingress-canary (previous: false). I0512 07:31:42.766725 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-m6ztm pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m6ztm\" is waiting to start: ContainerCreating" I0512 07:31:42.766744 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m6ztm\" is waiting to start: ContainerCreating" I0512 07:31:42.766761 1 tasks_processing.go:74] worker 63 stopped. I0512 07:31:42.766845 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=e7ac2c5f604cfeab2b01bbd98d1d1ccbdd5469709316b5f695fd2b6a92beb818 I0512 07:31:42.766957 1 recorder.go:75] Recording events/openshift-dns with fingerprint=a185950ec34385253e1a12a246a0cac0717fdf3098809ec9d55a66a4f0c8739d I0512 07:31:42.767052 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=7ef524ed7301431e95b4d2d7c44358efe3586747155edebb24f4e8c1c654ec9b I0512 07:31:42.767080 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=4f6ae237ba10614ca0d5f3b8f6870627911ee0032d964b1dd63937ec79f477b0 I0512 07:31:42.767133 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=7ff929cc67cc797374996c44d7f29b34555afa70dd17dded1afd917027038993 I0512 07:31:42.767179 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=e87fe7b26392907df39877dd1597373a221ee50e5867d009d5e23ef9e3bba314 I0512 07:31:42.768593 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-8c66b755f-nxrrl with fingerprint=f618b14f1bfd39564b9f272c568c27c7b23c69ae1f5a491016ede260a7bd8597 I0512 07:31:42.768725 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-8c66b755f-qcv7b with fingerprint=1b16409a939830510b48e9274d975457261a21e2be41a5435ccea3d75c6f1d55 I0512 07:31:42.768825 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-c4749f7fb-cnmhc with fingerprint=3a28e5a41dab4b3693a490db679354b0be05b80c4287257669eb73e7a2556f71 I0512 07:31:42.768892 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-8skr6 with fingerprint=a696060d5b7d93037545153d1fd3c977a9a12d36f9e4876fa5892e32b480f27a I0512 07:31:42.768959 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-m6ztm with fingerprint=b875c4d6c0af41e07e0b59115e3784c1e9d2db8ad4c652f0677f1bbeef6bdbec I0512 07:31:42.768970 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.674877863s to process 11 records W0512 07:31:43.137348 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded E0512 07:31:43.137381 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0512 07:31:43.137373 1 tasks_processing.go:74] worker 23 stopped. I0512 07:31:43.137409 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0512 07:31:43.137425 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0512 07:31:43.137434 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.045751317s to process 1 records I0512 07:31:50.536504 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 07:31:50.952845 1 tasks_processing.go:74] worker 28 stopped. I0512 07:31:50.952887 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0512 07:31:50.952900 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.861231145s to process 1 records I0512 07:31:51.647863 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 07:31:51.699433 1 tasks_processing.go:74] worker 8 stopped. I0512 07:31:51.699705 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=c5e0ad81555672a1ae6992800f0e8a9ad0a7406d6b5e671cb8278224bb66f9c4 I0512 07:31:51.699725 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608136009s to process 1 records E0512 07:31:51.699783 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0512 07:31:51.700881 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0512 07:31:51.700894 1 periodic.go:209] Running workloads gatherer I0512 07:31:51.700912 1 tasks_processing.go:45] number of workers: 2 I0512 07:31:51.700918 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 07:31:51.700922 1 tasks_processing.go:71] worker 1 working on workload_info task. I0512 07:31:51.700928 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 07:31:51.700941 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0512 07:31:51.741289 1 tasks_processing.go:74] worker 0 stopped. I0512 07:31:51.741305 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 40.331946ms to process 0 records I0512 07:31:51.822249 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0512 07:31:51.833048 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (12ms) I0512 07:31:51.845436 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (12ms) I0512 07:31:51.853649 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 07:31:51.859869 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (14ms) I0512 07:31:51.872587 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (13ms) I0512 07:31:51.884009 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (11ms) I0512 07:31:51.901657 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (18ms) I0512 07:31:51.912465 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (11ms) I0512 07:31:51.924393 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (12ms) I0512 07:31:51.935089 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (11ms) I0512 07:31:51.946106 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (11ms) I0512 07:31:51.959463 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (13ms) I0512 07:31:52.033868 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (74ms) I0512 07:31:52.133805 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0512 07:31:52.234009 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (100ms) I0512 07:31:52.334153 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0512 07:31:52.441480 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (107ms) I0512 07:31:52.533301 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (92ms) I0512 07:31:52.633337 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0512 07:31:52.736847 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (103ms) I0512 07:31:52.835062 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (98ms) I0512 07:31:52.936103 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0512 07:31:53.034042 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (98ms) I0512 07:31:53.134610 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0512 07:31:53.233521 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms) I0512 07:31:53.333320 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0512 07:31:53.432916 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0512 07:31:53.533615 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (101ms) I0512 07:31:53.633925 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0512 07:31:53.734084 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0512 07:31:53.833956 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0512 07:31:53.933396 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0512 07:31:54.037856 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (104ms) I0512 07:31:54.140771 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (103ms) I0512 07:31:54.253275 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (112ms) I0512 07:31:54.253310 1 tasks_processing.go:74] worker 1 stopped. E0512 07:31:54.253322 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0512 07:31:54.253630 1 recorder.go:75] Recording config/workload_info with fingerprint=b838ccb4e6c38cb514b4ae57f7dbf8d423540e742413a47b6ef727d96b16cdbb I0512 07:31:54.253651 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.552380866s to process 1 records E0512 07:31:54.253683 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.552s with: function \"workload_info\" failed with an error" I0512 07:31:54.254784 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0512 07:31:54.254796 1 periodic.go:209] Running conditional gatherer I0512 07:31:54.266224 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0512 07:31:54.272463 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.11:47242->172.30.0.10:53: read: connection refused E0512 07:31:54.272708 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0512 07:31:54.272799 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0512 07:31:54.289772 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0512 07:31:54.289795 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289801 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289804 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289808 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289811 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289814 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289817 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289820 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0512 07:31:54.289825 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0512 07:31:54.289843 1 tasks_processing.go:45] number of workers: 3 I0512 07:31:54.289854 1 tasks_processing.go:69] worker 2 listening for tasks. I0512 07:31:54.289858 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0512 07:31:54.289865 1 tasks_processing.go:69] worker 0 listening for tasks. I0512 07:31:54.289875 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0512 07:31:54.289880 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0512 07:31:54.289880 1 tasks_processing.go:69] worker 1 listening for tasks. I0512 07:31:54.289888 1 tasks_processing.go:74] worker 1 stopped. I0512 07:31:54.289945 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0512 07:31:54.289958 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 862ns to process 1 records I0512 07:31:54.289996 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0512 07:31:54.290005 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.156µs to process 1 records I0512 07:31:54.290010 1 tasks_processing.go:74] worker 0 stopped. I0512 07:31:54.290119 1 tasks_processing.go:74] worker 2 stopped. I0512 07:31:54.290130 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 233.992µs to process 0 records I0512 07:31:54.290167 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.11:47242->172.30.0.10:53: read: connection refused I0512 07:31:54.290185 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0512 07:31:54.344162 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=ebe3a3b48fee67e40d60648c0ec147644f2158fa566182ebe93901a8d1539fbe I0512 07:31:54.344287 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-05-12-073154.tar.gz I0512 07:31:54.350802 1 diskrecorder.go:51] Wrote 105 records to disk in 6ms I0512 07:31:54.350832 1 periodic.go:278] Gathering cluster info every 2h0m0s I0512 07:31:54.350846 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0512 07:32:04.589036 1 configmapobserver.go:84] configmaps "insights-config" not found I0512 07:32:47.688668 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="82e425770d16b12b84f571d0beb4b7bf0b2d7b2225aa166ea5ad2a9d75ed6673") W0512 07:32:47.688711 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0512 07:32:47.688758 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="4a7a89d3f53e09add3878d0fc8301bdc4bb33c0a112e1efbc9c9373d2bf14092") I0512 07:32:47.688833 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="c0baa7b7710f68fd866a5194e8d34f25a5087c0494c4bcd1b0704e0ca9e51e46") I0512 07:32:47.688852 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0512 07:32:47.688889 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0512 07:32:47.688918 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0512 07:32:47.688943 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0512 07:32:47.688953 1 base_controller.go:181] Shutting down LoggingSyncer ... I0512 07:32:47.688961 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0512 07:32:47.688973 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0512 07:32:47.688974 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0512 07:32:47.688975 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0512 07:32:47.688987 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0512 07:32:47.688973 1 base_controller.go:181] Shutting down ConfigController ... I0512 07:32:47.688999 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0512 07:32:47.689010 1 base_controller.go:113] All ConfigController workers have been terminated