I0430 13:51:21.897880 1 cmd.go:253] Using service-serving-cert provided certificates I0430 13:51:21.898368 1 observer_polling.go:159] Starting file observer I0430 13:51:22.276441 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0430 13:51:22.276633 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0430 13:51:22.277219 1 secure_serving.go:57] Forcing use of http/1.1 only W0430 13:51:22.277241 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0430 13:51:22.277245 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0430 13:51:22.277249 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0430 13:51:22.277252 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0430 13:51:22.277255 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0430 13:51:22.277257 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0430 13:51:22.277274 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0430 13:51:22.281222 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0430 13:51:22.281297 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"46ff1ca6-e08f-4bf1-b26a-bda03838fb7a", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0430 13:51:22.282040 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0430 13:51:22.282060 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0430 13:51:22.282249 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0430 13:51:22.282291 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:51:22.282069 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0430 13:51:22.282327 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:51:22.283089 1 secure_serving.go:213] Serving securely on [::]:8443 I0430 13:51:22.283089 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0430 13:51:22.283129 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0430 13:51:22.286469 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0430 13:51:22.286504 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:51:22.286539 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0430 13:51:22.291169 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:51:22.291187 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:51:22.296594 1 secretconfigobserver.go:119] support secret does not exist I0430 13:51:22.301005 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:51:22.304569 1 secretconfigobserver.go:119] support secret does not exist I0430 13:51:22.307063 1 recorder.go:161] Pruning old reports every 8h17m13s, max age is 288h0m0s I0430 13:51:22.311569 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0430 13:51:22.311586 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0430 13:51:22.311589 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0430 13:51:22.311597 1 insightsreport.go:296] Starting report retriever I0430 13:51:22.311596 1 periodic.go:209] Running clusterconfig gatherer I0430 13:51:22.311603 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0430 13:51:22.311642 1 tasks_processing.go:45] number of workers: 64 I0430 13:51:22.311670 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:51:22.311682 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:51:22.311693 1 tasks_processing.go:69] worker 3 listening for tasks. I0430 13:51:22.311690 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:51:22.311739 1 tasks_processing.go:71] worker 0 working on version task. I0430 13:51:22.311753 1 tasks_processing.go:69] worker 35 listening for tasks. I0430 13:51:22.311758 1 tasks_processing.go:71] worker 35 working on mutating_webhook_configurations task. I0430 13:51:22.311763 1 tasks_processing.go:69] worker 51 listening for tasks. I0430 13:51:22.311770 1 tasks_processing.go:69] worker 59 listening for tasks. I0430 13:51:22.311777 1 tasks_processing.go:69] worker 52 listening for tasks. I0430 13:51:22.311783 1 tasks_processing.go:69] worker 56 listening for tasks. I0430 13:51:22.311772 1 tasks_processing.go:69] worker 36 listening for tasks. I0430 13:51:22.311790 1 tasks_processing.go:69] worker 57 listening for tasks. I0430 13:51:22.311791 1 tasks_processing.go:69] worker 55 listening for tasks. I0430 13:51:22.311795 1 tasks_processing.go:69] worker 58 listening for tasks. I0430 13:51:22.311793 1 tasks_processing.go:69] worker 37 listening for tasks. I0430 13:51:22.311800 1 tasks_processing.go:69] worker 38 listening for tasks. I0430 13:51:22.311801 1 tasks_processing.go:69] worker 61 listening for tasks. I0430 13:51:22.311805 1 tasks_processing.go:69] worker 60 listening for tasks. I0430 13:51:22.311803 1 tasks_processing.go:69] worker 63 listening for tasks. I0430 13:51:22.311811 1 tasks_processing.go:69] worker 45 listening for tasks. I0430 13:51:22.311809 1 tasks_processing.go:69] worker 54 listening for tasks. I0430 13:51:22.311815 1 tasks_processing.go:71] worker 2 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0430 13:51:22.311820 1 tasks_processing.go:69] worker 47 listening for tasks. I0430 13:51:22.311821 1 tasks_processing.go:71] worker 3 working on pdbs task. I0430 13:51:22.311824 1 tasks_processing.go:69] worker 41 listening for tasks. I0430 13:51:22.311827 1 tasks_processing.go:69] worker 53 listening for tasks. I0430 13:51:22.311828 1 tasks_processing.go:69] worker 62 listening for tasks. I0430 13:51:22.311852 1 tasks_processing.go:69] worker 43 listening for tasks. I0430 13:51:22.311855 1 tasks_processing.go:71] worker 1 working on cost_management_metrics_configs task. I0430 13:51:22.311830 1 tasks_processing.go:69] worker 48 listening for tasks. I0430 13:51:22.311862 1 tasks_processing.go:69] worker 44 listening for tasks. I0430 13:51:22.311857 1 tasks_processing.go:69] worker 50 listening for tasks. I0430 13:51:22.311813 1 tasks_processing.go:69] worker 46 listening for tasks. I0430 13:51:22.311817 1 tasks_processing.go:69] worker 40 listening for tasks. I0430 13:51:22.311809 1 tasks_processing.go:69] worker 39 listening for tasks. I0430 13:51:22.311831 1 tasks_processing.go:69] worker 42 listening for tasks. I0430 13:51:22.311877 1 tasks_processing.go:69] worker 21 listening for tasks. I0430 13:51:22.311878 1 tasks_processing.go:69] worker 13 listening for tasks. I0430 13:51:22.311875 1 tasks_processing.go:69] worker 49 listening for tasks. I0430 13:51:22.311884 1 tasks_processing.go:69] worker 31 listening for tasks. I0430 13:51:22.311868 1 tasks_processing.go:69] worker 19 listening for tasks. I0430 13:51:22.311889 1 tasks_processing.go:69] worker 8 listening for tasks. I0430 13:51:22.311869 1 tasks_processing.go:69] worker 27 listening for tasks. I0430 13:51:22.311872 1 tasks_processing.go:69] worker 20 listening for tasks. I0430 13:51:22.311874 1 tasks_processing.go:69] worker 12 listening for tasks. I0430 13:51:22.311900 1 tasks_processing.go:69] worker 10 listening for tasks. I0430 13:51:22.311901 1 tasks_processing.go:69] worker 16 listening for tasks. I0430 13:51:22.311905 1 tasks_processing.go:69] worker 17 listening for tasks. I0430 13:51:22.311898 1 tasks_processing.go:69] worker 29 listening for tasks. I0430 13:51:22.311909 1 tasks_processing.go:69] worker 25 listening for tasks. I0430 13:51:22.311880 1 tasks_processing.go:69] worker 4 listening for tasks. I0430 13:51:22.311914 1 tasks_processing.go:69] worker 18 listening for tasks. I0430 13:51:22.311911 1 tasks_processing.go:69] worker 32 listening for tasks. I0430 13:51:22.311913 1 tasks_processing.go:69] worker 5 listening for tasks. I0430 13:51:22.311917 1 tasks_processing.go:69] worker 30 listening for tasks. I0430 13:51:22.311918 1 tasks_processing.go:69] worker 6 listening for tasks. I0430 13:51:22.311882 1 tasks_processing.go:69] worker 22 listening for tasks. I0430 13:51:22.311888 1 tasks_processing.go:69] worker 14 listening for tasks. I0430 13:51:22.311892 1 tasks_processing.go:69] worker 28 listening for tasks. I0430 13:51:22.311895 1 tasks_processing.go:69] worker 15 listening for tasks. I0430 13:51:22.311896 1 tasks_processing.go:69] worker 9 listening for tasks. I0430 13:51:22.311900 1 tasks_processing.go:69] worker 23 listening for tasks. I0430 13:51:22.311944 1 tasks_processing.go:69] worker 34 listening for tasks. I0430 13:51:22.311905 1 tasks_processing.go:69] worker 24 listening for tasks. I0430 13:51:22.311906 1 tasks_processing.go:69] worker 33 listening for tasks. I0430 13:51:22.311875 1 tasks_processing.go:69] worker 11 listening for tasks. I0430 13:51:22.311906 1 tasks_processing.go:69] worker 7 listening for tasks. I0430 13:51:22.311915 1 tasks_processing.go:69] worker 26 listening for tasks. I0430 13:51:22.311987 1 tasks_processing.go:71] worker 51 working on ingress task. I0430 13:51:22.311994 1 tasks_processing.go:71] worker 56 working on machine_autoscalers task. I0430 13:51:22.311995 1 tasks_processing.go:71] worker 52 working on openstack_version task. I0430 13:51:22.311999 1 tasks_processing.go:71] worker 26 working on crds task. I0430 13:51:22.312004 1 tasks_processing.go:71] worker 37 working on feature_gates task. I0430 13:51:22.312007 1 tasks_processing.go:71] worker 36 working on nodes task. I0430 13:51:22.312015 1 tasks_processing.go:71] worker 10 working on overlapping_namespace_uids task. I0430 13:51:22.312027 1 tasks_processing.go:71] worker 60 working on networks task. I0430 13:51:22.312048 1 tasks_processing.go:71] worker 22 working on openstack_dataplanenodesets task. I0430 13:51:22.312061 1 tasks_processing.go:71] worker 41 working on oauths task. I0430 13:51:22.312000 1 tasks_processing.go:71] worker 58 working on image task. I0430 13:51:22.312069 1 tasks_processing.go:71] worker 34 working on storage_classes task. I0430 13:51:22.312072 1 tasks_processing.go:71] worker 28 working on config_maps task. I0430 13:51:22.312354 1 tasks_processing.go:71] worker 63 working on sap_config task. I0430 13:51:22.312411 1 tasks_processing.go:71] worker 62 working on qemu_kubevirt_launcher_logs task. I0430 13:51:22.312451 1 tasks_processing.go:71] worker 11 working on operators task. I0430 13:51:22.312542 1 tasks_processing.go:71] worker 12 working on machines task. I0430 13:51:22.312544 1 tasks_processing.go:71] worker 24 working on container_runtime_configs task. I0430 13:51:22.312554 1 tasks_processing.go:71] worker 45 working on ingress_certificates task. I0430 13:51:22.312602 1 tasks_processing.go:71] worker 18 working on sap_pods task. I0430 13:51:22.312425 1 tasks_processing.go:71] worker 19 working on lokistack task. I0430 13:51:22.312629 1 tasks_processing.go:71] worker 5 working on tsdb_status task. I0430 13:51:22.312640 1 tasks_processing.go:71] worker 54 working on openstack_dataplanedeployments task. I0430 13:51:22.311996 1 tasks_processing.go:71] worker 55 working on machine_config_pools task. I0430 13:51:22.312715 1 tasks_processing.go:71] worker 29 working on image_pruners task. I0430 13:51:22.312781 1 tasks_processing.go:71] worker 16 working on certificate_signing_requests task. I0430 13:51:22.312782 1 tasks_processing.go:71] worker 30 working on node_logs task. I0430 13:51:22.312795 1 tasks_processing.go:71] worker 25 working on jaegers task. I0430 13:51:22.312861 1 tasks_processing.go:71] worker 6 working on openshift_machine_api_events task. I0430 13:51:22.312061 1 tasks_processing.go:71] worker 23 working on openshift_logging task. I0430 13:51:22.312998 1 tasks_processing.go:71] worker 48 working on monitoring_persistent_volumes task. I0430 13:51:22.312323 1 tasks_processing.go:71] worker 53 working on validating_webhook_configurations task. I0430 13:51:22.312078 1 tasks_processing.go:71] worker 42 working on support_secret task. I0430 13:51:22.313302 1 tasks_processing.go:71] worker 40 working on service_accounts task. I0430 13:51:22.313334 1 tasks_processing.go:71] worker 4 working on cluster_apiserver task. I0430 13:51:22.312364 1 tasks_processing.go:71] worker 61 working on machine_sets task. I0430 13:51:22.312067 1 tasks_processing.go:71] worker 14 working on proxies task. I0430 13:51:22.311992 1 tasks_processing.go:71] worker 47 working on schedulers task. I0430 13:51:22.312072 1 tasks_processing.go:71] worker 33 working on storage_cluster task. I0430 13:51:22.312382 1 tasks_processing.go:71] worker 21 working on nodenetworkconfigurationpolicies task. I0430 13:51:22.313881 1 tasks_processing.go:71] worker 44 working on machine_healthchecks task. I0430 13:51:22.312394 1 tasks_processing.go:71] worker 15 working on openstack_controlplanes task. I0430 13:51:22.312441 1 tasks_processing.go:71] worker 13 working on aggregated_monitoring_cr_names task. I0430 13:51:22.312444 1 tasks_processing.go:71] worker 27 working on pod_network_connectivity_checks task. I0430 13:51:22.312447 1 tasks_processing.go:71] worker 49 working on dvo_metrics task. I0430 13:51:22.312453 1 tasks_processing.go:71] worker 31 working on infrastructures task. I0430 13:51:22.312460 1 tasks_processing.go:71] worker 20 working on container_images task. I0430 13:51:22.312453 1 tasks_processing.go:71] worker 8 working on machine_configs task. I0430 13:51:22.312482 1 tasks_processing.go:71] worker 7 working on sap_datahubs task. I0430 13:51:22.312510 1 tasks_processing.go:71] worker 9 working on olm_operators task. I0430 13:51:22.312613 1 tasks_processing.go:71] worker 32 working on operators_pods_and_events task. I0430 13:51:22.312880 1 tasks_processing.go:71] worker 17 working on authentication task. I0430 13:51:22.312892 1 tasks_processing.go:71] worker 50 working on nodenetworkstates task. I0430 13:51:22.315254 1 tasks_processing.go:71] worker 59 working on metrics task. I0430 13:51:22.312896 1 tasks_processing.go:71] worker 43 working on active_alerts task. I0430 13:51:22.313296 1 tasks_processing.go:71] worker 46 working on image_registries task. I0430 13:51:22.311990 1 tasks_processing.go:71] worker 57 working on install_plans task. I0430 13:51:22.313464 1 tasks_processing.go:71] worker 39 working on silenced_alerts task. I0430 13:51:22.312077 1 tasks_processing.go:71] worker 38 working on clusterroles task. I0430 13:51:22.316795 1 tasks_processing.go:71] worker 56 working on ceph_cluster task. I0430 13:51:22.316809 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 4.792221ms to process 0 records I0430 13:51:22.317448 1 tasks_processing.go:74] worker 1 stopped. I0430 13:51:22.317462 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.580293ms to process 0 records I0430 13:51:22.319472 1 tasks_processing.go:74] worker 24 stopped. I0430 13:51:22.319490 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 6.905524ms to process 0 records I0430 13:51:22.319519 1 tasks_processing.go:74] worker 63 stopped. I0430 13:51:22.319527 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 7.106065ms to process 0 records I0430 13:51:22.319964 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0430 13:51:22.319971 1 tasks_processing.go:74] worker 41 stopped. I0430 13:51:22.319980 1 controller.go:326] The initial operator extension status is healthy I0430 13:51:22.319989 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:51:22.319994 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:51:22.319996 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:51:22.320011 1 controller.go:489] The operator is still being initialized I0430 13:51:22.320016 1 controller.go:512] The operator is healthy E0430 13:51:22.320011 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:44406->172.30.0.10:53: read: connection refused E0430 13:51:22.320043 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:44406->172.30.0.10:53: read: connection refused E0430 13:51:22.320052 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:55291->172.30.0.10:53: read: connection refused E0430 13:51:22.320075 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:55291->172.30.0.10:53: read: connection refused I0430 13:51:22.320090 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0430 13:51:22.320116 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0430 13:51:22.320183 1 recorder.go:75] Recording config/oauth with fingerprint=80704eacde2edda4b01d358f95cd555d9e0e5db924dbcdb1b60714de27f6f4ff I0430 13:51:22.320197 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 7.893564ms to process 1 records W0430 13:51:22.320238 1 operator.go:288] started I0430 13:51:22.320262 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0430 13:51:22.320277 1 tasks_processing.go:74] worker 60 stopped. I0430 13:51:22.320316 1 recorder.go:75] Recording config/network with fingerprint=747abce2c39abe312753616073c764e329fceacb555548437cbd43b30f167dfd I0430 13:51:22.320325 1 gather.go:177] gatherer "clusterconfig" function "networks" took 7.925248ms to process 1 records I0430 13:51:22.320394 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=d627cbc3049208567084acb087f10082d17a076175616da6be2e40b280acaf86 I0430 13:51:22.320402 1 tasks_processing.go:74] worker 3 stopped. I0430 13:51:22.320408 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=a2378b530cff52a2125432a4ea97eb7dddc0ae6ec62c2f636534a204d5078c58 I0430 13:51:22.320421 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=7604e65b1fb5367b343e09b2c874f96271295d18f559f428db773afe3b949ab8 I0430 13:51:22.320442 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=a9a55507aefbbedf4eaa004802c5606609f90023bff91e460c3e07608b613d5c I0430 13:51:22.320459 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=51f2e7a66c1860be292a6304470957c191846cb8c304e221271a6f293c70be8f I0430 13:51:22.320474 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=00ed06f3fdae73174ab76fe23dfaa082a34e7807d64b07a8fae3509eeb84f9db I0430 13:51:22.320489 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=5349bacf2fa2ed4ed4ed50d62e790510cc352887b08487765480680dc61a1e96 I0430 13:51:22.320506 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=b2a023c45880d6dfa296df3baf267a33f3b9f9e9b9d1d853fd0904d434d5e856 I0430 13:51:22.320521 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=8eb58e16da8299d0e7165b87478ea4d2ec873baf0e3bb6511bc975523902cc6d I0430 13:51:22.320537 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=9eded2161047216821eb05801c2fdf3e4fc730b72504f4937c2f4c44361f1f0d I0430 13:51:22.320553 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f3412f9f10f961894cc5025815a0de208ee75aecbdf479e5c81b9a8bb5d673e5 I0430 13:51:22.320560 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 8.170792ms to process 11 records E0430 13:51:22.320569 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:44406->172.30.0.10:53: read: connection refused I0430 13:51:22.320585 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.757782ms to process 0 records E0430 13:51:22.320596 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:44406->172.30.0.10:53: read: connection refused I0430 13:51:22.320606 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 7.419687ms to process 0 records E0430 13:51:22.320613 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:55291->172.30.0.10:53: read: connection refused I0430 13:51:22.320620 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 4.420336ms to process 0 records E0430 13:51:22.320628 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:55291->172.30.0.10:53: read: connection refused I0430 13:51:22.320634 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 4.683321ms to process 0 records I0430 13:51:22.320641 1 tasks_processing.go:74] worker 5 stopped. I0430 13:51:22.320645 1 tasks_processing.go:74] worker 39 stopped. I0430 13:51:22.320649 1 tasks_processing.go:74] worker 59 stopped. I0430 13:51:22.320650 1 tasks_processing.go:74] worker 43 stopped. I0430 13:51:22.320719 1 tasks_processing.go:74] worker 51 stopped. I0430 13:51:22.320731 1 recorder.go:75] Recording config/ingress with fingerprint=7814cceed0ce8f43bbdda65ac1fbce82db95db8b99d675e9fd53595b7eca8995 I0430 13:51:22.320737 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 8.213256ms to process 1 records I0430 13:51:22.320814 1 tasks_processing.go:74] worker 29 stopped. I0430 13:51:22.320914 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3329967eea77eba16916aee58c2396bb05d9546721c171902e4ca29a6aa5d48e I0430 13:51:22.320928 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 7.589386ms to process 1 records I0430 13:51:22.340035 1 tasks_processing.go:74] worker 19 stopped. I0430 13:51:22.340046 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 27.404091ms to process 0 records I0430 13:51:22.340259 1 tasks_processing.go:74] worker 14 stopped. I0430 13:51:22.340331 1 recorder.go:75] Recording config/proxy with fingerprint=8cfcaba74c604fcf8e6171c34a2c61343e865f0649298a9dfe6bf4a3d27b6f32 I0430 13:51:22.340345 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 26.763544ms to process 1 records I0430 13:51:22.347716 1 tasks_processing.go:74] worker 33 stopped. I0430 13:51:22.347732 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 34.001151ms to process 0 records I0430 13:51:22.347749 1 tasks_processing.go:74] worker 18 stopped. I0430 13:51:22.347759 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 35.129858ms to process 0 records I0430 13:51:22.347788 1 tasks_processing.go:74] worker 25 stopped. I0430 13:51:22.347797 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 34.981252ms to process 0 records I0430 13:51:22.347805 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 33.917078ms to process 0 records I0430 13:51:22.347814 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 34.850499ms to process 0 records I0430 13:51:22.347820 1 tasks_processing.go:74] worker 23 stopped. I0430 13:51:22.347823 1 tasks_processing.go:74] worker 61 stopped. I0430 13:51:22.347825 1 tasks_processing.go:74] worker 21 stopped. I0430 13:51:22.347832 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 34.466441ms to process 0 records E0430 13:51:22.347860 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0430 13:51:22.347870 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 33.516752ms to process 0 records I0430 13:51:22.347877 1 tasks_processing.go:74] worker 27 stopped. I0430 13:51:22.347890 1 tasks_processing.go:74] worker 7 stopped. I0430 13:51:22.347900 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 33.212678ms to process 0 records I0430 13:51:22.347908 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 33.839679ms to process 0 records I0430 13:51:22.347914 1 tasks_processing.go:74] worker 15 stopped. I0430 13:51:22.347967 1 tasks_processing.go:74] worker 4 stopped. I0430 13:51:22.348095 1 recorder.go:75] Recording config/apiserver with fingerprint=5e23f0e5c5c57a9767cfffae04e36f9c8bcc44c3bc13e176a62c9f0b173092e9 I0430 13:51:22.348107 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 34.618542ms to process 1 records E0430 13:51:22.348113 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0430 13:51:22.348118 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 34.078015ms to process 0 records I0430 13:51:22.348122 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 35.343844ms to process 0 records E0430 13:51:22.348126 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0430 13:51:22.348131 1 gather.go:177] gatherer "clusterconfig" function "machines" took 35.466287ms to process 0 records I0430 13:51:22.348137 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 35.397521ms to process 0 records I0430 13:51:22.348141 1 tasks_processing.go:74] worker 55 stopped. I0430 13:51:22.348140 1 tasks_processing.go:74] worker 54 stopped. I0430 13:51:22.348144 1 tasks_processing.go:74] worker 44 stopped. I0430 13:51:22.348148 1 tasks_processing.go:74] worker 12 stopped. I0430 13:51:22.348159 1 gather_logs.go:145] no pods in namespace were found I0430 13:51:22.348173 1 tasks_processing.go:74] worker 62 stopped. I0430 13:51:22.348181 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 35.709255ms to process 0 records I0430 13:51:22.348216 1 tasks_processing.go:74] worker 52 stopped. I0430 13:51:22.348224 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 36.214015ms to process 0 records I0430 13:51:22.348295 1 tasks_processing.go:74] worker 30 stopped. I0430 13:51:22.348307 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 35.487983ms to process 0 records I0430 13:51:22.348450 1 tasks_processing.go:74] worker 50 stopped. I0430 13:51:22.348460 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 33.220085ms to process 0 records I0430 13:51:22.348518 1 tasks_processing.go:74] worker 34 stopped. I0430 13:51:22.348609 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=315a78981903966e533f5c0c15264b4b7ccdb54b56d818b5a6abc57fe52a9457 I0430 13:51:22.348635 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=bc273b07229753d6f21babc27d637ec567a52ea00bbac557ec8a3862b80daa46 I0430 13:51:22.348648 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 36.443252ms to process 2 records I0430 13:51:22.348895 1 tasks_processing.go:74] worker 31 stopped. I0430 13:51:22.349940 1 recorder.go:75] Recording config/infrastructure with fingerprint=b0bdabbf97865171fe18f1979fd637627095593e8bc4c34173fee5e9b58df5ff I0430 13:51:22.350068 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 34.3006ms to process 1 records E0430 13:51:22.350106 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0430 13:51:22.350162 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 35.646894ms to process 0 records I0430 13:51:22.350192 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 36.965879ms to process 0 records I0430 13:51:22.350225 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 32.267041ms to process 0 records I0430 13:51:22.350395 1 recorder.go:75] Recording config/image with fingerprint=ffa43f45307e5b5e570c31d8a8bd1662ac06a35eeb9661309b4c4e3d4c4acee9 I0430 13:51:22.350427 1 gather.go:177] gatherer "clusterconfig" function "image" took 37.054539ms to process 1 records I0430 13:51:22.350455 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 36.872294ms to process 0 records I0430 13:51:22.350480 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 36.968592ms to process 0 records I0430 13:51:22.350504 1 tasks_processing.go:74] worker 56 stopped. I0430 13:51:22.350556 1 tasks_processing.go:74] worker 42 stopped. I0430 13:51:22.350582 1 tasks_processing.go:74] worker 22 stopped. I0430 13:51:22.350606 1 tasks_processing.go:74] worker 6 stopped. I0430 13:51:22.350628 1 tasks_processing.go:74] worker 58 stopped. I0430 13:51:22.350661 1 tasks_processing.go:74] worker 48 stopped. I0430 13:51:22.350693 1 tasks_processing.go:74] worker 17 stopped. I0430 13:51:22.350913 1 recorder.go:75] Recording config/authentication with fingerprint=caabbcf2e9c0d095cfddfb6f35af81965bec4cc578d8ae4676e9b51523f5559b I0430 13:51:22.351006 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 35.521587ms to process 1 records I0430 13:51:22.351057 1 tasks_processing.go:74] worker 37 stopped. I0430 13:51:22.351516 1 recorder.go:75] Recording config/featuregate with fingerprint=3030ecd04f2846e1063c2ec978c96ff4d60a9a1b2901c7870aaba60e8816183a I0430 13:51:22.351528 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 38.710916ms to process 1 records I0430 13:51:22.351589 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=9b37f4d65a579b46c1073809aa97b5952f1122174d02855239710ac38d3d44b6 I0430 13:51:22.351600 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 37.536312ms to process 1 records I0430 13:51:22.351606 1 tasks_processing.go:74] worker 47 stopped. I0430 13:51:22.352365 1 tasks_processing.go:74] worker 36 stopped. I0430 13:51:22.352662 1 recorder.go:75] Recording config/node/ip-10-0-0-16.ec2.internal with fingerprint=9ee0d579d96aa712c65a50bc9d49cb36ea7839f4f66c0b0516cd8b43a5c9ab6f I0430 13:51:22.352723 1 recorder.go:75] Recording config/node/ip-10-0-1-128.ec2.internal with fingerprint=2ad94146ecc8fb2f656d1787a5ba85c79e87430c024e6e9ad18738f5745af7dd I0430 13:51:22.352773 1 recorder.go:75] Recording config/node/ip-10-0-2-26.ec2.internal with fingerprint=e7d989a3d88edbec650516452af278a887e2c815f4d9d3547bbc8e1069e5e4ce I0430 13:51:22.352787 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 40.339991ms to process 3 records I0430 13:51:22.360437 1 tasks_processing.go:74] worker 35 stopped. I0430 13:51:22.360674 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e9d96174378874f2623f71845fe70a1651e0610885bf73a56deb9f52ff48d1e5 I0430 13:51:22.360738 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=361778d88e1ed45e3587716d7787198dedd5e17ac4815b48fedea832eeb01799 I0430 13:51:22.360797 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f3837df51e2f2fa7803ed8c64821c77510c3e5ab845ea6c369b131b6beee7bc6 I0430 13:51:22.360815 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 48.669511ms to process 3 records I0430 13:51:22.363233 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:51:22.363248 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:51:22.363252 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:51:22.363256 1 controller.go:212] Source scaController *sca.Controller is not ready I0430 13:51:22.363259 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0430 13:51:22.363301 1 controller.go:489] The operator is still being initialized I0430 13:51:22.363312 1 controller.go:512] The operator is healthy I0430 13:51:22.363929 1 tasks_processing.go:74] worker 53 stopped. I0430 13:51:22.364065 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=fdf2730191aaaabc9af256c6dc4a9e1a2661a1cb65841d9048bb810aa0429bbd I0430 13:51:22.364160 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=3422c80aab3f7a9a4e95d3a74e2cb7ddf6e7cd73e8a1104cdb48189c9159c6ad I0430 13:51:22.364290 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=7431557df5e19d6ff9c7fafd6a07a39a5f5b4626eb53a1292d0ad548b15bd033 I0430 13:51:22.364331 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ef15bc2dbf69c908908071d22ebc09a08be0e88a2abededb5193f122965b78ee I0430 13:51:22.364372 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=293ed2d77f479f0f846615c0c5eca3c3d72393fea2e7c2e7e6ff7195e7a131ed I0430 13:51:22.364415 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=bb536ad714a3ef04a4b04b04c35a4abe5299a91751124caa103ad698dcba55d6 I0430 13:51:22.364459 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=12fb4e8bda542e61c128bc43f42ec1aa58364b3096fac890c33189f81d7afef3 I0430 13:51:22.364498 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=1fa9d6fce42f8c85a6faeee25efe36b36e9253910aa34a54326d33d7cf1efd41 I0430 13:51:22.364537 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6e313a3f4f1b1d4c1b332e8dcffac27fdd1144b7e5999bfca83b52a0d4ef98f2 I0430 13:51:22.364595 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=9f1ad28fa548f3fb558fb853620dcd6f7f77cec4e79368dfb3e218a19c146bd4 I0430 13:51:22.364635 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=65087bf9415e0fc0146df978ed2186d424c4fe8b2458adc0bf8f6ba9f4ad151d I0430 13:51:22.364674 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=00abf918273187424eeb63650bc53b373e4270ea8b95d6dae1a3f4a7a3484199 I0430 13:51:22.364734 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=8d4187a67d3a246a2250cb1ea015bb3e1d86da8b31b7cab73dbbc2f7b38cff44 I0430 13:51:22.364747 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 50.845596ms to process 13 records I0430 13:51:22.364772 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0430 13:51:22.364784 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 52.296614ms to process 1 records I0430 13:51:22.364858 1 tasks_processing.go:74] worker 10 stopped. I0430 13:51:22.364930 1 tasks_processing.go:74] worker 46 stopped. I0430 13:51:22.365408 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=1dd0838f7878a4149f93da115b414d5a6d61bba327279d50e27ed02f7e59643c I0430 13:51:22.365424 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 49.250045ms to process 1 records I0430 13:51:22.365616 1 tasks_processing.go:74] worker 16 stopped. I0430 13:51:22.365629 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 52.811019ms to process 0 records W0430 13:51:22.366231 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:51:22.367531 1 tasks_processing.go:74] worker 26 stopped. I0430 13:51:22.368135 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=31c6b6abdc98d235c460b0786c44af8caef513f6811812b2cba8ab14eb110d98 I0430 13:51:22.368440 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=ef8fdcf6b4145e7e9294b530909a8085f97add0af1f6ea610ae12de46d98cb8b I0430 13:51:22.368456 1 gather.go:177] gatherer "clusterconfig" function "crds" took 55.512556ms to process 2 records I0430 13:51:22.368513 1 recorder.go:75] Recording config/olm_operators with fingerprint=d7b38ec3832c218ed9927b88e961195b663cfff2b445d4b9aafc1b2dd369f5f6 I0430 13:51:22.368525 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 53.208229ms to process 1 records I0430 13:51:22.368532 1 tasks_processing.go:74] worker 9 stopped. E0430 13:51:22.370115 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278680ef80-cc81-4b9f-a122-75c7af45a6d8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:54998->172.30.0.10:53: read: connection refused I0430 13:51:22.370130 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278680ef80-cc81-4b9f-a122-75c7af45a6d8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:54998->172.30.0.10:53: read: connection refused I0430 13:51:22.370910 1 tasks_processing.go:74] worker 0 stopped. I0430 13:51:22.371511 1 recorder.go:75] Recording config/version with fingerprint=c33e2128daa001f4cf70abe815d0194f21cbc3227e11301d81dc35134edf3642 I0430 13:51:22.371533 1 recorder.go:75] Recording config/id with fingerprint=6301b038b93b53a544ec61393302ac53f3e025c51afb76f88c772b6d5257de53 I0430 13:51:22.371543 1 gather.go:177] gatherer "clusterconfig" function "version" took 59.159945ms to process 2 records I0430 13:51:22.371658 1 tasks_processing.go:74] worker 38 stopped. I0430 13:51:22.371858 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=7095692202cf1601ebf581fcf6ae8f07567dc726ce423263f99f87a2a5584835 I0430 13:51:22.371998 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=895aa2f3cfdc272974994dd89cdd9ba76091bcd88bf79d9c0f75c5d2d94219e3 I0430 13:51:22.372051 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 55.371712ms to process 2 records I0430 13:51:22.373710 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0430 13:51:22.376651 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:54187->172.30.0.10:53: read: connection refused I0430 13:51:22.376663 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:54187->172.30.0.10:53: read: connection refused I0430 13:51:22.381966 1 tasks_processing.go:74] worker 13 stopped. I0430 13:51:22.381982 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 67.713181ms to process 0 records I0430 13:51:22.382998 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0430 13:51:22.383005 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:51:22.383027 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:51:22.385780 1 tasks_processing.go:74] worker 8 stopped. I0430 13:51:22.385814 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0430 13:51:22.385825 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 71.142351ms to process 1 records I0430 13:51:22.386854 1 base_controller.go:82] Caches are synced for ConfigController I0430 13:51:22.386873 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0430 13:51:22.390518 1 tasks_processing.go:74] worker 20 stopped. I0430 13:51:22.391749 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv with fingerprint=e25944a937bc54c0fc92649d711f18181e4bf8435a43ecf78856116943001f06 I0430 13:51:22.391824 1 recorder.go:75] Recording config/running_containers with fingerprint=43d978e759509f0a288c577ecd411f1cd7d6592d15aef1344a9e7f4e7a78b654 I0430 13:51:22.391852 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 75.89734ms to process 2 records I0430 13:51:22.392993 1 tasks_processing.go:74] worker 2 stopped. I0430 13:51:22.392997 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:51:22.393009 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 81.16334ms to process 0 records I0430 13:51:22.393469 1 tasks_processing.go:74] worker 45 stopped. E0430 13:51:22.393481 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0430 13:51:22.393488 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q0gm1uuhr9q3qc032e51jb7af5qc9os-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q0gm1uuhr9q3qc032e51jb7af5qc9os-primary-cert-bundle-secret" not found I0430 13:51:22.393548 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=f93e89d23f94610067d5a826688e6175bfc862920dc3b59a9065d370942476a1 I0430 13:51:22.393560 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 80.896617ms to process 1 records I0430 13:51:22.393654 1 tasks_processing.go:74] worker 28 stopped. E0430 13:51:22.393670 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0430 13:51:22.393678 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0430 13:51:22.393684 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0430 13:51:22.393698 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0430 13:51:22.393746 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0430 13:51:22.393755 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0430 13:51:22.393764 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0430 13:51:22.393778 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0430 13:51:22.393826 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0430 13:51:22.393856 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0430 13:51:22.393864 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 81.349186ms to process 7 records I0430 13:51:22.420409 1 base_controller.go:82] Caches are synced for LoggingSyncer I0430 13:51:22.420422 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0430 13:51:22.433148 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0430 13:51:22.437074 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found W0430 13:51:23.364085 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:51:24.194891 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found W0430 13:51:24.364419 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:51:24.370456 1 gather_cluster_operator_pods_and_events.go:121] Found 45 pods with 93 containers I0430 13:51:24.370467 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 270600 bytes I0430 13:51:24.370520 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:24.576005 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:24.777187 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:24.797175 1 tasks_processing.go:74] worker 11 stopped. I0430 13:51:24.797293 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=4b44b6e9c8481fe4ba582b28714ce41f7388e5932bc3519944ebf09bc271c2e5 I0430 13:51:24.797374 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0430 13:51:24.797409 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e3a89984d78a02e2c9e89966c0a47c45d73c7c01e3d2f1df2973c1b028462955 I0430 13:51:24.797421 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0430 13:51:24.797456 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=ce227c29e2c77ee16199680e9802e63d40bbed2807e0f5557e90cc75483daeea I0430 13:51:24.797479 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0430 13:51:24.797513 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=44458f660ace2445cbf4d01e0349ed12484c8ec9976fc06c7f65c50ab0664c8a I0430 13:51:24.797557 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=911d953dd007fdf8f5b68c03a706df984943784e339cc517186334db720518cd I0430 13:51:24.797594 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ad2407658907f2e2b96089a2a7c4d2d6e6f8395465ecfef043f0e6adf1da888b I0430 13:51:24.797639 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=27954c01fa22b4d70cfce01512d0c00c5cd405d10771e7162ceaf739d4e7b8b3 I0430 13:51:24.798093 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=aa0af39ab41a5e194f8e71c87772fedae26a45fdcde72a0f11e555d010f4518a I0430 13:51:24.798131 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=3431c9c4793c6c2777e7ff96b263a48a059019724b0b49fa57e623c750c0c4d0 I0430 13:51:24.798145 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0430 13:51:24.798169 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=14031e64d1249671b372ec459ffd6eec741ddfb6eb983b911ebbc7a88322d14b I0430 13:51:24.798185 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0430 13:51:24.798208 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d9ca7c4807cca14670bf11e6be7aa6e12a0d46dae325b12275205c6d28cadaef I0430 13:51:24.798221 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0430 13:51:24.798248 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=cf2e518490c897d25c102927089bb046f3039917995a33007946495a11202acf I0430 13:51:24.798261 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0430 13:51:24.798291 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=66db728b4d63716fd74a575a95289dd98c16615cc450d8886c60df21ac18b509 I0430 13:51:24.798446 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=a4cfce09d637b75fe4d4f5866bd8abb21395a49d60a2b8bad891550cb11c7e35 I0430 13:51:24.798461 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0430 13:51:24.798472 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0430 13:51:24.798502 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0430 13:51:24.798536 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=a9530e48be38d575b76bc28b26fe93cf04bcd9b00a16f5274739664261a685c2 I0430 13:51:24.798574 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=5bd607a9ea4ba96908b0199427eefa19fef29f45a870ac46f87ddb050ac026d2 I0430 13:51:24.798587 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0430 13:51:24.798610 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=dfc17a2ad408556184831815cb84746f75f1f37ce35148da45cefd4e6e3dcbc5 I0430 13:51:24.798624 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0430 13:51:24.798643 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=1e4473b9291f6c3ab7efe66728cc8aecf5c747e30d1979de25006428f0020c7d I0430 13:51:24.798665 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=cd81cb96043d74beaa87f1f0bb84dce229fcaf28913265c0fcd78f7310f13995 I0430 13:51:24.798688 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=34b047648e5bd4395a49a08a55b1953b237902f708fe1514f29d054b46cc39ee I0430 13:51:24.798710 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=088c41359f0b6a1d5b7d6e580eaaf56108934639d57ddb0cc2bda76f4a6e1b4e I0430 13:51:24.798746 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=bd2d7b5dd4d5b23e5957a407240ab20867ae21cf913b8f8cc37d3c2ba20a6054 I0430 13:51:24.798758 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0430 13:51:24.798795 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=10b2ec297fa46045af78f09d3a8f57a738239c3dc249f236690346a9fbada7f8 I0430 13:51:24.798865 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0430 13:51:24.798883 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0430 13:51:24.798892 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.484641548s to process 38 records I0430 13:51:24.975990 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:25.175485 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). W0430 13:51:25.364571 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:51:25.375809 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:25.575965 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:25.775243 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:25.977995 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:26.177112 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). W0430 13:51:26.363705 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:51:26.376540 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:26.576111 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:26.775857 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:26.975816 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:27.175916 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-monitoring-operator container cluster-monitoring-operator-698978dbbf-fjv5x pod in namespace openshift-monitoring (previous: false). W0430 13:51:27.361298 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:51:27.361332 1 tasks_processing.go:74] worker 49 stopped. E0430 13:51:27.361344 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:51:27.361359 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0430 13:51:27.361373 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.046827631s to process 1 records I0430 13:51:27.378218 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-state-metrics container kube-state-metrics-7c87d874d5-xsjrj pod in namespace openshift-monitoring (previous: false). I0430 13:51:27.576724 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container kube-state-metrics-7c87d874d5-xsjrj pod in namespace openshift-monitoring (previous: false). I0430 13:51:27.775824 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container kube-state-metrics-7c87d874d5-xsjrj pod in namespace openshift-monitoring (previous: false). I0430 13:51:27.975760 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-74658487c5-4jc5s pod in namespace openshift-monitoring (previous: false). I0430 13:51:28.175450 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-74658487c5-rvgbc pod in namespace openshift-monitoring (previous: false). I0430 13:51:28.375580 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-cqmfq pod in namespace openshift-monitoring (previous: false). I0430 13:51:28.575188 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-glb4n pod in namespace openshift-monitoring (previous: false). I0430 13:51:28.776286 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-gxnkl pod in namespace openshift-monitoring (previous: false). I0430 13:51:28.975563 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:28.975580 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-gxnkl pod in namespace openshift-monitoring (previous: false). I0430 13:51:29.177292 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-gxnkl pod in namespace openshift-monitoring (previous: false). I0430 13:51:29.375780 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-hdrb8 pod in namespace openshift-monitoring (previous: false). I0430 13:51:29.576127 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:29.576141 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-hdrb8 pod in namespace openshift-monitoring (previous: false). I0430 13:51:29.777937 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-hdrb8 pod in namespace openshift-monitoring (previous: false). I0430 13:51:29.976763 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-swzz7 pod in namespace openshift-monitoring (previous: false). I0430 13:51:30.175360 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:30.175375 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-swzz7 pod in namespace openshift-monitoring (previous: false). I0430 13:51:30.376331 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-swzz7 pod in namespace openshift-monitoring (previous: false). I0430 13:51:30.575612 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container openshift-state-metrics-6cb79d4dbd-xp8lm pod in namespace openshift-monitoring (previous: false). I0430 13:51:30.775923 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container openshift-state-metrics-6cb79d4dbd-xp8lm pod in namespace openshift-monitoring (previous: false). I0430 13:51:30.976187 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for openshift-state-metrics container openshift-state-metrics-6cb79d4dbd-xp8lm pod in namespace openshift-monitoring (previous: false). I0430 13:51:31.176000 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:31.375891 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:31.578847 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:31.776023 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:31.976620 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:32.175448 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:32.377095 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0430 13:51:32.576254 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:32.775072 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:32.976976 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:33.175039 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:33.375161 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:33.575809 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:33.774945 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0430 13:51:33.975471 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator container prometheus-operator-5df5b8bf6d-5l9bk pod in namespace openshift-monitoring (previous: false). I0430 13:51:34.177454 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-operator-5df5b8bf6d-5l9bk pod in namespace openshift-monitoring (previous: false). I0430 13:51:34.376373 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-8bszf pod in namespace openshift-monitoring (previous: false). I0430 13:51:34.576068 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-kbqcp pod in namespace openshift-monitoring (previous: false). I0430 13:51:34.776141 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:34.978589 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:35.166943 1 tasks_processing.go:74] worker 57 stopped. I0430 13:51:35.166996 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0430 13:51:35.167011 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.851399098s to process 1 records I0430 13:51:35.175588 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:35.375936 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:35.576268 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:35.775563 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-bf96768df-65ljd pod in namespace openshift-monitoring (previous: false). I0430 13:51:35.920481 1 tasks_processing.go:74] worker 40 stopped. I0430 13:51:35.920791 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=f5738032f28aea743b389898fadee779c5cd56b79a04dcc121fb2c80f0e9fc94 I0430 13:51:35.920808 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.607160282s to process 1 records I0430 13:51:35.975801 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:36.177349 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:36.377415 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:36.575967 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:36.777325 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:36.976769 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-bf96768df-mkr5b pod in namespace openshift-monitoring (previous: false). I0430 13:51:37.176506 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-jl7w7 pod in namespace openshift-network-console (previous: false). I0430 13:51:37.376297 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-n7d9m pod in namespace openshift-network-console (previous: false). I0430 13:51:37.577393 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-6bjlv pod in namespace openshift-console-operator (previous: true). I0430 13:51:37.775576 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-6bjlv pod in namespace openshift-console-operator (previous: false). I0430 13:51:37.979562 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5b56548c58-47fxh pod in namespace openshift-console (previous: false). I0430 13:51:38.175686 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5b56548c58-gxbt9 pod in namespace openshift-console (previous: false). I0430 13:51:38.377637 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-68f67d7c5-l5z7f pod in namespace openshift-console (previous: false). I0430 13:51:38.576929 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-cfp58 pod in namespace openshift-console (previous: false). I0430 13:51:38.782487 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-gb6fv pod in namespace openshift-console (previous: false). I0430 13:51:38.977462 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hxhbp pod in namespace openshift-dns (previous: false). I0430 13:51:39.175461 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxhbp pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:51:39.175480 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:51:39.175489 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hxhbp pod in namespace openshift-dns (previous: false). I0430 13:51:39.376969 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxhbp pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:51:39.376986 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:51:39.377016 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vs4hv pod in namespace openshift-dns (previous: false). I0430 13:51:39.575756 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vs4hv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:51:39.575773 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:51:39.575781 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vs4hv pod in namespace openshift-dns (previous: false). I0430 13:51:39.775908 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vs4hv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:51:39.775921 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:51:39.775947 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xpcrr pod in namespace openshift-dns (previous: false). I0430 13:51:39.976916 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xpcrr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:51:39.976934 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:51:39.976943 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xpcrr pod in namespace openshift-dns (previous: false). I0430 13:51:40.175793 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xpcrr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:51:40.175815 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:51:40.175828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9m58w pod in namespace openshift-dns (previous: false). I0430 13:51:40.375604 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:40.375625 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dnwvx pod in namespace openshift-dns (previous: false). I0430 13:51:40.575690 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:40.575708 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ms2bk pod in namespace openshift-dns (previous: false). I0430 13:51:40.776018 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:51:40.776036 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5945b8464d-9cr4j pod in namespace openshift-image-registry (previous: false). I0430 13:51:40.976222 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5945b8464d-v9fqr pod in namespace openshift-image-registry (previous: false). I0430 13:51:41.177793 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-69c9db5fb5-skv7k pod in namespace openshift-image-registry (previous: false). I0430 13:51:41.375928 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-69c9db5fb5-skv7k pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-69c9db5fb5-skv7k\" is waiting to start: ContainerCreating" I0430 13:51:41.375947 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-69c9db5fb5-skv7k\" is waiting to start: ContainerCreating" I0430 13:51:41.375959 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8m27p pod in namespace openshift-image-registry (previous: false). I0430 13:51:41.576321 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fcwck pod in namespace openshift-image-registry (previous: false). I0430 13:51:41.778285 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t58lt pod in namespace openshift-image-registry (previous: false). I0430 13:51:41.976666 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577cb9985d-7tml7 pod in namespace openshift-ingress (previous: false). I0430 13:51:42.176672 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577cb9985d-wpjhj pod in namespace openshift-ingress (previous: false). I0430 13:51:42.377982 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c89887b6f-5sr27 pod in namespace openshift-ingress (previous: false). I0430 13:51:42.577506 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-4l6zm pod in namespace openshift-ingress-canary (previous: false). I0430 13:51:42.775551 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-4l6zm pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-4l6zm\" is waiting to start: ContainerCreating" I0430 13:51:42.775568 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-4l6zm\" is waiting to start: ContainerCreating" I0430 13:51:42.775598 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sndx9 pod in namespace openshift-ingress-canary (previous: false). I0430 13:51:42.976468 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-sndx9 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-sndx9\" is waiting to start: ContainerCreating" I0430 13:51:42.976484 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-sndx9\" is waiting to start: ContainerCreating" I0430 13:51:42.976516 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tcd4j pod in namespace openshift-ingress-canary (previous: false). I0430 13:51:43.175788 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-tcd4j pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tcd4j\" is waiting to start: ContainerCreating" I0430 13:51:43.175804 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tcd4j\" is waiting to start: ContainerCreating" I0430 13:51:43.175824 1 tasks_processing.go:74] worker 32 stopped. I0430 13:51:43.176515 1 recorder.go:75] Recording events/openshift-monitoring with fingerprint=361a64f218ceaba58a2459569b7838c0aed19ccac38fb6eac376e788784d28a5 I0430 13:51:43.176561 1 recorder.go:75] Recording events/openshift-network-console with fingerprint=5f14a1abc1202e69ee3763fa61eec4bd4c29523d14aedd429080607d73917d07 I0430 13:51:43.176667 1 recorder.go:75] Recording events/openshift-console-operator with fingerprint=e5ac70407c91b4a58ac577deb8aa5efe4089bf371b0f06c4f7937fd68c721738 I0430 13:51:43.176781 1 recorder.go:75] Recording events/openshift-console with fingerprint=1519f8a463a3e8039e134c739a5733679c34abefc518f48440d6c937372212ad I0430 13:51:43.176826 1 recorder.go:75] Recording events/openshift-dns with fingerprint=1a97d49f48dd60c21069bff2900f3377eb4c8d149d0f7c3e11aca3499c0d3f88 I0430 13:51:43.176964 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=689b2eb773453fdaaf1cfdaebea9f758a1de1cfe65272c1cabf8d78f4c4847e7 I0430 13:51:43.176991 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=5d2fa1fe263d5a4837c97407db812d983e49692bd3a4dde9e5af625f99786ef5 I0430 13:51:43.177059 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=fc79197dbe61dbf36fd4b0b1a2c30b9a69d98557a093b0724f2989cd0f730665 I0430 13:51:43.177075 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=478359d4d67eea302e6f10472ae7d481f861be551e5b46a62e30f7805f33843e I0430 13:51:43.177109 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/init-config-reloader_current.log with fingerprint=a1a1b86c2ad3c6808ad1df28d5c7d33f7fe4030c5f0e2ed3e9255c0f2536b374 I0430 13:51:43.177132 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/alertmanager_current.log with fingerprint=906359ef1b78e3e36b7bba8c313239184fafccbdc598414724d9b6bbcce07cef I0430 13:51:43.177147 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/config-reloader_current.log with fingerprint=50974d4adb80f96b59999004bc2627302774cb2709f5cb6c293fba5acab6d609 I0430 13:51:43.177153 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-web_current.log with fingerprint=e6f184b61686a71cfec016207e3d4f616e60968ab874a5b3c09720e3e6d4e84e I0430 13:51:43.177159 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy_current.log with fingerprint=9da369ebc0b5ad004ee1e04412c8d74ade5ba07b7084c7e0913276bec539a005 I0430 13:51:43.177165 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-metric_current.log with fingerprint=74621cda36fcbeeb0eee6e6696cfa350113c9766b67b795612600eca9f08abe1 I0430 13:51:43.177168 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/prom-label-proxy_current.log with fingerprint=385727f8fee18d1292fd5488a3d9dc5d181661ab3f019b4952b9946246484b08 I0430 13:51:43.177174 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/init-config-reloader_current.log with fingerprint=0b96d15de5818b6ad679b54ce989d9f2e2ec512f1392c4d49550142a51c7feb0 I0430 13:51:43.177195 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/alertmanager_current.log with fingerprint=c2449f4a7530de1f1ca965a9785e786a286f32efc55895c5ca5415a7da678d0e I0430 13:51:43.177211 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/config-reloader_current.log with fingerprint=6207983d3a048e97361542ec6c22fa6a543a27777e8cadd8bbde8a64517f1631 I0430 13:51:43.177218 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-web_current.log with fingerprint=b706cfd48bb6e72b43ab2a0e215e2114e5a5cd51b52d3937264e6dac1d33f371 I0430 13:51:43.177224 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy_current.log with fingerprint=70eb26d49aed04c9ed0a170e41e541740ca2f8a9b999ff4c440b841e33d68303 I0430 13:51:43.177232 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-metric_current.log with fingerprint=ed070fc6621d1cf09814ff25584084665ad5acfb490c140e8afd00b2ef648c42 I0430 13:51:43.177236 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/prom-label-proxy_current.log with fingerprint=87148ac013f93bf1645aba0b13057264c072b38a499ee10f7899a6d7efe780ed I0430 13:51:43.177363 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/cluster-monitoring-operator-698978dbbf-fjv5x/cluster-monitoring-operator_current.log with fingerprint=4f19a2af4ba598e7ab32fbe48acb777e3ef15ad1d07029523e4f9a0737ab91a3 I0430 13:51:43.177384 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-xsjrj/kube-state-metrics_current.log with fingerprint=e1db225a4f4868bc2422e68711cc304b317149e89c98881d3bc33a5710f216cc I0430 13:51:43.177394 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-xsjrj/kube-rbac-proxy-main_current.log with fingerprint=860e4fbef079f3236fa5da5ab1e4f917fc33dcc6b608804dce829e079bd41288 I0430 13:51:43.177400 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-xsjrj/kube-rbac-proxy-self_current.log with fingerprint=11e990fdb69d728d818a13fdb3e64a7cb92e9d2fa54d7e452f79808141e42152 I0430 13:51:43.177407 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-74658487c5-4jc5s/metrics-server_current.log with fingerprint=f3be0ad7776a09f0e6ac32f78dcf877a83e1dd1f249c5396b0ec47987e6ef270 I0430 13:51:43.177413 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-74658487c5-rvgbc/metrics-server_current.log with fingerprint=af232bb56f1814caf1ee7074e4525efc6c18cc01f668c1d715e7f9a3e8d6a2f5 I0430 13:51:43.177425 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-cqmfq/monitoring-plugin_current.log with fingerprint=daeb8d4cc8d5f8541bc7905e08867fdc742fa2260a325acf952e3ca5beb659d5 I0430 13:51:43.177437 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-glb4n/monitoring-plugin_current.log with fingerprint=9b26a2f0f164ee1d32d9ffb9c9efc466abde4fd35b303e4e788ebfc65066145f I0430 13:51:43.177463 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-gxnkl/node-exporter_current.log with fingerprint=241f88e3994872d2c1322c6a327baa0671062b37d022493ec0ed5229af912993 I0430 13:51:43.177471 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-gxnkl/kube-rbac-proxy_current.log with fingerprint=27c1a76af33d59405f911354974e50acb6fe5b556c1fd367b1b32892d8603e34 I0430 13:51:43.177497 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-hdrb8/node-exporter_current.log with fingerprint=c7bc8a3589284bde2199afd76177410b3a2fe0dfc77f7fd480d5ffdbc7028b7c I0430 13:51:43.177505 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-hdrb8/kube-rbac-proxy_current.log with fingerprint=a4ddf71e198d240b9e086860f414e12870486e188087753d59ca2d578e07fdea I0430 13:51:43.177532 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-swzz7/node-exporter_current.log with fingerprint=170c80ce10dd506171781f9360a3d9d806f773ccc526c4ffd6465b0c42dcdc78 I0430 13:51:43.177541 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-swzz7/kube-rbac-proxy_current.log with fingerprint=3663603d7edd1c73a23d3b97cea76707765ecb092e34fc068d30ebdf8a3494f0 I0430 13:51:43.177547 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-xp8lm/kube-rbac-proxy-main_current.log with fingerprint=df033c6906c17aebab6f822bed8fb59786f68136fabecedcd2323bea8ec43e84 I0430 13:51:43.177553 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-xp8lm/kube-rbac-proxy-self_current.log with fingerprint=c46e0fc4d564aad850cc09de2790b3ab49ce67a5a9944429ddba917168bcf30e I0430 13:51:43.177563 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-xp8lm/openshift-state-metrics_current.log with fingerprint=f14f158dc4fe996a70331e96d63e0599e58e607089c34aaadb4180afd9aae4c2 I0430 13:51:43.177569 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/init-config-reloader_current.log with fingerprint=b34550be3514b5e103fbd4718dae9e6fffc5750bf4484dbc721cc06ad0f33000 I0430 13:51:43.177664 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/prometheus_current.log with fingerprint=b9161b49faa02f70847865b1342458135fbf1f88c2ab5ad88bdb3f8424ef88c5 I0430 13:51:43.177678 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/config-reloader_current.log with fingerprint=2be718929330804cc90eabcbff09c6f84d8335f59946e93843b06ad4757e997a I0430 13:51:43.177689 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/thanos-sidecar_current.log with fingerprint=718d559c1a38e2826285f0d73fa3a70b0a5b28270f4e6d8ef7fc5cfc3cc03759 I0430 13:51:43.177696 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-web_current.log with fingerprint=b2bf5e7ad3e25a462f550652ddad5a4e48539d043a09b6923c105d3e54a1f7da I0430 13:51:43.177702 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy_current.log with fingerprint=07e71454748b491a4b62c795cd660b8e590d92f4b04d499c0a149dba95020b3d I0430 13:51:43.177710 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-thanos_current.log with fingerprint=c8167ea22fe85c077cbbdf36f3bbfc7fe1f0ccfb194d1f1c21a9ab407b5812a0 I0430 13:51:43.177718 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/init-config-reloader_current.log with fingerprint=b6363652522ff34a1a993b40ac45f1b2473ca6aa8c5961f5f56f823a4ca2da93 I0430 13:51:43.177812 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/prometheus_current.log with fingerprint=cb60d4285fbd3ea4c8d49843f8117c00ed351eac3f39edb8ba3b3656773dd294 I0430 13:51:43.177825 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/config-reloader_current.log with fingerprint=5205c09b75c5f2b0864d6c80b6973aed9a9a11ce1f83208c3d5a8623932f989a I0430 13:51:43.177849 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/thanos-sidecar_current.log with fingerprint=3f6d70c7ac05ca7f33894187e282846730689102dd8dcbb37f3a7005cba38e7b I0430 13:51:43.177856 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-web_current.log with fingerprint=43787870c1cb2db056f2959dc295fd3db210cd8d85b86971fffc7aa734b0944f I0430 13:51:43.177863 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy_current.log with fingerprint=1bd828d6599ea36aa06b0366ea8704a2d3030db1e705238bf20ab2d4910785ae I0430 13:51:43.177869 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-thanos_current.log with fingerprint=8806a5a0a79c65d7413b4aa282c8ca776a72706a8a76450ca12937fe1b668a3b I0430 13:51:43.177949 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-5l9bk/prometheus-operator_current.log with fingerprint=c9aa1a1e329ff33a0e91cc36eb819c3eb8c64ee01c0388dda2ba4db9c99dceb4 I0430 13:51:43.177957 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-5l9bk/kube-rbac-proxy_current.log with fingerprint=fdfd10c174ef25bd44947a7b587b1f023c7cf28cd15bc75d8331173a79086c5d I0430 13:51:43.177963 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-8bszf/prometheus-operator-admission-webhook_current.log with fingerprint=9b8b8daccc1bf41aa9eeaa8e929393f9a27c7e03fd0d5eadf382650226e3d6ee I0430 13:51:43.177972 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-kbqcp/prometheus-operator-admission-webhook_current.log with fingerprint=4d927a51112b028f74e4630eb47e40ce47c38cfeaf0f3042ce232a0ef2c7d8a2 I0430 13:51:43.177996 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/thanos-query_current.log with fingerprint=5cf0b16cd4c3cdee16a76ccc61dd3ef385d72e0168b057200fddd84ba2bd6048 I0430 13:51:43.178009 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/kube-rbac-proxy-web_current.log with fingerprint=016826329b57a54abe2ca35cee4dd55f4f15c617e780768f5f10a9c9646864bc I0430 13:51:43.178014 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/kube-rbac-proxy_current.log with fingerprint=14daba7d369d27496f617d27a0ef5f0a344607fb84136280ef18083b5b44135b I0430 13:51:43.178018 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/prom-label-proxy_current.log with fingerprint=035b5974cbac8572c1bd150f006a026e1230ddb192cfd0600d2219141df31c88 I0430 13:51:43.178024 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/kube-rbac-proxy-rules_current.log with fingerprint=378500982ea6bce8bc94d76c905d8ff704128cf7aa22a9c726c603ba6f39b78c I0430 13:51:43.178030 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-65ljd/kube-rbac-proxy-metrics_current.log with fingerprint=4ad085cb2ec79a599853454adf7bf3895c4b56d74be650d8e974f4961db12a5d I0430 13:51:43.178053 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/thanos-query_current.log with fingerprint=727b5f88ab12e2b95876a51c52d048c2c2e75259d76da662d7245aa91a09e6bc I0430 13:51:43.178066 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/kube-rbac-proxy-web_current.log with fingerprint=96a1f19f09608ab7621e6d9b27cc004d60eaa071b9db25b21a757f4bde5aa487 I0430 13:51:43.178072 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/kube-rbac-proxy_current.log with fingerprint=72a5c17e4da597ef82c04e50724a4c726afa9f2b5621b5bf686be60d0fee01a4 I0430 13:51:43.178076 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/prom-label-proxy_current.log with fingerprint=c37a687a1b591016a435712ea0278f6f866423f45bcf478687b74113000e846f I0430 13:51:43.178081 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/kube-rbac-proxy-rules_current.log with fingerprint=d2f77e7250c3a462591557c8a43e46bd25dc6be29753044617297623a354b860 I0430 13:51:43.178087 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-bf96768df-mkr5b/kube-rbac-proxy-metrics_current.log with fingerprint=c59b91bc2c1c7da16c42611be00b981ab0c81cf1aa872d1c219f8137261f7aee I0430 13:51:43.178094 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-jl7w7/networking-console-plugin_current.log with fingerprint=1f913420f1eff5f8e3963e99c569e44d0b94a3dbe4cc532bee73f4c9d9c30d6a I0430 13:51:43.178100 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-n7d9m/networking-console-plugin_current.log with fingerprint=dee5ede6f7533730bd7261a61da85d9443d1377dc0a39bc86844b0c96bd1be79 I0430 13:51:43.178233 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv with fingerprint=e25944a937bc54c0fc92649d711f18181e4bf8435a43ecf78856116943001f06 E0430 13:51:43.178250 1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json" was already recorded and had the fingerprint "e25944a937bc54c0fc92649d711f18181e4bf8435a43ecf78856116943001f06", overwriting with the record having fingerprint "e25944a937bc54c0fc92649d711f18181e4bf8435a43ecf78856116943001f06" W0430 13:51:43.178263 1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json" because of the warning: warning: the record with the same fingerprint "e25944a937bc54c0fc92649d711f18181e4bf8435a43ecf78856116943001f06" was already recorded at path "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json" I0430 13:51:43.178272 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-6bjlv/console-operator_previous.log with fingerprint=eae5f3f1520ec3d30845985d7bcabe14f2f5628d83427ca8a07e864a61666279 I0430 13:51:43.178405 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-6bjlv/console-operator_current.log with fingerprint=ee3081492c53a1e0c495e7af5197458b87f2769ce5eeb8e9ce65b258d55f2329 I0430 13:51:43.178418 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-5b56548c58-47fxh/console_current.log with fingerprint=66268ed5a159f985f2933a9524bcee27aaf02ec042aa7a646a5068f4b317a03c I0430 13:51:43.178429 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-5b56548c58-gxbt9/console_current.log with fingerprint=f153a62ad8a380a50dc638bc00e9603c59b0bf1fa4bfd1d795b718598a6096e5 I0430 13:51:43.178440 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-68f67d7c5-l5z7f/console_current.log with fingerprint=b2b6e526649cf641a14684fb3a5f503f40b244ee742714853701daf975c2e2f6 I0430 13:51:43.178445 1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-cfp58/download-server_current.log with fingerprint=10bce18f79234426af16596a7047aed2d58f5bbf465afe9af7b5fec72edc86c8 I0430 13:51:43.178451 1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-gb6fv/download-server_current.log with fingerprint=083cb28114e077e4dce295e28578f850b36f1dc97c6c1e9929ad57584f1d1f46 I0430 13:51:43.178539 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-hxhbp with fingerprint=cfbbb7712ebf13e182a6aad903b0801e5e88e0425a1908b879b7e49087cd2b26 I0430 13:51:43.178612 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-vs4hv with fingerprint=845ea4c9318a151acc70b9be3b60c94c4c4b93dfd205df8e9b87587a9cc0451c I0430 13:51:43.178682 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-xpcrr with fingerprint=8845419b0f0f73e80d0ce09dfd1d4b60a9d80e167e76896008a82cb2d1a8dab9 I0430 13:51:43.178695 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-registry-5945b8464d-9cr4j/registry_current.log with fingerprint=9d7b894b1eb521497c53cc0bd3ef717ecfb529d42bb73e384bc26bd7bd7b5279 I0430 13:51:43.178705 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-registry-5945b8464d-v9fqr/registry_current.log with fingerprint=0cff2a548bc90e64286f153f9225e300de838aa38921a8c6b6c28c5f8665632f I0430 13:51:43.178803 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-69c9db5fb5-skv7k with fingerprint=6216a3c45dfcdc8069b12cf57e2b5257c32bbe205334f7e7322c54516f0dccac I0430 13:51:43.178810 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/node-ca-8m27p/node-ca_current.log with fingerprint=31dc6bc4072c0512cd70a278390e47128dcda8951bad6b7f0435cb64135bcf0d I0430 13:51:43.178815 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/node-ca-fcwck/node-ca_current.log with fingerprint=b547b586b2bbd3e1aa3d1d7cc78060206c9678c8e33b105cd68b518260e5acfc I0430 13:51:43.178820 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/node-ca-t58lt/node-ca_current.log with fingerprint=411c0cb8b609a1d06d3b82916bc27c9f25288e4da6fb890177d82b1d0efb4c59 I0430 13:51:43.178868 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-577cb9985d-7tml7/router_current.log with fingerprint=aa42c57fc6f10298627c688615a624eb5df543ed17837d332fd8c0d2ed5b7b55 I0430 13:51:43.178902 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-577cb9985d-wpjhj/router_current.log with fingerprint=82f1ab65b4bf5b3e5116b38f977ac8efb291aa1e08ac8959e529d054a4f73ab6 I0430 13:51:43.178957 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-6c89887b6f-5sr27/router_current.log with fingerprint=eac6d83bea4aa585a6d740a00f34f389f161aba98b93e0207c2b92c6941160ea I0430 13:51:43.179016 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-4l6zm with fingerprint=570815f171f791756b365040fe4ea64d43d8862b1c26f21cb06a8ed54ec02ae0 I0430 13:51:43.179071 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-sndx9 with fingerprint=20ac3265d065f799348f3c5a1a9385cc752055c5aa8d6d74e48a0cb7bcb5d86c I0430 13:51:43.179125 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-tcd4j with fingerprint=ac8c7d2a0265a5a0283c84ca721d01e9b51ba2f93967d641d6f3eb08dc13337c I0430 13:51:43.179133 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 20.860996076s to process 95 records E0430 13:51:43.179211 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 20.867s with: function \"metrics\" failed with an error, function \"tsdb_status\" failed with an error, function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json\"" I0430 13:51:43.180321 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "metrics" failed with an error, function "tsdb_status" failed with an error, function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-575cd97545-6bjlv.json" I0430 13:51:43.180336 1 periodic.go:209] Running workloads gatherer I0430 13:51:43.180350 1 tasks_processing.go:45] number of workers: 2 I0430 13:51:43.180355 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:51:43.180359 1 tasks_processing.go:71] worker 1 working on workload_info task. I0430 13:51:43.180371 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:51:43.180392 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0430 13:51:43.186868 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-16.ec2.internal... I0430 13:51:43.186929 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-26.ec2.internal... I0430 13:51:43.186943 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-128.ec2.internal... I0430 13:51:43.205104 1 tasks_processing.go:74] worker 0 stopped. I0430 13:51:43.205120 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.692654ms to process 0 records I0430 13:51:49.405446 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 6s I0430 13:51:49.429770 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0430 13:51:49.438182 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0430 13:51:49.446611 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0430 13:51:49.455964 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0430 13:51:49.465613 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (10ms) I0430 13:51:49.475277 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (10ms) I0430 13:51:49.484875 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (10ms) I0430 13:51:49.494973 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (10ms) I0430 13:51:49.505749 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (11ms) I0430 13:51:49.515896 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (10ms) I0430 13:51:49.525192 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (9ms) I0430 13:51:49.538302 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (13ms) I0430 13:51:49.639443 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (101ms) I0430 13:51:49.740303 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0430 13:51:49.839462 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (99ms) I0430 13:51:49.938435 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms) I0430 13:51:50.038819 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0430 13:51:50.138376 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0430 13:51:50.240213 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (102ms) I0430 13:51:50.339134 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (99ms) I0430 13:51:50.439642 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0430 13:51:50.538405 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (99ms) I0430 13:51:50.639028 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0430 13:51:50.738973 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0430 13:51:50.839443 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0430 13:51:50.938222 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (99ms) I0430 13:51:51.039818 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (102ms) I0430 13:51:51.138378 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms) I0430 13:51:51.239382 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (101ms) I0430 13:51:51.338973 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0430 13:51:51.438496 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0430 13:51:51.539674 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0430 13:51:51.639083 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (99ms) I0430 13:51:51.739300 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0430 13:51:51.838713 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0430 13:51:51.942178 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (103ms) I0430 13:51:52.040246 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (98ms) I0430 13:51:52.139027 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0430 13:51:52.239125 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0430 13:51:52.339255 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0430 13:51:52.439371 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0430 13:51:52.538987 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0430 13:51:52.641574 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (103ms) I0430 13:51:52.738576 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (97ms) I0430 13:51:52.839198 1 gather_workloads_info.go:387] No image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (101ms) I0430 13:51:52.939526 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (100ms) I0430 13:51:53.038543 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0430 13:51:53.138301 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (100ms) I0430 13:51:53.239365 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (101ms) I0430 13:51:53.338785 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (99ms) I0430 13:51:53.439200 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0430 13:51:53.439232 1 tasks_processing.go:74] worker 1 stopped. I0430 13:51:53.439521 1 recorder.go:75] Recording config/workload_info with fingerprint=98badb2c4e43cc3f3ad32a143dc6b84cf4788e24075a4d065972012a0566f328 I0430 13:51:53.439536 1 gather.go:177] gatherer "workloads" function "workload_info" took 10.258865312s to process 1 records I0430 13:51:53.439549 1 periodic.go:256] Periodic gather workloads completed in 10.259s I0430 13:51:53.439557 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0430 13:51:53.439562 1 periodic.go:209] Running conditional gatherer I0430 13:51:53.445967 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0430 13:51:53.452314 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.14:38198->172.30.0.10:53: read: connection refused I0430 13:51:53.452600 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0430 13:51:53.455733 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.130.0.14:38652->172.30.0.10:53: read: connection refused I0430 13:51:53.455817 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0430 13:51:53.461747 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0430 13:51:53.461760 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461765 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461769 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461772 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461775 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461778 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461781 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461783 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:51:53.461786 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0430 13:51:53.461801 1 tasks_processing.go:45] number of workers: 3 I0430 13:51:53.461815 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:51:53.461821 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0430 13:51:53.461824 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:51:53.461851 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0430 13:51:53.461854 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:51:53.461866 1 tasks_processing.go:74] worker 1 stopped. I0430 13:51:53.461869 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0430 13:51:53.461923 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0430 13:51:53.461937 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 943ns to process 1 records I0430 13:51:53.461967 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0430 13:51:53.461974 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 866ns to process 1 records I0430 13:51:53.461979 1 tasks_processing.go:74] worker 0 stopped. I0430 13:51:53.462177 1 tasks_processing.go:74] worker 2 stopped. I0430 13:51:53.462195 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 288.404µs to process 0 records I0430 13:51:53.462222 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.14:38198->172.30.0.10:53: read: connection refused I0430 13:51:53.462242 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0430 13:51:53.488428 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=05906565414717082befa1e21bf06ddcd6ca358b38365bf9fb3fa5b9db186fdf I0430 13:51:53.488570 1 diskrecorder.go:70] Writing 202 records to /var/lib/insights-operator/insights-2026-04-30-135153.tar.gz I0430 13:51:53.502179 1 diskrecorder.go:51] Wrote 202 records to disk in 13ms I0430 13:51:53.502206 1 periodic.go:278] Gathering cluster info every 2h0m0s I0430 13:51:53.502220 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0430 13:52:52.312679 1 diskrecorder.go:223] Found files to send: insights-2026-04-30-135153.tar.gz I0430 13:52:52.312710 1 insightsuploader.go:150] Checking archives to upload periodically every 15m6.837919718s I0430 13:52:52.312718 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0430 13:52:52.322669 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0430 13:52:52.580469 1 requests.go:87] Successfully reported id=2026-04-30T13:52:52Z x-rh-insights-request-id=ab7e775a5c66438d9ffff0076a92025e, wrote=103299 I0430 13:52:52.580533 1 insightsuploader.go:187] Uploaded report successfully in 267.806729ms I0430 13:52:52.580554 1 controller.go:128] Initializing last reported time to 2026-04-30T13:52:52Z I0430 13:52:52.580633 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0430 13:52:52.580648 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0430 13:52:52.580658 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0430 13:52:52.586352 1 controller.go:512] The operator is healthy I0430 13:53:22.327503 1 controller.go:512] The operator is healthy I0430 13:53:56.786850 1 insightsreport.go:137] Pulling report from smart-proxy I0430 13:53:56.786879 1 insightsreport.go:149] Retrieving report I0430 13:53:56.793483 1 requests.go:110] Retrieving report for cluster: 8680ef80-cc81-4b9f-a122-75c7af45a6d8 I0430 13:53:56.793494 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8680ef80-cc81-4b9f-a122-75c7af45a6d8/reports I0430 13:53:56.796218 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8680ef80-cc81-4b9f-a122-75c7af45a6d8/reports I0430 13:53:57.013495 1 insightsreport.go:184] Report retrieved I0430 13:53:57.036768 1 insightsreport.go:239] Report retrieved correctly I0430 13:55:22.330664 1 controller.go:512] The operator is healthy I0430 13:56:22.304988 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0430 13:56:22.310948 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:56:22.310968 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0430 13:56:22.315284 1 secretconfigobserver.go:119] support secret does not exist I0430 13:57:22.326235 1 controller.go:512] The operator is healthy I0430 13:59:22.329700 1 controller.go:512] The operator is healthy I0430 14:01:22.301758 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 14:01:22.305421 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 14:01:22.315507 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0430 14:01:22.319501 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 14:01:22.319516 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0430 14:01:22.323201 1 secretconfigobserver.go:119] support secret does not exist I0430 14:01:22.325082 1 controller.go:512] The operator is healthy I0430 14:03:22.331477 1 controller.go:512] The operator is healthy I0430 14:05:22.329862 1 controller.go:512] The operator is healthy I0430 14:06:22.324221 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0430 14:06:22.333219 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 14:06:22.333240 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0430 14:06:22.337237 1 secretconfigobserver.go:119] support secret does not exist I0430 14:07:22.328525 1 controller.go:512] The operator is healthy I0430 14:08:04.419947 1 insightsuploader.go:146] Nothing to report since 2026-04-30T13:52:52Z