W0507 08:42:02.907784 1 cmd.go:257] Using insecure, self-signed certificates I0507 08:42:03.880296 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 08:42:03.880614 1 observer_polling.go:159] Starting file observer I0507 08:42:04.715891 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 08:42:04.716101 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 08:42:04.716633 1 secure_serving.go:57] Forcing use of http/1.1 only I0507 08:42:04.716929 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0507 08:42:04.717013 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 08:42:04.717026 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 08:42:04.717031 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 08:42:04.717038 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 08:42:04.717041 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 08:42:04.717044 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 08:42:04.721562 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0507 08:42:04.721619 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"a42815fb-980c-4d4b-89a1-f04702bf6630", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0507 08:42:04.721798 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 08:42:04.721812 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 08:42:04.721819 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 08:42:04.721839 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 08:42:04.721831 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 08:42:04.721859 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 08:42:04.722090 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2710055875/tls.crt::/tmp/serving-cert-2710055875/tls.key" I0507 08:42:04.722374 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 08:42:04.722403 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 08:42:04.727322 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 08:42:04.727349 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 08:42:04.727450 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 08:42:04.733651 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 08:42:04.733667 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 08:42:04.740396 1 secretconfigobserver.go:119] support secret does not exist I0507 08:42:04.747198 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 08:42:04.751245 1 secretconfigobserver.go:119] support secret does not exist I0507 08:42:04.753271 1 recorder.go:176] Pruning old reports every 4h9m11s, max age is 288h0m0s I0507 08:42:04.759169 1 periodic.go:216] Running clusterconfig gatherer I0507 08:42:04.759178 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 08:42:04.759191 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 08:42:04.759208 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 08:42:04.759217 1 insightsreport.go:296] Starting report retriever I0507 08:42:04.759224 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 08:42:04.759209 1 tasks_processing.go:45] number of workers: 64 I0507 08:42:04.759242 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 08:42:04.759251 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 08:42:04.759255 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 08:42:04.759257 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 08:42:04.759262 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 08:42:04.759265 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 08:42:04.759268 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 08:42:04.759269 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 08:42:04.759261 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 08:42:04.759277 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 08:42:04.759273 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 08:42:04.759284 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 08:42:04.759285 1 tasks_processing.go:71] worker 9 working on lokistack task. I0507 08:42:04.759289 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 08:42:04.759287 1 tasks_processing.go:71] worker 10 working on ingress task. I0507 08:42:04.759294 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 08:42:04.759298 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 08:42:04.759298 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 08:42:04.759303 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 08:42:04.759310 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 08:42:04.759303 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 08:42:04.759316 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 08:42:04.759316 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 08:42:04.759322 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 08:42:04.759319 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 08:42:04.759326 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 08:42:04.759307 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 08:42:04.759307 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 08:42:04.759333 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 08:42:04.759342 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 08:42:04.759324 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 08:42:04.759332 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 08:42:04.759353 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 08:42:04.759354 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 08:42:04.759327 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 08:42:04.759360 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 08:42:04.759363 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 08:42:04.759365 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 08:42:04.759337 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 08:42:04.759370 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 08:42:04.759373 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 08:42:04.759337 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 08:42:04.759377 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 08:42:04.759381 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 08:42:04.759382 1 tasks_processing.go:71] worker 0 working on nodenetworkstates task. I0507 08:42:04.759383 1 tasks_processing.go:71] worker 4 working on overlapping_namespace_uids task. I0507 08:42:04.759387 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 08:42:04.759389 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 08:42:04.759349 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 08:42:04.759353 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 08:42:04.759398 1 tasks_processing.go:71] worker 33 working on monitoring_persistent_volumes task. I0507 08:42:04.759400 1 tasks_processing.go:71] worker 38 working on cost_management_metrics_configs task. I0507 08:42:04.759403 1 tasks_processing.go:71] worker 48 working on image_pruners task. I0507 08:42:04.759406 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 08:42:04.759415 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 08:42:04.759423 1 tasks_processing.go:71] worker 17 working on certificate_signing_requests task. I0507 08:42:04.759441 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 08:42:04.759468 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 08:42:04.759345 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 08:42:04.759353 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 08:42:04.759331 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 08:42:04.759471 1 tasks_processing.go:71] worker 1 working on openstack_version task. I0507 08:42:04.759485 1 tasks_processing.go:71] worker 56 working on authentication task. I0507 08:42:04.759480 1 tasks_processing.go:71] worker 2 working on container_runtime_configs task. I0507 08:42:04.759486 1 tasks_processing.go:71] worker 23 working on qemu_kubevirt_launcher_logs task. I0507 08:42:04.759499 1 tasks_processing.go:71] worker 19 working on ceph_cluster task. I0507 08:42:04.759502 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 08:42:04.759287 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 08:42:04.759364 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 08:42:04.759364 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 08:42:04.759518 1 tasks_processing.go:71] worker 37 working on operators task. I0507 08:42:04.759371 1 tasks_processing.go:71] worker 7 working on openshift_machine_api_events task. I0507 08:42:04.759518 1 tasks_processing.go:71] worker 52 working on active_alerts task. I0507 08:42:04.759371 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 08:42:04.759378 1 tasks_processing.go:71] worker 8 working on operators_pods_and_events task. W0507 08:42:04.759566 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 08:42:04.759585 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 47.113µs to process 0 records I0507 08:42:04.759355 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 08:42:04.759383 1 tasks_processing.go:71] worker 46 working on schedulers task. I0507 08:42:04.759604 1 tasks_processing.go:71] worker 22 working on image_registries task. I0507 08:42:04.759636 1 tasks_processing.go:71] worker 39 working on infrastructures task. I0507 08:42:04.759644 1 tasks_processing.go:71] worker 6 working on version task. I0507 08:42:04.759699 1 tasks_processing.go:71] worker 24 working on openstack_controlplanes task. I0507 08:42:04.759715 1 tasks_processing.go:71] worker 12 working on jaegers task. I0507 08:42:04.759776 1 tasks_processing.go:71] worker 40 working on silenced_alerts task. W0507 08:42:04.759802 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 08:42:04.759383 1 tasks_processing.go:71] worker 62 working on sap_datahubs task. I0507 08:42:04.759814 1 tasks_processing.go:71] worker 40 working on nodenetworkconfigurationpolicies task. I0507 08:42:04.759825 1 tasks_processing.go:71] worker 30 working on machine_config_pools task. I0507 08:42:04.759836 1 tasks_processing.go:71] worker 14 working on storage_cluster task. I0507 08:42:04.759866 1 tasks_processing.go:71] worker 26 working on image task. I0507 08:42:04.759877 1 tasks_processing.go:71] worker 58 working on feature_gates task. I0507 08:42:04.759908 1 tasks_processing.go:71] worker 44 working on pod_network_connectivity_checks task. I0507 08:42:04.759964 1 tasks_processing.go:71] worker 34 working on nodes task. I0507 08:42:04.759968 1 tasks_processing.go:71] worker 20 working on container_images task. I0507 08:42:04.759974 1 tasks_processing.go:71] worker 31 working on config_maps task. I0507 08:42:04.759389 1 tasks_processing.go:71] worker 53 working on support_secret task. I0507 08:42:04.759346 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 08:42:04.760010 1 tasks_processing.go:71] worker 47 working on ingress_certificates task. I0507 08:42:04.760016 1 tasks_processing.go:71] worker 27 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 08:42:04.760023 1 tasks_processing.go:71] worker 43 working on proxies task. I0507 08:42:04.759963 1 tasks_processing.go:71] worker 35 working on install_plans task. I0507 08:42:04.759378 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 08:42:04.759394 1 tasks_processing.go:71] worker 54 working on storage_classes task. I0507 08:42:04.760056 1 tasks_processing.go:71] worker 41 working on dvo_metrics task. I0507 08:42:04.760204 1 tasks_processing.go:71] worker 49 working on service_accounts task. I0507 08:42:04.759283 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 08:42:04.759510 1 tasks_processing.go:71] worker 15 working on node_features task. I0507 08:42:04.759399 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 08:42:04.759913 1 tasks_processing.go:71] worker 5 working on sap_pods task. I0507 08:42:04.760399 1 tasks_processing.go:71] worker 50 working on validating_webhook_configurations task. I0507 08:42:04.760418 1 tasks_processing.go:71] worker 29 working on olm_operators task. I0507 08:42:04.759278 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 08:42:04.759925 1 tasks_processing.go:71] worker 42 working on aggregated_monitoring_cr_names task. I0507 08:42:04.760449 1 tasks_processing.go:71] worker 3 working on crds task. I0507 08:42:04.760477 1 tasks_processing.go:71] worker 32 working on mutating_webhook_configurations task. I0507 08:42:04.759513 1 tasks_processing.go:71] worker 16 working on metrics task. I0507 08:42:04.760508 1 tasks_processing.go:71] worker 57 working on tsdb_status task. I0507 08:42:04.760513 1 tasks_processing.go:71] worker 63 working on openstack_dataplanenodesets task. W0507 08:42:04.760526 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0507 08:42:04.760527 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 08:42:04.759932 1 tasks_processing.go:71] worker 25 working on oauths task. I0507 08:42:04.759393 1 tasks_processing.go:71] worker 18 working on machine_autoscalers task. I0507 08:42:04.759934 1 tasks_processing.go:71] worker 45 working on clusterroles task. I0507 08:42:04.759938 1 tasks_processing.go:71] worker 51 working on sap_config task. I0507 08:42:04.759388 1 tasks_processing.go:71] worker 11 working on openstack_dataplanedeployments task. I0507 08:42:04.759940 1 tasks_processing.go:71] worker 60 working on machine_configs task. I0507 08:42:04.759922 1 tasks_processing.go:71] worker 52 working on cluster_apiserver task. I0507 08:42:04.759928 1 tasks_processing.go:71] worker 36 working on openshift_logging task. I0507 08:42:04.759945 1 tasks_processing.go:71] worker 59 working on pdbs task. I0507 08:42:04.759951 1 tasks_processing.go:71] worker 21 working on node_logs task. I0507 08:42:04.761193 1 tasks_processing.go:71] worker 13 working on machine_healthchecks task. I0507 08:42:04.759945 1 tasks_processing.go:71] worker 61 working on machine_sets task. I0507 08:42:04.759959 1 tasks_processing.go:71] worker 28 working on networks task. I0507 08:42:04.759962 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 26.313µs to process 0 records I0507 08:42:04.761363 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 26.056µs to process 0 records I0507 08:42:04.761372 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 21.169µs to process 0 records I0507 08:42:04.761381 1 tasks_processing.go:74] worker 57 stopped. I0507 08:42:04.761386 1 tasks_processing.go:74] worker 16 stopped. I0507 08:42:04.759931 1 tasks_processing.go:71] worker 55 working on machines task. I0507 08:42:04.771107 1 tasks_processing.go:74] worker 2 stopped. I0507 08:42:04.771120 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 11.605169ms to process 0 records I0507 08:42:04.782395 1 tasks_processing.go:74] worker 9 stopped. I0507 08:42:04.782409 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 23.093684ms to process 0 records I0507 08:42:04.782523 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0507 08:42:04.782709 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 08:42:04.782719 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 08:42:04.782723 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 08:42:04.782761 1 controller.go:531] The operator is still being initialized I0507 08:42:04.782769 1 controller.go:554] The operator is healthy I0507 08:42:04.791087 1 tasks_processing.go:74] worker 1 stopped. I0507 08:42:04.791102 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 31.593077ms to process 0 records I0507 08:42:04.791110 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 31.700086ms to process 0 records I0507 08:42:04.791116 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 31.602696ms to process 0 records I0507 08:42:04.791121 1 tasks_processing.go:74] worker 19 stopped. I0507 08:42:04.791119 1 tasks_processing.go:74] worker 38 stopped. I0507 08:42:04.791130 1 tasks_processing.go:74] worker 0 stopped. I0507 08:42:04.791141 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 31.73871ms to process 0 records I0507 08:42:04.798407 1 tasks_processing.go:74] worker 12 stopped. I0507 08:42:04.798421 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 38.680306ms to process 0 records I0507 08:42:04.798433 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 38.592839ms to process 0 records I0507 08:42:04.798438 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 38.598804ms to process 0 records I0507 08:42:04.798444 1 tasks_processing.go:74] worker 40 stopped. I0507 08:42:04.798463 1 tasks_processing.go:74] worker 24 stopped. I0507 08:42:04.798448 1 tasks_processing.go:74] worker 62 stopped. I0507 08:42:04.798475 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 38.73782ms to process 0 records I0507 08:42:04.798657 1 tasks_processing.go:74] worker 39 stopped. I0507 08:42:04.799155 1 recorder.go:75] Recording config/infrastructure with fingerprint=291aa95e2291c4e25ae7d8d2b46b8f5cfb604c6dd1036b1f7f7d9227b28562e8 I0507 08:42:04.799172 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 39.003407ms to process 1 records I0507 08:42:04.799254 1 tasks_processing.go:74] worker 10 stopped. I0507 08:42:04.799303 1 recorder.go:75] Recording config/ingress with fingerprint=c40aa8a6e8d984903cc85860f2e6ed5b189bdd2c7db65bd1a9fd0ef801b4ff25 I0507 08:42:04.799313 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 39.371523ms to process 1 records I0507 08:42:04.802406 1 tasks_processing.go:74] worker 30 stopped. I0507 08:42:04.802415 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 42.572535ms to process 0 records I0507 08:42:04.802420 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 43.015846ms to process 0 records I0507 08:42:04.802427 1 tasks_processing.go:74] worker 33 stopped. I0507 08:42:04.802431 1 tasks_processing.go:74] worker 44 stopped. E0507 08:42:04.802438 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 08:42:04.802446 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 42.463568ms to process 0 records E0507 08:42:04.802567 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0507 08:42:04.802575 1 tasks_processing.go:74] worker 15 stopped. I0507 08:42:04.802580 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 42.238955ms to process 0 records I0507 08:42:04.802678 1 tasks_processing.go:74] worker 14 stopped. I0507 08:42:04.802691 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 42.833539ms to process 0 records I0507 08:42:04.802798 1 tasks_processing.go:74] worker 46 stopped. I0507 08:42:04.802862 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=5d4bee680622d741a57ec538c300e1298c9afc7fa65970a908ea62abb794cc11 I0507 08:42:04.802878 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 43.194872ms to process 1 records E0507 08:42:04.802886 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 08:42:04.802891 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 42.854594ms to process 0 records I0507 08:42:04.802896 1 tasks_processing.go:74] worker 53 stopped. I0507 08:42:04.803200 1 tasks_processing.go:74] worker 54 stopped. I0507 08:42:04.803307 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=ce327aa55464c90a9f4bab5ef3b18f5fb61ea8762408a8fdda535fe58b49579d I0507 08:42:04.803326 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=bdc0aed1609dcab895d3b70402c77ec5924d7f8a3f44d5c5657c3da028d1f2b2 I0507 08:42:04.803332 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 43.14092ms to process 2 records I0507 08:42:04.803365 1 tasks_processing.go:74] worker 61 stopped. I0507 08:42:04.803377 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 42.143106ms to process 0 records I0507 08:42:04.803387 1 tasks_processing.go:74] worker 56 stopped. I0507 08:42:04.803575 1 recorder.go:75] Recording config/authentication with fingerprint=1486fcdf19763a3c1005b5fa340513a42bd356ec48e683eeb244cb6206adc504 I0507 08:42:04.803588 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 43.89276ms to process 1 records I0507 08:42:04.803595 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 43.941141ms to process 0 records I0507 08:42:04.803600 1 tasks_processing.go:74] worker 7 stopped. I0507 08:42:04.803660 1 tasks_processing.go:74] worker 28 stopped. I0507 08:42:04.803783 1 recorder.go:75] Recording config/network with fingerprint=75386b346f45712dc51c309c509be4e605543dd1dd7491f13508d8656b1fcdae I0507 08:42:04.803795 1 gather.go:177] gatherer "clusterconfig" function "networks" took 42.412962ms to process 1 records I0507 08:42:04.803800 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 42.651921ms to process 0 records E0507 08:42:04.803806 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 08:42:04.803811 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 42.552162ms to process 0 records I0507 08:42:04.803816 1 tasks_processing.go:74] worker 21 stopped. I0507 08:42:04.803825 1 tasks_processing.go:74] worker 13 stopped. I0507 08:42:04.803852 1 recorder.go:75] Recording config/proxy with fingerprint=2be51c314e3ae7b0c19ff20690a3fdd3312007d884bc151c213e259493323862 I0507 08:42:04.803860 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 43.776519ms to process 1 records I0507 08:42:04.803864 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 43.088718ms to process 0 records I0507 08:42:04.803869 1 tasks_processing.go:74] worker 51 stopped. I0507 08:42:04.803873 1 tasks_processing.go:74] worker 43 stopped. I0507 08:42:04.803916 1 gather_logs.go:145] no pods in namespace were found I0507 08:42:04.803926 1 tasks_processing.go:74] worker 23 stopped. I0507 08:42:04.803933 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 44.423777ms to process 0 records I0507 08:42:04.807897 1 tasks_processing.go:74] worker 5 stopped. I0507 08:42:04.807908 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 47.498501ms to process 0 records I0507 08:42:04.807966 1 tasks_processing.go:74] worker 18 stopped. I0507 08:42:04.807974 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 47.277718ms to process 0 records I0507 08:42:04.808005 1 tasks_processing.go:74] worker 26 stopped. I0507 08:42:04.808082 1 recorder.go:75] Recording config/image with fingerprint=31a93caa2db7433ba21a3a0619dc8ffcc89e125b580a51fdf0f32fc7b5774331 I0507 08:42:04.808096 1 gather.go:177] gatherer "clusterconfig" function "image" took 48.125213ms to process 1 records I0507 08:42:04.808168 1 tasks_processing.go:74] worker 58 stopped. I0507 08:42:04.808184 1 recorder.go:75] Recording config/featuregate with fingerprint=fc8e6856260149fb4a83f0d0c2e41613b1550c2850d4134a2dca96d5a3339ecc I0507 08:42:04.808191 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 48.217628ms to process 1 records I0507 08:42:04.809682 1 tasks_processing.go:74] worker 17 stopped. I0507 08:42:04.809699 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 50.233079ms to process 0 records I0507 08:42:04.811510 1 tasks_processing.go:74] worker 36 stopped. I0507 08:42:04.811525 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 50.60839ms to process 0 records I0507 08:42:04.811674 1 tasks_processing.go:74] worker 32 stopped. I0507 08:42:04.812391 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=365b4bf82ed4539ada2ff6334bae72764aee483ada7877e5fac81b4165a0fe3d I0507 08:42:04.812471 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=857c7e6c2faa4746d4b78cc3af17b95c860524ce404e328c2cf71bf930b72322 I0507 08:42:04.812646 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=32fee8041c4043dd1fd75a2abfb207b9d7758e89a947ecfd8771ab704a7cc72a I0507 08:42:04.812706 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 51.185426ms to process 3 records I0507 08:42:04.812976 1 recorder.go:75] Recording config/apiserver with fingerprint=4b8369ceba71cfac5de55f819a2ead147095deb974551c48165a471a95327291 I0507 08:42:04.812990 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 50.970931ms to process 1 records I0507 08:42:04.813000 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 51.651636ms to process 0 records I0507 08:42:04.813014 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 51.815581ms to process 0 records E0507 08:42:04.813077 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 08:42:04.813132 1 gather.go:177] gatherer "clusterconfig" function "machines" took 50.960622ms to process 0 records I0507 08:42:04.813150 1 tasks_processing.go:74] worker 29 stopped. I0507 08:42:04.813165 1 tasks_processing.go:74] worker 52 stopped. I0507 08:42:04.813181 1 tasks_processing.go:74] worker 55 stopped. I0507 08:42:04.813469 1 tasks_processing.go:74] worker 34 stopped. I0507 08:42:04.813181 1 tasks_processing.go:74] worker 63 stopped. I0507 08:42:04.815012 1 recorder.go:75] Recording config/node/ip-10-0-0-220.ec2.internal with fingerprint=e16fade83f379620d3b0b1f8d75bc989e64cf9d4e397c940ec730f9c946a9c75 I0507 08:42:04.815133 1 recorder.go:75] Recording config/node/ip-10-0-1-107.ec2.internal with fingerprint=f49dc17f1e7d8f73c5a0034ec17f2ea520dea5e344eeff28520b58b474f97c89 I0507 08:42:04.815223 1 recorder.go:75] Recording config/node/ip-10-0-2-252.ec2.internal with fingerprint=3a08a2f8ac861cafa71c6e01fa510f5e52927e7ceb385c94f83cb8a5a1a78f40 I0507 08:42:04.815236 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 52.966258ms to process 3 records I0507 08:42:04.815244 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 52.529315ms to process 0 records I0507 08:42:04.815314 1 tasks_processing.go:74] worker 11 stopped. I0507 08:42:04.815390 1 tasks_processing.go:74] worker 22 stopped. I0507 08:42:04.815949 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=d3999a8bbc1aa5818daf415ea6c5a1a5195ae8da987470a3d293dd0df184dd8a I0507 08:42:04.815965 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 54.068999ms to process 1 records I0507 08:42:04.816101 1 tasks_processing.go:74] worker 25 stopped. I0507 08:42:04.816268 1 recorder.go:75] Recording config/oauth with fingerprint=b1f021956a067c66dbc448f0b5cb31ca17923ba7969c4f29fd31c55baa42171c I0507 08:42:04.816281 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 54.195232ms to process 1 records I0507 08:42:04.816301 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 08:42:04.816310 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 55.63738ms to process 1 records I0507 08:42:04.816366 1 tasks_processing.go:74] worker 4 stopped. I0507 08:42:04.816441 1 tasks_processing.go:74] worker 50 stopped. I0507 08:42:04.816469 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b91255a6717ce63b8e4d8031a280181c1291a27177e46f98b69a8eba9cbd00a0 I0507 08:42:04.816598 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=fa7ccdb2bf5754b4a98df820108000f328dd529050868d00378a944fa06b926f I0507 08:42:04.816632 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=d929500c60ac6bf70296743b11a4a720a7dc99e93b339a7fd3e78e6527eeb34f I0507 08:42:04.816674 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=5f61a95cb4e8697ca18301b05a3c10742f8fede1bc2daf96e21d35ed70fc3d0d I0507 08:42:04.816716 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1e2e86d388979c7ddbd9ec352c134774ed5d2e4854829827725f2a1e9077b4e1 I0507 08:42:04.816757 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=0defe5d2a6e5ab0e858ad29e86c307b5f587bed83591569cc6d8758f20ba0a64 I0507 08:42:04.816796 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=eb790c3eb4e9b988f09a5967d6064260009c73fd3e7c0a5c2ff566a48d416955 I0507 08:42:04.816852 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=5044db594f2e0f4f80b117ba99fe7a6c86f4821919e75d7b33dc4b71af85fbf6 I0507 08:42:04.816891 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=a137f8ab5cf3e6b64c5a7e981e92f61ecd1d82d2755fd0a9f921e9a264c21453 I0507 08:42:04.816937 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=05317bce48b6d697221651004631ad80fa222d3ba3619ffed63dae86330cb889 I0507 08:42:04.816973 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b0370b411c13d26328d332e9e60cdf4a98c032a116bd7bd4d0958d6910c10110 I0507 08:42:04.816985 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 54.725641ms to process 11 records W0507 08:42:04.819107 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 08:42:04.819524 1 tasks_processing.go:74] worker 60 stopped. E0507 08:42:04.819540 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0507 08:42:04.819570 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 08:42:04.819586 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 58.669283ms to process 1 records I0507 08:42:04.821884 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 08:42:04.821903 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 08:42:04.821969 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 08:42:04.824553 1 tasks_processing.go:74] worker 20 stopped. I0507 08:42:04.825790 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-nrnlg with fingerprint=dc8954558a4887f6ea8acaec7c135df4990111634cfa19c57f32ccc6535bff0c I0507 08:42:04.825839 1 recorder.go:75] Recording config/running_containers with fingerprint=75ef3eb29a0d376b770fa3e38eee06924eacf9941b65b78f4a3139e4bcdeb52b I0507 08:42:04.825849 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 64.566611ms to process 2 records I0507 08:42:04.827505 1 base_controller.go:82] Caches are synced for ConfigController I0507 08:42:04.827520 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 08:42:04.829636 1 tasks_processing.go:74] worker 59 stopped. I0507 08:42:04.829760 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=74b568629a43aafe42fd653fcc2f5dae976db389dfba11f28a674d4bc8346080 I0507 08:42:04.829792 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=6ce17de6bbc18a1d1c7e91f1b3d77ca262b981525733ec9bf2e37a9c241bffa8 I0507 08:42:04.829819 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9afe9cceeb76858eb8ae86d2443922eb658db6beb2c70002f881ffe1c0fe0ead I0507 08:42:04.829832 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 08:42:04.829832 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 68.667613ms to process 3 records I0507 08:42:04.829927 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0507 08:42:04.829939 1 operator.go:328] started I0507 08:42:04.829957 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 08:42:04.830004 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=47cd15b7d20771fbb754293a2b94e1655db8d3a936bbc7a1430d90c942e279f0 I0507 08:42:04.830019 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 70.345263ms to process 1 records I0507 08:42:04.830026 1 tasks_processing.go:74] worker 48 stopped. I0507 08:42:04.834986 1 tasks_processing.go:74] worker 45 stopped. I0507 08:42:04.835184 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=ebbfd748a7c36b58821eeb20b141d9907db41b69a2b80fd6f4e2085e43800615 I0507 08:42:04.835287 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=5bdb58614a983a90ed45a9d331a07dc45593989da9fc982dad31d612a1d9a723 I0507 08:42:04.835301 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 74.264155ms to process 2 records I0507 08:42:04.835387 1 tasks_processing.go:74] worker 3 stopped. I0507 08:42:04.835795 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=c4548482a32c55fe80e79fa7585986f24fcf20ca3d6a9d740c6a800cdc2fe4a3 I0507 08:42:04.836007 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=7d50f014d83f16be21dbf72843ef97e844f9458b4d18107168f525cc648b595f I0507 08:42:04.836021 1 gather.go:177] gatherer "clusterconfig" function "crds" took 74.632833ms to process 2 records I0507 08:42:04.840436 1 tasks_processing.go:74] worker 27 stopped. I0507 08:42:04.840447 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 80.403388ms to process 0 records I0507 08:42:04.846590 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 08:42:04.846738 1 prometheus_rules.go:88] Prometheus rules successfully created I0507 08:42:04.852009 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 08:42:04.852027 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 08:42:04.852034 1 controller.go:254] Source scaController *sca.Controller is not ready I0507 08:42:04.852042 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0507 08:42:04.852049 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 08:42:04.852076 1 controller.go:531] The operator is still being initialized I0507 08:42:04.852088 1 controller.go:554] The operator is healthy E0507 08:42:04.858295 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27d0c2f2c9-b7ac-41d8-91d7-39bd0b2f7a4b%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:37954->172.30.0.10:53: read: connection refused I0507 08:42:04.858307 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27d0c2f2c9-b7ac-41d8-91d7-39bd0b2f7a4b%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:37954->172.30.0.10:53: read: connection refused I0507 08:42:04.868353 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0507 08:42:04.871449 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:34320->172.30.0.10:53: read: connection refused I0507 08:42:04.871479 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:34320->172.30.0.10:53: read: connection refused I0507 08:42:04.877186 1 tasks_processing.go:74] worker 31 stopped. E0507 08:42:04.877198 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 08:42:04.877203 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 08:42:04.877207 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 08:42:04.877216 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0507 08:42:04.877254 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 08:42:04.877261 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 08:42:04.877266 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0507 08:42:04.877270 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 08:42:04.877308 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 08:42:04.877315 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 08:42:04.877320 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 117.195049ms to process 7 records I0507 08:42:04.894901 1 tasks_processing.go:74] worker 6 stopped. I0507 08:42:04.895726 1 recorder.go:75] Recording config/version with fingerprint=a6ed68601644356969a4705ada970236892f9013ab58046e77badeb4199b84a8 I0507 08:42:04.895802 1 recorder.go:75] Recording config/id with fingerprint=24c5c0dcb4beb0e59174d0532b39460aa1334f49080cc6a6c96a611776c2f32d I0507 08:42:04.895838 1 gather.go:177] gatherer "clusterconfig" function "version" took 135.24386ms to process 2 records I0507 08:42:04.930655 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 08:42:04.930670 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 08:42:04.941788 1 tasks_processing.go:74] worker 47 stopped. E0507 08:42:04.941805 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 08:42:04.941812 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q4vtdvejrrvj7fqh7irgbvhm1lon1ci-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q4vtdvejrrvj7fqh7irgbvhm1lon1ci-primary-cert-bundle-secret" not found I0507 08:42:04.941876 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=7abf33099fbab1abc74b812d9915484a9d2d9b19133be590b0762329551f3688 I0507 08:42:04.941891 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 181.762379ms to process 1 records W0507 08:42:05.816226 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 08:42:06.023667 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0507 08:42:06.023682 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0507 08:42:06.024517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-kcn8h pod in namespace openshift-dns (previous: false). I0507 08:42:06.255520 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kcn8h pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-kcn8h\" is waiting to start: ContainerCreating" I0507 08:42:06.255537 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-kcn8h\" is waiting to start: ContainerCreating" I0507 08:42:06.255547 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-kcn8h pod in namespace openshift-dns (previous: false). I0507 08:42:06.268505 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0507 08:42:06.451421 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kcn8h pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-kcn8h\" is waiting to start: ContainerCreating" I0507 08:42:06.451601 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-kcn8h\" is waiting to start: ContainerCreating" I0507 08:42:06.451618 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-nrzmg pod in namespace openshift-dns (previous: false). I0507 08:42:06.631691 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nrzmg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-nrzmg\" is waiting to start: ContainerCreating" I0507 08:42:06.631711 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-nrzmg\" is waiting to start: ContainerCreating" I0507 08:42:06.631719 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-nrzmg pod in namespace openshift-dns (previous: false). W0507 08:42:06.816327 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 08:42:06.826466 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nrzmg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-nrzmg\" is waiting to start: ContainerCreating" I0507 08:42:06.826481 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-nrzmg\" is waiting to start: ContainerCreating" I0507 08:42:06.826490 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hr87s pod in namespace openshift-dns (previous: false). I0507 08:42:06.852213 1 tasks_processing.go:74] worker 37 stopped. I0507 08:42:06.852263 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=10e41d5415907690e2e62f7b2b33fa7b3abd763d74407ae73025885b5fae041a I0507 08:42:06.852305 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=68d40bff36e79254e0f06132fd58dfec28d1e05d7dfa21c55354c81d5381ee0a I0507 08:42:06.852333 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 08:42:06.852358 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=9610df2cfd89603160960440acc998a984ac9e5484846c186870f2558fd4199d I0507 08:42:06.852375 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 08:42:06.852410 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=c67d1f7190aa4ba3565e38a583d86261ed52af04aea413a712dddfae7de208ad I0507 08:42:06.852444 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=cbc821f7aa0e1f8066c091ec3650c50dc90001489fe57c28d952b8b2e072bec0 I0507 08:42:06.852484 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=8b8a8bd66139cf55af8872ff2cc316895434b78d4b11c3ca45f541cb65a4293a I0507 08:42:06.852498 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=9b3a05ae2b1fe47befca1d3af64a0cab00a02937fbc02f13c1d7dd401b70c181 I0507 08:42:06.852515 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=8881e4177fe5a2a64918e5f3ec334ae49fba9bece9b9baacaa3dbd8147e3eeed I0507 08:42:06.852523 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 08:42:06.852539 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=58562d99dc220a82b97ff0904e721a2620a07f0b0b87ccd1af4686b675e2fedf I0507 08:42:06.852550 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 08:42:06.852567 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7de0181d3c61cc35c9c5358b9c30f0be90d0a4fa824f4e3e8849243549dfff1c I0507 08:42:06.852575 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 08:42:06.852595 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=cddc74ed7ea8f04374dde9b4d70c64653d3eb6622b06dbd6d2912970bb50b25f I0507 08:42:06.852604 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 08:42:06.852619 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=bbba74c823ad13a7e7a7221eba6fa9f948c084244ff53cab142b06465f3dd1a8 I0507 08:42:06.852746 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=acf9b019285a07c343ba5421eb2f47c50e3a6f3018173da5949233ee556d9014 I0507 08:42:06.852755 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 08:42:06.852761 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 08:42:06.852781 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 08:42:06.852804 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=5b37e6d8c0896613106b8e52309b6616e80868baf76478fe2d6241a140146f51 I0507 08:42:06.852829 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=974ab9723f5d7ce64710aed573f8ac1a9a9789f41d6f50d7ffc8e3568f88caa4 I0507 08:42:06.852838 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 08:42:06.852854 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=df100700b47d5a63a6ea1dff82cc7fed340f056f75dd82a63b8ecc4249708f83 I0507 08:42:06.852863 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 08:42:06.852875 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c0139dc1c980b90bb9320a5de9c410076dbddbda3bac369415598d0b55083125 I0507 08:42:06.852888 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=6bdada5b9b79624eee0fce151c4b0e3d89012a2da2859639b5f80d2d2571212f I0507 08:42:06.852902 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=ed49ecf5340fae0e7b054156fdc721e59ce333fc95d1b95e1fbf44561f689e1f I0507 08:42:06.852916 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=339ec9dbf9aec1f1871c21043a85f54738e388d3c485e6e9fe7a9a69bc0d60a0 I0507 08:42:06.852937 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=efc8d4f5e2f72267b864eeb9c240c90ed707d1dffa1fef1e0dee1e8c208d5386 I0507 08:42:06.852946 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0507 08:42:06.852974 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=fbd895267d4e20292859e89e432a71246fed9e311904c7cf70f395e48aaa3da5 I0507 08:42:06.852990 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 08:42:06.852997 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 08:42:06.853003 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.092678032s to process 36 records I0507 08:42:06.930583 1 tasks_processing.go:74] worker 42 stopped. I0507 08:42:06.930601 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 2.170134258s to process 0 records I0507 08:42:07.058480 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:07.058499 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-s4dsr pod in namespace openshift-dns (previous: false). I0507 08:42:07.228767 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:07.228783 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-xsrqs pod in namespace openshift-dns (previous: false). I0507 08:42:07.427512 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:07.427529 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-744fd46c4b-xvszm pod in namespace openshift-image-registry (previous: false). I0507 08:42:07.625946 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-744fd46c4b-xvszm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-744fd46c4b-xvszm\" is waiting to start: ContainerCreating" I0507 08:42:07.625964 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-744fd46c4b-xvszm\" is waiting to start: ContainerCreating" I0507 08:42:07.625974 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-744fd46c4b-zfcbs pod in namespace openshift-image-registry (previous: false). W0507 08:42:07.816069 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 08:42:07.827879 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-744fd46c4b-zfcbs pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-744fd46c4b-zfcbs\" is waiting to start: ContainerCreating" I0507 08:42:07.827894 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-744fd46c4b-zfcbs\" is waiting to start: ContainerCreating" I0507 08:42:07.827905 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-9d9bc95d9-xd7fg pod in namespace openshift-image-registry (previous: false). I0507 08:42:08.021967 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:08.021983 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6j99c pod in namespace openshift-image-registry (previous: false). I0507 08:42:08.227027 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:08.227042 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6jlwk pod in namespace openshift-image-registry (previous: false). I0507 08:42:08.428539 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:08.428556 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-pgv2k pod in namespace openshift-image-registry (previous: false). I0507 08:42:08.626547 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 08:42:08.626563 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5654d84b7f-qlnqs pod in namespace openshift-ingress (previous: false). W0507 08:42:08.816763 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 08:42:08.828944 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5654d84b7f-qlnqs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5654d84b7f-qlnqs\" is waiting to start: ContainerCreating" I0507 08:42:08.828957 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5654d84b7f-qlnqs\" is waiting to start: ContainerCreating" I0507 08:42:08.828967 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6bff9b896-9m4k7 pod in namespace openshift-ingress (previous: false). I0507 08:42:09.026525 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6bff9b896-9m4k7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6bff9b896-9m4k7\" is waiting to start: ContainerCreating" I0507 08:42:09.026541 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6bff9b896-9m4k7\" is waiting to start: ContainerCreating" I0507 08:42:09.026554 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6bff9b896-pbv24 pod in namespace openshift-ingress (previous: false). I0507 08:42:09.228628 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6bff9b896-pbv24 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6bff9b896-pbv24\" is waiting to start: ContainerCreating" I0507 08:42:09.228648 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6bff9b896-pbv24\" is waiting to start: ContainerCreating" I0507 08:42:09.228658 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8s64l pod in namespace openshift-ingress-canary (previous: false). I0507 08:42:09.428765 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-9b9vg pod in namespace openshift-ingress-canary (previous: false). I0507 08:42:09.627404 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-gzrmw pod in namespace openshift-kube-storage-version-migrator (previous: false). W0507 08:42:09.812914 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 08:42:09.812939 1 tasks_processing.go:74] worker 41 stopped. E0507 08:42:09.812949 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 08:42:09.812978 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0507 08:42:09.813001 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0507 08:42:09.813015 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.052869056s to process 1 records I0507 08:42:09.827220 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-gzrmw pod in namespace openshift-kube-storage-version-migrator (previous: false). I0507 08:42:10.027313 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-sx95c pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0507 08:42:10.230477 1 tasks_processing.go:74] worker 8 stopped. I0507 08:42:10.230566 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=639baedda48caca8bb9d7921bfd475510a6f09aaf54d4a253b5f3eba46d7d2cc I0507 08:42:10.230617 1 recorder.go:75] Recording events/openshift-dns with fingerprint=1b719013c2dd3b27f9a907c967953808916f9ddba86d6d4e45563e8d5d9be9d2 I0507 08:42:10.230699 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=83d7b425761f1b17cef0c52364b8b6c261bf0515f9285c1174eccf80e844b407 I0507 08:42:10.230728 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=c4274fa41e6113a4a94b9bc5d056327049ccc3783eb290306b232da7d15b6a27 I0507 08:42:10.230774 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=926a6a6ae23b4f5552f86d36d584d00b91d4ec295d7a8a7ce22e6ff1ea93e339 I0507 08:42:10.230799 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=8f8197844a9c6cdcfe9be98f9a59a20bdd25ca6064be685ecd7bc8a0123ffc03 I0507 08:42:10.230812 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=23e42a6bf68ab1e4eb5ba8f309090ccbc8998eb063524a33e36f6a447c36a4b0 I0507 08:42:10.230857 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=a3927732d3670861056b6d5749ceb84b47df0e79963023879e3506af8adb7d33 I0507 08:42:10.230864 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-8s64l/serve-healthcheck-canary_current.log with fingerprint=58a7c42ea8794cce975cb1fc38db74477cc3e883f1382729a84bd953007d8141 I0507 08:42:10.230870 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-9b9vg/serve-healthcheck-canary_current.log with fingerprint=9ed56b5500e6d0ffb3b9fa6b3675f48eaebcca55c6d67440297245274e2ec5e0 I0507 08:42:10.230883 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-gzrmw/migrator_current.log with fingerprint=48e3d84c45a3d78392c7e25cc9cdd17f6343adebeeee6d529e96a5326b47c3a7 I0507 08:42:10.230888 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-gzrmw/graceful-termination_current.log with fingerprint=04a014de7e8559610c92181c6d41f8207e11735026d3927f1501a9f1fb96b1fb I0507 08:42:10.230980 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-sx95c/kube-storage-version-migrator-operator_current.log with fingerprint=6ca35eba3c942d568eb5495b705743f357bbad06cd04a615cb2206d788465e6e I0507 08:42:10.230988 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.470883253s to process 13 records I0507 08:42:17.123403 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 08:42:17.621404 1 tasks_processing.go:74] worker 35 stopped. I0507 08:42:17.621438 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0507 08:42:17.621450 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.861357336s to process 1 records I0507 08:42:18.366983 1 tasks_processing.go:74] worker 49 stopped. I0507 08:42:18.367247 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=c8ec6b4e3ff562aa9cffb0c6c8a7aad5bc75cfbbdcd0f7c491f6727973a8d911 I0507 08:42:18.367263 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.60671759s to process 1 records E0507 08:42:18.367319 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.608s with: function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 08:42:18.368423 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 08:42:18.368439 1 periodic.go:216] Running workloads gatherer I0507 08:42:18.368472 1 tasks_processing.go:45] number of workers: 2 I0507 08:42:18.368480 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 08:42:18.368485 1 tasks_processing.go:71] worker 1 working on workload_info task. I0507 08:42:18.368537 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 08:42:18.368551 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0507 08:42:18.392232 1 tasks_processing.go:74] worker 0 stopped. I0507 08:42:18.392249 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 23.668613ms to process 0 records I0507 08:42:18.423605 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0507 08:42:18.431729 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0507 08:42:18.439621 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (8ms) I0507 08:42:18.447572 1 gather_workloads_info.go:387] No image sha256:c886c2a85f0c920fcd6927a7c76644a422cf77f07b185120a8021e0e98d6acb9 (8ms) I0507 08:42:18.454793 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (7ms) I0507 08:42:18.462147 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (7ms) I0507 08:42:18.469420 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (7ms) I0507 08:42:18.476713 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (7ms) I0507 08:42:18.484042 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (7ms) I0507 08:42:18.492101 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (8ms) I0507 08:42:18.499491 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (7ms) I0507 08:42:18.534541 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (35ms) I0507 08:42:18.632666 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (98ms) I0507 08:42:18.738150 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (105ms) I0507 08:42:18.832034 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (94ms) I0507 08:42:18.935751 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (104ms) I0507 08:42:19.031695 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (96ms) I0507 08:42:19.136149 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (104ms) I0507 08:42:19.233165 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (97ms) I0507 08:42:19.336002 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (103ms) I0507 08:42:19.432078 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (96ms) I0507 08:42:19.535578 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (103ms) I0507 08:42:19.632771 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (97ms) I0507 08:42:19.734284 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (101ms) I0507 08:42:19.832677 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (98ms) I0507 08:42:19.935597 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (103ms) I0507 08:42:20.032971 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (97ms) I0507 08:42:20.135638 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (103ms) I0507 08:42:20.231992 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (96ms) I0507 08:42:20.334313 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (102ms) I0507 08:42:20.432122 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (98ms) I0507 08:42:20.534598 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (102ms) I0507 08:42:20.632711 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (98ms) I0507 08:42:20.735121 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (102ms) I0507 08:42:20.832821 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (98ms) I0507 08:42:20.932268 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (99ms) I0507 08:42:21.032209 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0507 08:42:21.032237 1 tasks_processing.go:74] worker 1 stopped. E0507 08:42:21.032246 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0507 08:42:21.032527 1 recorder.go:75] Recording config/workload_info with fingerprint=b00050f2a4c5de687acde582a53235fc40cf18fd3d707641827427276e800525 I0507 08:42:21.032542 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.663745253s to process 1 records E0507 08:42:21.032567 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.664s with: function \"workload_info\" failed with an error" I0507 08:42:21.033669 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 08:42:21.033681 1 periodic.go:216] Running conditional gatherer I0507 08:42:21.038936 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0507 08:42:21.045415 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:53597->172.30.0.10:53: read: connection refused E0507 08:42:21.045712 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 08:42:21.045768 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 08:42:21.051159 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0507 08:42:21.051171 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051176 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051179 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051182 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051185 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051188 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051190 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051193 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 08:42:21.051196 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 08:42:21.051209 1 tasks_processing.go:45] number of workers: 3 I0507 08:42:21.051220 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 08:42:21.051226 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 08:42:21.051246 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 08:42:21.051248 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 08:42:21.051266 1 tasks_processing.go:74] worker 0 stopped. I0507 08:42:21.051279 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0507 08:42:21.051283 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 08:42:21.051305 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0507 08:42:21.051314 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 729ns to process 1 records I0507 08:42:21.051340 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0507 08:42:21.051347 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.84µs to process 1 records I0507 08:42:21.051353 1 tasks_processing.go:74] worker 1 stopped. I0507 08:42:21.051565 1 tasks_processing.go:74] worker 2 stopped. I0507 08:42:21.051578 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 258.419µs to process 0 records I0507 08:42:21.051597 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:53597->172.30.0.10:53: read: connection refused I0507 08:42:21.051612 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0507 08:42:21.081302 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4599310ec0f06819b244c6c2326e9d14d11d2eb5a9881afb372211cb56ea8029 I0507 08:42:21.081413 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-05-07-084221.tar.gz I0507 08:42:21.089225 1 diskrecorder.go:51] Wrote 108 records to disk in 7ms I0507 08:42:21.089257 1 periodic.go:285] Gathering cluster info every 2h0m0s I0507 08:42:21.089273 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 08:42:22.339258 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 08:42:22.543468 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 08:42:31.270398 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 08:43:08.881373 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="305202941dd9c504c39e4bc7ad07bce0937c325581a4b3b7a707b216bcbcfcb9") W0507 08:43:08.881406 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0507 08:43:08.881449 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="362f3f9f5ae5c51213b4fed57b3330031dcc8dafdcc1ec6c4053696b8f025555") I0507 08:43:08.881480 1 periodic.go:177] Shutting down I0507 08:43:08.881483 1 base_controller.go:181] Shutting down ConfigController ... I0507 08:43:08.881500 1 base_controller.go:181] Shutting down LoggingSyncer ... I0507 08:43:08.881491 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0507 08:43:08.881560 1 base_controller.go:123] Shutting down worker of ConfigController controller ...