W0701 19:17:07.238353 1 cmd.go:257] Using insecure, self-signed certificates I0701 19:17:07.746446 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:07.746869 1 observer_polling.go:159] Starting file observer I0701 19:17:08.289526 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0701 19:17:08.289825 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0701 19:17:08.290751 1 secure_serving.go:57] Forcing use of http/1.1 only W0701 19:17:08.290776 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0701 19:17:08.290783 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0701 19:17:08.290790 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0701 19:17:08.290795 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0701 19:17:08.290801 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0701 19:17:08.290822 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0701 19:17:08.290837 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0701 19:17:08.317302 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0701 19:17:08.317321 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"63a01164-ed55-4dc0-9451-2e9ec897d064", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0701 19:17:08.341755 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0701 19:17:08.341775 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0701 19:17:08.341775 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0701 19:17:08.341797 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0701 19:17:08.341805 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0701 19:17:08.341783 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0701 19:17:08.342265 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1312449267/tls.crt::/tmp/serving-cert-1312449267/tls.key" I0701 19:17:08.342920 1 secure_serving.go:213] Serving securely on [::]:8443 I0701 19:17:08.343006 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0701 19:17:08.350164 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0701 19:17:08.350195 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0701 19:17:08.350483 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0701 19:17:08.367484 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0701 19:17:08.367513 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0701 19:17:08.385897 1 secretconfigobserver.go:119] support secret does not exist I0701 19:17:08.409983 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0701 19:17:08.433671 1 secretconfigobserver.go:119] support secret does not exist I0701 19:17:08.437971 1 recorder.go:161] Pruning old reports every 8h45m1s, max age is 288h0m0s I0701 19:17:08.442774 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0701 19:17:08.442786 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0701 19:17:08.442793 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0701 19:17:08.451036 1 base_controller.go:82] Caches are synced for ConfigController I0701 19:17:08.451055 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0701 19:17:08.454713 1 periodic.go:209] Running clusterconfig gatherer I0701 19:17:08.454734 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0701 19:17:08.454745 1 insightsreport.go:296] Starting report retriever I0701 19:17:08.454754 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0701 19:17:08.454814 1 tasks_processing.go:45] number of workers: 32 I0701 19:17:08.454838 1 tasks_processing.go:69] worker 1 listening for tasks. I0701 19:17:08.454713 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0701 19:17:08.454856 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0701 19:17:08.454859 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. I0701 19:17:08.454877 1 tasks_processing.go:69] worker 0 listening for tasks. I0701 19:17:08.454883 1 tasks_processing.go:71] worker 0 working on dvo_metrics task. I0701 19:17:08.455152 1 tasks_processing.go:69] worker 2 listening for tasks. I0701 19:17:08.455164 1 tasks_processing.go:69] worker 3 listening for tasks. I0701 19:17:08.455173 1 tasks_processing.go:69] worker 4 listening for tasks. I0701 19:17:08.455181 1 tasks_processing.go:69] worker 5 listening for tasks. I0701 19:17:08.455188 1 tasks_processing.go:69] worker 6 listening for tasks. I0701 19:17:08.455206 1 tasks_processing.go:69] worker 7 listening for tasks. I0701 19:17:08.455215 1 tasks_processing.go:69] worker 8 listening for tasks. I0701 19:17:08.455224 1 tasks_processing.go:69] worker 9 listening for tasks. I0701 19:17:08.455232 1 tasks_processing.go:69] worker 10 listening for tasks. I0701 19:17:08.455241 1 tasks_processing.go:69] worker 11 listening for tasks. I0701 19:17:08.455268 1 tasks_processing.go:69] worker 12 listening for tasks. I0701 19:17:08.455277 1 tasks_processing.go:69] worker 13 listening for tasks. I0701 19:17:08.455285 1 tasks_processing.go:69] worker 14 listening for tasks. I0701 19:17:08.455292 1 tasks_processing.go:69] worker 15 listening for tasks. I0701 19:17:08.455300 1 tasks_processing.go:69] worker 16 listening for tasks. I0701 19:17:08.455308 1 tasks_processing.go:69] worker 17 listening for tasks. I0701 19:17:08.455316 1 tasks_processing.go:69] worker 18 listening for tasks. I0701 19:17:08.455326 1 tasks_processing.go:69] worker 19 listening for tasks. I0701 19:17:08.455348 1 tasks_processing.go:69] worker 20 listening for tasks. I0701 19:17:08.455363 1 tasks_processing.go:69] worker 21 listening for tasks. I0701 19:17:08.455372 1 tasks_processing.go:69] worker 22 listening for tasks. I0701 19:17:08.455380 1 tasks_processing.go:69] worker 23 listening for tasks. I0701 19:17:08.455387 1 tasks_processing.go:69] worker 24 listening for tasks. I0701 19:17:08.455394 1 tasks_processing.go:69] worker 25 listening for tasks. I0701 19:17:08.455402 1 tasks_processing.go:69] worker 29 listening for tasks. I0701 19:17:08.455409 1 tasks_processing.go:69] worker 30 listening for tasks. I0701 19:17:08.455410 1 tasks_processing.go:69] worker 28 listening for tasks. I0701 19:17:08.455417 1 tasks_processing.go:69] worker 31 listening for tasks. I0701 19:17:08.455422 1 tasks_processing.go:69] worker 27 listening for tasks. I0701 19:17:08.455446 1 tasks_processing.go:69] worker 26 listening for tasks. I0701 19:17:08.455497 1 tasks_processing.go:71] worker 26 working on sap_datahubs task. I0701 19:17:08.455532 1 tasks_processing.go:71] worker 6 working on silenced_alerts task. I0701 19:17:08.455554 1 tasks_processing.go:71] worker 22 working on lokistack task. W0701 19:17:08.455588 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:08.455601 1 tasks_processing.go:71] worker 6 working on ceph_cluster task. I0701 19:17:08.455813 1 tasks_processing.go:71] worker 7 working on machine_sets task. I0701 19:17:08.455878 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 37.495µs to process 0 records I0701 19:17:08.455898 1 tasks_processing.go:71] worker 8 working on openshift_logging task. I0701 19:17:08.455998 1 tasks_processing.go:71] worker 30 working on ingress_certificates task. I0701 19:17:08.456057 1 tasks_processing.go:71] worker 31 working on machines task. I0701 19:17:08.456094 1 tasks_processing.go:71] worker 28 working on qemu_kubevirt_launcher_logs task. I0701 19:17:08.455532 1 tasks_processing.go:71] worker 23 working on openstack_version task. I0701 19:17:08.455502 1 tasks_processing.go:71] worker 2 working on cost_management_metrics_configs task. I0701 19:17:08.455507 1 tasks_processing.go:71] worker 3 working on version task. I0701 19:17:08.455511 1 tasks_processing.go:71] worker 10 working on service_accounts task. I0701 19:17:08.455515 1 tasks_processing.go:71] worker 11 working on container_images task. I0701 19:17:08.455519 1 tasks_processing.go:71] worker 12 working on storage_classes task. I0701 19:17:08.455518 1 tasks_processing.go:71] worker 9 working on openstack_dataplanenodesets task. I0701 19:17:08.455522 1 tasks_processing.go:71] worker 13 working on machine_healthchecks task. I0701 19:17:08.455525 1 tasks_processing.go:71] worker 4 working on node_logs task. I0701 19:17:08.455526 1 tasks_processing.go:71] worker 14 working on pdbs task. I0701 19:17:08.455529 1 tasks_processing.go:71] worker 5 working on overlapping_namespace_uids task. I0701 19:17:08.455536 1 tasks_processing.go:71] worker 16 working on schedulers task. I0701 19:17:08.455539 1 tasks_processing.go:71] worker 17 working on storage_cluster task. I0701 19:17:08.455542 1 tasks_processing.go:71] worker 18 working on support_secret task. I0701 19:17:08.455545 1 tasks_processing.go:71] worker 19 working on feature_gates task. I0701 19:17:08.455548 1 tasks_processing.go:71] worker 20 working on infrastructures task. I0701 19:17:08.455551 1 tasks_processing.go:71] worker 21 working on crds task. I0701 19:17:08.456069 1 tasks_processing.go:71] worker 27 working on openstack_controlplanes task. I0701 19:17:08.455497 1 tasks_processing.go:71] worker 15 working on mutating_webhook_configurations task. I0701 19:17:08.456083 1 tasks_processing.go:71] worker 25 working on certificate_signing_requests task. I0701 19:17:08.456084 1 tasks_processing.go:71] worker 29 working on nodenetworkstates task. I0701 19:17:08.456088 1 tasks_processing.go:71] worker 24 working on nodenetworkconfigurationpolicies task. I0701 19:17:08.464735 1 tasks_processing.go:71] worker 2 working on tsdb_status task. I0701 19:17:08.464754 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 8.334511ms to process 0 records W0701 19:17:08.464770 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:08.464780 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 32.635µs to process 0 records I0701 19:17:08.464786 1 tasks_processing.go:71] worker 2 working on ingress task. I0701 19:17:08.465078 1 tasks_processing.go:71] worker 26 working on image_registries task. I0701 19:17:08.465090 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 9.536756ms to process 0 records I0701 19:17:08.465100 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 9.52589ms to process 0 records I0701 19:17:08.465110 1 tasks_processing.go:71] worker 22 working on active_alerts task. W0701 19:17:08.465143 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:08.465153 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 35.92µs to process 0 records I0701 19:17:08.465158 1 tasks_processing.go:71] worker 22 working on machine_config_pools task. I0701 19:17:08.469717 1 tasks_processing.go:71] worker 23 working on sap_config task. I0701 19:17:08.469829 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 13.529858ms to process 0 records I0701 19:17:08.469898 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.900304ms to process 0 records I0701 19:17:08.469930 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 14.138544ms to process 0 records I0701 19:17:08.469958 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.350121ms to process 0 records I0701 19:17:08.469988 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 10.89279ms to process 0 records I0701 19:17:08.470014 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 10.186327ms to process 0 records I0701 19:17:08.469962 1 tasks_processing.go:71] worker 6 working on networks task. I0701 19:17:08.470072 1 tasks_processing.go:71] worker 13 working on container_runtime_configs task. I0701 19:17:08.469967 1 tasks_processing.go:71] worker 7 working on proxies task. I0701 19:17:08.469973 1 tasks_processing.go:71] worker 9 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0701 19:17:08.470025 1 tasks_processing.go:71] worker 17 working on operators task. I0701 19:17:08.470031 1 tasks_processing.go:71] worker 27 working on oauths task. E0701 19:17:08.470043 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0701 19:17:08.470676 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.116897ms to process 0 records I0701 19:17:08.479138 1 tasks_processing.go:71] worker 8 working on validating_webhook_configurations task. I0701 19:17:08.479309 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 23.229786ms to process 0 records I0701 19:17:08.479329 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 18.805828ms to process 0 records E0701 19:17:08.479336 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0701 19:17:08.479345 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 20.261213ms to process 0 records I0701 19:17:08.479351 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 19.192767ms to process 0 records I0701 19:17:08.479391 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0701 19:17:08.479469 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready E0701 19:17:08.479492 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0701 19:17:08.479510 1 gather.go:177] gatherer "clusterconfig" function "machines" took 23.380565ms to process 0 records I0701 19:17:08.479481 1 tasks_processing.go:71] worker 31 working on install_plans task. I0701 19:17:08.479500 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0701 19:17:08.479553 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0701 19:17:08.479578 1 controller.go:489] The operator is still being initialized I0701 19:17:08.479589 1 controller.go:512] The operator is healthy I0701 19:17:08.479440 1 tasks_processing.go:71] worker 29 working on config_maps task. I0701 19:17:08.479734 1 tasks_processing.go:71] worker 1 working on aggregated_monitoring_cr_names task. I0701 19:17:08.479445 1 tasks_processing.go:71] worker 24 working on jaegers task. I0701 19:17:08.479435 1 tasks_processing.go:71] worker 18 working on metrics task. I0701 19:17:08.480148 1 recorder.go:75] Recording config/apiserver with fingerprint=967fd59b393a4d64c2da25ef17a072eb22777d7d0330d4811a92cf4633123be9 I0701 19:17:08.480206 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 24.863998ms to process 1 records W0701 19:17:08.480151 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:08.480296 1 tasks_processing.go:71] worker 18 working on operators_pods_and_events task. I0701 19:17:08.480311 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 174.315µs to process 0 records I0701 19:17:08.489201 1 tasks_processing.go:71] worker 2 working on image task. I0701 19:17:08.489417 1 gather_logs.go:145] no pods in namespace were found I0701 19:17:08.489536 1 recorder.go:75] Recording config/ingress with fingerprint=4302169f2c6a5a268a200b1147bd404a60eaba094c7e2b6b7560b28f762dcc1b I0701 19:17:08.489598 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.404407ms to process 1 records I0701 19:17:08.489612 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 33.303273ms to process 0 records I0701 19:17:08.489619 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 31.415429ms to process 0 records I0701 19:17:08.489628 1 tasks_processing.go:71] worker 4 working on pod_network_connectivity_checks task. I0701 19:17:08.489580 1 configmapobserver.go:84] configmaps "insights-config" not found I0701 19:17:08.489771 1 tasks_processing.go:71] worker 28 working on nodes task. I0701 19:17:08.489885 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=4aa1c9521121d6685f3ee68aedd1454e607d7474bf8a5671d552eab2c16ec029 I0701 19:17:08.489958 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 31.092598ms to process 1 records I0701 19:17:08.489788 1 tasks_processing.go:71] worker 16 working on authentication task. I0701 19:17:08.500184 1 tasks_processing.go:71] worker 19 working on machine_autoscalers task. I0701 19:17:08.500685 1 recorder.go:75] Recording config/featuregate with fingerprint=1a3e46fa14ca506af1169e8b6919202ce74041ae41e9d1164564a61b120241fd I0701 19:17:08.500708 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 41.084669ms to process 1 records I0701 19:17:08.500802 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=8fb01fce3d49cce11d9b8e558704e65cb1e01625a2068c09d794e62c6ce0252a I0701 19:17:08.500822 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f91e6659dad06a3eb895036e3f615cb6154ed032aef3ef56734ea4912075b4bb I0701 19:17:08.500831 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 43.52182ms to process 2 records I0701 19:17:08.500838 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 20.501365ms to process 0 records I0701 19:17:08.500846 1 tasks_processing.go:71] worker 24 working on olm_operators task. I0701 19:17:08.501073 1 tasks_processing.go:71] worker 12 working on sap_pods task. I0701 19:17:08.501160 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0701 19:17:08.501632 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 31.420645ms to process 0 records I0701 19:17:08.502101 1 tasks_processing.go:71] worker 20 working on machine_configs task. I0701 19:17:08.502559 1 recorder.go:75] Recording config/infrastructure with fingerprint=9b03b284fdb9bab842ed0e440dc34fdaf3dfd5563c162c308ed91e2be6c1b61f I0701 19:17:08.502621 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 42.224359ms to process 1 records I0701 19:17:08.502660 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 36.610746ms to process 0 records I0701 19:17:08.503232 1 tasks_processing.go:71] worker 22 working on monitoring_persistent_volumes task. I0701 19:17:08.503944 1 tasks_processing.go:71] worker 26 working on openshift_machine_api_events task. I0701 19:17:08.503878 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7f477a0d89343bb6a7b2a0cd02132130e0324006e96786876f299127a18e93d1 I0701 19:17:08.510432 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 36.936208ms to process 1 records I0701 19:17:08.510468 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 32.330333ms to process 0 records I0701 19:17:08.510559 1 tasks_processing.go:71] worker 13 working on openstack_dataplanedeployments task. I0701 19:17:08.510691 1 tasks_processing.go:71] worker 14 working on image_pruners task. I0701 19:17:08.510694 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5ded4345bbceab62ab6df962ede6355a856ef73831420ee5d4ef16d1aa851330 I0701 19:17:08.510939 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=80ee53c538ba366330a69c72e876213a149bcc491263cd380f181e39648530ae I0701 19:17:08.511021 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=d98b69df99cb8f95344ccc0c344511d6c9e39752f7e752bbdb2075eebc1261a8 I0701 19:17:08.511056 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 44.301652ms to process 3 records I0701 19:17:08.511167 1 tasks_processing.go:74] worker 15 stopped. I0701 19:17:08.511446 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=d3816b9b27c6b169acd7b06695f2c721ba30b0e68c4c3b79734c8dadf0ba8789 I0701 19:17:08.511549 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=7343ce090321e598e72fd6c210199ccc921cd9b77e4c59758d63e1c73e9c1aac I0701 19:17:08.511619 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=8e2b1129e51dbdff430f58fa1758cff616339cd0547a56badd69d27f99cefa91 I0701 19:17:08.511654 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 42.916179ms to process 3 records I0701 19:17:08.511981 1 recorder.go:75] Recording config/network with fingerprint=446e4401a1d99901afc49a07aaa9085f3411c93ce6a0816abfcb8657fa35da7b I0701 19:17:08.512037 1 gather.go:177] gatherer "clusterconfig" function "networks" took 33.134863ms to process 1 records E0701 19:17:08.512077 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0701 19:17:08.512115 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.59271ms to process 0 records I0701 19:17:08.512158 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0701 19:17:08.512189 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 51.480653ms to process 1 records I0701 19:17:08.512222 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 50.744203ms to process 0 records I0701 19:17:08.512267 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.011359ms to process 0 records I0701 19:17:08.512306 1 tasks_processing.go:74] worker 19 stopped. I0701 19:17:08.512330 1 tasks_processing.go:74] worker 6 stopped. I0701 19:17:08.512354 1 tasks_processing.go:74] worker 4 stopped. I0701 19:17:08.512377 1 tasks_processing.go:74] worker 5 stopped. I0701 19:17:08.512406 1 tasks_processing.go:74] worker 25 stopped. I0701 19:17:08.514405 1 tasks_processing.go:74] worker 2 stopped. I0701 19:17:08.514523 1 recorder.go:75] Recording config/image with fingerprint=ac6fe97eec3c33a058af480e5b7fd0956f2d4ec271e75209d1482fb8da9e8f33 I0701 19:17:08.514579 1 gather.go:177] gatherer "clusterconfig" function "image" took 25.102015ms to process 1 records I0701 19:17:08.515415 1 tasks_processing.go:74] worker 12 stopped. I0701 19:17:08.515434 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.287388ms to process 0 records I0701 19:17:08.515516 1 tasks_processing.go:74] worker 7 stopped. I0701 19:17:08.515585 1 recorder.go:75] Recording config/proxy with fingerprint=f6e6677707920568b0b16d8b1cc86f7be80ae6d97b158724f9b48dd9feafcef8 I0701 19:17:08.515626 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 45.323294ms to process 1 records I0701 19:17:08.515662 1 tasks_processing.go:74] worker 16 stopped. I0701 19:17:08.515960 1 recorder.go:75] Recording config/authentication with fingerprint=14ed32795d53b0965e675b8a0443a034e3b78504d65912c65ec6ede08bc68fdf I0701 19:17:08.516016 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 25.68726ms to process 1 records W0701 19:17:08.517538 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0701 19:17:08.519012 1 tasks_processing.go:74] worker 11 stopped. W0701 19:17:08.520277 1 operator.go:288] started I0701 19:17:08.520307 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0701 19:17:08.520564 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0701 19:17:08.520642 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0701 19:17:08.520880 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-qjgcw with fingerprint=520ea084d8352c5e616ab3f467988008f0ce60988e4eb403d2f8a494151e30cb I0701 19:17:08.520933 1 recorder.go:75] Recording config/running_containers with fingerprint=d115ba9b84a04b78c53263966c64c4c2205e23212368a13889b4397af2cb8500 I0701 19:17:08.520947 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 62.171731ms to process 2 records I0701 19:17:08.521039 1 tasks_processing.go:74] worker 8 stopped. I0701 19:17:08.521119 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1725931436df6ea90dce8bc4d6e7cd12b03d2c94df2632cd89e2d3bd28d13782 I0701 19:17:08.521222 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=638e59dc708bbdab74849219da90f4cc9b2a0f85f3d2b72ca7fe708bcb1fd176 I0701 19:17:08.521242 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=39e2d3e98d93bdbfbe94892d362f0c178af0a3a4cbc9e1ff5466da30688d1942 I0701 19:17:08.521286 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e1c302cc64beedf5b4a6296ea0cb630826f7c8f186f41f098202f07ef3b3b2a6 I0701 19:17:08.521312 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=51406cc1b9be83e2c672bfbc4a726f89959765cdf5f8f54685c2cc128624dbdf I0701 19:17:08.521336 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=b577c1a6d42c7496ea90acbe4e2b7ff27066cdf31a070337819afaa459be7a15 I0701 19:17:08.521374 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=053db3450d55dbbace21c8a0a2322922ecb9d5c577db8d30ae02d6a3cdc7aa0f I0701 19:17:08.521411 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=64abc8c98411a5e45112e46b36947a9a3e93653f1cbe7c1c52db7b963fc44992 I0701 19:17:08.521440 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=739b43919f9b0a20b7b111748c14b9c9d56143b54c2348d1fb75bd3efdc24b44 I0701 19:17:08.521462 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=0363e924e5c9c5d5a639eff1a6e4517016da88f83006031dc3a7343b247f9941 I0701 19:17:08.521486 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=70ee2ca5f6e1e934235195c1ddcc689b00901a5e602d8840bdf23f55a3cbeedb I0701 19:17:08.521493 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 40.720674ms to process 11 records I0701 19:17:08.525470 1 tasks_processing.go:74] worker 13 stopped. I0701 19:17:08.525482 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 14.858763ms to process 0 records I0701 19:17:08.526228 1 tasks_processing.go:74] worker 27 stopped. I0701 19:17:08.526540 1 recorder.go:75] Recording config/oauth with fingerprint=aef7bc268a7e7b560c4957ad00c96a5a49811f18d48d06058f9e431aba5ab972 I0701 19:17:08.526558 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 55.647017ms to process 1 records I0701 19:17:08.526571 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 25.507922ms to process 0 records I0701 19:17:08.526585 1 tasks_processing.go:74] worker 24 stopped. I0701 19:17:08.535493 1 tasks_processing.go:74] worker 22 stopped. I0701 19:17:08.535510 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.188022ms to process 0 records I0701 19:17:08.535683 1 tasks_processing.go:74] worker 14 stopped. I0701 19:17:08.535803 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=8862c4c58952740abb484703fea478ecffb1e1cacfacf6b2bae20081a96f4a89 I0701 19:17:08.535822 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.951591ms to process 1 records I0701 19:17:08.535840 1 tasks_processing.go:74] worker 1 stopped. I0701 19:17:08.535855 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 56.091521ms to process 0 records I0701 19:17:08.535934 1 tasks_processing.go:74] worker 23 stopped. I0701 19:17:08.536111 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=1e37f60d348f2c1af7e516791b4621c47e87c07ccf11f0943bb066344c8a9347 I0701 19:17:08.536197 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=66b4c2fdedc86f8fe64135830205f1826255d276d734a41a47b1a41b44fad8be I0701 19:17:08.536206 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 34.755112ms to process 2 records I0701 19:17:08.536284 1 tasks_processing.go:74] worker 21 stopped. I0701 19:17:08.536677 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=1a3cb75017828b9b7a529b1b6f807a58fbe167b3a39e66999c8050edd5ab2c6c I0701 19:17:08.536875 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=6a2083507a05c3037089ecb8ee7b05d84c80b5c546200bb46fc129139a6a1953 I0701 19:17:08.536884 1 gather.go:177] gatherer "clusterconfig" function "crds" took 76.41447ms to process 2 records I0701 19:17:08.543124 1 prometheus_rules.go:88] Prometheus rules successfully created I0701 19:17:08.554804 1 tasks_processing.go:74] worker 3 stopped. I0701 19:17:08.555157 1 recorder.go:75] Recording config/version with fingerprint=d38d057e0172dbdac16f8ac7e25dd0e507f2dc43ec1ae30a8176f4a638a32f6d I0701 19:17:08.555174 1 recorder.go:75] Recording config/id with fingerprint=0c37466f55bb04ce6e6ff59dd6d2c0a4373bd3261a26e9cf08dda64d6d129d48 I0701 19:17:08.555183 1 gather.go:177] gatherer "clusterconfig" function "version" took 98.242604ms to process 2 records I0701 19:17:08.555342 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0701 19:17:08.555359 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0701 19:17:08.555385 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0701 19:17:08.555389 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0701 19:17:08.555394 1 controller.go:212] Source scaController *sca.Controller is not ready I0701 19:17:08.555418 1 controller.go:489] The operator is still being initialized I0701 19:17:08.555434 1 controller.go:512] The operator is healthy I0701 19:17:08.557494 1 tasks_processing.go:74] worker 26 stopped. I0701 19:17:08.557513 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 47.547134ms to process 0 records E0701 19:17:08.563028 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2711beda1b-203a-4cce-9a9e-1896a20428f2%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:60454->172.30.0.10:53: read: connection refused I0701 19:17:08.563045 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2711beda1b-203a-4cce-9a9e-1896a20428f2%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:60454->172.30.0.10:53: read: connection refused I0701 19:17:08.573195 1 tasks_processing.go:74] worker 9 stopped. I0701 19:17:08.573213 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 102.83924ms to process 0 records I0701 19:17:08.576692 1 tasks_processing.go:74] worker 29 stopped. E0701 19:17:08.576726 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0701 19:17:08.576800 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0701 19:17:08.576812 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0701 19:17:08.576830 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0701 19:17:08.576885 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0701 19:17:08.576896 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0701 19:17:08.576902 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0701 19:17:08.576908 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0701 19:17:08.576976 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0701 19:17:08.576987 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0701 19:17:08.576996 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 96.942201ms to process 7 records I0701 19:17:08.587698 1 tasks_processing.go:74] worker 28 stopped. I0701 19:17:08.588230 1 recorder.go:75] Recording config/node/ip-10-0-2-226.ec2.internal with fingerprint=3e7d09b5b2b65e3f3ece1b8a9f3bd00b6ad355787c58d413e3b87715cc12e19e I0701 19:17:08.588289 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 97.891179ms to process 1 records I0701 19:17:08.592565 1 tasks_processing.go:74] worker 20 stopped. I0701 19:17:08.592598 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0701 19:17:08.592608 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 90.439644ms to process 1 records I0701 19:17:08.601801 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0701 19:17:08.607315 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:48469->172.30.0.10:53: read: connection refused I0701 19:17:08.607336 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:48469->172.30.0.10:53: read: connection refused I0701 19:17:08.620703 1 base_controller.go:82] Caches are synced for LoggingSyncer I0701 19:17:08.620720 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0701 19:17:08.626173 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0701 19:17:08.657845 1 tasks_processing.go:74] worker 30 stopped. E0701 19:17:08.657904 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0701 19:17:08.657993 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r9h8n05fjgmel2d3av4qf8julb1tirv-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r9h8n05fjgmel2d3av4qf8julb1tirv-primary-cert-bundle-secret" not found I0701 19:17:08.658086 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=6b2578e5b9159a49b2e2ab5a27efdbcc8f4d9921f5bc40b8fed455311649ef7a I0701 19:17:08.658106 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 201.818617ms to process 1 records W0701 19:17:09.507734 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0701 19:17:09.740806 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 14 containers I0701 19:17:09.740888 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1797558 bytes I0701 19:17:09.743406 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zdhvn pod in namespace openshift-dns (previous: false). I0701 19:17:09.973718 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zdhvn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-zdhvn\" is waiting to start: ContainerCreating" I0701 19:17:09.973745 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-zdhvn\" is waiting to start: ContainerCreating" I0701 19:17:09.973756 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zdhvn pod in namespace openshift-dns (previous: false). I0701 19:17:10.145622 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zdhvn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-zdhvn\" is waiting to start: ContainerCreating" I0701 19:17:10.145642 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-zdhvn\" is waiting to start: ContainerCreating" I0701 19:17:10.145652 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6wn4c pod in namespace openshift-dns (previous: false). I0701 19:17:10.155777 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0701 19:17:10.349038 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0701 19:17:10.349064 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-58645dcdfd-bb9r8 pod in namespace openshift-image-registry (previous: false). W0701 19:17:10.506851 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0701 19:17:10.546981 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-58645dcdfd-bb9r8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-58645dcdfd-bb9r8\" is waiting to start: ContainerCreating" I0701 19:17:10.547003 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-58645dcdfd-bb9r8\" is waiting to start: ContainerCreating" I0701 19:17:10.547016 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-58645dcdfd-c7nh5 pod in namespace openshift-image-registry (previous: false). I0701 19:17:10.557232 1 tasks_processing.go:74] worker 17 stopped. I0701 19:17:10.557300 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=252ce1488d4524df66ba35136a978d65959c87fdeaf36f48972180fbb3ae6f68 I0701 19:17:10.557334 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=035416e492c40e0cfa773f65f9312567164592492a902293470bdcad3931882b I0701 19:17:10.557366 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0701 19:17:10.557391 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=386ddccd87b8c735a7984a5273dfa9a89681bc9727452d279c1b0a8d55878b6b I0701 19:17:10.557408 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0701 19:17:10.557430 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=fbb2c89663aea9fcc3712d25c7ebef9578e4c16c159202dc47c028dffe18f016 I0701 19:17:10.557462 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=ba64ff56ba7ebd46f6f526c52df1056087eee7f6babd56cb50ca225827ebea49 I0701 19:17:10.557502 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b243bd54394edcdc6df08bac1749a169151084d8b41a6ef3699d3cf79333931b I0701 19:17:10.557534 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=27a08f365545b4177e471e3114af7e42c604d64d4a665cc2054d9b76a90757e0 I0701 19:17:10.557543 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0701 19:17:10.557560 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=7f22c7ca973feb650e9204480400710372499d949b3c08f873521dfa6d8561b1 I0701 19:17:10.557570 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0701 19:17:10.557585 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=9823208887159679630180811fe486ed29b9488a8a304b0584f37f65d7ad808a I0701 19:17:10.557593 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0701 19:17:10.557608 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=ed0c75c86a09e5d007662e2d9f3410db27547db9e982ce393c0f5133dce2c7bb I0701 19:17:10.557617 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0701 19:17:10.557639 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=74a9cb55bdf5047a590da4c8ad2ae0873adb1330b007194147246a84efe0fe51 I0701 19:17:10.557648 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0701 19:17:10.557665 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=72479c681955cd3ed2a508cb1afb15e463ffbc119282b7e2ae7e69bfd0b400cb I0701 19:17:10.557786 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=dd105fd7b5c46eee47513c9fa7d3f9c860edc771600c66b9b2522efddf2b7f89 I0701 19:17:10.557795 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0701 19:17:10.557802 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0701 19:17:10.557822 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0701 19:17:10.557844 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=04858be4ce2b7ab671150511e5b00dab66b57c7d08c83752acddf6e9d818f65d I0701 19:17:10.557877 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=395dcd102ffde6d013fcb276d80ec3ffb567246bb9319c8e53f3587b77b1e480 I0701 19:17:10.557886 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0701 19:17:10.557912 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f56f1df89d3687f8f40aae79ab31f7e87090c6739ff1700d098f189055f7e1d8 I0701 19:17:10.557922 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0701 19:17:10.557937 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ef2b7dee2d05822f1475b9046f48c0d92f2b4947ef5b615d42a9dbb297482e6b I0701 19:17:10.557952 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=204957587fae4d4493bd490b83b8099444a60ae69ce7683abf0955fd5e6aa816 I0701 19:17:10.557965 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6b092a61dd38b29da321d8b7cd60f7e4918ecee6096de87f82478bfaf1fab598 I0701 19:17:10.557981 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=42694c5d28ac6f777910f17a12d89e37658a24718e314a1b8ce1144ad5c5a239 I0701 19:17:10.557994 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=b660a76c3799bb712153432dc33a25982b4bcc0fa938e5d3c73566e9171de53a I0701 19:17:10.558021 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=361367f6c32fa916cbe0c7fe0edd7bf8eb939b1cf6f7a907232905b2d1715376 I0701 19:17:10.558037 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0701 19:17:10.558046 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0701 19:17:10.558053 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.086806867s to process 36 records I0701 19:17:10.741575 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0701 19:17:10.741593 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6d4bdc745c-9n945 pod in namespace openshift-image-registry (previous: false). I0701 19:17:10.938051 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0701 19:17:10.938068 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-n84jq pod in namespace openshift-image-registry (previous: false). I0701 19:17:11.145568 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0701 19:17:11.145593 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d7cc55746-l4m7v pod in namespace openshift-ingress (previous: false). I0701 19:17:11.337732 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0701 19:17:11.337759 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d7cc55746-vv2k5 pod in namespace openshift-ingress (previous: false). W0701 19:17:11.506416 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0701 19:17:11.544147 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5d7cc55746-vv2k5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5d7cc55746-vv2k5\" is waiting to start: ContainerCreating" I0701 19:17:11.544170 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5d7cc55746-vv2k5\" is waiting to start: ContainerCreating" I0701 19:17:11.544185 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-68b654865c-bdrkr pod in namespace openshift-ingress (previous: false). I0701 19:17:11.748527 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-68b654865c-bdrkr pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-68b654865c-bdrkr\" is waiting to start: ContainerCreating" I0701 19:17:11.748548 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-68b654865c-bdrkr\" is waiting to start: ContainerCreating" I0701 19:17:11.748563 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5v9sd pod in namespace openshift-ingress-canary (previous: false). I0701 19:17:11.947034 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5v9sd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5v9sd\" is waiting to start: ContainerCreating" I0701 19:17:11.947059 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5v9sd\" is waiting to start: ContainerCreating" I0701 19:17:11.947074 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-ns9p7 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0701 19:17:12.163477 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-ns9p7 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0701 19:17:12.344369 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-rlgj6 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). W0701 19:17:12.513826 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0701 19:17:12.553538 1 tasks_processing.go:74] worker 18 stopped. I0701 19:17:12.553674 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=0d2132161a2046723fa7196c37523fc5f75f40b54bd6deaf2cd0837ad2ead4cb I0701 19:17:12.553756 1 recorder.go:75] Recording events/openshift-dns with fingerprint=32108dd1702bc6dcc42dde3af9d8c6ff489a009585e66861dca4a4925779bc3e I0701 19:17:12.553884 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=1de4dd6ceabc62c0272173909b7092ce90963eb77579312d408fe3fc5180ffb5 I0701 19:17:12.553947 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=bd634b26f21284c7c01f72a2f89877b8b483c76c2bb269858187f23e33c87f98 I0701 19:17:12.554043 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=3c3f6a5b7ba928ee535da45008bc85f8d1cda05de0a29784e6e5859916a96faf I0701 19:17:12.554078 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=ed6d6045630e941ca41679049bf8c7c786e819e499b359e60fba4f11c2d20c82 I0701 19:17:12.554116 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=8ee96459d8906bb8de80f2ce60068bf6160069cc277457936d2c402b30ffb1bb I0701 19:17:12.554217 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=977ea6bc7898af032057efb29fb3fa8ec60f65190430ab01d78aa75b7d3bf62b I0701 19:17:12.554279 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-ns9p7/migrator_current.log with fingerprint=d72738a6accf47d1bc6c85da6273a7edc029c666e1a9e0ab646595f32edfcc89 I0701 19:17:12.554317 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-ns9p7/graceful-termination_current.log with fingerprint=296a15c78010dee902083ef8eea30f348c00aa0077fce1c6344d82cdb08c1b6b I0701 19:17:12.554440 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-rlgj6/kube-storage-version-migrator-operator_current.log with fingerprint=cd588c1d39d4ae8a2d0d03ebc4ce3b1c36cc7d7e4d986c64ffadf1ff18dea6db I0701 19:17:12.554469 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.073215053s to process 11 records W0701 19:17:13.502332 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0701 19:17:13.502366 1 tasks_processing.go:74] worker 0 stopped. E0701 19:17:13.502377 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0701 19:17:13.502392 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0701 19:17:13.502413 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0701 19:17:13.502431 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.047469062s to process 1 records I0701 19:17:21.397324 1 tasks_processing.go:74] worker 31 stopped. I0701 19:17:21.397373 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0701 19:17:21.397391 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.917784622s to process 1 records I0701 19:17:21.455927 1 configmapobserver.go:84] configmaps "insights-config" not found I0701 19:17:21.810662 1 configmapobserver.go:84] configmaps "insights-config" not found I0701 19:17:21.816593 1 configmapobserver.go:84] configmaps "insights-config" not found I0701 19:17:22.010098 1 configmapobserver.go:84] configmaps "insights-config" not found I0701 19:17:22.066515 1 tasks_processing.go:74] worker 10 stopped. I0701 19:17:22.066791 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=9d475996b970b5499163b99cb7866431c26bc05ed77261e8b402c7515458063c I0701 19:17:22.066808 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.609823095s to process 1 records E0701 19:17:22.066866 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.612s with: function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0701 19:17:22.067974 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0701 19:17:22.067986 1 periodic.go:209] Running workloads gatherer I0701 19:17:22.068001 1 tasks_processing.go:45] number of workers: 2 I0701 19:17:22.068007 1 tasks_processing.go:69] worker 1 listening for tasks. I0701 19:17:22.068011 1 tasks_processing.go:71] worker 1 working on workload_info task. I0701 19:17:22.068027 1 tasks_processing.go:69] worker 0 listening for tasks. I0701 19:17:22.068044 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0701 19:17:22.096500 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 19s for image data I0701 19:17:22.104245 1 tasks_processing.go:74] worker 0 stopped. I0701 19:17:22.104282 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 36.186578ms to process 0 records I0701 19:17:22.107268 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0701 19:17:22.118348 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0701 19:17:22.129457 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (11ms) I0701 19:17:22.142575 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (13ms) I0701 19:17:22.160505 1 gather_workloads_info.go:387] No image sha256:1d9034b8dddb11d606bdcb5fa3c5d8c681941a64c07efb00e7f0f1ec71de1f9f (18ms) I0701 19:17:22.172108 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (12ms) I0701 19:17:22.183749 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (12ms) I0701 19:17:22.197576 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (14ms) I0701 19:17:22.219710 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (22ms) I0701 19:17:22.237653 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (18ms) I0701 19:17:22.248092 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (10ms) I0701 19:17:22.308548 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (60ms) I0701 19:17:22.411344 1 gather_workloads_info.go:387] No image sha256:84a344c64bf6b1cf2227dbc98e3d80cb7e5b11022be8b1b5aeadac3591f70a6c (103ms) I0701 19:17:22.510092 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms) I0701 19:17:22.611663 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (102ms) I0701 19:17:22.708632 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (97ms) I0701 19:17:22.810177 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (102ms) I0701 19:17:22.908871 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0701 19:17:23.009177 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0701 19:17:23.108232 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0701 19:17:23.211149 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (103ms) I0701 19:17:23.308792 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (98ms) I0701 19:17:23.411758 1 gather_workloads_info.go:387] No image sha256:bffebf689df67af02a06b97d3d9bfcfdccd597350d132171ee68f3d0ed29a3f6 (103ms) I0701 19:17:23.508708 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (97ms) I0701 19:17:23.612474 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (104ms) I0701 19:17:23.708629 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (96ms) I0701 19:17:23.810728 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (102ms) I0701 19:17:23.909320 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0701 19:17:24.011497 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (102ms) I0701 19:17:24.109139 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (98ms) I0701 19:17:24.210360 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0701 19:17:24.310411 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0701 19:17:24.411375 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0701 19:17:24.508946 1 gather_workloads_info.go:387] No image sha256:940c9e9e0ee17d8b20629fd9956a0b8997150c6ab19e1ca7be384b403ac4439a (98ms) I0701 19:17:24.609895 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (101ms) I0701 19:17:24.708838 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0701 19:17:24.810243 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0701 19:17:24.810299 1 tasks_processing.go:74] worker 1 stopped. E0701 19:17:24.810312 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0701 19:17:24.810767 1 recorder.go:75] Recording config/workload_info with fingerprint=86b0d20701d13f34de578476e551adf11cb7c45820b3b330ce50230f91e2d431 I0701 19:17:24.810789 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.742279519s to process 1 records E0701 19:17:24.810825 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.742s with: function \"workload_info\" failed with an error" I0701 19:17:24.811947 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0701 19:17:24.811965 1 periodic.go:209] Running conditional gatherer I0701 19:17:24.820707 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0701 19:17:24.829293 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:54774->172.30.0.10:53: read: connection refused E0701 19:17:24.829572 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0701 19:17:24.829639 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0701 19:17:24.838129 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0701 19:17:24.838144 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838149 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838153 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838156 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838159 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838163 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838167 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838171 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0701 19:17:24.838176 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0701 19:17:24.838192 1 tasks_processing.go:45] number of workers: 3 I0701 19:17:24.838203 1 tasks_processing.go:69] worker 2 listening for tasks. I0701 19:17:24.838207 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0701 19:17:24.838225 1 tasks_processing.go:69] worker 0 listening for tasks. I0701 19:17:24.838229 1 tasks_processing.go:69] worker 1 listening for tasks. I0701 19:17:24.838245 1 tasks_processing.go:74] worker 1 stopped. I0701 19:17:24.838265 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0701 19:17:24.838269 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0701 19:17:24.838336 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0701 19:17:24.838350 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 2.205µs to process 1 records I0701 19:17:24.838387 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0701 19:17:24.838397 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.083µs to process 1 records I0701 19:17:24.838402 1 tasks_processing.go:74] worker 0 stopped. I0701 19:17:24.838640 1 tasks_processing.go:74] worker 2 stopped. I0701 19:17:24.838656 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 366.788µs to process 0 records I0701 19:17:24.838683 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:54774->172.30.0.10:53: read: connection refused I0701 19:17:24.838710 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0701 19:17:24.864928 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=3c79c9f1606075e71cbbbca69b693ae059672bf88678e8dc7ba8efc2059196df I0701 19:17:24.865142 1 diskrecorder.go:70] Writing 104 records to /var/lib/insights-operator/insights-2026-07-01-191724.tar.gz I0701 19:17:24.872482 1 diskrecorder.go:51] Wrote 104 records to disk in 7ms I0701 19:17:24.872514 1 periodic.go:278] Gathering cluster info every 2h0m0s I0701 19:17:24.872532 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0701 19:18:27.747483 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="506053b04f98bf3a2faa8a89e3b8f73555fd841d4cd829ef4caac0ff38d7cf91") W0701 19:18:27.747516 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0701 19:18:27.747569 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="1a56b6e963cd414ab27c7303afed52b5ef75116d444f3efc277c13777e9d7baf") I0701 19:18:27.747581 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0701 19:18:27.747591 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0701 19:18:27.747618 1 base_controller.go:181] Shutting down ConfigController ... I0701 19:18:27.747625 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="cf559b8808fb92fbd78ca83cc5c30a8c5e67e01c28eae2f2b8587fb4a71c1c9c") I0701 19:18:27.747697 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1312449267/tls.crt::/tmp/serving-cert-1312449267/tls.key" E0701 19:18:27.747754 1 controller.go:299] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled E0701 19:18:27.747828 1 controller.go:299] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0701 19:18:27.747633 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector E0701 19:18:27.747862 1 controller.go:299] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0701 19:18:27.747652 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0701 19:18:27.747657 1 periodic.go:170] Shutting down I0701 19:18:27.747674 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0701 19:18:27.747676 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" E0701 19:18:27.747889 1 controller.go:299] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled