W0629 11:14:49.546225 1 cmd.go:254] Using insecure, self-signed certificates I0629 11:14:49.805357 1 start.go:223] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:14:49.805579 1 observer_polling.go:159] Starting file observer W0629 11:14:49.828879 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0629 11:14:50.331665 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0629 11:14:50.331866 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0629 11:14:50.332166 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0629 11:14:50.332301 1 secure_serving.go:57] Forcing use of http/1.1 only W0629 11:14:50.332322 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0629 11:14:50.332331 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0629 11:14:50.332337 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0629 11:14:50.332340 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0629 11:14:50.332343 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0629 11:14:50.332346 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0629 11:14:50.340116 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0629 11:14:50.340127 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0629 11:14:50.348430 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0629 11:14:50.348443 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0629 11:14:50.348442 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0629 11:14:50.348471 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 11:14:50.348473 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0629 11:14:50.348486 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 11:14:50.348692 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-3093390860/tls.crt::/tmp/serving-cert-3093390860/tls.key" I0629 11:14:50.348885 1 secure_serving.go:213] Serving securely on [::]:8443 I0629 11:14:50.348918 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0629 11:14:50.350276 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bd8906ec8d1720 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-06-29 11:14:50.340063008 +0000 UTC m=+0.823643349,LastTimestamp:2026-06-29 11:14:50.340063008 +0000 UTC m=+0.823643349,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0629 11:14:50.352231 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0629 11:14:50.352248 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 11:14:50.352316 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0629 11:14:50.357187 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 11:14:50.357204 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 11:14:50.364281 1 secretconfigobserver.go:119] support secret does not exist I0629 11:14:50.369741 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 11:14:50.370714 1 recorder.go:156] Pruning old reports every 7h19m38s, max age is 288h0m0s I0629 11:14:50.373560 1 secretconfigobserver.go:119] support secret does not exist I0629 11:14:50.375304 1 periodic.go:214] Running clusterconfig gatherer I0629 11:14:50.375316 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0629 11:14:50.375336 1 tasks_processing.go:45] number of workers: 64 I0629 11:14:50.375333 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0629 11:14:50.375347 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0629 11:14:50.375351 1 insightsreport.go:296] Starting report retriever I0629 11:14:50.375355 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0629 11:14:50.375362 1 tasks_processing.go:69] worker 8 listening for tasks. I0629 11:14:50.375363 1 tasks_processing.go:69] worker 3 listening for tasks. I0629 11:14:50.375368 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 11:14:50.375374 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 11:14:50.375374 1 tasks_processing.go:69] worker 6 listening for tasks. I0629 11:14:50.375374 1 tasks_processing.go:69] worker 5 listening for tasks. I0629 11:14:50.375379 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 11:14:50.375380 1 tasks_processing.go:69] worker 7 listening for tasks. I0629 11:14:50.375385 1 tasks_processing.go:69] worker 32 listening for tasks. I0629 11:14:50.375386 1 tasks_processing.go:69] worker 4 listening for tasks. I0629 11:14:50.375386 1 tasks_processing.go:69] worker 16 listening for tasks. I0629 11:14:50.375394 1 tasks_processing.go:69] worker 9 listening for tasks. I0629 11:14:50.375394 1 tasks_processing.go:69] worker 28 listening for tasks. I0629 11:14:50.375397 1 tasks_processing.go:69] worker 29 listening for tasks. I0629 11:14:50.375401 1 tasks_processing.go:69] worker 10 listening for tasks. I0629 11:14:50.375401 1 tasks_processing.go:69] worker 25 listening for tasks. I0629 11:14:50.375398 1 tasks_processing.go:69] worker 24 listening for tasks. I0629 11:14:50.375407 1 tasks_processing.go:69] worker 31 listening for tasks. I0629 11:14:50.375408 1 tasks_processing.go:69] worker 26 listening for tasks. I0629 11:14:50.375408 1 tasks_processing.go:71] worker 25 working on config_maps task. I0629 11:14:50.375413 1 tasks_processing.go:69] worker 14 listening for tasks. I0629 11:14:50.375415 1 tasks_processing.go:69] worker 34 listening for tasks. I0629 11:14:50.375415 1 tasks_processing.go:69] worker 17 listening for tasks. I0629 11:14:50.375416 1 tasks_processing.go:71] worker 14 working on container_images task. I0629 11:14:50.375421 1 tasks_processing.go:69] worker 27 listening for tasks. I0629 11:14:50.375414 1 tasks_processing.go:69] worker 13 listening for tasks. I0629 11:14:50.375403 1 tasks_processing.go:69] worker 30 listening for tasks. I0629 11:14:50.375428 1 tasks_processing.go:69] worker 22 listening for tasks. I0629 11:14:50.375429 1 tasks_processing.go:69] worker 19 listening for tasks. I0629 11:14:50.375432 1 tasks_processing.go:69] worker 36 listening for tasks. I0629 11:14:50.375433 1 tasks_processing.go:71] worker 31 working on nodenetworkconfigurationpolicies task. I0629 11:14:50.375435 1 tasks_processing.go:71] worker 19 working on sap_config task. I0629 11:14:50.375431 1 tasks_processing.go:69] worker 15 listening for tasks. I0629 11:14:50.375438 1 tasks_processing.go:69] worker 57 listening for tasks. I0629 11:14:50.375438 1 tasks_processing.go:69] worker 23 listening for tasks. I0629 11:14:50.375435 1 tasks_processing.go:71] worker 22 working on feature_gates task. I0629 11:14:50.375444 1 tasks_processing.go:69] worker 11 listening for tasks. I0629 11:14:50.375462 1 tasks_processing.go:69] worker 12 listening for tasks. I0629 11:14:50.375463 1 tasks_processing.go:69] worker 56 listening for tasks. I0629 11:14:50.375445 1 tasks_processing.go:69] worker 58 listening for tasks. I0629 11:14:50.375412 1 tasks_processing.go:69] worker 18 listening for tasks. I0629 11:14:50.375474 1 tasks_processing.go:71] worker 6 working on active_alerts task. I0629 11:14:50.375415 1 tasks_processing.go:71] worker 26 working on machine_config_pools task. I0629 11:14:50.375480 1 tasks_processing.go:71] worker 2 working on tsdb_status task. I0629 11:14:50.375480 1 tasks_processing.go:69] worker 48 listening for tasks. I0629 11:14:50.375480 1 tasks_processing.go:69] worker 46 listening for tasks. I0629 11:14:50.375489 1 tasks_processing.go:71] worker 48 working on olm_operators task. I0629 11:14:50.375487 1 tasks_processing.go:71] worker 18 working on clusterroles task. I0629 11:14:50.375492 1 tasks_processing.go:71] worker 15 working on operators_pods_and_events task. I0629 11:14:50.375496 1 tasks_processing.go:69] worker 43 listening for tasks. W0629 11:14:50.375497 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:14:50.375496 1 tasks_processing.go:69] worker 41 listening for tasks. W0629 11:14:50.375503 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:14:50.375424 1 tasks_processing.go:71] worker 27 working on nodenetworkstates task. I0629 11:14:50.375502 1 tasks_processing.go:71] worker 4 working on machines task. I0629 11:14:50.375508 1 tasks_processing.go:69] worker 44 listening for tasks. I0629 11:14:50.375513 1 tasks_processing.go:69] worker 39 listening for tasks. I0629 11:14:50.375512 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 25.791µs to process 0 records I0629 11:14:50.375521 1 tasks_processing.go:69] worker 61 listening for tasks. I0629 11:14:50.375523 1 tasks_processing.go:71] worker 8 working on container_runtime_configs task. I0629 11:14:50.375523 1 tasks_processing.go:69] worker 38 listening for tasks. I0629 11:14:50.375526 1 tasks_processing.go:71] worker 3 working on image task. I0629 11:14:50.375550 1 tasks_processing.go:69] worker 63 listening for tasks. I0629 11:14:50.375551 1 tasks_processing.go:71] worker 12 working on lokistack task. I0629 11:14:50.375553 1 tasks_processing.go:71] worker 16 working on ceph_cluster task. I0629 11:14:50.375551 1 tasks_processing.go:71] worker 58 working on authentication task. I0629 11:14:50.375553 1 tasks_processing.go:71] worker 56 working on openstack_dataplanedeployments task. I0629 11:14:50.375562 1 tasks_processing.go:71] worker 28 working on cost_management_metrics_configs task. I0629 11:14:50.375416 1 tasks_processing.go:69] worker 20 listening for tasks. I0629 11:14:50.375674 1 tasks_processing.go:69] worker 55 listening for tasks. I0629 11:14:50.375422 1 tasks_processing.go:71] worker 17 working on sap_datahubs task. I0629 11:14:50.375726 1 tasks_processing.go:71] worker 61 working on silenced_alerts task. W0629 11:14:50.375744 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:14:50.375423 1 tasks_processing.go:69] worker 21 listening for tasks. I0629 11:14:50.375468 1 tasks_processing.go:71] worker 30 working on proxies task. I0629 11:14:50.375466 1 tasks_processing.go:69] worker 59 listening for tasks. I0629 11:14:50.375838 1 tasks_processing.go:71] worker 59 working on mutating_webhook_configurations task. I0629 11:14:50.375472 1 tasks_processing.go:69] worker 60 listening for tasks. I0629 11:14:50.375476 1 tasks_processing.go:71] worker 5 working on openstack_dataplanenodesets task. I0629 11:14:50.375907 1 tasks_processing.go:71] worker 60 working on image_pruners task. I0629 11:14:50.375490 1 tasks_processing.go:71] worker 36 working on machine_configs task. I0629 11:14:50.375502 1 tasks_processing.go:69] worker 42 listening for tasks. I0629 11:14:50.376007 1 tasks_processing.go:71] worker 39 working on ingress task. I0629 11:14:50.375428 1 tasks_processing.go:69] worker 35 listening for tasks. I0629 11:14:50.376051 1 tasks_processing.go:71] worker 35 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0629 11:14:50.375419 1 tasks_processing.go:71] worker 34 working on node_logs task. I0629 11:14:50.375523 1 tasks_processing.go:69] worker 40 listening for tasks. I0629 11:14:50.376164 1 tasks_processing.go:71] worker 40 working on metrics task. I0629 11:14:50.375529 1 tasks_processing.go:71] worker 0 working on openstack_version task. W0629 11:14:50.376179 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:14:50.375530 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 25.734µs to process 0 records I0629 11:14:50.376193 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 17.133µs to process 0 records I0629 11:14:50.376197 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 18.685µs to process 0 records I0629 11:14:50.376200 1 tasks_processing.go:71] worker 40 working on certificate_signing_requests task. I0629 11:14:50.375410 1 tasks_processing.go:69] worker 33 listening for tasks. I0629 11:14:50.375532 1 tasks_processing.go:71] worker 1 working on openshift_logging task. I0629 11:14:50.376248 1 tasks_processing.go:71] worker 33 working on aggregated_monitoring_cr_names task. I0629 11:14:50.376255 1 tasks_processing.go:71] worker 61 working on pod_network_connectivity_checks task. I0629 11:14:50.375535 1 tasks_processing.go:71] worker 11 working on nodes task. I0629 11:14:50.375404 1 tasks_processing.go:71] worker 10 working on operators task. I0629 11:14:50.375541 1 tasks_processing.go:71] worker 57 working on machine_autoscalers task. I0629 11:14:50.375540 1 tasks_processing.go:69] worker 45 listening for tasks. I0629 11:14:50.376420 1 tasks_processing.go:71] worker 45 working on sap_pods task. I0629 11:14:50.375533 1 tasks_processing.go:69] worker 37 listening for tasks. I0629 11:14:50.375404 1 tasks_processing.go:71] worker 29 working on storage_classes task. I0629 11:14:50.375544 1 tasks_processing.go:69] worker 62 listening for tasks. I0629 11:14:50.375545 1 tasks_processing.go:71] worker 23 working on version task. I0629 11:14:50.375548 1 tasks_processing.go:71] worker 9 working on image_registries task. I0629 11:14:50.376538 1 tasks_processing.go:71] worker 37 working on openshift_machine_api_events task. I0629 11:14:50.375556 1 tasks_processing.go:71] worker 7 working on ingress_certificates task. I0629 11:14:50.375639 1 tasks_processing.go:71] worker 32 working on machine_healthchecks task. I0629 11:14:50.375646 1 tasks_processing.go:69] worker 52 listening for tasks. I0629 11:14:50.376665 1 tasks_processing.go:71] worker 52 working on networks task. I0629 11:14:50.375652 1 tasks_processing.go:69] worker 49 listening for tasks. I0629 11:14:50.375656 1 tasks_processing.go:69] worker 50 listening for tasks. I0629 11:14:50.375660 1 tasks_processing.go:69] worker 51 listening for tasks. I0629 11:14:50.375665 1 tasks_processing.go:69] worker 54 listening for tasks. I0629 11:14:50.375666 1 tasks_processing.go:69] worker 53 listening for tasks. I0629 11:14:50.375673 1 tasks_processing.go:71] worker 63 working on schedulers task. I0629 11:14:50.375675 1 tasks_processing.go:71] worker 46 working on support_secret task. I0629 11:14:50.376760 1 tasks_processing.go:74] worker 53 stopped. I0629 11:14:50.376764 1 tasks_processing.go:74] worker 54 stopped. I0629 11:14:50.376765 1 tasks_processing.go:71] worker 50 working on service_accounts task. I0629 11:14:50.376767 1 tasks_processing.go:71] worker 49 working on machine_sets task. I0629 11:14:50.375677 1 tasks_processing.go:71] worker 43 working on crds task. I0629 11:14:50.375410 1 tasks_processing.go:71] worker 24 working on infrastructures task. I0629 11:14:50.375680 1 tasks_processing.go:71] worker 6 working on dvo_metrics task. I0629 11:14:50.375681 1 tasks_processing.go:71] worker 20 working on oauths task. I0629 11:14:50.375684 1 tasks_processing.go:71] worker 41 working on overlapping_namespace_uids task. I0629 11:14:50.375686 1 tasks_processing.go:71] worker 44 working on cluster_apiserver task. I0629 11:14:50.375691 1 tasks_processing.go:71] worker 38 working on pdbs task. I0629 11:14:50.375429 1 tasks_processing.go:71] worker 13 working on monitoring_persistent_volumes task. I0629 11:14:50.375693 1 tasks_processing.go:71] worker 2 working on storage_cluster task. I0629 11:14:50.375719 1 tasks_processing.go:71] worker 55 working on validating_webhook_configurations task. I0629 11:14:50.375788 1 tasks_processing.go:71] worker 21 working on install_plans task. I0629 11:14:50.375475 1 tasks_processing.go:69] worker 47 listening for tasks. I0629 11:14:50.377440 1 tasks_processing.go:74] worker 47 stopped. I0629 11:14:50.376013 1 tasks_processing.go:71] worker 42 working on jaegers task. I0629 11:14:50.376534 1 tasks_processing.go:71] worker 62 working on openstack_controlplanes task. I0629 11:14:50.376757 1 tasks_processing.go:74] worker 51 stopped. I0629 11:14:50.382829 1 tasks_processing.go:74] worker 27 stopped. I0629 11:14:50.382840 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 7.310828ms to process 0 records I0629 11:14:50.383433 1 tasks_processing.go:74] worker 8 stopped. I0629 11:14:50.383443 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 7.900104ms to process 0 records I0629 11:14:50.392963 1 tasks_processing.go:74] worker 12 stopped. I0629 11:14:50.392975 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 17.403186ms to process 0 records I0629 11:14:50.392991 1 tasks_processing.go:74] worker 4 stopped. E0629 11:14:50.393011 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0629 11:14:50.393024 1 gather.go:181] gatherer "clusterconfig" function "machines" took 17.472342ms to process 0 records I0629 11:14:50.393052 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0629 11:14:50.393066 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 11:14:50.393071 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 11:14:50.393073 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 11:14:50.393102 1 controller.go:457] The operator is still being initialized I0629 11:14:50.393109 1 controller.go:482] The operator is healthy I0629 11:14:50.402010 1 tasks_processing.go:74] worker 28 stopped. I0629 11:14:50.402026 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.434596ms to process 0 records I0629 11:14:50.406975 1 tasks_processing.go:74] worker 16 stopped. I0629 11:14:50.406983 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 31.410857ms to process 0 records I0629 11:14:50.406993 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 31.412153ms to process 0 records I0629 11:14:50.406998 1 tasks_processing.go:74] worker 56 stopped. I0629 11:14:50.407261 1 tasks_processing.go:74] worker 58 stopped. I0629 11:14:50.407473 1 recorder.go:70] Recording config/authentication with fingerprint=326fa538a115986192f71ab4f2706d38f661d6a2c40128665dcd1871217bbda4 I0629 11:14:50.407484 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 31.691129ms to process 1 records I0629 11:14:50.408061 1 tasks_processing.go:74] worker 31 stopped. I0629 11:14:50.408071 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 32.619665ms to process 0 records I0629 11:14:50.408244 1 tasks_processing.go:74] worker 22 stopped. I0629 11:14:50.408364 1 recorder.go:70] Recording config/featuregate with fingerprint=645c960ec5ed450dc77f82f3850600721e88eac92bbe49bd197c2d25defb18d3 I0629 11:14:50.408378 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 32.792356ms to process 1 records I0629 11:14:50.408608 1 tasks_processing.go:74] worker 26 stopped. I0629 11:14:50.408619 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 33.126377ms to process 0 records I0629 11:14:50.408630 1 tasks_processing.go:74] worker 19 stopped. I0629 11:14:50.408636 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 33.191903ms to process 0 records I0629 11:14:50.408667 1 tasks_processing.go:74] worker 5 stopped. I0629 11:14:50.408676 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 32.818081ms to process 0 records I0629 11:14:50.408700 1 tasks_processing.go:74] worker 61 stopped. E0629 11:14:50.408710 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0629 11:14:50.408717 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 32.438609ms to process 0 records I0629 11:14:50.408778 1 tasks_processing.go:74] worker 0 stopped. I0629 11:14:50.408786 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 32.596558ms to process 0 records I0629 11:14:50.408796 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 32.548232ms to process 0 records I0629 11:14:50.408805 1 tasks_processing.go:74] worker 1 stopped. I0629 11:14:50.408831 1 tasks_processing.go:74] worker 3 stopped. I0629 11:14:50.408930 1 recorder.go:70] Recording config/image with fingerprint=f320d8fe8e8e5805cd9789fa939ac688f3ce4b90770c0c993f9a40438dfc374d I0629 11:14:50.408943 1 gather.go:181] gatherer "clusterconfig" function "image" took 33.276773ms to process 1 records I0629 11:14:50.409160 1 tasks_processing.go:74] worker 57 stopped. I0629 11:14:50.409168 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 32.789394ms to process 0 records I0629 11:14:50.409249 1 tasks_processing.go:74] worker 34 stopped. I0629 11:14:50.409258 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 33.157789ms to process 0 records I0629 11:14:50.409268 1 tasks_processing.go:74] worker 17 stopped. I0629 11:14:50.409277 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 33.537975ms to process 0 records I0629 11:14:50.409301 1 tasks_processing.go:74] worker 32 stopped. E0629 11:14:50.409313 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0629 11:14:50.409322 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 32.640831ms to process 0 records I0629 11:14:50.409331 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 32.543932ms to process 0 records I0629 11:14:50.409336 1 tasks_processing.go:74] worker 49 stopped. I0629 11:14:50.409355 1 tasks_processing.go:74] worker 2 stopped. I0629 11:14:50.409372 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 32.072569ms to process 0 records I0629 11:14:50.409388 1 tasks_processing.go:74] worker 60 stopped. I0629 11:14:50.409637 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=0d1963c42fc3a6af9019c6e7a76d4442962588365cfd065ea059563dab5dc3a5 I0629 11:14:50.409651 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 33.472431ms to process 1 records I0629 11:14:50.409660 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 32.971868ms to process 0 records I0629 11:14:50.409674 1 tasks_processing.go:74] worker 45 stopped. I0629 11:14:50.409699 1 recorder.go:70] Recording config/proxy with fingerprint=b149e361c9a95a0262735532f0c194b7b67ea1ab1734f5762ceb87e5dcd807de I0629 11:14:50.409706 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 33.631672ms to process 1 records I0629 11:14:50.409710 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 31.940517ms to process 0 records I0629 11:14:50.409713 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 32.09924ms to process 0 records I0629 11:14:50.409748 1 tasks_processing.go:74] worker 62 stopped. I0629 11:14:50.409751 1 tasks_processing.go:74] worker 42 stopped. I0629 11:14:50.409761 1 tasks_processing.go:74] worker 30 stopped. I0629 11:14:50.409816 1 tasks_processing.go:74] worker 39 stopped. I0629 11:14:50.409832 1 recorder.go:70] Recording config/ingress with fingerprint=1a8dea248419cf3ebae1cf85299634fe696b15dd5b0955c3b2623979e8c28e71 I0629 11:14:50.409839 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 33.565192ms to process 1 records I0629 11:14:50.409915 1 tasks_processing.go:74] worker 59 stopped. I0629 11:14:50.409941 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=d9e1c4421f847cce77a0d530849a08ae6d9f5b9b65e72e6497b37dad3fefc11f I0629 11:14:50.409959 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=4fb157dbb314eb7b13ce4a325ad1f7dc843d8dc284dc77548822a2dc7372e462 I0629 11:14:50.409974 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f62b3d3341cc181e4b4d986ce9cad7caddd918ecd2bc79ce5b32a3f3ea4a83f7 I0629 11:14:50.409981 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.948055ms to process 3 records I0629 11:14:50.417676 1 tasks_processing.go:74] worker 24 stopped. I0629 11:14:50.418080 1 recorder.go:70] Recording config/infrastructure with fingerprint=554db4768de99930b93890f7f2e5fb314a303a7dc75dc17d8fc9477b07f8e172 I0629 11:14:50.418093 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 40.818388ms to process 1 records I0629 11:14:50.421831 1 tasks_processing.go:74] worker 37 stopped. I0629 11:14:50.421842 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 45.283286ms to process 0 records E0629 11:14:50.421848 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0629 11:14:50.421853 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 45.066903ms to process 0 records I0629 11:14:50.421857 1 tasks_processing.go:74] worker 46 stopped. I0629 11:14:50.421905 1 tasks_processing.go:74] worker 44 stopped. I0629 11:14:50.422007 1 recorder.go:70] Recording config/apiserver with fingerprint=a9144853f41c4f27dd54be0cd1eaa0d905e6f8b527909249c60ea40ea6815e3b I0629 11:14:50.422019 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 44.831178ms to process 1 records I0629 11:14:50.422181 1 tasks_processing.go:74] worker 20 stopped. I0629 11:14:50.422356 1 recorder.go:70] Recording config/oauth with fingerprint=83b544730f0e647ff697c60fd3fa673d4b58d5cb71dd48dc90051e01104ba284 I0629 11:14:50.422367 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 45.181534ms to process 1 records I0629 11:14:50.422443 1 tasks_processing.go:74] worker 52 stopped. I0629 11:14:50.422482 1 recorder.go:70] Recording config/network with fingerprint=3ea04df6b52b2ecc969ae7a4bdd16060dfced9dfd228d984bf774e6cedcfb033 I0629 11:14:50.422487 1 gather.go:181] gatherer "clusterconfig" function "networks" took 45.680568ms to process 1 records I0629 11:14:50.422565 1 tasks_processing.go:74] worker 9 stopped. I0629 11:14:50.422785 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=46b5a6414339fd5ed2eea09fc851a2a330fe239852514f0c6ef229e8ce027a96 I0629 11:14:50.422798 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 45.870441ms to process 1 records I0629 11:14:50.423589 1 tasks_processing.go:74] worker 63 stopped. I0629 11:14:50.423655 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=00a66f3f541aaf6324379719500a6709192e2cf643a7bbc22154e74120638da3 I0629 11:14:50.423667 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 46.888184ms to process 1 records I0629 11:14:50.425594 1 tasks_processing.go:74] worker 13 stopped. I0629 11:14:50.425604 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 48.374679ms to process 0 records I0629 11:14:50.427076 1 tasks_processing.go:74] worker 36 stopped. E0629 11:14:50.427085 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0629 11:14:50.427102 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0629 11:14:50.427111 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 51.136807ms to process 1 records I0629 11:14:50.428038 1 tasks_processing.go:74] worker 55 stopped. I0629 11:14:50.428247 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=bad5dcfdd5c5a444accbdae7845e0a008e73a8380f510fc719693b918c8d95dd I0629 11:14:50.428365 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=42c7c0815d5f8d623e881b6c7541f74387c52bb40ec6a28ac17d219d42d8fc22 I0629 11:14:50.428474 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=955d0e1eb9138cfbe1fbdd1ac2ce254a700b0002fb589847e2718c46b4c63d82 I0629 11:14:50.428537 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0629 11:14:50.428479 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0629 11:14:50.429233 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=b6eb892a0aee69a68957fe1bdf5c1cb56d402567b249ddcd4aede6c07d18efe3 I0629 11:14:50.429256 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=de4d831095f074ab67f4e0d79deddadabe500687d19555e7316e62fe13a539c1 W0629 11:14:50.429267 1 operator.go:288] started I0629 11:14:50.429272 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=262e5610e3c9858018721d7e4e68fb346aef5cb727e4b812fd08410bfa1d9746 I0629 11:14:50.429306 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=3cd94cbfa00c71c1313bc7b3c65f504efddecff0d68b3e09e9cf98cb115ec111 I0629 11:14:50.429331 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=b385ccbdcc8b54d4f50148ee09bb5b372701ba65eebd5b6fe492ccd37bdd23e8 I0629 11:14:50.429346 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=b5def25fb9053ba4ffa4b227ba3e7d6b15be7905089255c280c849b7f8604bf6 I0629 11:14:50.429367 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=0de34aa830ed7909e87978428f875bc07d264efcf7fc614531930f653b12423c I0629 11:14:50.429378 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0629 11:14:50.429383 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=adaac16b62539e661a5b8bf0937cf1240f6ae0821255456a387f014be0887c14 I0629 11:14:50.429393 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 50.675472ms to process 11 records I0629 11:14:50.429473 1 tasks_processing.go:74] worker 38 stopped. I0629 11:14:50.429484 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6a16ddba0031ef4bbad125a3eab764a1be94693ef4cd267d63258a04b6aaee85 I0629 11:14:50.429499 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e322c92d5b8460f6a12be186531b9b6cf95bdf108576142057e2e98207f4a72f I0629 11:14:50.429511 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=301071df482ba35acb78c5df5e61f333d9dbe42135ebfe33c131b71021015319 I0629 11:14:50.429521 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 50.899267ms to process 3 records I0629 11:14:50.429561 1 recorder.go:70] Recording config/olm_operators with fingerprint=5682022fcd477257ebf5c6db6988cb3bb3e6e5114cc80ba051d31374dfa3b258 I0629 11:14:50.429568 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 52.686443ms to process 1 records I0629 11:14:50.429590 1 tasks_processing.go:74] worker 48 stopped. I0629 11:14:50.429658 1 tasks_processing.go:74] worker 18 stopped. I0629 11:14:50.429670 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=703224c74dcad6e833f7ab54cb55165a3e22ae70288807b2cee3af9b49d7652f I0629 11:14:50.429717 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7832182ea5d9432b1e50d156b0f5cd8dfa3b4f835eabee6a95eba87570e8df22 I0629 11:14:50.429726 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 52.931335ms to process 2 records I0629 11:14:50.429978 1 tasks_processing.go:74] worker 29 stopped. I0629 11:14:50.430107 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=4cbac0e00ee86baea43387fd3cb2e473fad6cdef196bfa64140cd90e1e67da1b I0629 11:14:50.430126 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=822144f76198e7487bdd768be9da209d157ca2a269a93a6619a4e504972c8479 I0629 11:14:50.430137 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 53.547483ms to process 2 records I0629 11:14:50.430499 1 tasks_processing.go:74] worker 40 stopped. I0629 11:14:50.430515 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 54.289459ms to process 0 records I0629 11:14:50.433350 1 tasks_processing.go:74] worker 41 stopped. I0629 11:14:50.433359 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0629 11:14:50.433370 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 56.269048ms to process 1 records I0629 11:14:50.434338 1 tasks_processing.go:74] worker 14 stopped. W0629 11:14:50.434504 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 11:14:50.435465 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-8rqrk with fingerprint=097df0d24b750fa2c4b7b7725d77bbceaac2f2b56569937403a0e4d0fb62f344 I0629 11:14:50.435585 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-bs9b5 with fingerprint=5e539c829c646464a836b9651220567400cf5d64dd7c27799258070abe909742 I0629 11:14:50.435622 1 recorder.go:70] Recording config/running_containers with fingerprint=e5d15401d996013b9784ade5434e2ef38da8ea6b3f3e55315f8a515202de3f5c I0629 11:14:50.435630 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 58.910695ms to process 3 records I0629 11:14:50.439124 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 11:14:50.439134 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 11:14:50.439137 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 11:14:50.439141 1 controller.go:203] Source scaController *sca.Controller is not ready I0629 11:14:50.439143 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0629 11:14:50.439156 1 controller.go:457] The operator is still being initialized I0629 11:14:50.439163 1 controller.go:482] The operator is healthy I0629 11:14:50.440166 1 prometheus_rules.go:88] Prometheus rules successfully created I0629 11:14:50.442948 1 tasks_processing.go:74] worker 33 stopped. I0629 11:14:50.442965 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 66.68512ms to process 0 records I0629 11:14:50.443797 1 tasks_processing.go:74] worker 43 stopped. I0629 11:14:50.444342 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=cb0b0f9d866da30ac68daab1060ef9525f9ecd40bcdd732553b1bf29d35354ec I0629 11:14:50.444563 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9143124934186c07139999de13dfdfc497dd2907c936a3391afdf627bf9fee8b I0629 11:14:50.444577 1 gather.go:181] gatherer "clusterconfig" function "crds" took 66.952439ms to process 2 records I0629 11:14:50.444871 1 requests.go:204] Asking for SCA certificate for x86_64 architecture W0629 11:14:50.447532 1 sca.go:117] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:38123->172.30.0.10:53: read: connection refused I0629 11:14:50.447550 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:38123->172.30.0.10:53: read: connection refused E0629 11:14:50.447532 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%!d(MISSING)af4a515-cce1-4858-974b-0cb998b931fa%!+(MISSING)and+status+is+%!a(MISSING)ccepted%!"(MISSING): dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:38123->172.30.0.10:53: read: connection refused I0629 11:14:50.447559 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27daf4a515-cce1-4858-974b-0cb998b931fa%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:38123->172.30.0.10:53: read: connection refused I0629 11:14:50.448558 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 11:14:50.448625 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0629 11:14:50.448634 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 11:14:50.450075 1 tasks_processing.go:74] worker 25 stopped. E0629 11:14:50.450091 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0629 11:14:50.450099 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0629 11:14:50.450104 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0629 11:14:50.450151 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0629 11:14:50.450163 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0629 11:14:50.450168 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0629 11:14:50.450175 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0629 11:14:50.450196 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0629 11:14:50.450205 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0629 11:14:50.450211 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 74.653215ms to process 6 records I0629 11:14:50.451532 1 tasks_processing.go:74] worker 7 stopped. E0629 11:14:50.451545 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0629 11:14:50.451555 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r80198b21vepbs0nis99otm7esc5rne-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r80198b21vepbs0nis99otm7esc5rne-primary-cert-bundle-secret" not found I0629 11:14:50.451902 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=8c0d115fe3b5286b1a7353e1a42e164c5a2b4f3e543c33b602978ee2624b2bae I0629 11:14:50.451918 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 74.88877ms to process 1 records I0629 11:14:50.452418 1 base_controller.go:73] Caches are synced for ConfigController I0629 11:14:50.452429 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0629 11:14:50.459028 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 11:14:50.491008 1 tasks_processing.go:74] worker 23 stopped. I0629 11:14:50.491364 1 recorder.go:70] Recording config/version with fingerprint=a3c4b47e3f00e35e57c42840b3273dc66f100e6f7de47824b50753caca315d0f I0629 11:14:50.491377 1 recorder.go:70] Recording config/id with fingerprint=681f0fd2f3471c3cf4ed88035db2e8b98e3e888ea4f93f86f2495ab41d84980f I0629 11:14:50.491384 1 gather.go:181] gatherer "clusterconfig" function "version" took 114.538226ms to process 2 records I0629 11:14:50.499893 1 tasks_processing.go:74] worker 11 stopped. I0629 11:14:50.500157 1 recorder.go:70] Recording config/node/ip-10-0-131-143.ec2.internal with fingerprint=cdc34e589794fd7156615a8481c39dc1a61476be8e9f590c06cdd3f13a7b9180 I0629 11:14:50.500212 1 recorder.go:70] Recording config/node/ip-10-0-153-71.ec2.internal with fingerprint=71816405fb0d5fba6a614f297d57bafb35ab095104f3ba31f2beb2bd1440a864 I0629 11:14:50.500276 1 recorder.go:70] Recording config/node/ip-10-0-172-155.ec2.internal with fingerprint=440a4198564be00c55af10b15077a50547d77b102292e333dd7f51f16014cfc7 I0629 11:14:50.500296 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 123.597432ms to process 3 records I0629 11:14:50.508673 1 tasks_processing.go:74] worker 35 stopped. I0629 11:14:50.508692 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 132.611691ms to process 0 records I0629 11:14:50.529796 1 base_controller.go:73] Caches are synced for LoggingSyncer I0629 11:14:50.529807 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0629 11:14:50.817534 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0629 11:14:50.817548 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0629 11:14:50.817594 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-czsdr pod in namespace openshift-dns (previous: false). I0629 11:14:50.857397 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0629 11:14:51.043990 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-czsdr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-czsdr\" is waiting to start: ContainerCreating" I0629 11:14:51.044010 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-czsdr\" is waiting to start: ContainerCreating" I0629 11:14:51.044017 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-czsdr pod in namespace openshift-dns (previous: false). I0629 11:14:51.055473 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0629 11:14:51.221787 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-czsdr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-czsdr\" is waiting to start: ContainerCreating" I0629 11:14:51.221804 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-czsdr\" is waiting to start: ContainerCreating" I0629 11:14:51.221829 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hwrfv pod in namespace openshift-dns (previous: false). W0629 11:14:51.433310 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 11:14:51.445361 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hwrfv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hwrfv\" is waiting to start: ContainerCreating" I0629 11:14:51.445378 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hwrfv\" is waiting to start: ContainerCreating" I0629 11:14:51.445385 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hwrfv pod in namespace openshift-dns (previous: false). I0629 11:14:51.621896 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hwrfv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hwrfv\" is waiting to start: ContainerCreating" I0629 11:14:51.621914 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hwrfv\" is waiting to start: ContainerCreating" I0629 11:14:51.621940 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jfhdl pod in namespace openshift-dns (previous: false). I0629 11:14:51.842863 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jfhdl pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jfhdl\" is waiting to start: ContainerCreating" I0629 11:14:51.842881 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jfhdl\" is waiting to start: ContainerCreating" I0629 11:14:51.842887 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jfhdl pod in namespace openshift-dns (previous: false). I0629 11:14:51.857102 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0629 11:14:52.021144 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jfhdl pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jfhdl\" is waiting to start: ContainerCreating" I0629 11:14:52.021161 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jfhdl\" is waiting to start: ContainerCreating" I0629 11:14:52.021169 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-87wk4 pod in namespace openshift-dns (previous: false). I0629 11:14:52.228808 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:52.228828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9dwjk pod in namespace openshift-dns (previous: false). I0629 11:14:52.420742 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:52.420760 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zxc6p pod in namespace openshift-dns (previous: false). W0629 11:14:52.432680 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 11:14:52.458835 1 tasks_processing.go:74] worker 10 stopped. I0629 11:14:52.458880 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=37b31d56143368405df676fc2555f83f88ee72a92c6aa01145b13f55b535cffb I0629 11:14:52.458914 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=863a0276feb040378cf67679a2eb56a00ac092d67b7131d394fba57d132b99bd I0629 11:14:52.458945 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0629 11:14:52.458968 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=b198d3457fad0b35ee28f42c759e47f811c45b643095b561a91d44282737cf69 I0629 11:14:52.458983 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0629 11:14:52.459000 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=f0eeae0d648a8ec275dd0b5a7d965b92b89ce7b323b9ec1e7c7426ae5dec2e17 I0629 11:14:52.459016 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=b015b9dba991bb0f82b5e84a34e8bb5c597cee5bb8fb1f8d0c33e5d78e2d8ac3 I0629 11:14:52.459042 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=cd31f3bfcf7ce4e3900c773cf17700c1ddd71b7136caf9018cc2f7a24d95473d I0629 11:14:52.459063 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=5c0a8d3e27aa4cbc7cc83b095f1cecf175df348fc89c0408cfbffdc83ffd2c41 I0629 11:14:52.459071 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0629 11:14:52.459083 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=c5353c8a4923262aaa2e6d29fbd288cae82e99085d968d77a91e8a9fe58b8454 I0629 11:14:52.459093 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0629 11:14:52.459102 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=7258421d117213b147bc58d56b5bc7d21e11108ae78e67a453ce111dfad81692 I0629 11:14:52.459112 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0629 11:14:52.459122 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=8e95a3d950f1b2bd606a9b455311c455201a2413bfda6bdd0063e0de905949ae I0629 11:14:52.459131 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0629 11:14:52.459140 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=40b10b30f9e7a52f37c2e0db00fb973953a2086bd7a8579c16f2606897c9e1be I0629 11:14:52.459148 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0629 11:14:52.459159 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=250a60912bbde3c386b322710d40470c257d94327cf54005ae8415b062b742bb I0629 11:14:52.459260 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=2f1015c5438bf4048824b74522ccda611f4a30c985119c952825aee6f3f4c549 I0629 11:14:52.459287 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0629 11:14:52.459302 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=48f9541aa89bf6f40f9aafe7b98d91fbfd8d92438914f9e6b5aa26f6babe98aa I0629 11:14:52.459317 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=bca7e715baae24a2c63d9dbc55598b36fd0fdb1173a069ed1f69f3d00aa4ccec I0629 11:14:52.459325 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0629 11:14:52.459334 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=909ee31b8de4140272b8b56d6264d121ba7b2e3344da60f42886f3e0fb210ad6 I0629 11:14:52.459343 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0629 11:14:52.459352 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=83d32c3bf8efb15db79f0978f5c8e49721bb5fc0ca7e26a0423b35159317983f I0629 11:14:52.459363 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=409166fe310b7db74e472a2092e8c42f20e7d68a50dedd0cb1a2c5a576e94209 I0629 11:14:52.459372 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=ed2503c7ac793d0879e4416a5296b82a27d0b08455c96364236c4b165994bbb4 I0629 11:14:52.459385 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=d9d9c71ffdd1a8843a3254509998e3570a589e71078ac5723b897c2cec1c9916 I0629 11:14:52.459401 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=1da73bcbffaf7697935bc781fa5999400294c15c07bf045896ba9db7c953cff1 I0629 11:14:52.459409 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0629 11:14:52.459425 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=be66013cec73a344b542e94f9c8f187051afa0a1b2275dea3107c6f7f44f6b1a I0629 11:14:52.459439 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0629 11:14:52.459461 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0629 11:14:52.459466 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.082467203s to process 35 records I0629 11:14:52.624828 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:52.624884 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-656d465c74-wkv7z pod in namespace openshift-image-registry (previous: false). I0629 11:14:52.824017 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-656d465c74-wkv7z pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-656d465c74-wkv7z\" is waiting to start: ContainerCreating" I0629 11:14:52.824035 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-656d465c74-wkv7z\" is waiting to start: ContainerCreating" I0629 11:14:52.824071 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-78c556bb45-b2hds pod in namespace openshift-image-registry (previous: false). I0629 11:14:53.022222 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-78c556bb45-b2hds pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-78c556bb45-b2hds\" is waiting to start: ContainerCreating" I0629 11:14:53.022241 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-78c556bb45-b2hds\" is waiting to start: ContainerCreating" I0629 11:14:53.022274 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-78c556bb45-xbxqn pod in namespace openshift-image-registry (previous: false). I0629 11:14:53.221943 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-78c556bb45-xbxqn pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-78c556bb45-xbxqn\" is waiting to start: ContainerCreating" I0629 11:14:53.221959 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-78c556bb45-xbxqn\" is waiting to start: ContainerCreating" I0629 11:14:53.221969 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6nnpz pod in namespace openshift-image-registry (previous: false). I0629 11:14:53.421642 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:53.421661 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-j22ld pod in namespace openshift-image-registry (previous: false). W0629 11:14:53.433811 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 11:14:53.625264 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:53.625283 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-kp75m pod in namespace openshift-image-registry (previous: false). I0629 11:14:53.822430 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 11:14:53.822446 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-56dcb65785-fchf7 pod in namespace openshift-ingress (previous: false). I0629 11:14:54.020908 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-56dcb65785-fchf7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-56dcb65785-fchf7\" is waiting to start: ContainerCreating" I0629 11:14:54.020924 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-56dcb65785-fchf7\" is waiting to start: ContainerCreating" I0629 11:14:54.020934 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-764b6d9864-4mdvb pod in namespace openshift-ingress (previous: false). I0629 11:14:54.225680 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-764b6d9864-4mdvb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-764b6d9864-4mdvb\" is waiting to start: ContainerCreating" I0629 11:14:54.225696 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-764b6d9864-4mdvb\" is waiting to start: ContainerCreating" I0629 11:14:54.225706 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-764b6d9864-f5tmv pod in namespace openshift-ingress (previous: false). I0629 11:14:54.421336 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-764b6d9864-f5tmv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-764b6d9864-f5tmv\" is waiting to start: ContainerCreating" I0629 11:14:54.421354 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-764b6d9864-f5tmv\" is waiting to start: ContainerCreating" I0629 11:14:54.421378 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-bmx2s pod in namespace openshift-ingress-canary (previous: false). W0629 11:14:54.433065 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 11:14:54.621846 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-bmx2s pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-bmx2s\" is waiting to start: ContainerCreating" I0629 11:14:54.621865 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-bmx2s\" is waiting to start: ContainerCreating" I0629 11:14:54.621898 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-dptc9 pod in namespace openshift-ingress-canary (previous: false). I0629 11:14:54.821237 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-dptc9 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-dptc9\" is waiting to start: ContainerCreating" I0629 11:14:54.821257 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-dptc9\" is waiting to start: ContainerCreating" I0629 11:14:54.821294 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-vbbbk pod in namespace openshift-ingress-canary (previous: false). I0629 11:14:55.025922 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-vbbbk pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vbbbk\" is waiting to start: ContainerCreating" I0629 11:14:55.025940 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vbbbk\" is waiting to start: ContainerCreating" I0629 11:14:55.025954 1 tasks_processing.go:74] worker 15 stopped. I0629 11:14:55.026019 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=47eff29190e07626ae6522aa8c4425428a9190c580abf3ac4944f0bc9a935df3 I0629 11:14:55.026054 1 recorder.go:70] Recording events/openshift-dns with fingerprint=eb7f47d56cadf4590202e8c13b35b48e2dec9028260f6db2bdb4b1be4c713a5d I0629 11:14:55.026100 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=ab776e37e950e8fbbfa8d4fdb54ab4539125320fb8b0037a047ff557eeb874d6 I0629 11:14:55.026114 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=a3f54c510b0a8aefc08b320a8ada788dc43d208c8244cdbe6d5a890d22b58579 I0629 11:14:55.026137 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=a70285ec277c78bbfc5631b52a9e5eca4719178f823bf314c64d498e94df981b I0629 11:14:55.026149 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=55f1e98b7686027d27b2019780931434df18e72d0a6e3dd230eb6c21bb929814 I0629 11:14:55.026241 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-czsdr with fingerprint=cdd40747245209744b73d1c3b9b895c99f26b0b20f38213c2bd5b54fb33e2fd2 I0629 11:14:55.026297 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-hwrfv with fingerprint=43ccaad2b65414244c8f44e432d0212c3623b7b0d5a8c1a01d90db7f1cfa5fce I0629 11:14:55.026337 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-jfhdl with fingerprint=d00695cfaa8048ebcf84c2f9217d606ec7a07c3a67425bb37c6fad7c0576efe6 I0629 11:14:55.026406 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-656d465c74-wkv7z with fingerprint=d11b52813e841999f18ee6e44e67c33e3c85a49cc2a9224ae3a4aff188b00670 I0629 11:14:55.026474 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-78c556bb45-b2hds with fingerprint=ae6e203c9545de8e2630d8cbb84ddd0c43c25cf6c4f20b69c28517e54e2c4b97 I0629 11:14:55.026523 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-78c556bb45-xbxqn with fingerprint=b78ce16a8c146e22959abe50c168be7db7795641360664c5db83ac4423233a9a I0629 11:14:55.026557 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-bmx2s with fingerprint=4ef960d07916e119d60d5bb3c16a82ba12e648be0e15ec6b4978629c6ebe2272 I0629 11:14:55.026589 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-dptc9 with fingerprint=fdbed0433776f316a327a888e025fe55da169aef1fe25a0f9e97c46fd4a318a1 I0629 11:14:55.026619 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-vbbbk with fingerprint=5f8a41d82735c3461f227c406a794f08a371e41467fbb2d05810da25c30f8b08 I0629 11:14:55.026626 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 4.650451554s to process 15 records W0629 11:14:55.430182 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0629 11:14:55.430206 1 tasks_processing.go:74] worker 6 stopped. E0629 11:14:55.430216 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0629 11:14:55.430226 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0629 11:14:55.430237 1 gather.go:159] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0629 11:14:55.430245 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.05332828s to process 1 records I0629 11:15:03.034769 1 tasks_processing.go:74] worker 21 stopped. I0629 11:15:03.034804 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0629 11:15:03.034819 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 12.657332551s to process 1 records I0629 11:15:03.781946 1 tasks_processing.go:74] worker 50 stopped. I0629 11:15:03.782149 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=765abbbb8353a910402ad1771e2ae09bfdf14a9dd166bdb2594893eccc550da6 I0629 11:15:03.782166 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.405165795s to process 1 records E0629 11:15:03.782224 1 periodic.go:252] clusterconfig failed after 13.406s with: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0629 11:15:03.782235 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0629 11:15:03.782242 1 periodic.go:214] Running workloads gatherer I0629 11:15:03.782252 1 tasks_processing.go:45] number of workers: 2 I0629 11:15:03.782256 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 11:15:03.782259 1 tasks_processing.go:71] worker 1 working on workload_info task. I0629 11:15:03.782269 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 11:15:03.782345 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0629 11:15:03.798557 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 22s for image data I0629 11:15:03.807130 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (9ms) I0629 11:15:03.808533 1 tasks_processing.go:74] worker 0 stopped. I0629 11:15:03.808551 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 26.169692ms to process 0 records I0629 11:15:03.815935 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (9ms) I0629 11:15:03.824210 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (8ms) I0629 11:15:03.834245 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (10ms) I0629 11:15:03.842897 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (9ms) I0629 11:15:03.854127 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (11ms) I0629 11:15:03.862757 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (9ms) I0629 11:15:03.870587 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (8ms) I0629 11:15:03.879046 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (8ms) I0629 11:15:03.887536 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (8ms) I0629 11:15:03.906849 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (19ms) I0629 11:15:04.007854 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (101ms) I0629 11:15:04.107780 1 gather_workloads_info.go:390] No image sha256:d09ac899f3001937771c6cadd50802a983e7c833fa2e0bde1958e134458c76ae (100ms) I0629 11:15:04.208686 1 gather_workloads_info.go:390] No image sha256:80fdd5049bd2815e49c198a795a116976a852e8de630be74872439ba6c08758a (101ms) I0629 11:15:04.308314 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (100ms) I0629 11:15:04.409821 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (101ms) I0629 11:15:04.507256 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (97ms) I0629 11:15:04.608680 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (101ms) I0629 11:15:04.655609 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 11:15:04.708015 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (99ms) I0629 11:15:04.807959 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (100ms) I0629 11:15:04.859246 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 11:15:04.907414 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (99ms) I0629 11:15:05.009376 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (102ms) I0629 11:15:05.108175 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (99ms) I0629 11:15:05.208211 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (100ms) I0629 11:15:05.309549 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (101ms) I0629 11:15:05.407611 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (98ms) I0629 11:15:05.508029 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0629 11:15:05.607276 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (99ms) I0629 11:15:05.707993 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (101ms) I0629 11:15:05.807469 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (99ms) I0629 11:15:05.807495 1 tasks_processing.go:74] worker 1 stopped. I0629 11:15:05.807733 1 recorder.go:70] Recording config/workload_info with fingerprint=85216c8a2f6907d7e376fb47952a4b172edfdb892099d4ce2614fa8e44048def I0629 11:15:05.807759 1 gather.go:181] gatherer "workloads" function "workload_info" took 2.025229753s to process 1 records I0629 11:15:05.807775 1 periodic.go:261] Periodic gather workloads completed in 2.025s I0629 11:15:05.807783 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0629 11:15:05.807789 1 periodic.go:214] Running conditional gatherer I0629 11:15:05.815318 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0629 11:15:05.820014 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:46547->172.30.0.10:53: read: connection refused E0629 11:15:05.820250 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 11:15:05.820321 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0629 11:15:05.828068 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0629 11:15:05.828080 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828084 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828087 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828089 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828091 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828094 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828097 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828099 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 11:15:05.828101 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0629 11:15:05.828113 1 tasks_processing.go:45] number of workers: 3 I0629 11:15:05.828127 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 11:15:05.828131 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0629 11:15:05.828135 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 11:15:05.828146 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0629 11:15:05.828147 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 11:15:05.828151 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0629 11:15:05.828153 1 tasks_processing.go:74] worker 1 stopped. I0629 11:15:05.828220 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0629 11:15:05.828238 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 905ns to process 1 records I0629 11:15:05.828290 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0629 11:15:05.828302 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.005µs to process 1 records I0629 11:15:05.828309 1 tasks_processing.go:74] worker 0 stopped. I0629 11:15:05.828351 1 tasks_processing.go:74] worker 2 stopped. I0629 11:15:05.828357 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 196.61µs to process 0 records I0629 11:15:05.828373 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:46547->172.30.0.10:53: read: connection refused I0629 11:15:05.828380 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 W0629 11:15:05.847692 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0629 11:15:05.847832 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=74b9525cd99f265bc6d321ccdadf363b1d1bf56619ccee8650a73e905cfc6c7e I0629 11:15:05.847944 1 diskrecorder.go:70] Writing 110 records to /var/lib/insights-operator/insights-2026-06-29-111505.tar.gz I0629 11:15:05.854226 1 diskrecorder.go:51] Wrote 110 records to disk in 6ms I0629 11:15:05.854253 1 periodic.go:283] Gathering cluster info every 2h0m0s I0629 11:15:05.854267 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0629 11:15:13.181408 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 11:16:19.806626 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="d964bcaa3a7af9a5fdb3d307accb8308b4718452702d81e02600ce8f31913777") W0629 11:16:19.806657 1 builder.go:154] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0629 11:16:19.806684 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="10af18f6749e60f557ba57a874156b529a3b319f81a156ac19733f0e7b8be475") I0629 11:16:19.806734 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="598ef534566b05366254a1094a259c71af367aa807bf5ddd367dacbcbc038d9e") I0629 11:16:19.806759 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0629 11:16:19.806828 1 base_controller.go:172] Shutting down ConfigController ... I0629 11:16:19.806827 1 genericapiserver.go:527] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0629 11:16:19.806837 1 genericapiserver.go:670] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0629 11:16:19.806851 1 periodic.go:175] Shutting down I0629 11:16:19.806855 1 base_controller.go:172] Shutting down LoggingSyncer ... I0629 11:16:19.806858 1 genericapiserver.go:628] "[graceful-termination] not going to wait for active watch request(s) to drain" I0629 11:16:19.806859 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0629 11:16:19.806867 1 base_controller.go:114] Shutting down worker of ConfigController controller ... I0629 11:16:19.806873 1 base_controller.go:104] All ConfigController workers have been terminated