W0312 11:37:44.861990 1 cmd.go:257] Using insecure, self-signed certificates I0312 11:37:45.323595 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:37:45.323950 1 observer_polling.go:159] Starting file observer W0312 11:37:45.350292 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0312 11:37:46.046489 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0312 11:37:46.046849 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0312 11:37:46.047328 1 secure_serving.go:57] Forcing use of http/1.1 only W0312 11:37:46.047348 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0312 11:37:46.047353 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0312 11:37:46.047357 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0312 11:37:46.047360 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0312 11:37:46.047363 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0312 11:37:46.047366 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0312 11:37:46.047860 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0312 11:37:46.052540 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0312 11:37:46.052557 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0312 11:37:46.057213 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0312 11:37:46.057230 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0312 11:37:46.057242 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0312 11:37:46.057260 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0312 11:37:46.057275 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0312 11:37:46.057264 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file E0312 11:37:46.057408 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.189c15055cc440dc openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-03-12 11:37:46.052518108 +0000 UTC m=+1.259967478,LastTimestamp:2026-03-12 11:37:46.052518108 +0000 UTC m=+1.259967478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0312 11:37:46.057519 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2980590813/tls.crt::/tmp/serving-cert-2980590813/tls.key" I0312 11:37:46.057807 1 secure_serving.go:213] Serving securely on [::]:8443 I0312 11:37:46.057848 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0312 11:37:46.061041 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0312 11:37:46.061078 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0312 11:37:46.061177 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0312 11:37:46.071989 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0312 11:37:46.072012 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0312 11:37:46.084359 1 secretconfigobserver.go:119] support secret does not exist I0312 11:37:46.097410 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0312 11:37:46.109986 1 secretconfigobserver.go:119] support secret does not exist I0312 11:37:46.110151 1 recorder.go:156] Pruning old reports every 7h50m22s, max age is 288h0m0s I0312 11:37:46.120183 1 periodic.go:212] Running clusterconfig gatherer I0312 11:37:46.120195 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0312 11:37:46.120215 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0312 11:37:46.120243 1 tasks_processing.go:45] number of workers: 32 I0312 11:37:46.120245 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0312 11:37:46.120253 1 insightsreport.go:296] Starting report retriever I0312 11:37:46.120260 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0312 11:37:46.120275 1 tasks_processing.go:69] worker 1 listening for tasks. I0312 11:37:46.120281 1 tasks_processing.go:69] worker 31 listening for tasks. I0312 11:37:46.120285 1 tasks_processing.go:71] worker 1 working on ingress_certificates task. I0312 11:37:46.120287 1 tasks_processing.go:69] worker 5 listening for tasks. I0312 11:37:46.120292 1 tasks_processing.go:69] worker 0 listening for tasks. I0312 11:37:46.120288 1 tasks_processing.go:69] worker 4 listening for tasks. I0312 11:37:46.120295 1 tasks_processing.go:69] worker 19 listening for tasks. I0312 11:37:46.120301 1 tasks_processing.go:69] worker 2 listening for tasks. I0312 11:37:46.120307 1 tasks_processing.go:69] worker 3 listening for tasks. I0312 11:37:46.120308 1 tasks_processing.go:69] worker 18 listening for tasks. I0312 11:37:46.120313 1 tasks_processing.go:69] worker 26 listening for tasks. I0312 11:37:46.120315 1 tasks_processing.go:69] worker 11 listening for tasks. I0312 11:37:46.120322 1 tasks_processing.go:69] worker 21 listening for tasks. I0312 11:37:46.120322 1 tasks_processing.go:69] worker 25 listening for tasks. I0312 11:37:46.120331 1 tasks_processing.go:69] worker 29 listening for tasks. I0312 11:37:46.120333 1 tasks_processing.go:69] worker 7 listening for tasks. I0312 11:37:46.120337 1 tasks_processing.go:69] worker 15 listening for tasks. I0312 11:37:46.120339 1 tasks_processing.go:69] worker 30 listening for tasks. I0312 11:37:46.120335 1 tasks_processing.go:69] worker 13 listening for tasks. I0312 11:37:46.120345 1 tasks_processing.go:69] worker 14 listening for tasks. I0312 11:37:46.120345 1 tasks_processing.go:69] worker 16 listening for tasks. I0312 11:37:46.120351 1 tasks_processing.go:69] worker 9 listening for tasks. I0312 11:37:46.120353 1 tasks_processing.go:69] worker 27 listening for tasks. I0312 11:37:46.120355 1 tasks_processing.go:69] worker 17 listening for tasks. I0312 11:37:46.120340 1 tasks_processing.go:69] worker 28 listening for tasks. I0312 11:37:46.120359 1 tasks_processing.go:69] worker 10 listening for tasks. I0312 11:37:46.120359 1 tasks_processing.go:69] worker 23 listening for tasks. I0312 11:37:46.120362 1 tasks_processing.go:69] worker 24 listening for tasks. I0312 11:37:46.120344 1 tasks_processing.go:69] worker 8 listening for tasks. I0312 11:37:46.120326 1 tasks_processing.go:69] worker 12 listening for tasks. I0312 11:37:46.120373 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I0312 11:37:46.120376 1 tasks_processing.go:71] worker 0 working on image_registries task. I0312 11:37:46.120382 1 tasks_processing.go:71] worker 12 working on machine_autoscalers task. I0312 11:37:46.120387 1 tasks_processing.go:71] worker 2 working on service_accounts task. I0312 11:37:46.120383 1 tasks_processing.go:69] worker 22 listening for tasks. I0312 11:37:46.120396 1 tasks_processing.go:71] worker 22 working on validating_webhook_configurations task. I0312 11:37:46.120438 1 tasks_processing.go:71] worker 9 working on container_images task. I0312 11:37:46.120468 1 tasks_processing.go:71] worker 21 working on config_maps task. I0312 11:37:46.120518 1 tasks_processing.go:71] worker 23 working on networks task. I0312 11:37:46.120604 1 tasks_processing.go:71] worker 8 working on support_secret task. I0312 11:37:46.120882 1 tasks_processing.go:71] worker 25 working on tsdb_status task. I0312 11:37:46.120948 1 tasks_processing.go:71] worker 14 working on sap_config task. I0312 11:37:46.120453 1 tasks_processing.go:71] worker 3 working on silenced_alerts task. W0312 11:37:46.121044 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:37:46.120468 1 tasks_processing.go:71] worker 10 working on machine_configs task. I0312 11:37:46.121063 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 20.09µs to process 0 records I0312 11:37:46.120382 1 tasks_processing.go:71] worker 19 working on mutating_webhook_configurations task. W0312 11:37:46.120973 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:37:46.121152 1 tasks_processing.go:71] worker 25 working on openshift_machine_api_events task. I0312 11:37:46.120324 1 tasks_processing.go:69] worker 6 listening for tasks. I0312 11:37:46.120302 1 tasks_processing.go:69] worker 20 listening for tasks. I0312 11:37:46.120368 1 tasks_processing.go:71] worker 5 working on openstack_controlplanes task. I0312 11:37:46.120371 1 tasks_processing.go:71] worker 4 working on lokistack task. I0312 11:37:46.121233 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 199.241µs to process 0 records I0312 11:37:46.120378 1 tasks_processing.go:71] worker 29 working on storage_cluster task. I0312 11:37:46.121358 1 tasks_processing.go:71] worker 20 working on pod_network_connectivity_checks task. I0312 11:37:46.120457 1 tasks_processing.go:71] worker 18 working on nodes task. I0312 11:37:46.121364 1 tasks_processing.go:71] worker 6 working on certificate_signing_requests task. I0312 11:37:46.120460 1 tasks_processing.go:71] worker 26 working on ceph_cluster task. I0312 11:37:46.120464 1 tasks_processing.go:71] worker 11 working on openshift_logging task. I0312 11:37:46.120473 1 tasks_processing.go:71] worker 27 working on crds task. I0312 11:37:46.120477 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0312 11:37:46.120483 1 tasks_processing.go:71] worker 28 working on feature_gates task. I0312 11:37:46.120493 1 tasks_processing.go:71] worker 13 working on pdbs task. I0312 11:37:46.120497 1 tasks_processing.go:71] worker 7 working on machine_config_pools task. I0312 11:37:46.120500 1 tasks_processing.go:71] worker 15 working on overlapping_namespace_uids task. I0312 11:37:46.120504 1 tasks_processing.go:71] worker 30 working on cluster_apiserver task. I0312 11:37:46.120514 1 tasks_processing.go:71] worker 24 working on authentication task. I0312 11:37:46.120977 1 tasks_processing.go:71] worker 16 working on olm_operators task. I0312 11:37:46.121053 1 tasks_processing.go:71] worker 3 working on cost_management_metrics_configs task. I0312 11:37:46.125172 1 tasks_processing.go:71] worker 12 working on machines task. I0312 11:37:46.125207 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 4.781419ms to process 0 records I0312 11:37:46.125224 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 4.824739ms to process 0 records I0312 11:37:46.125230 1 tasks_processing.go:71] worker 31 working on openstack_version task. I0312 11:37:46.134132 1 tasks_processing.go:71] worker 14 working on sap_datahubs task. I0312 11:37:46.134172 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 13.132036ms to process 0 records I0312 11:37:46.134230 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 11.631609ms to process 0 records I0312 11:37:46.134243 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 11.975977ms to process 0 records I0312 11:37:46.134251 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 12.840249ms to process 0 records I0312 11:37:46.134257 1 tasks_processing.go:71] worker 3 working on oauths task. I0312 11:37:46.134267 1 tasks_processing.go:71] worker 29 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0312 11:37:46.134259 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.43774ms to process 0 records I0312 11:37:46.134321 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 13.048318ms to process 0 records I0312 11:37:46.134331 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 12.983581ms to process 0 records I0312 11:37:46.134338 1 tasks_processing.go:71] worker 4 working on openstack_dataplanenodesets task. I0312 11:37:46.134367 1 tasks_processing.go:71] worker 11 working on machine_sets task. I0312 11:37:46.134403 1 tasks_processing.go:71] worker 7 working on nodenetworkconfigurationpolicies task. I0312 11:37:46.134519 1 tasks_processing.go:71] worker 5 working on container_runtime_configs task. I0312 11:37:46.144412 1 tasks_processing.go:71] worker 20 working on image task. E0312 11:37:46.144506 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0312 11:37:46.144585 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 23.001472ms to process 0 records I0312 11:37:46.144632 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 19.368078ms to process 0 records I0312 11:37:46.144723 1 tasks_processing.go:71] worker 31 working on sap_pods task. E0312 11:37:46.144753 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0312 11:37:46.144836 1 gather.go:177] gatherer "clusterconfig" function "machines" took 19.56356ms to process 0 records I0312 11:37:46.145217 1 tasks_processing.go:71] worker 23 working on storage_classes task. I0312 11:37:46.145264 1 recorder.go:70] Recording config/network with fingerprint=b927f70c3e073ca8e7b494c26e07967406f1aa88ccaa97dbf55f50ca12a0f01d I0312 11:37:46.145310 1 tasks_processing.go:71] worker 12 working on node_logs task. I0312 11:37:46.146453 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0312 11:37:46.146523 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0312 11:37:46.145324 1 gather.go:177] gatherer "clusterconfig" function "networks" took 24.36394ms to process 1 records I0312 11:37:46.146701 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 23.634142ms to process 0 records I0312 11:37:46.146554 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0312 11:37:46.146763 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0312 11:37:46.146802 1 controller.go:458] The operator is still being initialized I0312 11:37:46.146829 1 controller.go:481] The operator is healthy I0312 11:37:46.146973 1 tasks_processing.go:71] worker 24 working on aggregated_monitoring_cr_names task. I0312 11:37:46.147290 1 tasks_processing.go:71] worker 26 working on image_pruners task. I0312 11:37:46.147650 1 recorder.go:70] Recording config/authentication with fingerprint=c0850de5748530708a1cffff72474a941cdead327e214100bcfcc3fd7e21c85d I0312 11:37:46.147712 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 22.929646ms to process 1 records I0312 11:37:46.148037 1 recorder.go:70] Recording config/apiserver with fingerprint=7595398be432260ab99dd05cd99952bee70186be78c0a26c64b972c360611da2 I0312 11:37:46.148096 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 23.722094ms to process 1 records I0312 11:37:46.148112 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 25.590089ms to process 0 records I0312 11:37:46.148207 1 tasks_processing.go:71] worker 30 working on ingress task. I0312 11:37:46.148299 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6e8a701f3ab7e34a68f0808b1c827408a9c24ba4ff24f359d253e5b8000ce67f I0312 11:37:46.148340 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=af0d7fd49079f15793170b999a9b35282ee7190a22f83b7811d22f7c791ce3f3 I0312 11:37:46.148380 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=91a2e8652ec96f0265f4a3d9aa41e4a4898eeeaa3c1b5276de6eb156d7a2c7fb I0312 11:37:46.148396 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 24.77978ms to process 3 records I0312 11:37:46.148414 1 tasks_processing.go:71] worker 25 working on dvo_metrics task. I0312 11:37:46.148594 1 tasks_processing.go:71] worker 13 working on operators task. I0312 11:37:46.148686 1 recorder.go:70] Recording config/featuregate with fingerprint=fe0661878e79be6fec6f17f67761ed716bcaf8e18b6b04876c17d4c62365e76c I0312 11:37:46.148703 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 25.332173ms to process 1 records I0312 11:37:46.149007 1 tasks_processing.go:71] worker 28 working on version task. I0312 11:37:46.149061 1 tasks_processing.go:71] worker 0 working on machine_healthchecks task. I0312 11:37:46.150078 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=013b52785d4ffeb0403807cc8d82512d93cd8dd0236662c1318f089e3931aedd I0312 11:37:46.150098 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 27.131005ms to process 1 records E0312 11:37:46.150129 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0312 11:37:46.150137 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 27.549101ms to process 0 records I0312 11:37:46.150195 1 tasks_processing.go:71] worker 8 working on operators_pods_and_events task. I0312 11:37:46.150357 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=4c94f56345e63d6e76aacbe152773e3a47665f2d31e3d2dfc4ae37e264d92d2d I0312 11:37:46.150459 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=3cf26ae7ebd57b1f07c52f42135d5e0189e7deb9f751d664b97c77a4417ff5ad I0312 11:37:46.150490 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=8152b400252b76017f87d6b6f42ec7dd29322d817f97302e38eb9d033ef390b8 I0312 11:37:46.150519 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a58d2e3d588c7afa4711986dcc8d90b1471c2c83162853dd0507a95822a2b435 I0312 11:37:46.150550 1 tasks_processing.go:71] worker 22 working on jaegers task. I0312 11:37:46.150552 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9e2bd21a3b2917cadf48188bee8a2d3bf9859dbd543ed29277b0ffb3b670f2fd I0312 11:37:46.150595 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=7ee0c236ae42f58cf176697fa53f66dae3bf5a9813aff878405c8ef9fc601a3c I0312 11:37:46.150653 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=114b1d9ac69d937787542fe7d28828f9da3559791f6761005b1b41d386c6b040 I0312 11:37:46.150694 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=c139906589d9433407e20b71fc6a2e66df4d2b85edb33768ab1d25fa9d12ef0f I0312 11:37:46.150735 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f16b65454d88804d9e3574d42379104f79b5aa5fa24ebc2f5e9a08ab70a91d61 I0312 11:37:46.150773 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=9d909089bda1132eacaf9d1f499906cba07181886d2b7fdf5e2ae0e155a37719 I0312 11:37:46.150785 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 27.869883ms to process 10 records I0312 11:37:46.150803 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.339728ms to process 0 records I0312 11:37:46.150832 1 tasks_processing.go:71] worker 6 working on active_alerts task. W0312 11:37:46.150861 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:37:46.150874 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 29.972µs to process 0 records I0312 11:37:46.150881 1 tasks_processing.go:71] worker 6 working on openstack_dataplanedeployments task. I0312 11:37:46.153892 1 tasks_processing.go:71] worker 14 working on schedulers task. I0312 11:37:46.154005 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 19.700724ms to process 0 records I0312 11:37:46.154069 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 19.381421ms to process 0 records I0312 11:37:46.154139 1 tasks_processing.go:71] worker 5 working on install_plans task. I0312 11:37:46.154231 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=9b5ee4d548f1caed920423d758e60a79908b0e85a42e1b465ca28f814c30c325 I0312 11:37:46.154286 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=e6adddb797248826251469b67691c36fe086a9b15fad8b26513b1572076cb96e I0312 11:37:46.154329 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=d6cd3c5c37df63344db2a370a0b45b8d301796daf227e018f263fc0c01aeac7c I0312 11:37:46.154344 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 32.865651ms to process 3 records I0312 11:37:46.154354 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 19.588645ms to process 0 records I0312 11:37:46.154385 1 tasks_processing.go:71] worker 19 working on metrics task. W0312 11:37:46.154435 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:37:46.154452 1 tasks_processing.go:71] worker 19 working on proxies task. I0312 11:37:46.154636 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 54.034µs to process 0 records I0312 11:37:46.154689 1 tasks_processing.go:71] worker 11 working on infrastructures task. I0312 11:37:46.154897 1 tasks_processing.go:71] worker 3 working on monitoring_persistent_volumes task. I0312 11:37:46.155072 1 recorder.go:70] Recording config/oauth with fingerprint=8a97a7ec07705c412730bd78ae2c8d4c50e873ae8d88824abcd2c861bd73187a I0312 11:37:46.155125 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 20.433488ms to process 1 records I0312 11:37:46.155149 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0312 11:37:46.155160 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.629078ms to process 1 records I0312 11:37:46.155171 1 tasks_processing.go:74] worker 15 stopped. I0312 11:37:46.155260 1 tasks_processing.go:74] worker 4 stopped. I0312 11:37:46.155276 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 20.91278ms to process 0 records I0312 11:37:46.155329 1 tasks_processing.go:74] worker 7 stopped. I0312 11:37:46.155350 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 20.915135ms to process 0 records I0312 11:37:46.156259 1 tasks_processing.go:74] worker 31 stopped. I0312 11:37:46.156273 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 11.505823ms to process 0 records I0312 11:37:46.157373 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0312 11:37:46.157382 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0312 11:37:46.157399 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0312 11:37:46.158652 1 tasks_processing.go:74] worker 9 stopped. I0312 11:37:46.158716 1 recorder.go:70] Recording config/running_containers with fingerprint=86a5fd86e0b552252073816ad93c506b3f0ccbe31059280ca234042e0a3fdb8e I0312 11:37:46.158731 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 38.172641ms to process 1 records I0312 11:37:46.161539 1 base_controller.go:82] Caches are synced for ConfigController I0312 11:37:46.161551 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0312 11:37:46.164057 1 tasks_processing.go:74] worker 10 stopped. E0312 11:37:46.164070 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0312 11:37:46.164122 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0312 11:37:46.164137 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 42.994627ms to process 1 records I0312 11:37:46.164147 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 13.544331ms to process 0 records I0312 11:37:46.164152 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 13.234676ms to process 0 records I0312 11:37:46.164161 1 tasks_processing.go:74] worker 6 stopped. I0312 11:37:46.164168 1 tasks_processing.go:74] worker 22 stopped. I0312 11:37:46.164171 1 tasks_processing.go:74] worker 0 stopped. E0312 11:37:46.164178 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0312 11:37:46.164191 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 15.058262ms to process 0 records I0312 11:37:46.164269 1 tasks_processing.go:74] worker 18 stopped. I0312 11:37:46.164559 1 recorder.go:70] Recording config/node/ip-10-0-0-38.ec2.internal with fingerprint=0d889cbf1a4689c7fc826635d76fa1f2b449ee2b76a9684c9a42a0e70141a923 I0312 11:37:46.164613 1 recorder.go:70] Recording config/node/ip-10-0-2-72.ec2.internal with fingerprint=9a164a36bc931c1e3f085d2f93a8850c7aeb672d79575ef3c562c1ecadb18172 I0312 11:37:46.164627 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 42.760773ms to process 2 records I0312 11:37:46.171960 1 tasks_processing.go:74] worker 30 stopped. I0312 11:37:46.172509 1 recorder.go:70] Recording config/ingress with fingerprint=1d9c78db5a174298297fe5eb9e38840052f9fcff4e4ec48020802d8e0194b56d I0312 11:37:46.172542 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.708978ms to process 1 records I0312 11:37:46.174768 1 tasks_processing.go:74] worker 20 stopped. I0312 11:37:46.175288 1 recorder.go:70] Recording config/image with fingerprint=e8a0e60884e498725dbe5f9fe5f41b411710c95fe6604267dacaab47ab8ac06c I0312 11:37:46.175346 1 gather.go:177] gatherer "clusterconfig" function "image" took 30.337239ms to process 1 records I0312 11:37:46.175640 1 tasks_processing.go:74] worker 27 stopped. I0312 11:37:46.175829 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0312 11:37:46.175896 1 operator.go:287] started I0312 11:37:46.175990 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0312 11:37:46.176096 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0312 11:37:46.176186 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=5d9c015fe2a66e59d9aa73573e2ea23c1a9240b34acae1a1635c84511b508550 I0312 11:37:46.176606 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=a920a5e77343faf728678ccba45edff7ed365f9c4a3e93e52bd764d9070b543b I0312 11:37:46.176619 1 gather.go:177] gatherer "clusterconfig" function "crds" took 53.329605ms to process 2 records I0312 11:37:46.176719 1 tasks_processing.go:74] worker 17 stopped. I0312 11:37:46.176786 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=e87095852ef7ce1a41b40512c219e9d0b38829cd269a7e1abf2bd29aea01fc81 I0312 11:37:46.176914 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8f484046f6722b691537082fd60a130eb523091fb95b9d78b70d541f40746633 I0312 11:37:46.176925 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 53.330832ms to process 2 records I0312 11:37:46.177000 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=885744400e596700f43848ce4fa721fbc1f059a92db61f2719a05006a5db3a05 I0312 11:37:46.177013 1 tasks_processing.go:74] worker 23 stopped. I0312 11:37:46.177020 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=0bc32eafd33dbd2b2e875e685752a7ef04d4053269a3e45e207b65addae4b182 I0312 11:37:46.177028 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 30.039951ms to process 2 records I0312 11:37:46.177104 1 tasks_processing.go:74] worker 26 stopped. I0312 11:37:46.177105 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1fbffbe49a63ec6bb42b5637dd99eb273de49e099cb4d3cc7a02bf2a0855f8db I0312 11:37:46.177117 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 28.036159ms to process 1 records W0312 11:37:46.180049 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0312 11:37:46.182267 1 configmapobserver.go:84] configmaps "insights-config" not found I0312 11:37:46.182450 1 tasks_processing.go:74] worker 11 stopped. I0312 11:37:46.183080 1 recorder.go:70] Recording config/infrastructure with fingerprint=9b70f9f1e6d724552d05dc713be1d576393a94bdfa5cb2d5c60f3efccbfa7228 I0312 11:37:46.183098 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 27.730402ms to process 1 records I0312 11:37:46.183157 1 tasks_processing.go:74] worker 19 stopped. I0312 11:37:46.183184 1 recorder.go:70] Recording config/proxy with fingerprint=80b1df303fca3ccd2e836365bab14f1650900e53944c2ddfa8a4bac0ee88648a I0312 11:37:46.183199 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.107674ms to process 1 records I0312 11:37:46.183215 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 60.248582ms to process 0 records I0312 11:37:46.183227 1 tasks_processing.go:74] worker 16 stopped. I0312 11:37:46.190660 1 tasks_processing.go:74] worker 3 stopped. I0312 11:37:46.190673 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 35.704244ms to process 0 records I0312 11:37:46.190890 1 tasks_processing.go:74] worker 14 stopped. I0312 11:37:46.190985 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=a6cec3e36fa8800b8feb3fceea80d53f7bdeb085483c6fe64d763d3f9e24de8d I0312 11:37:46.191001 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 36.934898ms to process 1 records I0312 11:37:46.202114 1 controller.go:203] Source scaController *sca.Controller is not ready I0312 11:37:46.202131 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0312 11:37:46.202135 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0312 11:37:46.202139 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0312 11:37:46.202142 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0312 11:37:46.202160 1 controller.go:458] The operator is still being initialized I0312 11:37:46.202165 1 controller.go:481] The operator is healthy I0312 11:37:46.202653 1 prometheus_rules.go:88] Prometheus rules successfully created I0312 11:37:46.204688 1 tasks_processing.go:74] worker 29 stopped. I0312 11:37:46.204707 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 70.409807ms to process 0 records I0312 11:37:46.205059 1 tasks_processing.go:74] worker 24 stopped. I0312 11:37:46.205075 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 58.06744ms to process 0 records E0312 11:37:46.210317 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2732e98db1-fbdd-464c-8c99-1337a8a65565%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:55421->172.30.0.10:53: read: connection refused I0312 11:37:46.210332 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2732e98db1-fbdd-464c-8c99-1337a8a65565%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:55421->172.30.0.10:53: read: connection refused I0312 11:37:46.222722 1 tasks_processing.go:74] worker 21 stopped. E0312 11:37:46.222737 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0312 11:37:46.222743 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0312 11:37:46.222746 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0312 11:37:46.222760 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0312 11:37:46.222792 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0312 11:37:46.222801 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0312 11:37:46.222806 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0312 11:37:46.222832 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0312 11:37:46.222879 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0312 11:37:46.222889 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0312 11:37:46.222895 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 102.192723ms to process 7 records I0312 11:37:46.241988 1 tasks_processing.go:74] worker 28 stopped. I0312 11:37:46.242462 1 recorder.go:70] Recording config/version with fingerprint=8c40e65781936671d6ef2ba60c9f23e3035d99d61552c4028d7315d38d30f7ec I0312 11:37:46.242476 1 recorder.go:70] Recording config/id with fingerprint=0a14b17ca08e1cb324149db86104ea967017fbb51b8fc59948bd406319d574a7 I0312 11:37:46.242483 1 gather.go:177] gatherer "clusterconfig" function "version" took 92.957781ms to process 2 records I0312 11:37:46.259047 1 tasks_processing.go:74] worker 12 stopped. I0312 11:37:46.259070 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 113.67183ms to process 0 records I0312 11:37:46.277266 1 base_controller.go:82] Caches are synced for LoggingSyncer I0312 11:37:46.277353 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0312 11:37:46.281615 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0312 11:37:46.285119 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:50932->172.30.0.10:53: read: connection refused I0312 11:37:46.285132 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:50932->172.30.0.10:53: read: connection refused I0312 11:37:46.287175 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0312 11:37:46.300020 1 tasks_processing.go:74] worker 1 stopped. I0312 11:37:46.300030 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" E0312 11:37:46.300042 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0312 11:37:46.300049 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p055t8osssausu034arnp0jmbopcfps-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p055t8osssausu034arnp0jmbopcfps-primary-cert-bundle-secret" not found I0312 11:37:46.300144 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=c44ac7d3d009ae922fb25049a09f54284c84d1114446e0565a147df30f9882fc I0312 11:37:46.300160 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 179.725446ms to process 1 records I0312 11:37:46.610769 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0312 11:37:46.811082 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0312 11:37:47.179542 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0312 11:37:47.397491 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers I0312 11:37:47.397509 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes I0312 11:37:47.397772 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-sqrfm pod in namespace openshift-dns (previous: false). I0312 11:37:47.613750 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0312 11:37:47.640936 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sqrfm pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-sqrfm\" is waiting to start: ContainerCreating" I0312 11:37:47.640955 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-sqrfm\" is waiting to start: ContainerCreating" I0312 11:37:47.640966 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-sqrfm pod in namespace openshift-dns (previous: false). I0312 11:37:47.801920 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sqrfm pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-sqrfm\" is waiting to start: ContainerCreating" I0312 11:37:47.801940 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-sqrfm\" is waiting to start: ContainerCreating" I0312 11:37:47.801966 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4v84f pod in namespace openshift-dns (previous: false). I0312 11:37:48.001751 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0312 11:37:48.001771 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-tkjkh pod in namespace openshift-dns (previous: false). W0312 11:37:48.178971 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0312 11:37:48.216317 1 tasks_processing.go:74] worker 13 stopped. I0312 11:37:48.216367 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=489c965e367c4d4d7ae79f06c858465fa41376ba07a692f86fd78e9e11516491 I0312 11:37:48.216394 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ef0493586bc0f2ef97307a054b3547d4cba98f56abc7748d05d6dd4611f3300b I0312 11:37:48.216424 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0312 11:37:48.216449 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=e6cae3f0e10cf74bb3b3e8564d46ac7640bfe61dcf652ad4cf84076091538dd3 I0312 11:37:48.216476 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0312 11:37:48.216505 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=bc9a4d4181d4500e94b6a297fe684115ee8e06f9bd668d1336994b4d63cf04f6 I0312 11:37:48.216539 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=8f70ae6d2f89c706992f378d9d65fe5b21b323b8a13c5908dbf7981c0c0476f2 I0312 11:37:48.216566 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=f067e689ec5651ff33aaad1fbab6d389d4deccc0e68e30d9380a210b82fd9424 I0312 11:37:48.216583 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=086205ae9b2a396ff5ee9a521c69803e10f3aa58cbf4d20165a0b3a000110aa0 I0312 11:37:48.216603 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=d480c041d252fb8e71e259bdb30ce21f00bfad7d8256c1c7d5141dd96b65cd63 I0312 11:37:48.216613 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0312 11:37:48.216629 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=611da78ea1410f82d1c7d1534c6ff66e1eb6e0f0a1fae4c75989fe38555fc2ec I0312 11:37:48.216638 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0312 11:37:48.216655 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=dcc09f1c6999e7c641a9c235a7805423b9bb8de1b6f718000df049c5ef5aeb92 I0312 11:37:48.216677 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0312 11:37:48.216701 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=9f3c0d96d164171b0ce7be4b3746ddef45759d36724693744cb45bb16e2ffef2 I0312 11:37:48.216711 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0312 11:37:48.216728 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=e7f48ce93431c5a4f053429c605f88c85c5b55abdfccea0f66e3ffbe88c520e9 I0312 11:37:48.216879 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=ce769184a341955039d9799daa38e37e8ba068e90db8f35bf23dce26d642c6e9 I0312 11:37:48.216914 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0312 11:37:48.216957 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=e731d39e30af5a49fd3bde72ce4f291992ab08a0141b7e34370af44e39a4858c I0312 11:37:48.216984 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=ca4968d97d2e385a62684a71181b6c41f57e08feeeb5482d587564fe2fe2927c I0312 11:37:48.216995 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0312 11:37:48.217012 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e89b9c76e02ebf461e5065c39309dda64fcc023e9d04aa3d989ce9d793f7356b I0312 11:37:48.217022 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0312 11:37:48.217037 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=2c44cca3fa39729d798b7f5d234ed3f93eb39ff612d224c304296a305fb50617 I0312 11:37:48.217050 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=86c281fa64507a577179118513c410a4e2bac4b395373ea4b19fc8400c1a8cb2 I0312 11:37:48.217076 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=625bbe0700ba280b7cc491a0741c80640c8aa7226be8cd6992bb6cdac3a26053 I0312 11:37:48.217091 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=a75e8d28ae1d7dd353e74a4c22ccdd9555851507fa29ccd66d4572c95fa0e71c I0312 11:37:48.217124 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=a20e4b967dd7313f8738ba71f73e4401a09a5565432b7766b507c18009a6319f I0312 11:37:48.217137 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0312 11:37:48.217175 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=dc236bf331b41b27e4a74c8015a5231b2334b26001f1c3f2eeb0b4031ede45ad I0312 11:37:48.217197 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0312 11:37:48.217216 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0312 11:37:48.217235 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.067699976s to process 34 records I0312 11:37:48.231721 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-tkjkh pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-tkjkh\" is waiting to start: ContainerCreating" I0312 11:37:48.231742 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-tkjkh\" is waiting to start: ContainerCreating" I0312 11:37:48.231753 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7c6f8468b7-nt4p9 pod in namespace openshift-image-registry (previous: false). I0312 11:37:48.396612 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0312 11:37:48.396638 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7c6f8468b7-pnwwf pod in namespace openshift-image-registry (previous: false). I0312 11:37:48.602939 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7c6f8468b7-pnwwf pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7c6f8468b7-pnwwf\" is waiting to start: ContainerCreating" I0312 11:37:48.603039 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7c6f8468b7-pnwwf\" is waiting to start: ContainerCreating" I0312 11:37:48.603083 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7c849cbfd4-qhrcn pod in namespace openshift-image-registry (previous: false). I0312 11:37:48.796253 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0312 11:37:48.796272 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-qc5wx pod in namespace openshift-image-registry (previous: false). I0312 11:37:49.002677 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-qc5wx pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-qc5wx\" is waiting to start: ContainerCreating" I0312 11:37:49.002695 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-qc5wx\" is waiting to start: ContainerCreating" I0312 11:37:49.002706 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rmbqx pod in namespace openshift-image-registry (previous: false). W0312 11:37:49.179979 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0312 11:37:49.203342 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0312 11:37:49.203363 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5548d9dbf-kxtlc pod in namespace openshift-ingress (previous: false). I0312 11:37:49.396664 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0312 11:37:49.396685 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5548d9dbf-whqb9 pod in namespace openshift-ingress (previous: false). I0312 11:37:49.615800 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5548d9dbf-whqb9 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5548d9dbf-whqb9\" is waiting to start: ContainerCreating" I0312 11:37:49.615841 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5548d9dbf-whqb9\" is waiting to start: ContainerCreating" I0312 11:37:49.615853 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d56694779-zn2xc pod in namespace openshift-ingress (previous: false). I0312 11:37:49.819535 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5d56694779-zn2xc pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5d56694779-zn2xc\" is waiting to start: ContainerCreating" I0312 11:37:49.819560 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5d56694779-zn2xc\" is waiting to start: ContainerCreating" I0312 11:37:49.819574 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5c6hn pod in namespace openshift-ingress-canary (previous: false). I0312 11:37:50.001970 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5c6hn pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5c6hn\" is waiting to start: ContainerCreating" I0312 11:37:50.001990 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5c6hn\" is waiting to start: ContainerCreating" I0312 11:37:50.002008 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-znv97 pod in namespace openshift-kube-storage-version-migrator (previous: false). W0312 11:37:50.179062 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0312 11:37:50.211078 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-znv97 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0312 11:37:50.406205 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-c5fl8 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0312 11:37:50.617643 1 tasks_processing.go:74] worker 8 stopped. I0312 11:37:50.617731 1 recorder.go:70] Recording events/openshift-dns with fingerprint=73289f3c9df62e1db26f25a7c0914a7a47832ecfb7e5eba27e4d0ba3bde3f035 I0312 11:37:50.617798 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=f875168cf315903a54b7a56ba4287b280fed978b1a89a334e45650f502b6b6a5 I0312 11:37:50.617850 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ce11b1cbd3d48e9c6a1eea24919cd43553129c8d8c1ec5a0e3fe1d81ca674d4a I0312 11:37:50.617895 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=e46079f069b751303e234acd46b5e98a233d35c1c2c9eea738af3ea4d078bb34 I0312 11:37:50.617907 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=4be6108893719fb7050746ed79ce05ce741866631bed6af561c685525afaf45e I0312 11:37:50.617922 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=0ae185fa29d3e7378fc1bb21cfdd5b2fc619cb7721e00df7e54bd22d1632f83c I0312 11:37:50.617970 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=41615ae39478c3422d60a83796b56c72c646208637f5cb72561fc3480568e47e I0312 11:37:50.617985 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-znv97/migrator_current.log with fingerprint=a20fef87b60fc7261d74107b01e761f7959aa715e1e7684f112f379050313295 I0312 11:37:50.617993 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-znv97/graceful-termination_current.log with fingerprint=dc161e2bd2f7964a3aa5e009553a9d4391245d7eac689f7373f326b51a8fd9f6 I0312 11:37:50.618066 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-c5fl8/kube-storage-version-migrator-operator_current.log with fingerprint=124fd6247d266c350bfc261183bfa55b4a591f7d47ef48aa82cc6f01d144a6b2 I0312 11:37:50.618076 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.467391355s to process 10 records W0312 11:37:51.175691 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0312 11:37:51.175721 1 tasks_processing.go:74] worker 25 stopped. E0312 11:37:51.175733 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0312 11:37:51.175744 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0312 11:37:51.175758 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0312 11:37:51.175767 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.027293841s to process 1 records I0312 11:37:58.790643 1 configmapobserver.go:84] configmaps "insights-config" not found I0312 11:37:58.859355 1 tasks_processing.go:74] worker 5 stopped. I0312 11:37:58.859391 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0312 11:37:58.859403 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.705154313s to process 1 records I0312 11:37:58.989354 1 configmapobserver.go:84] configmaps "insights-config" not found I0312 11:37:59.529012 1 tasks_processing.go:74] worker 2 stopped. I0312 11:37:59.529322 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=1675fe780bd56f847caa71480c9940aaa99dd398e74ecdf1ad178c4833f9a52c I0312 11:37:59.529345 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.4086072s to process 1 records E0312 11:37:59.529434 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.409s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0312 11:37:59.530554 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0312 11:37:59.530573 1 periodic.go:212] Running workloads gatherer I0312 11:37:59.530593 1 tasks_processing.go:45] number of workers: 2 I0312 11:37:59.530607 1 tasks_processing.go:69] worker 1 listening for tasks. I0312 11:37:59.530612 1 tasks_processing.go:71] worker 1 working on workload_info task. I0312 11:37:59.530621 1 tasks_processing.go:69] worker 0 listening for tasks. I0312 11:37:59.530682 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0312 11:37:59.555036 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0312 11:37:59.563377 1 tasks_processing.go:74] worker 0 stopped. I0312 11:37:59.563398 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 32.675818ms to process 0 records I0312 11:37:59.566408 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (12ms) I0312 11:37:59.577985 1 gather_workloads_info.go:387] No image sha256:e769c66a73547a7f9dc0cd096deac5e195e193e231e232d124bbea6c989fc0ac (12ms) I0312 11:37:59.589499 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (11ms) I0312 11:37:59.601133 1 gather_workloads_info.go:387] No image sha256:b3adb38c4c5f4283e38ac14fbd4c1ccb1ab5a2e6db97002d4a0a86532c9f57f9 (12ms) I0312 11:37:59.612169 1 gather_workloads_info.go:387] No image sha256:e2bb91005aafe2b2a1cf98231daf533b77c424be875471059664c632d83beb7c (11ms) I0312 11:37:59.623348 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (11ms) I0312 11:37:59.634696 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (11ms) I0312 11:37:59.645787 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (11ms) I0312 11:37:59.657035 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (11ms) I0312 11:37:59.668966 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (12ms) I0312 11:37:59.680172 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (11ms) I0312 11:37:59.767574 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (87ms) I0312 11:37:59.867301 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0312 11:37:59.966690 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (99ms) I0312 11:38:00.067975 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (101ms) I0312 11:38:00.167633 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms) I0312 11:38:00.268793 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I0312 11:38:00.368457 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (100ms) I0312 11:38:00.467847 1 gather_workloads_info.go:387] No image sha256:c130d9ed2555ee901ae165b105445ce7550bb90c7d91f1430c6c36d960ce04ea (99ms) I0312 11:38:00.568237 1 gather_workloads_info.go:387] No image sha256:ec06a66459e1645424664e74b9d17cb30db18d10b5a8feb9bf05e1fc3b85aafa (100ms) I0312 11:38:00.667939 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms) I0312 11:38:00.768150 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms) I0312 11:38:00.816176 1 configmapobserver.go:84] configmaps "insights-config" not found I0312 11:38:00.868979 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (101ms) I0312 11:38:00.972023 1 gather_workloads_info.go:387] No image sha256:e36eaf2777370280753c5e56471c656b03903318a7a1777dec2fd7aa8939e445 (103ms) I0312 11:38:01.068056 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (96ms) I0312 11:38:01.168413 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms) I0312 11:38:01.269045 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (101ms) I0312 11:38:01.367735 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms) I0312 11:38:01.469010 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (101ms) I0312 11:38:01.567394 1 gather_workloads_info.go:387] No image sha256:c72808eca4192c623de8ff11fae45d61179141ff5270ae2e3c3199aef2ff1937 (98ms) I0312 11:38:01.667825 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (100ms) I0312 11:38:01.767846 1 gather_workloads_info.go:387] No image sha256:d93441b88bd020cae0a819977b23ca7be19e037d9bf634c16710864a08a4929f (100ms) I0312 11:38:01.867572 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I0312 11:38:01.967681 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms) I0312 11:38:02.068001 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I0312 11:38:02.168336 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (100ms) I0312 11:38:02.273325 1 gather_workloads_info.go:387] No image sha256:a677901ab281a207eb3e91187175b3881a1ee9a7e7e18758d76612e4b361f0f9 (105ms) I0312 11:38:02.368080 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (95ms) I0312 11:38:02.468521 1 gather_workloads_info.go:387] No image sha256:f1b21788197e9801d6826d91c565583fe54959d23d499c0fba2180d924eeee73 (100ms) I0312 11:38:02.569939 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (101ms) I0312 11:38:02.668156 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (98ms) I0312 11:38:02.767967 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms) I0312 11:38:02.768001 1 tasks_processing.go:74] worker 1 stopped. E0312 11:38:02.768014 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0312 11:38:02.768289 1 recorder.go:70] Recording config/workload_info with fingerprint=6357f78b5a62de5f25aa5a36205286f26a100b768901a693d9e572592e117bfe I0312 11:38:02.768304 1 gather.go:177] gatherer "workloads" function "workload_info" took 3.237382059s to process 1 records E0312 11:38:02.768327 1 periodic.go:250] "Unhandled Error" err="workloads failed after 3.237s with: function \"workload_info\" failed with an error" I0312 11:38:02.769439 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0312 11:38:02.769455 1 periodic.go:212] Running conditional gatherer I0312 11:38:02.778788 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0312 11:38:02.786170 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:44203->172.30.0.10:53: read: connection refused E0312 11:38:02.786454 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0312 11:38:02.786526 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0312 11:38:02.795455 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0312 11:38:02.795474 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795481 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795486 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795491 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795495 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795500 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795505 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795508 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0312 11:38:02.795513 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0312 11:38:02.795534 1 tasks_processing.go:45] number of workers: 3 I0312 11:38:02.795550 1 tasks_processing.go:69] worker 2 listening for tasks. I0312 11:38:02.795558 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0312 11:38:02.795565 1 tasks_processing.go:69] worker 1 listening for tasks. I0312 11:38:02.795564 1 tasks_processing.go:69] worker 0 listening for tasks. I0312 11:38:02.795576 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0312 11:38:02.795584 1 tasks_processing.go:74] worker 0 stopped. I0312 11:38:02.795592 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0312 11:38:02.795674 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0312 11:38:02.795691 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.516µs to process 1 records I0312 11:38:02.795734 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0312 11:38:02.795746 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.397µs to process 1 records I0312 11:38:02.795756 1 tasks_processing.go:74] worker 1 stopped. I0312 11:38:02.795927 1 tasks_processing.go:74] worker 2 stopped. I0312 11:38:02.795942 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 322.749µs to process 0 records I0312 11:38:02.795965 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:44203->172.30.0.10:53: read: connection refused I0312 11:38:02.795989 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0312 11:38:02.822360 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=c3fb4497fd67317942c0eeec434dc54de262398fe3d4e9b146aec624f8cc0c18 I0312 11:38:02.822539 1 diskrecorder.go:70] Writing 100 records to /var/lib/insights-operator/insights-2026-03-12-113802.tar.gz I0312 11:38:02.828753 1 diskrecorder.go:51] Wrote 100 records to disk in 6ms I0312 11:38:02.828803 1 periodic.go:281] Gathering cluster info every 2h0m0s I0312 11:38:02.828845 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0312 11:38:12.407869 1 configmapobserver.go:84] configmaps "insights-config" not found I0312 11:39:16.120354 1 diskrecorder.go:223] Found files to send: insights-2026-03-12-113802.tar.gz I0312 11:39:16.120388 1 insightsuploader.go:150] Checking archives to upload periodically every 15m24.950830989s I0312 11:39:16.120399 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0312 11:39:16.135537 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0312 11:39:16.391768 1 requests.go:87] Successfully reported id=2026-03-12T11:39:16Z x-rh-insights-request-id=acdcd5c2ce454abd9546ccb8c86f602a, wrote=47603 I0312 11:39:16.391918 1 insightsuploader.go:187] Uploaded report successfully in 271.512524ms I0312 11:39:16.391944 1 controller.go:119] Initializing last reported time to 2026-03-12T11:39:16Z I0312 11:39:16.392009 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0312 11:39:16.392018 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0312 11:39:16.392026 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0312 11:39:16.398569 1 controller.go:481] The operator is healthy I0312 11:39:20.325196 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="87d57ba714a3dd391a5dbb17a6cc6ea0cbc9677f55c4345133841385e43f784d") W0312 11:39:20.325231 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created I0312 11:39:20.325300 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0312 11:39:20.325317 1 base_controller.go:181] Shutting down ConfigController ... I0312 11:39:20.325333 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0312 11:39:20.325334 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="6d1a928c06642c2d913b5f67859825879be9c6de7f2feb31403c254dbcab91bd") I0312 11:39:20.325347 1 periodic.go:173] Shutting down I0312 11:39:20.325351 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0312 11:39:20.325360 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0312 11:39:20.325364 1 base_controller.go:113] All ConfigController workers have been terminated I0312 11:39:20.325369 1 base_controller.go:181] Shutting down LoggingSyncer ... E0312 11:39:20.325376 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0312 11:39:20.325382 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"