W0504 09:24:38.204028 1 cmd.go:257] Using insecure, self-signed certificates I0504 09:24:38.825121 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:38.825430 1 observer_polling.go:159] Starting file observer I0504 09:24:39.323449 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0504 09:24:39.323633 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0504 09:24:39.324248 1 secure_serving.go:57] Forcing use of http/1.1 only I0504 09:24:39.324262 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0504 09:24:39.324275 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0504 09:24:39.324282 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0504 09:24:39.324287 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0504 09:24:39.324291 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0504 09:24:39.324294 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0504 09:24:39.324298 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0504 09:24:39.332782 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0504 09:24:39.332802 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0504 09:24:39.332837 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0504 09:24:39.332854 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0504 09:24:39.332841 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0504 09:24:39.332882 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0504 09:24:39.333091 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1461041396/tls.crt::/tmp/serving-cert-1461041396/tls.key" I0504 09:24:39.333425 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0504 09:24:39.333455 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"30739a64-2df6-442b-9a64-2cd49f5181bf", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0504 09:24:39.333478 1 secure_serving.go:213] Serving securely on [::]:8443 I0504 09:24:39.333514 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0504 09:24:39.345636 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0504 09:24:39.345656 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0504 09:24:39.345795 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0504 09:24:39.358910 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0504 09:24:39.358935 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0504 09:24:39.369387 1 secretconfigobserver.go:119] support secret does not exist I0504 09:24:39.379663 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0504 09:24:39.388398 1 secretconfigobserver.go:119] support secret does not exist I0504 09:24:39.388703 1 recorder.go:161] Pruning old reports every 4h34m36s, max age is 288h0m0s I0504 09:24:39.397923 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0504 09:24:39.397935 1 periodic.go:209] Running clusterconfig gatherer I0504 09:24:39.397945 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0504 09:24:39.397975 1 tasks_processing.go:45] number of workers: 64 I0504 09:24:39.398015 1 tasks_processing.go:69] worker 63 listening for tasks. I0504 09:24:39.398023 1 tasks_processing.go:71] worker 63 working on feature_gates task. I0504 09:24:39.398025 1 tasks_processing.go:69] worker 27 listening for tasks. I0504 09:24:39.397935 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0504 09:24:39.398035 1 insightsreport.go:296] Starting report retriever I0504 09:24:39.398040 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0504 09:24:39.398040 1 tasks_processing.go:69] worker 45 listening for tasks. I0504 09:24:39.398048 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 09:24:39.398053 1 tasks_processing.go:69] worker 37 listening for tasks. I0504 09:24:39.398053 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 09:24:39.398058 1 tasks_processing.go:69] worker 2 listening for tasks. I0504 09:24:39.398059 1 tasks_processing.go:69] worker 36 listening for tasks. I0504 09:24:39.398063 1 tasks_processing.go:69] worker 42 listening for tasks. I0504 09:24:39.398067 1 tasks_processing.go:69] worker 43 listening for tasks. I0504 09:24:39.398073 1 tasks_processing.go:69] worker 44 listening for tasks. I0504 09:24:39.398070 1 tasks_processing.go:69] worker 3 listening for tasks. I0504 09:24:39.398077 1 tasks_processing.go:69] worker 4 listening for tasks. I0504 09:24:39.398084 1 tasks_processing.go:69] worker 16 listening for tasks. I0504 09:24:39.398074 1 tasks_processing.go:69] worker 41 listening for tasks. I0504 09:24:39.398091 1 tasks_processing.go:69] worker 38 listening for tasks. I0504 09:24:39.398084 1 tasks_processing.go:69] worker 28 listening for tasks. I0504 09:24:39.398085 1 tasks_processing.go:69] worker 39 listening for tasks. I0504 09:24:39.398093 1 tasks_processing.go:69] worker 15 listening for tasks. I0504 09:24:39.398102 1 tasks_processing.go:69] worker 40 listening for tasks. I0504 09:24:39.398091 1 tasks_processing.go:69] worker 17 listening for tasks. I0504 09:24:39.398108 1 tasks_processing.go:69] worker 35 listening for tasks. I0504 09:24:39.398109 1 tasks_processing.go:69] worker 9 listening for tasks. I0504 09:24:39.398114 1 tasks_processing.go:69] worker 23 listening for tasks. I0504 09:24:39.398116 1 tasks_processing.go:69] worker 24 listening for tasks. I0504 09:24:39.398117 1 tasks_processing.go:69] worker 10 listening for tasks. I0504 09:24:39.398121 1 tasks_processing.go:69] worker 30 listening for tasks. I0504 09:24:39.398122 1 tasks_processing.go:69] worker 31 listening for tasks. I0504 09:24:39.398125 1 tasks_processing.go:69] worker 25 listening for tasks. I0504 09:24:39.398123 1 tasks_processing.go:69] worker 20 listening for tasks. I0504 09:24:39.398130 1 tasks_processing.go:69] worker 26 listening for tasks. I0504 09:24:39.398108 1 tasks_processing.go:69] worker 19 listening for tasks. I0504 09:24:39.398133 1 tasks_processing.go:69] worker 13 listening for tasks. I0504 09:24:39.398129 1 tasks_processing.go:69] worker 34 listening for tasks. I0504 09:24:39.398139 1 tasks_processing.go:69] worker 22 listening for tasks. I0504 09:24:39.398142 1 tasks_processing.go:69] worker 14 listening for tasks. I0504 09:24:39.398128 1 tasks_processing.go:69] worker 6 listening for tasks. I0504 09:24:39.398101 1 tasks_processing.go:69] worker 33 listening for tasks. I0504 09:24:39.398143 1 tasks_processing.go:69] worker 7 listening for tasks. I0504 09:24:39.398153 1 tasks_processing.go:69] worker 60 listening for tasks. I0504 09:24:39.398092 1 tasks_processing.go:69] worker 29 listening for tasks. I0504 09:24:39.398160 1 tasks_processing.go:69] worker 57 listening for tasks. I0504 09:24:39.398153 1 tasks_processing.go:69] worker 46 listening for tasks. I0504 09:24:39.398164 1 tasks_processing.go:69] worker 59 listening for tasks. I0504 09:24:39.398166 1 tasks_processing.go:69] worker 53 listening for tasks. I0504 09:24:39.398161 1 tasks_processing.go:69] worker 47 listening for tasks. I0504 09:24:39.398172 1 tasks_processing.go:69] worker 48 listening for tasks. I0504 09:24:39.398173 1 tasks_processing.go:69] worker 62 listening for tasks. I0504 09:24:39.398176 1 tasks_processing.go:71] worker 27 working on openstack_controlplanes task. I0504 09:24:39.398181 1 tasks_processing.go:71] worker 2 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0504 09:24:39.398183 1 tasks_processing.go:71] worker 45 working on schedulers task. I0504 09:24:39.398183 1 tasks_processing.go:71] worker 37 working on active_alerts task. I0504 09:24:39.398190 1 tasks_processing.go:71] worker 62 working on monitoring_persistent_volumes task. I0504 09:24:39.398199 1 tasks_processing.go:71] worker 1 working on machines task. W0504 09:24:39.398222 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:39.398232 1 tasks_processing.go:71] worker 37 working on version task. I0504 09:24:39.398242 1 tasks_processing.go:71] worker 30 working on dvo_metrics task. I0504 09:24:39.398249 1 tasks_processing.go:71] worker 31 working on crds task. I0504 09:24:39.398391 1 tasks_processing.go:71] worker 25 working on machine_configs task. I0504 09:24:39.398469 1 tasks_processing.go:71] worker 3 working on cost_management_metrics_configs task. I0504 09:24:39.398518 1 tasks_processing.go:71] worker 26 working on qemu_kubevirt_launcher_logs task. I0504 09:24:39.398110 1 tasks_processing.go:69] worker 32 listening for tasks. I0504 09:24:39.398245 1 tasks_processing.go:71] worker 6 working on authentication task. I0504 09:24:39.398471 1 tasks_processing.go:71] worker 35 working on openshift_logging task. I0504 09:24:39.398567 1 tasks_processing.go:71] worker 22 working on sap_pods task. I0504 09:24:39.398124 1 tasks_processing.go:69] worker 11 listening for tasks. I0504 09:24:39.399471 1 tasks_processing.go:71] worker 11 working on aggregated_monitoring_cr_names task. I0504 09:24:39.398133 1 tasks_processing.go:69] worker 12 listening for tasks. I0504 09:24:39.398132 1 tasks_processing.go:69] worker 21 listening for tasks. I0504 09:24:39.398100 1 tasks_processing.go:69] worker 18 listening for tasks. I0504 09:24:39.398141 1 tasks_processing.go:69] worker 54 listening for tasks. I0504 09:24:39.398144 1 tasks_processing.go:69] worker 49 listening for tasks. I0504 09:24:39.398143 1 tasks_processing.go:69] worker 8 listening for tasks. I0504 09:24:39.398148 1 tasks_processing.go:69] worker 50 listening for tasks. I0504 09:24:39.398151 1 tasks_processing.go:69] worker 58 listening for tasks. I0504 09:24:39.398154 1 tasks_processing.go:69] worker 56 listening for tasks. I0504 09:24:39.398156 1 tasks_processing.go:69] worker 51 listening for tasks. I0504 09:24:39.398157 1 tasks_processing.go:69] worker 61 listening for tasks. I0504 09:24:39.398161 1 tasks_processing.go:69] worker 55 listening for tasks. I0504 09:24:39.398161 1 tasks_processing.go:69] worker 52 listening for tasks. I0504 09:24:39.398178 1 tasks_processing.go:71] worker 0 working on clusterroles task. I0504 09:24:39.398446 1 tasks_processing.go:71] worker 28 working on storage_classes task. I0504 09:24:39.398454 1 tasks_processing.go:71] worker 36 working on config_maps task. I0504 09:24:39.398458 1 tasks_processing.go:71] worker 42 working on oauths task. I0504 09:24:39.398462 1 tasks_processing.go:71] worker 43 working on service_accounts task. I0504 09:24:39.398465 1 tasks_processing.go:71] worker 44 working on lokistack task. I0504 09:24:39.398475 1 tasks_processing.go:71] worker 39 working on networks task. I0504 09:24:39.398480 1 tasks_processing.go:71] worker 15 working on machine_sets task. I0504 09:24:39.399577 1 tasks_processing.go:71] worker 51 working on ingress task. I0504 09:24:39.399581 1 tasks_processing.go:71] worker 49 working on storage_cluster task. I0504 09:24:39.399663 1 tasks_processing.go:71] worker 58 working on image_registries task. I0504 09:24:39.399738 1 tasks_processing.go:71] worker 55 working on pod_network_connectivity_checks task. I0504 09:24:39.398483 1 tasks_processing.go:71] worker 40 working on image_pruners task. I0504 09:24:39.399754 1 tasks_processing.go:71] worker 61 working on install_plans task. I0504 09:24:39.399666 1 tasks_processing.go:71] worker 52 working on jaegers task. I0504 09:24:39.398498 1 tasks_processing.go:71] worker 9 working on node_logs task. I0504 09:24:39.398504 1 tasks_processing.go:71] worker 24 working on cluster_apiserver task. I0504 09:24:39.398120 1 tasks_processing.go:69] worker 5 listening for tasks. I0504 09:24:39.400124 1 tasks_processing.go:71] worker 5 working on proxies task. I0504 09:24:39.398511 1 tasks_processing.go:71] worker 13 working on nodenetworkstates task. I0504 09:24:39.398574 1 tasks_processing.go:71] worker 34 working on operators_pods_and_events task. I0504 09:24:39.398580 1 tasks_processing.go:71] worker 7 working on image task. I0504 09:24:39.398584 1 tasks_processing.go:71] worker 33 working on ceph_cluster task. I0504 09:24:39.398598 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 38.44µs to process 0 records I0504 09:24:39.398607 1 tasks_processing.go:71] worker 14 working on silenced_alerts task. I0504 09:24:39.398603 1 tasks_processing.go:71] worker 57 working on certificate_signing_requests task. W0504 09:24:39.400370 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:39.400388 1 tasks_processing.go:74] worker 14 stopped. I0504 09:24:39.400399 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 62.313µs to process 0 records I0504 09:24:39.398604 1 tasks_processing.go:71] worker 19 working on validating_webhook_configurations task. I0504 09:24:39.398614 1 tasks_processing.go:71] worker 60 working on metrics task. W0504 09:24:39.400537 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:39.400555 1 tasks_processing.go:74] worker 60 stopped. I0504 09:24:39.400566 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 35.892µs to process 0 records I0504 09:24:39.398620 1 tasks_processing.go:71] worker 29 working on container_images task. I0504 09:24:39.398621 1 tasks_processing.go:71] worker 10 working on machine_config_pools task. I0504 09:24:39.400602 1 tasks_processing.go:71] worker 56 working on sap_config task. I0504 09:24:39.398623 1 tasks_processing.go:71] worker 16 working on infrastructures task. I0504 09:24:39.398628 1 tasks_processing.go:71] worker 53 working on machine_autoscalers task. I0504 09:24:39.398628 1 tasks_processing.go:71] worker 4 working on openstack_version task. I0504 09:24:39.398629 1 tasks_processing.go:71] worker 41 working on pdbs task. I0504 09:24:39.398633 1 tasks_processing.go:71] worker 46 working on container_runtime_configs task. I0504 09:24:39.398634 1 tasks_processing.go:71] worker 47 working on machine_healthchecks task. I0504 09:24:39.398636 1 tasks_processing.go:71] worker 38 working on overlapping_namespace_uids task. I0504 09:24:39.398638 1 tasks_processing.go:71] worker 59 working on sap_datahubs task. I0504 09:24:39.398641 1 tasks_processing.go:71] worker 48 working on nodes task. I0504 09:24:39.398763 1 tasks_processing.go:71] worker 32 working on tsdb_status task. W0504 09:24:39.402534 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:39.399544 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0504 09:24:39.399553 1 tasks_processing.go:71] worker 21 working on openstack_dataplanedeployments task. I0504 09:24:39.399558 1 tasks_processing.go:71] worker 50 working on ingress_certificates task. I0504 09:24:39.399570 1 tasks_processing.go:71] worker 8 working on olm_operators task. I0504 09:24:39.399574 1 tasks_processing.go:71] worker 18 working on openstack_dataplanenodesets task. I0504 09:24:39.399572 1 tasks_processing.go:71] worker 54 working on support_secret task. I0504 09:24:39.398487 1 tasks_processing.go:71] worker 17 working on openshift_machine_api_events task. I0504 09:24:39.398495 1 tasks_processing.go:71] worker 23 working on nodenetworkconfigurationpolicies task. I0504 09:24:39.398514 1 tasks_processing.go:71] worker 20 working on operators task. I0504 09:24:39.402937 1 tasks_processing.go:74] worker 32 stopped. I0504 09:24:39.402956 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 429.058µs to process 0 records I0504 09:24:39.404003 1 tasks_processing.go:74] worker 27 stopped. I0504 09:24:39.404034 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.81523ms to process 0 records I0504 09:24:39.404136 1 tasks_processing.go:74] worker 1 stopped. E0504 09:24:39.404149 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0504 09:24:39.404157 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.91816ms to process 0 records I0504 09:24:39.409596 1 tasks_processing.go:74] worker 55 stopped. E0504 09:24:39.409610 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0504 09:24:39.409622 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 9.80328ms to process 0 records I0504 09:24:39.409634 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 10.034411ms to process 0 records I0504 09:24:39.409641 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 10.032832ms to process 0 records I0504 09:24:39.409647 1 tasks_processing.go:74] worker 44 stopped. I0504 09:24:39.409645 1 tasks_processing.go:74] worker 15 stopped. I0504 09:24:39.412464 1 tasks_processing.go:74] worker 3 stopped. I0504 09:24:39.412492 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 13.941327ms to process 0 records I0504 09:24:39.412510 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 13.490025ms to process 0 records I0504 09:24:39.412518 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.483437ms to process 0 records I0504 09:24:39.412528 1 tasks_processing.go:74] worker 52 stopped. I0504 09:24:39.412536 1 tasks_processing.go:74] worker 35 stopped. I0504 09:24:39.413350 1 tasks_processing.go:74] worker 22 stopped. I0504 09:24:39.413364 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.178939ms to process 0 records I0504 09:24:39.413375 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 13.755582ms to process 0 records I0504 09:24:39.413380 1 tasks_processing.go:74] worker 49 stopped. I0504 09:24:39.413440 1 tasks_processing.go:74] worker 47 stopped. E0504 09:24:39.413446 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0504 09:24:39.413455 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 11.609575ms to process 0 records I0504 09:24:39.413460 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 13.181274ms to process 0 records I0504 09:24:39.413465 1 tasks_processing.go:74] worker 33 stopped. I0504 09:24:39.416399 1 tasks_processing.go:74] worker 18 stopped. I0504 09:24:39.416429 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 13.579511ms to process 0 records I0504 09:24:39.416439 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.789541ms to process 0 records I0504 09:24:39.416445 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 16.294692ms to process 0 records I0504 09:24:39.416452 1 tasks_processing.go:74] worker 56 stopped. I0504 09:24:39.416454 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.696639ms to process 0 records I0504 09:24:39.416459 1 tasks_processing.go:74] worker 46 stopped. I0504 09:24:39.416457 1 tasks_processing.go:74] worker 13 stopped. I0504 09:24:39.416467 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.223616ms to process 0 records I0504 09:24:39.416475 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 13.442803ms to process 0 records I0504 09:24:39.416479 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 15.334712ms to process 0 records I0504 09:24:39.416482 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 15.68294ms to process 0 records I0504 09:24:39.416485 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 13.474176ms to process 0 records I0504 09:24:39.416490 1 tasks_processing.go:74] worker 23 stopped. I0504 09:24:39.416493 1 tasks_processing.go:74] worker 59 stopped. I0504 09:24:39.416496 1 tasks_processing.go:74] worker 21 stopped. I0504 09:24:39.416499 1 tasks_processing.go:74] worker 4 stopped. I0504 09:24:39.416502 1 tasks_processing.go:74] worker 53 stopped. I0504 09:24:39.418600 1 tasks_processing.go:74] worker 16 stopped. I0504 09:24:39.419143 1 recorder.go:75] Recording config/infrastructure with fingerprint=a984451d0c87572e8efb03b06958682d15859ac34b2875d41f3e4bb599882200 I0504 09:24:39.419159 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 17.892701ms to process 1 records I0504 09:24:39.422765 1 tasks_processing.go:74] worker 24 stopped. I0504 09:24:39.422930 1 recorder.go:75] Recording config/apiserver with fingerprint=7da26d2ed569394846df6ff9dacae7fe0e34478dc32aea54ae53c9a3bf585c5f I0504 09:24:39.422944 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.74354ms to process 1 records I0504 09:24:39.423053 1 tasks_processing.go:74] worker 51 stopped. I0504 09:24:39.423123 1 recorder.go:75] Recording config/ingress with fingerprint=9d5054ce2ad0f700388fc21a53da83d9d8b1872f2b6b92024d729a7746921ccd I0504 09:24:39.423134 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.17885ms to process 1 records I0504 09:24:39.423257 1 tasks_processing.go:74] worker 42 stopped. I0504 09:24:39.423352 1 recorder.go:75] Recording config/oauth with fingerprint=0e625b9c52f2bbc64d9ae91f115bf145e51d2585fbaef768ef5491e2a2c4b5b4 I0504 09:24:39.423365 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 23.208518ms to process 1 records I0504 09:24:39.423438 1 recorder.go:75] Recording config/proxy with fingerprint=38df21180928f53b88cef6f77e5fc685da79aa168a56edf8d588cd0a84abf156 I0504 09:24:39.423457 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 22.853726ms to process 1 records I0504 09:24:39.423462 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 23.108167ms to process 0 records I0504 09:24:39.423437 1 tasks_processing.go:74] worker 5 stopped. I0504 09:24:39.423510 1 tasks_processing.go:74] worker 9 stopped. I0504 09:24:39.423528 1 recorder.go:75] Recording config/image with fingerprint=8f111afb70f6315d5900028e2c7b04fcd3210808249df5f2c00234aefa540588 I0504 09:24:39.423538 1 gather.go:177] gatherer "clusterconfig" function "image" took 23.0869ms to process 1 records I0504 09:24:39.423581 1 tasks_processing.go:74] worker 7 stopped. I0504 09:24:39.423653 1 tasks_processing.go:74] worker 6 stopped. I0504 09:24:39.423689 1 recorder.go:75] Recording config/authentication with fingerprint=47f3e742db5323d9705c88a11aa6e99444c2d848b9d8d94a81d1e00de30f5ceb I0504 09:24:39.423702 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 24.564062ms to process 1 records I0504 09:24:39.423782 1 tasks_processing.go:74] worker 40 stopped. I0504 09:24:39.423899 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=d9d78a32b8ffd829ba55b64cb4079fbb076e8aa3d55c97954da67ac63f3af659 I0504 09:24:39.423911 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 23.551482ms to process 1 records I0504 09:24:39.427037 1 tasks_processing.go:74] worker 63 stopped. I0504 09:24:39.427203 1 recorder.go:75] Recording config/featuregate with fingerprint=25e792cc30a024c0ae2ce8de8a7de502647ff4b9ca4da977da3c5404cebdb307 I0504 09:24:39.427226 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.001866ms to process 1 records I0504 09:24:39.427476 1 tasks_processing.go:74] worker 58 stopped. I0504 09:24:39.427664 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0504 09:24:39.427687 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0504 09:24:39.427694 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0504 09:24:39.427697 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0504 09:24:39.427719 1 controller.go:489] The operator is still being initialized I0504 09:24:39.427729 1 controller.go:512] The operator is healthy I0504 09:24:39.427885 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c7d35b391c45eec48cbd15b9e2ec9b31e19a992b87d14afaf9ef0e034758782d I0504 09:24:39.427903 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 27.77852ms to process 1 records I0504 09:24:39.427991 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a19aaaf0a3596cd6c504b962273425ad8509188177fbbebe01de4dd84ce2d218 I0504 09:24:39.428006 1 tasks_processing.go:74] worker 28 stopped. I0504 09:24:39.428012 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=4f2936309e987722be52afeae22a9a1b6491a230338465da542986e00c17b6b1 I0504 09:24:39.428035 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 27.854804ms to process 2 records E0504 09:24:39.428047 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0504 09:24:39.428054 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 24.563365ms to process 0 records I0504 09:24:39.428084 1 tasks_processing.go:74] worker 54 stopped. I0504 09:24:39.428169 1 tasks_processing.go:74] worker 39 stopped. I0504 09:24:39.428237 1 recorder.go:75] Recording config/network with fingerprint=f38edc6beae6f51f52895bfb4e46dad06c7171f541cb28bd347719c840fb0049 I0504 09:24:39.428253 1 gather.go:177] gatherer "clusterconfig" function "networks" took 28.036198ms to process 1 records I0504 09:24:39.428358 1 tasks_processing.go:74] worker 19 stopped. I0504 09:24:39.428479 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=6af90d6c250d682186e1adbe91b88066cc64a9e41ba40facb24c7d868a4076c6 I0504 09:24:39.428620 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=0384ffbe470debeed177d4bac04b122d0ee716337a53b1b3c95528238a3b5142 I0504 09:24:39.428662 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e1f6e04c28e5f67b95617bbba43c3f80186de06a1d06f7631128c708f012f337 I0504 09:24:39.428700 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=36d8a5162577788bcbee8f865a8f4db1da8bafa23e64f5d1abae9a8057ff5581 I0504 09:24:39.428733 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=0ad82ec235d75422ade28e1c8aeac94af8eb1621908fc9f7f3223d614f49f40b I0504 09:24:39.428797 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=d10d25c51c331a832f001ae3aa171373b8a4cf23e7e30ab17489db893891c021 I0504 09:24:39.428832 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=afa1a31284aa9cb6c4b3cb41ff269e98dc48f7a797cde8a41ee4cc018ea2ba42 I0504 09:24:39.428891 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=42a30964fdaa473694d80a0e0a196014f83b0c782de60bf0c6fd649703692452 I0504 09:24:39.428932 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=3dff1b2858915534f568ccc6c845fb5d0beab8907cfb1eeb9564f4d25bc4c3aa I0504 09:24:39.428975 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=144ddf763ab15d8cc539a2728c6eeec4458c87df4cbcdb62cdb47e18746de89d I0504 09:24:39.429009 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=17ac920ecf4ef006ce8e77a0c8110e19f6a58b8e6c8c8f547568cf2232bd3f7c I0504 09:24:39.429020 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 27.598546ms to process 11 records I0504 09:24:39.429175 1 tasks_processing.go:74] worker 48 stopped. I0504 09:24:39.430270 1 recorder.go:75] Recording config/node/ip-10-0-0-139.ec2.internal with fingerprint=6849463c895c7668bb644a651d26bbebba81badfc3b806a7f9747f04db9f21bd I0504 09:24:39.430504 1 recorder.go:75] Recording config/node/ip-10-0-2-148.ec2.internal with fingerprint=0aac5395a58a65445bda69ffb8c0e20b49b764c46de32f6afced2cf24bf89978 I0504 09:24:39.430518 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 25.960992ms to process 2 records I0504 09:24:39.430751 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=b77150caefbd2eaa8607293c70fbc9b08228c612e8f13fcef814b82d5b67b919 I0504 09:24:39.430773 1 gather_logs.go:145] no pods in namespace were found I0504 09:24:39.430909 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=74a31c629cd956ed3ad6872e096ac5dc1af1161dcf0cf97bc2a9de2a61d15d65 I0504 09:24:39.430946 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7205f9b44814d758daeadf8078bca5528ee08b585c73b06413a57d69bf359fc2 I0504 09:24:39.431035 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 27.489479ms to process 3 records I0504 09:24:39.431050 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 30.783797ms to process 0 records I0504 09:24:39.431188 1 tasks_processing.go:74] worker 41 stopped. I0504 09:24:39.431198 1 tasks_processing.go:74] worker 62 stopped. I0504 09:24:39.431267 1 tasks_processing.go:74] worker 45 stopped. I0504 09:24:39.431357 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=6d5c456034f4effe5e675d49f5d2c9c1fd1c76e3d1b5bf5e9fb13c578753c5fe I0504 09:24:39.431377 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 31.259174ms to process 1 records I0504 09:24:39.431397 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0504 09:24:39.431406 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 28.534679ms to process 1 records I0504 09:24:39.431430 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 30.117621ms to process 0 records I0504 09:24:39.431440 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 32.122636ms to process 0 records I0504 09:24:39.431444 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 28.157811ms to process 0 records I0504 09:24:39.431453 1 tasks_processing.go:74] worker 8 stopped. I0504 09:24:39.431457 1 tasks_processing.go:74] worker 38 stopped. I0504 09:24:39.431460 1 tasks_processing.go:74] worker 10 stopped. I0504 09:24:39.431468 1 tasks_processing.go:74] worker 26 stopped. I0504 09:24:39.432844 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0504 09:24:39.432935 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0504 09:24:39.432934 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0504 09:24:39.433382 1 tasks_processing.go:74] worker 17 stopped. I0504 09:24:39.433398 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 30.412662ms to process 0 records I0504 09:24:39.433490 1 tasks_processing.go:74] worker 12 stopped. I0504 09:24:39.433644 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=c08094547f23e87900a7af58aaca88fea491fb3fe8ff109bf8c4b1ef24f3f8c2 I0504 09:24:39.433697 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=6cb924b537087a1fdea03d12df477641bce543002236d6685eac7e833fc33166 I0504 09:24:39.433785 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=e4a063ffbc92d8a16372bb691deb7a8591c3bb05fc66c910102c489a5e5fb684 I0504 09:24:39.433800 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 30.861036ms to process 3 records I0504 09:24:39.434471 1 tasks_processing.go:74] worker 57 stopped. I0504 09:24:39.434492 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 34.114761ms to process 0 records W0504 09:24:39.436645 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 09:24:39.444616 1 tasks_processing.go:74] worker 37 stopped. I0504 09:24:39.444973 1 recorder.go:75] Recording config/version with fingerprint=880261a457da30f987272e7eb4b0ad8a5d7f443c17d9561db26f8e6ff7091a5f I0504 09:24:39.444994 1 recorder.go:75] Recording config/id with fingerprint=9b7f39dc8870ba0aa22931fbf5b4b41908ee5ba7c6f5bfe3f1ffdf3ac8755f5a I0504 09:24:39.445005 1 gather.go:177] gatherer "clusterconfig" function "version" took 46.370901ms to process 2 records I0504 09:24:39.445434 1 tasks_processing.go:74] worker 0 stopped. I0504 09:24:39.445691 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=9c02022f51d6c2bc6562ca24ff8eb2ee5edcee4dcbc54bebb09635df84a9fcc2 I0504 09:24:39.445843 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=fae7bbf179e8952c52324ac0016f5ffee0c0826acdac6144cda0981524d750bf I0504 09:24:39.445852 1 base_controller.go:82] Caches are synced for ConfigController I0504 09:24:39.445857 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 45.858097ms to process 2 records I0504 09:24:39.445861 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0504 09:24:39.445869 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 46.201285ms to process 0 records I0504 09:24:39.445878 1 tasks_processing.go:74] worker 11 stopped. I0504 09:24:39.447200 1 tasks_processing.go:74] worker 31 stopped. I0504 09:24:39.448689 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=39f500fa9bc3937282f0c0d1d5135a06a2392bf495c9c4f2de2974190370087b I0504 09:24:39.449043 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f1f1a452b84cc4a302e6ad9da2b4eac2537c3f2ad1bc4f5a1b2df751f4e8ad98 I0504 09:24:39.449105 1 gather.go:177] gatherer "clusterconfig" function "crds" took 48.893112ms to process 2 records I0504 09:24:39.451404 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0504 09:24:39.451474 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0504 09:24:39.451595 1 operator.go:288] started I0504 09:24:39.451622 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0504 09:24:39.452782 1 tasks_processing.go:74] worker 29 stopped. I0504 09:24:39.452865 1 recorder.go:75] Recording config/running_containers with fingerprint=9dce7461689f35281d321b060bbe7f778816379b1a33767fbe03e90800f8fd9e I0504 09:24:39.452882 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 52.193431ms to process 1 records I0504 09:24:39.453971 1 tasks_processing.go:74] worker 25 stopped. I0504 09:24:39.453995 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0504 09:24:39.454018 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 55.494233ms to process 1 records I0504 09:24:39.454609 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 09:24:39.457500 1 tasks_processing.go:74] worker 2 stopped. I0504 09:24:39.457516 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 59.309608ms to process 0 records I0504 09:24:39.465208 1 prometheus_rules.go:88] Prometheus rules successfully created I0504 09:24:39.465239 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0504 09:24:39.465249 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0504 09:24:39.465253 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0504 09:24:39.465258 1 controller.go:212] Source scaController *sca.Controller is not ready I0504 09:24:39.465263 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0504 09:24:39.465283 1 controller.go:489] The operator is still being initialized I0504 09:24:39.465296 1 controller.go:512] The operator is healthy E0504 09:24:39.473650 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2793319b1a-765c-43fa-9336-49f27210a3bb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:60514->172.30.0.10:53: read: connection refused I0504 09:24:39.473666 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2793319b1a-765c-43fa-9336-49f27210a3bb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:60514->172.30.0.10:53: read: connection refused I0504 09:24:39.475519 1 tasks_processing.go:74] worker 36 stopped. E0504 09:24:39.475535 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0504 09:24:39.475543 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0504 09:24:39.475549 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0504 09:24:39.475562 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0504 09:24:39.475600 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0504 09:24:39.475610 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0504 09:24:39.475617 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0504 09:24:39.475625 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0504 09:24:39.475669 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0504 09:24:39.475680 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0504 09:24:39.475690 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 75.776532ms to process 7 records I0504 09:24:39.528997 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0504 09:24:39.532826 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:44257->172.30.0.10:53: read: connection refused I0504 09:24:39.532844 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:44257->172.30.0.10:53: read: connection refused I0504 09:24:39.552293 1 base_controller.go:82] Caches are synced for LoggingSyncer I0504 09:24:39.552305 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0504 09:24:39.558042 1 tasks_processing.go:74] worker 50 stopped. E0504 09:24:39.558057 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0504 09:24:39.558064 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q30v0f5d08ldfuqipauo96f2043s3ip-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q30v0f5d08ldfuqipauo96f2043s3ip-primary-cert-bundle-secret" not found I0504 09:24:39.558127 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=02e87671d71d3b7b4fb247d85e14dd608ee05ffbb89c1beffabf0b632dcb6c49 I0504 09:24:39.558143 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 155.067388ms to process 1 records I0504 09:24:39.844114 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers I0504 09:24:39.844129 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes I0504 09:24:39.844564 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-cgmrz pod in namespace openshift-dns (previous: false). I0504 09:24:40.126517 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-cgmrz pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-cgmrz\" is waiting to start: ContainerCreating" I0504 09:24:40.126537 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-cgmrz\" is waiting to start: ContainerCreating" I0504 09:24:40.126544 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-cgmrz pod in namespace openshift-dns (previous: false). I0504 09:24:40.250129 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-cgmrz pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-cgmrz\" is waiting to start: ContainerCreating" I0504 09:24:40.250147 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-cgmrz\" is waiting to start: ContainerCreating" I0504 09:24:40.250158 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-z2wnq pod in namespace openshift-dns (previous: false). W0504 09:24:40.434563 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 09:24:40.474166 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-z2wnq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-z2wnq\" is waiting to start: ContainerCreating" I0504 09:24:40.474181 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-z2wnq\" is waiting to start: ContainerCreating" I0504 09:24:40.474189 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-z2wnq pod in namespace openshift-dns (previous: false). I0504 09:24:40.649403 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-z2wnq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-z2wnq\" is waiting to start: ContainerCreating" I0504 09:24:40.649435 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-z2wnq\" is waiting to start: ContainerCreating" I0504 09:24:40.649446 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dbswx pod in namespace openshift-dns (previous: false). I0504 09:24:40.849752 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 09:24:40.849829 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-l4nnj pod in namespace openshift-dns (previous: false). I0504 09:24:40.864020 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0504 09:24:41.049835 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 09:24:41.049902 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5dcdfdc68-hgb7q pod in namespace openshift-image-registry (previous: false). I0504 09:24:41.257682 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5dcdfdc68-hgb7q pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5dcdfdc68-hgb7q\" is waiting to start: ContainerCreating" I0504 09:24:41.257701 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5dcdfdc68-hgb7q\" is waiting to start: ContainerCreating" I0504 09:24:41.257717 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5dcdfdc68-s8rnd pod in namespace openshift-image-registry (previous: false). I0504 09:24:41.268726 1 tasks_processing.go:74] worker 20 stopped. I0504 09:24:41.268774 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=dac5db719e69fd0fac744756125357d6abbd0acda2d90cae099126fe75a5e8ed I0504 09:24:41.268808 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=1430c79ec4b6137aa357a42917ff5a629ec1ac2e4e8fb1cbd04b0f97395c9d0d I0504 09:24:41.268838 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0504 09:24:41.268862 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=d8f8fc7f9b946b7d57641622080e7aa83b08fb95b7e4aa26279df496ef12e0c5 I0504 09:24:41.268879 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0504 09:24:41.268901 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=85c7c8820c0c97e1b49b4f7dd70541d8652d834168915e041f3d9bb3c810a90f I0504 09:24:41.268937 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=430a94406f370f5ec81a5f50ce92eace2b34414975669da6e97ec4a7575af01f I0504 09:24:41.268976 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b61010b912860f4c164edb45e7dd4fc6ed7015b1a154e0f690e0332bdc930fe5 I0504 09:24:41.268989 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=4de027088e21677514ff22c42349054fecf3ff766c05b2ec094dce78e97df65d I0504 09:24:41.269006 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=8a7cd44cc4d31308bdb654e5ca8210beb0863e48eefcbfa207cca83d10dc91b5 I0504 09:24:41.269015 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0504 09:24:41.269032 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=3d495e2cdeddf160c7753855025c315dce9680dabb676ee5fe5c628f98e37312 I0504 09:24:41.269042 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0504 09:24:41.269057 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=a6f911594cbb29347c8f71e1dc867cc625c48207a32f4ecd0797c788b81f5984 I0504 09:24:41.269067 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0504 09:24:41.269080 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=6545ef3f5348b240e223e7b9df345015dd27e330fd89c7772283a2b7dc9eb166 I0504 09:24:41.269089 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0504 09:24:41.269105 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=fd9d6f7ec33a753375cb7ad1f6c37953a942ce8721f0a2fbc9dbb4c693172a03 I0504 09:24:41.269230 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=a6f62bcd73a081445b6300dfdde28406b5ad2e6c7e5234e94b291243c35df4fa I0504 09:24:41.269239 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0504 09:24:41.269246 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0504 09:24:41.269265 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0504 09:24:41.269286 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=d8f0cbc10d0582fe2d6611c4a3fe199808ef2ea09abbab40e9ea6f24043b40bd I0504 09:24:41.269310 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=1c8044c1daf51ecd253ab0e8656567e8404c34aae53a0632c5d79e0488ced3fa I0504 09:24:41.269319 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0504 09:24:41.269335 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=40481583c4810ec6c9ae06e5b75bc41ae4d7c47ce29f7b73c4a86427c841a3f0 I0504 09:24:41.269345 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0504 09:24:41.269358 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=8e9af7396214531f5947928fce124ba47081619989381fea845e790132a99eb1 I0504 09:24:41.269373 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=1a5752f0f9baa82749b3aa1bec4d80eb55e5196ff7d39ce429b624175219141b I0504 09:24:41.269388 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=3a7f31f686756f72462fe52bc71a1bd25213519feb2bc9d6659e4be11d1cf1e7 I0504 09:24:41.269403 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=d3439d1270526c93ea7f478fb6de35508f8f3d13b8036479380156e83d74082a I0504 09:24:41.269432 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=0771f0df9eb2b36d0693eec680d73d8243f866e93933513b101ef2f2aa148679 I0504 09:24:41.269463 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=52ef9e79d0694e5b23ac848d1cb49ab29d6889a71ccad8900d8e5018ba30480a I0504 09:24:41.269478 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0504 09:24:41.269486 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0504 09:24:41.269493 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.865949686s to process 35 records W0504 09:24:41.433065 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 09:24:41.449743 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5dcdfdc68-s8rnd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5dcdfdc68-s8rnd\" is waiting to start: ContainerCreating" I0504 09:24:41.449757 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5dcdfdc68-s8rnd\" is waiting to start: ContainerCreating" I0504 09:24:41.449802 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6fb8cc75bc-xx24f pod in namespace openshift-image-registry (previous: false). I0504 09:24:41.644172 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 09:24:41.644189 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-cnwg7 pod in namespace openshift-image-registry (previous: false). I0504 09:24:41.849344 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 09:24:41.849361 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-pmw6c pod in namespace openshift-image-registry (previous: false). I0504 09:24:42.056107 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 09:24:42.056175 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-54db5f9bf9-sqnns pod in namespace openshift-ingress (previous: false). I0504 09:24:42.251951 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-54db5f9bf9-sqnns pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-54db5f9bf9-sqnns\" is waiting to start: ContainerCreating" I0504 09:24:42.251979 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-54db5f9bf9-sqnns\" is waiting to start: ContainerCreating" I0504 09:24:42.252026 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-54db5f9bf9-wpxlv pod in namespace openshift-ingress (previous: false). W0504 09:24:42.432512 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 09:24:42.449328 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-54db5f9bf9-wpxlv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-54db5f9bf9-wpxlv\" is waiting to start: ContainerCreating" I0504 09:24:42.449343 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-54db5f9bf9-wpxlv\" is waiting to start: ContainerCreating" I0504 09:24:42.449375 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7b7b7c4b9-qzxcd pod in namespace openshift-ingress (previous: false). I0504 09:24:42.649289 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7b7b7c4b9-qzxcd pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7b7b7c4b9-qzxcd\" is waiting to start: ContainerCreating" I0504 09:24:42.649304 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7b7b7c4b9-qzxcd\" is waiting to start: ContainerCreating" I0504 09:24:42.649318 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7b5rz pod in namespace openshift-ingress-canary (previous: false). I0504 09:24:42.851244 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-7b5rz pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7b5rz\" is waiting to start: ContainerCreating" I0504 09:24:42.851261 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7b5rz\" is waiting to start: ContainerCreating" I0504 09:24:42.851273 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jz9mw pod in namespace openshift-ingress-canary (previous: false). I0504 09:24:43.049996 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-jz9mw pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jz9mw\" is waiting to start: ContainerCreating" I0504 09:24:43.050016 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jz9mw\" is waiting to start: ContainerCreating" I0504 09:24:43.050035 1 tasks_processing.go:74] worker 34 stopped. I0504 09:24:43.050115 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=19fdc777f8865b2d23fad99e363ad180414ac742c9dc723b712a5f3d062de406 I0504 09:24:43.050165 1 recorder.go:75] Recording events/openshift-dns with fingerprint=003bc152afb8de38cce7c27a9a790ae2c3dd768c90059c5fc741bd607e2ace60 I0504 09:24:43.050268 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=4c031ec459a16134540100355f4529bdff3a4fb8c6179abb0306b7e0e45099de I0504 09:24:43.050296 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=9e0bd646445f71b27879d85ecd43d7749f073cee76c7857ced3bc81c90424c57 I0504 09:24:43.050365 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=bfa69ca8051bad060d176508371528fd7082f1a13b6395e9f711ee0722cc0f34 I0504 09:24:43.050383 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=2d15513e54be80e5b30874f8faceff60fdc95d859d17139f70be0eacac18a7fe I0504 09:24:43.051813 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5dcdfdc68-hgb7q with fingerprint=d978465507979a69c1b79581efca2d49570b48033d396ee498f763494ab263af I0504 09:24:43.051917 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6fb8cc75bc-xx24f with fingerprint=8114d9379c810f62910c39de533e4ceae94eae18b69277140c4bb6889cc45713 I0504 09:24:43.052037 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-54db5f9bf9-sqnns with fingerprint=e4cab8428e2f91676a254be30e39347d1d31d7a26a873a356a39e3918f33c64b I0504 09:24:43.052138 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-54db5f9bf9-wpxlv with fingerprint=e08d03d8c6cc7f75f1f7ef08b873214c84cf966e445e45998f9bc90b3064d463 I0504 09:24:43.052232 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-7b7b7c4b9-qzxcd with fingerprint=f13fad2070762856677c572dae131fffa2357df44e96c407dc560ec662c8c2c7 I0504 09:24:43.052244 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.649815631s to process 11 records W0504 09:24:43.432880 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0504 09:24:44.429454 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0504 09:24:44.429474 1 tasks_processing.go:74] worker 30 stopped. E0504 09:24:44.429484 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0504 09:24:44.429495 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0504 09:24:44.429508 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0504 09:24:44.429518 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.031221409s to process 1 records I0504 09:24:45.679694 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 09:24:51.840729 1 tasks_processing.go:74] worker 61 stopped. I0504 09:24:51.840764 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0504 09:24:51.840777 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.440731748s to process 1 records I0504 09:24:52.607895 1 tasks_processing.go:74] worker 43 stopped. I0504 09:24:52.608188 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=6f02bbed9776fbc53f719d04062abe458034f9ac95b2963e439b1381b6c8e3c4 I0504 09:24:52.608207 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208250807s to process 1 records E0504 09:24:52.608262 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.21s with: function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0504 09:24:52.609382 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0504 09:24:52.609395 1 periodic.go:209] Running workloads gatherer I0504 09:24:52.609408 1 tasks_processing.go:45] number of workers: 2 I0504 09:24:52.609423 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 09:24:52.609427 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0504 09:24:52.609433 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 09:24:52.609508 1 tasks_processing.go:71] worker 0 working on workload_info task. I0504 09:24:52.632051 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 20s for image data I0504 09:24:52.643230 1 tasks_processing.go:74] worker 1 stopped. I0504 09:24:52.643243 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.791048ms to process 0 records I0504 09:24:52.643881 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (12ms) I0504 09:24:52.656825 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (13ms) I0504 09:24:52.676438 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (20ms) I0504 09:24:52.691002 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (15ms) I0504 09:24:52.702804 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (12ms) I0504 09:24:52.714710 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (12ms) I0504 09:24:52.741971 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (27ms) I0504 09:24:52.753194 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (11ms) I0504 09:24:52.764882 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (12ms) I0504 09:24:52.775568 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (11ms) I0504 09:24:52.786078 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (10ms) I0504 09:24:52.844004 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (58ms) I0504 09:24:52.946923 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (103ms) I0504 09:24:53.047614 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0504 09:24:53.144040 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (96ms) I0504 09:24:53.244263 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0504 09:24:53.344536 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0504 09:24:53.443566 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0504 09:24:53.543310 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (100ms) I0504 09:24:53.644120 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (101ms) I0504 09:24:53.744070 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0504 09:24:53.845068 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (101ms) I0504 09:24:53.944789 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0504 09:24:54.044047 1 gather_workloads_info.go:387] No image sha256:bffebf689df67af02a06b97d3d9bfcfdccd597350d132171ee68f3d0ed29a3f6 (99ms) I0504 09:24:54.144084 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0504 09:24:54.244401 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0504 09:24:54.343282 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0504 09:24:54.444692 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (101ms) I0504 09:24:54.543794 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (99ms) I0504 09:24:54.643543 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0504 09:24:54.743960 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0504 09:24:54.844161 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0504 09:24:54.944039 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (100ms) I0504 09:24:55.044120 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0504 09:24:55.044152 1 tasks_processing.go:74] worker 0 stopped. E0504 09:24:55.044161 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0504 09:24:55.044477 1 recorder.go:75] Recording config/workload_info with fingerprint=91a5c14acd3ab4a492678054f340d9e662eef6cf471bbaf6b451704263c4a517 I0504 09:24:55.044493 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.434627132s to process 1 records E0504 09:24:55.044528 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.435s with: function \"workload_info\" failed with an error" I0504 09:24:55.045629 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0504 09:24:55.045644 1 periodic.go:209] Running conditional gatherer I0504 09:24:55.053694 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0504 09:24:55.059936 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.10:45706->172.30.0.10:53: read: connection refused E0504 09:24:55.060183 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 09:24:55.060240 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0504 09:24:55.069964 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0504 09:24:55.069979 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.069984 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.069988 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.069991 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.069995 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.069998 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.070000 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.070003 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 09:24:55.070006 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0504 09:24:55.070020 1 tasks_processing.go:45] number of workers: 3 I0504 09:24:55.070026 1 tasks_processing.go:69] worker 2 listening for tasks. I0504 09:24:55.070030 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0504 09:24:55.070094 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 09:24:55.070106 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 09:24:55.070113 1 tasks_processing.go:74] worker 0 stopped. I0504 09:24:55.070113 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0504 09:24:55.070120 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0504 09:24:55.070130 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 944ns to process 1 records I0504 09:24:55.070125 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0504 09:24:55.070162 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0504 09:24:55.070174 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.207µs to process 1 records I0504 09:24:55.070179 1 tasks_processing.go:74] worker 1 stopped. I0504 09:24:55.070398 1 tasks_processing.go:74] worker 2 stopped. I0504 09:24:55.070432 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 251.212µs to process 0 records I0504 09:24:55.070466 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.10:45706->172.30.0.10:53: read: connection refused I0504 09:24:55.070484 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0504 09:24:55.097849 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=a388edb36b1673d16a76fa8691e4c34afd4a6d862dbd59e427d596cded4138ef I0504 09:24:55.097961 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-05-04-092455.tar.gz I0504 09:24:55.105759 1 diskrecorder.go:51] Wrote 103 records to disk in 7ms I0504 09:24:55.105789 1 periodic.go:278] Gathering cluster info every 2h0m0s I0504 09:24:55.105811 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0504 09:24:55.272942 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 09:24:55.478035 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 09:25:07.523232 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 09:25:53.826382 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="b8a3574626cb2bc1fd4820589297ec5e0b7406f0e682ba2a78ea1bef0b17d0db") W0504 09:25:53.826428 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0504 09:25:53.826476 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="d99fdbd956db0bd78ed429caea6b92f58b22b9f29c2b36d7500f638bd33c5759") I0504 09:25:53.826553 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="eb3319a07098c91717bc4100d383338e86aa0b0b1cb9bd414dd432bb17eb062c") I0504 09:25:53.826547 1 periodic.go:170] Shutting down I0504 09:25:53.826575 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0504 09:25:53.826588 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0504 09:25:53.826592 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0504 09:25:53.826600 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... E0504 09:25:53.826592 1 controller.go:299] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0504 09:25:53.826605 1 base_controller.go:181] Shutting down LoggingSyncer ... I0504 09:25:53.826614 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0504 09:25:53.826609 1 base_controller.go:181] Shutting down ConfigController ...