W0403 00:04:39.735096 1 cmd.go:257] Using insecure, self-signed certificates I0403 00:04:40.422943 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:04:40.423318 1 observer_polling.go:159] Starting file observer I0403 00:04:40.798415 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0403 00:04:40.798609 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0403 00:04:40.799163 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0403 00:04:40.799226 1 secure_serving.go:57] Forcing use of http/1.1 only W0403 00:04:40.799245 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0403 00:04:40.799250 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0403 00:04:40.799256 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0403 00:04:40.799260 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0403 00:04:40.799263 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0403 00:04:40.799265 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0403 00:04:40.803445 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0403 00:04:40.803513 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"5836dfcd-330b-4935-afdd-40c1f7d20498", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0403 00:04:40.809034 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0403 00:04:40.809063 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0403 00:04:40.809051 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0403 00:04:40.809107 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0403 00:04:40.809146 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0403 00:04:40.809146 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0403 00:04:40.809357 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1942870887/tls.crt::/tmp/serving-cert-1942870887/tls.key" I0403 00:04:40.810195 1 secure_serving.go:213] Serving securely on [::]:8443 I0403 00:04:40.810222 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0403 00:04:40.812749 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0403 00:04:40.812774 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0403 00:04:40.812883 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0403 00:04:40.825309 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0403 00:04:40.825333 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0403 00:04:40.850280 1 secretconfigobserver.go:119] support secret does not exist I0403 00:04:40.900979 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0403 00:04:40.910033 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0403 00:04:40.910108 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0403 00:04:40.910118 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0403 00:04:40.911481 1 secretconfigobserver.go:119] support secret does not exist I0403 00:04:40.911772 1 recorder.go:161] Pruning old reports every 6h23m10s, max age is 288h0m0s I0403 00:04:40.913591 1 base_controller.go:82] Caches are synced for ConfigController I0403 00:04:40.913603 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0403 00:04:40.931704 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:04:40.931884 1 periodic.go:209] Running clusterconfig gatherer I0403 00:04:40.931905 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0403 00:04:40.931918 1 insightsreport.go:296] Starting report retriever I0403 00:04:40.931926 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0403 00:04:40.931933 1 tasks_processing.go:45] number of workers: 64 I0403 00:04:40.931883 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0403 00:04:40.931966 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:04:40.931982 1 tasks_processing.go:69] worker 3 listening for tasks. I0403 00:04:40.931978 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0403 00:04:40.931990 1 tasks_processing.go:69] worker 2 listening for tasks. I0403 00:04:40.931957 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:04:40.932001 1 tasks_processing.go:69] worker 4 listening for tasks. I0403 00:04:40.932065 1 tasks_processing.go:69] worker 21 listening for tasks. I0403 00:04:40.932072 1 tasks_processing.go:71] worker 4 working on nodenetworkstates task. I0403 00:04:40.932074 1 tasks_processing.go:71] worker 21 working on pdbs task. I0403 00:04:40.932075 1 tasks_processing.go:69] worker 40 listening for tasks. I0403 00:04:40.932082 1 tasks_processing.go:69] worker 22 listening for tasks. I0403 00:04:40.932086 1 tasks_processing.go:69] worker 12 listening for tasks. I0403 00:04:40.932089 1 tasks_processing.go:69] worker 23 listening for tasks. I0403 00:04:40.932093 1 tasks_processing.go:69] worker 24 listening for tasks. I0403 00:04:40.932098 1 tasks_processing.go:69] worker 9 listening for tasks. I0403 00:04:40.932100 1 tasks_processing.go:69] worker 25 listening for tasks. I0403 00:04:40.932103 1 tasks_processing.go:69] worker 8 listening for tasks. I0403 00:04:40.932108 1 tasks_processing.go:69] worker 27 listening for tasks. I0403 00:04:40.932105 1 tasks_processing.go:69] worker 26 listening for tasks. I0403 00:04:40.932112 1 tasks_processing.go:69] worker 10 listening for tasks. I0403 00:04:40.932115 1 tasks_processing.go:69] worker 5 listening for tasks. I0403 00:04:40.932116 1 tasks_processing.go:69] worker 28 listening for tasks. I0403 00:04:40.932133 1 tasks_processing.go:69] worker 54 listening for tasks. I0403 00:04:40.932139 1 tasks_processing.go:69] worker 29 listening for tasks. I0403 00:04:40.932140 1 tasks_processing.go:69] worker 6 listening for tasks. I0403 00:04:40.932142 1 tasks_processing.go:69] worker 41 listening for tasks. I0403 00:04:40.932142 1 tasks_processing.go:69] worker 11 listening for tasks. I0403 00:04:40.932153 1 tasks_processing.go:69] worker 36 listening for tasks. I0403 00:04:40.932149 1 tasks_processing.go:69] worker 35 listening for tasks. I0403 00:04:40.932159 1 tasks_processing.go:69] worker 39 listening for tasks. I0403 00:04:40.932161 1 tasks_processing.go:69] worker 38 listening for tasks. I0403 00:04:40.932146 1 tasks_processing.go:69] worker 7 listening for tasks. I0403 00:04:40.932149 1 tasks_processing.go:69] worker 42 listening for tasks. I0403 00:04:40.932155 1 tasks_processing.go:69] worker 43 listening for tasks. I0403 00:04:40.932169 1 tasks_processing.go:69] worker 37 listening for tasks. I0403 00:04:40.932165 1 tasks_processing.go:69] worker 44 listening for tasks. I0403 00:04:40.932171 1 tasks_processing.go:69] worker 51 listening for tasks. I0403 00:04:40.932174 1 tasks_processing.go:69] worker 52 listening for tasks. I0403 00:04:40.932166 1 tasks_processing.go:69] worker 34 listening for tasks. I0403 00:04:40.932176 1 tasks_processing.go:69] worker 50 listening for tasks. I0403 00:04:40.932179 1 tasks_processing.go:69] worker 53 listening for tasks. I0403 00:04:40.932179 1 tasks_processing.go:69] worker 30 listening for tasks. I0403 00:04:40.932185 1 tasks_processing.go:69] worker 46 listening for tasks. I0403 00:04:40.932187 1 tasks_processing.go:69] worker 33 listening for tasks. I0403 00:04:40.932184 1 tasks_processing.go:69] worker 32 listening for tasks. I0403 00:04:40.932190 1 tasks_processing.go:69] worker 31 listening for tasks. I0403 00:04:40.932193 1 tasks_processing.go:69] worker 48 listening for tasks. I0403 00:04:40.932197 1 tasks_processing.go:69] worker 20 listening for tasks. I0403 00:04:40.932198 1 tasks_processing.go:69] worker 17 listening for tasks. I0403 00:04:40.932197 1 tasks_processing.go:69] worker 19 listening for tasks. I0403 00:04:40.932183 1 tasks_processing.go:69] worker 49 listening for tasks. I0403 00:04:40.932205 1 tasks_processing.go:69] worker 57 listening for tasks. I0403 00:04:40.932207 1 tasks_processing.go:69] worker 55 listening for tasks. I0403 00:04:40.932209 1 tasks_processing.go:69] worker 58 listening for tasks. I0403 00:04:40.932210 1 tasks_processing.go:69] worker 59 listening for tasks. I0403 00:04:40.932201 1 tasks_processing.go:69] worker 61 listening for tasks. I0403 00:04:40.932213 1 tasks_processing.go:69] worker 56 listening for tasks. I0403 00:04:40.932217 1 tasks_processing.go:71] worker 2 working on version task. I0403 00:04:40.932218 1 tasks_processing.go:71] worker 1 working on olm_operators task. I0403 00:04:40.932220 1 tasks_processing.go:71] worker 3 working on container_runtime_configs task. I0403 00:04:40.932222 1 tasks_processing.go:69] worker 13 listening for tasks. I0403 00:04:40.932225 1 tasks_processing.go:69] worker 63 listening for tasks. I0403 00:04:40.932223 1 tasks_processing.go:69] worker 15 listening for tasks. I0403 00:04:40.932234 1 tasks_processing.go:71] worker 40 working on sap_datahubs task. I0403 00:04:40.932236 1 tasks_processing.go:71] worker 9 working on qemu_kubevirt_launcher_logs task. I0403 00:04:40.932193 1 tasks_processing.go:69] worker 47 listening for tasks. I0403 00:04:40.932239 1 tasks_processing.go:71] worker 31 working on openshift_logging task. I0403 00:04:40.932247 1 tasks_processing.go:71] worker 20 working on ingress_certificates task. I0403 00:04:40.932253 1 tasks_processing.go:71] worker 27 working on infrastructures task. I0403 00:04:40.932257 1 tasks_processing.go:71] worker 54 working on service_accounts task. I0403 00:04:40.932187 1 tasks_processing.go:69] worker 45 listening for tasks. I0403 00:04:40.932304 1 tasks_processing.go:71] worker 45 working on machine_autoscalers task. I0403 00:04:40.932311 1 tasks_processing.go:71] worker 25 working on crds task. I0403 00:04:40.932315 1 tasks_processing.go:71] worker 37 working on aggregated_monitoring_cr_names task. I0403 00:04:40.932319 1 tasks_processing.go:71] worker 26 working on machine_healthchecks task. I0403 00:04:40.932535 1 tasks_processing.go:71] worker 29 working on sap_pods task. I0403 00:04:40.932706 1 tasks_processing.go:71] worker 41 working on install_plans task. I0403 00:04:40.932790 1 tasks_processing.go:71] worker 17 working on validating_webhook_configurations task. I0403 00:04:40.932902 1 tasks_processing.go:71] worker 61 working on sap_config task. I0403 00:04:40.932931 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0403 00:04:40.932209 1 tasks_processing.go:69] worker 18 listening for tasks. I0403 00:04:40.933159 1 tasks_processing.go:71] worker 18 working on image task. I0403 00:04:40.933573 1 tasks_processing.go:71] worker 35 working on pod_network_connectivity_checks task. I0403 00:04:40.932678 1 tasks_processing.go:71] worker 55 working on active_alerts task. I0403 00:04:40.933920 1 tasks_processing.go:71] worker 36 working on operators task. I0403 00:04:40.933964 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I0403 00:04:40.934033 1 tasks_processing.go:71] worker 44 working on overlapping_namespace_uids task. I0403 00:04:40.934112 1 tasks_processing.go:71] worker 12 working on openshift_machine_api_events task. W0403 00:04:40.934084 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:04:40.933653 1 tasks_processing.go:71] worker 39 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0403 00:04:40.934153 1 tasks_processing.go:71] worker 55 working on tsdb_status task. I0403 00:04:40.934175 1 tasks_processing.go:71] worker 51 working on container_images task. I0403 00:04:40.934196 1 tasks_processing.go:71] worker 50 working on openstack_controlplanes task. I0403 00:04:40.933925 1 tasks_processing.go:71] worker 59 working on image_pruners task. I0403 00:04:40.934346 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 279.016µs to process 0 records I0403 00:04:40.932241 1 tasks_processing.go:71] worker 48 working on storage_cluster task. I0403 00:04:40.932253 1 tasks_processing.go:71] worker 28 working on lokistack task. I0403 00:04:40.932248 1 tasks_processing.go:71] worker 47 working on cost_management_metrics_configs task. W0403 00:04:40.934039 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0403 00:04:40.934175 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:04:40.934845 1 tasks_processing.go:71] worker 52 working on metrics task. I0403 00:04:40.932575 1 tasks_processing.go:71] worker 22 working on openstack_dataplanenodesets task. I0403 00:04:40.933968 1 tasks_processing.go:71] worker 53 working on proxies task. I0403 00:04:40.932231 1 tasks_processing.go:71] worker 5 working on machine_configs task. W0403 00:04:40.934894 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:04:40.932231 1 tasks_processing.go:69] worker 14 listening for tasks. I0403 00:04:40.934903 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 818.955µs to process 0 records I0403 00:04:40.932237 1 tasks_processing.go:71] worker 63 working on config_maps task. I0403 00:04:40.934918 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 697.523µs to process 0 records I0403 00:04:40.932240 1 tasks_processing.go:71] worker 15 working on nodenetworkconfigurationpolicies task. I0403 00:04:40.932241 1 tasks_processing.go:71] worker 43 working on openstack_dataplanedeployments task. I0403 00:04:40.934930 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 49.104µs to process 0 records I0403 00:04:40.934935 1 tasks_processing.go:71] worker 55 working on cluster_apiserver task. I0403 00:04:40.932198 1 tasks_processing.go:69] worker 16 listening for tasks. I0403 00:04:40.935055 1 tasks_processing.go:71] worker 52 working on openstack_version task. I0403 00:04:40.932320 1 tasks_processing.go:71] worker 10 working on certificate_signing_requests task. I0403 00:04:40.932214 1 tasks_processing.go:69] worker 60 listening for tasks. I0403 00:04:40.932201 1 tasks_processing.go:71] worker 0 working on jaegers task. I0403 00:04:40.933685 1 tasks_processing.go:71] worker 24 working on ingress task. I0403 00:04:40.935599 1 tasks_processing.go:74] worker 16 stopped. I0403 00:04:40.935672 1 tasks_processing.go:71] worker 14 working on authentication task. I0403 00:04:40.932215 1 tasks_processing.go:69] worker 62 listening for tasks. I0403 00:04:40.935759 1 tasks_processing.go:74] worker 62 stopped. I0403 00:04:40.933725 1 tasks_processing.go:71] worker 7 working on monitoring_persistent_volumes task. I0403 00:04:40.933755 1 tasks_processing.go:71] worker 19 working on feature_gates task. I0403 00:04:40.933773 1 tasks_processing.go:71] worker 42 working on nodes task. I0403 00:04:40.936067 1 tasks_processing.go:74] worker 60 stopped. I0403 00:04:40.933799 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. I0403 00:04:40.933823 1 tasks_processing.go:71] worker 13 working on support_secret task. I0403 00:04:40.933826 1 tasks_processing.go:71] worker 49 working on machines task. I0403 00:04:40.933852 1 tasks_processing.go:71] worker 57 working on machine_sets task. I0403 00:04:40.933935 1 tasks_processing.go:71] worker 56 working on node_logs task. I0403 00:04:40.933948 1 tasks_processing.go:71] worker 8 working on dvo_metrics task. I0403 00:04:40.936358 1 tasks_processing.go:74] worker 3 stopped. I0403 00:04:40.936377 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 4.12764ms to process 0 records I0403 00:04:40.933975 1 tasks_processing.go:71] worker 38 working on schedulers task. I0403 00:04:40.933978 1 tasks_processing.go:71] worker 6 working on mutating_webhook_configurations task. I0403 00:04:40.933962 1 tasks_processing.go:71] worker 58 working on image_registries task. I0403 00:04:40.934047 1 tasks_processing.go:71] worker 33 working on ceph_cluster task. I0403 00:04:40.934052 1 tasks_processing.go:71] worker 34 working on networks task. I0403 00:04:40.934052 1 tasks_processing.go:71] worker 32 working on oauths task. I0403 00:04:40.934061 1 tasks_processing.go:71] worker 30 working on operators_pods_and_events task. I0403 00:04:40.934063 1 tasks_processing.go:71] worker 46 working on storage_classes task. I0403 00:04:40.942892 1 tasks_processing.go:74] worker 31 stopped. I0403 00:04:40.942910 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 10.626982ms to process 0 records I0403 00:04:40.943570 1 tasks_processing.go:74] worker 29 stopped. I0403 00:04:40.943589 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 10.963812ms to process 0 records I0403 00:04:40.943628 1 tasks_processing.go:74] worker 35 stopped. E0403 00:04:40.943643 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0403 00:04:40.943658 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 9.924482ms to process 0 records I0403 00:04:40.943892 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0403 00:04:40.943915 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0403 00:04:40.943921 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0403 00:04:40.943926 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0403 00:04:40.943940 1 tasks_processing.go:74] worker 45 stopped. I0403 00:04:40.943944 1 controller.go:489] The operator is still being initialized I0403 00:04:40.943955 1 controller.go:512] The operator is healthy I0403 00:04:40.943953 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.619088ms to process 0 records I0403 00:04:40.943965 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 11.700314ms to process 0 records I0403 00:04:40.943974 1 tasks_processing.go:74] worker 40 stopped. I0403 00:04:40.950649 1 tasks_processing.go:74] worker 27 stopped. I0403 00:04:40.951272 1 recorder.go:75] Recording config/infrastructure with fingerprint=49a939f2db5837749001eb0c58f0d11bd5bbdf0536b703eea99826203ae19260 I0403 00:04:40.951289 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 18.380504ms to process 1 records I0403 00:04:40.951357 1 recorder.go:75] Recording config/image with fingerprint=6a44ca56a99447a996bffda3ac5f443a0f405f5451a8c0e785ca3bd22b8b25d8 I0403 00:04:40.951365 1 gather.go:177] gatherer "clusterconfig" function "image" took 17.48918ms to process 1 records I0403 00:04:40.951373 1 tasks_processing.go:74] worker 18 stopped. I0403 00:04:40.956419 1 gather_logs.go:145] no pods in namespace were found I0403 00:04:40.956436 1 tasks_processing.go:74] worker 9 stopped. I0403 00:04:40.956450 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 24.186668ms to process 0 records I0403 00:04:40.973779 1 tasks_processing.go:74] worker 12 stopped. I0403 00:04:40.973805 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 39.623202ms to process 0 records I0403 00:04:40.974191 1 tasks_processing.go:74] worker 59 stopped. I0403 00:04:40.974524 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=d16d5e76303add9698c2789a5195d83df1d53b054770020af9cd2d2209cf47ab I0403 00:04:40.974541 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 39.833071ms to process 1 records I0403 00:04:40.974779 1 tasks_processing.go:74] worker 53 stopped. I0403 00:04:40.974862 1 recorder.go:75] Recording config/proxy with fingerprint=7712ed1e2d2189fb3d5c23ba2c3dfbe80b00545056e9f9494f4adebc3ba42cdb I0403 00:04:40.974878 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 39.888592ms to process 1 records I0403 00:04:40.974903 1 tasks_processing.go:74] worker 55 stopped. I0403 00:04:40.975041 1 recorder.go:75] Recording config/apiserver with fingerprint=7b223dfe798e12c33f0a5f382d0e04a57ee7061f78d0a76f3b7546bf0dabb3e7 I0403 00:04:40.975059 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 39.95437ms to process 1 records I0403 00:04:40.975308 1 tasks_processing.go:74] worker 50 stopped. I0403 00:04:40.975324 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 41.076955ms to process 0 records I0403 00:04:40.975332 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 40.384752ms to process 0 records I0403 00:04:40.975340 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 40.458612ms to process 0 records I0403 00:04:40.975344 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 40.385971ms to process 0 records I0403 00:04:40.975347 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 40.499588ms to process 0 records I0403 00:04:40.975350 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 40.581037ms to process 0 records I0403 00:04:40.975355 1 tasks_processing.go:74] worker 28 stopped. I0403 00:04:40.975358 1 tasks_processing.go:74] worker 15 stopped. I0403 00:04:40.975362 1 tasks_processing.go:74] worker 22 stopped. I0403 00:04:40.975365 1 tasks_processing.go:74] worker 43 stopped. I0403 00:04:40.975368 1 tasks_processing.go:74] worker 47 stopped. I0403 00:04:40.975636 1 tasks_processing.go:74] worker 24 stopped. I0403 00:04:40.975862 1 recorder.go:75] Recording config/ingress with fingerprint=4d4d905c7104a3437490b7ba1b3fceb24bcc89d697200742dd5b91c2189b2ede I0403 00:04:40.975881 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 40.048808ms to process 1 records I0403 00:04:40.975954 1 tasks_processing.go:74] worker 21 stopped. I0403 00:04:40.975991 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5ac03b3727a85e5bcb2ff42df40d095a84d4cd54ebd2934ee9400146c87283bb I0403 00:04:40.976020 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=606c504a2954075511e515c74030879ec14d1fe8a7cf32616622a9ff14b8427c I0403 00:04:40.976045 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=621c83b2c99217ef5dd654e6a8378cfaeff4001994b5086cc75b03770f6f4d64 I0403 00:04:40.976067 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 43.600183ms to process 3 records I0403 00:04:40.980323 1 tasks_processing.go:74] worker 49 stopped. E0403 00:04:40.980336 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0403 00:04:40.980344 1 gather.go:177] gatherer "clusterconfig" function "machines" took 44.158868ms to process 0 records I0403 00:04:40.981241 1 tasks_processing.go:74] worker 57 stopped. I0403 00:04:40.981263 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 45.011998ms to process 0 records I0403 00:04:40.981912 1 tasks_processing.go:74] worker 44 stopped. I0403 00:04:40.981950 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0403 00:04:40.981971 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 47.815952ms to process 1 records I0403 00:04:40.983100 1 tasks_processing.go:74] worker 33 stopped. I0403 00:04:40.983114 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 46.645782ms to process 0 records I0403 00:04:40.985675 1 tasks_processing.go:74] worker 4 stopped. I0403 00:04:40.985685 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 53.592244ms to process 0 records I0403 00:04:40.985924 1 tasks_processing.go:74] worker 61 stopped. I0403 00:04:40.985932 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 53.006874ms to process 0 records I0403 00:04:40.985949 1 tasks_processing.go:74] worker 48 stopped. I0403 00:04:40.985955 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 51.257369ms to process 0 records I0403 00:04:40.985960 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 50.892122ms to process 0 records I0403 00:04:40.985964 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 50.730739ms to process 0 records I0403 00:04:40.985968 1 tasks_processing.go:74] worker 0 stopped. I0403 00:04:40.985971 1 tasks_processing.go:74] worker 52 stopped. I0403 00:04:40.986154 1 tasks_processing.go:74] worker 1 stopped. I0403 00:04:40.986167 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 53.923559ms to process 0 records I0403 00:04:40.987987 1 tasks_processing.go:74] worker 26 stopped. E0403 00:04:40.988000 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0403 00:04:40.988010 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 55.45942ms to process 0 records I0403 00:04:40.989177 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0403 00:04:40.989186 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0403 00:04:40.989347 1 operator.go:288] started I0403 00:04:40.989365 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0403 00:04:40.990840 1 tasks_processing.go:74] worker 14 stopped. I0403 00:04:40.991054 1 recorder.go:75] Recording config/authentication with fingerprint=6371ef60c6886b3bca588ff724eb55edefe83abe392b7a351d7c980f9260c081 I0403 00:04:40.991069 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 55.155704ms to process 1 records I0403 00:04:40.991326 1 tasks_processing.go:74] worker 19 stopped. I0403 00:04:40.991454 1 recorder.go:75] Recording config/featuregate with fingerprint=4a7074d6024ba4d9cfe7792caf3f401c8df643f17a65646e4802dfe2ee3a7a08 I0403 00:04:40.991472 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 55.430916ms to process 1 records I0403 00:04:40.993862 1 tasks_processing.go:74] worker 17 stopped. I0403 00:04:40.994050 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=89f52b10ec66d99ed406062e04cff9a8405b6d1a625220364cc184be36069b98 I0403 00:04:40.994146 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=949660264176fc9aeea536c76ff14a11bf82d928fbecf3737cb92b26e6bc13f3 I0403 00:04:40.994170 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=d5e7864406ef06acf0ef4c622f7b0a5ad30ccb472077819b189d0baa70e88eb5 I0403 00:04:40.994196 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=973cd69ebb654e067dec785411140c5196c7717665875dfd52df4cff6770c165 I0403 00:04:40.994220 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=3dc102eb3dd4b47ab4572f35e8301a7be81b18717bb6e8db46e615f161917a1c I0403 00:04:40.994243 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=23fb6251a0e9c541788a3a40843028dfdbf3c5efba90c852d602853361b85983 I0403 00:04:40.994269 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=54e1855149f352dbb817de0cf7f7a99c4f7e67a431389dd75493ab075833db44 I0403 00:04:40.994321 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=84f56357eaaf8850341e91d0a83ae036d6dbcd0e75581afd04f38e4a8d56c3c0 I0403 00:04:40.994352 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=7c7cdd4b756e35f124bfda7bba1841e1655feabcdd941713069a902ac9af406c I0403 00:04:40.994383 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4d953c4865e9f48ebe95e4e95b9a3886cda6b7f9654cf8f1dbccd41c281364b6 I0403 00:04:40.994406 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=e522008ccacbe172b2375cbbb23ddcca7cab5851765914774f645ac28394c0dd I0403 00:04:40.994413 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 61.049168ms to process 11 records E0403 00:04:40.994425 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0403 00:04:40.994431 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 58.211275ms to process 0 records I0403 00:04:40.994437 1 tasks_processing.go:74] worker 13 stopped. I0403 00:04:40.994837 1 tasks_processing.go:74] worker 2 stopped. I0403 00:04:40.995065 1 recorder.go:75] Recording config/version with fingerprint=a220c297ca95f181220dcdd909a2fbb148fa9d378d9578498b60e96d80f90a33 I0403 00:04:40.995077 1 recorder.go:75] Recording config/id with fingerprint=605da291b88bc788c4905a28e6756503d37a3756cdc741daf602ed6e6a46ef35 I0403 00:04:40.995084 1 gather.go:177] gatherer "clusterconfig" function "version" took 62.608784ms to process 2 records I0403 00:04:40.998562 1 tasks_processing.go:74] worker 25 stopped. I0403 00:04:41.000215 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=afed89a309c0bd9d018820e97a32cc12eac4c5110c06c49dfa09f9c5351fe93b I0403 00:04:41.000573 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=aad3fb0b3c448c040400c38f3464fab8f0794611c341e57eb28548dde50bfae1 I0403 00:04:41.000589 1 gather.go:177] gatherer "clusterconfig" function "crds" took 66.236757ms to process 2 records I0403 00:04:41.000670 1 tasks_processing.go:74] worker 34 stopped. I0403 00:04:41.000742 1 recorder.go:75] Recording config/network with fingerprint=0ac9bed9053ae891ffdf1041a7518a8a0815a7a1c4e88d9e1f43477958de220f I0403 00:04:41.000752 1 gather.go:177] gatherer "clusterconfig" function "networks" took 63.586523ms to process 1 records I0403 00:04:41.003597 1 tasks_processing.go:74] worker 23 stopped. I0403 00:04:41.003797 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=e1fbc711fdba1726671f76f4975b47e3e9618851bc089104b5c01d100122efc0 I0403 00:04:41.003905 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=fd7617d09c97f9b9eac9887d20f36fd15ba88d9115f4f0bd95d0233408d61575 I0403 00:04:41.003915 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 70.649462ms to process 2 records I0403 00:04:41.004784 1 tasks_processing.go:74] worker 56 stopped. I0403 00:04:41.004800 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 68.441093ms to process 0 records I0403 00:04:41.004885 1 tasks_processing.go:74] worker 38 stopped. I0403 00:04:41.004965 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=6b90f948df3f691cb0cab89f503d5a163c613292b1ff396d32fef593176f0458 I0403 00:04:41.004980 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 68.483977ms to process 1 records I0403 00:04:41.005477 1 tasks_processing.go:74] worker 7 stopped. I0403 00:04:41.005491 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 69.70489ms to process 0 records I0403 00:04:41.008007 1 tasks_processing.go:74] worker 6 stopped. I0403 00:04:41.008144 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=9cff01879180b744622f4bb9f427a5b6410efed61f64b02f41e5b6c660377ba6 I0403 00:04:41.008177 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=30601ec8586e7ab327e8bd124f42b68b60515c9a56c0e187e1057511b17b7b10 I0403 00:04:41.008202 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=124c11e070e1be0742cd6b9325925623d09f64ad2c81bdf1bb8a309206b95c8d I0403 00:04:41.008211 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 71.600209ms to process 3 records I0403 00:04:41.008277 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=cae32a42e88843a5ad2b84cadfbeb9cfd84d5da926de7c8929a4b3bcda15a43a I0403 00:04:41.008290 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=5976e041ee7df9b649f1156bf776459668f454540e78db1d9cb40cd37ff74842 I0403 00:04:41.008295 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 71.338294ms to process 2 records I0403 00:04:41.008295 1 tasks_processing.go:74] worker 46 stopped. I0403 00:04:41.008365 1 tasks_processing.go:74] worker 42 stopped. I0403 00:04:41.008563 1 recorder.go:75] Recording config/node/ip-10-0-0-60.ec2.internal with fingerprint=fffa587e39f7b3eaf40cec65e6120abeb145a5fee39445e97d899cd3f3c8c0f8 I0403 00:04:41.008618 1 recorder.go:75] Recording config/node/ip-10-0-1-118.ec2.internal with fingerprint=2e3d3580e789026afd72b6702864f6c788c395a4ca8a2de10b1ef5967a23f665 I0403 00:04:41.008677 1 recorder.go:75] Recording config/node/ip-10-0-2-176.ec2.internal with fingerprint=8cd87d0726a5e2055850bc9b78607ddb194d671ed1ea86076e21a95071f60f2c I0403 00:04:41.008685 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 72.27192ms to process 3 records I0403 00:04:41.008694 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 75.964986ms to process 0 records I0403 00:04:41.008710 1 tasks_processing.go:74] worker 37 stopped. I0403 00:04:41.008779 1 tasks_processing.go:74] worker 58 stopped. I0403 00:04:41.008990 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=30eb65cc0d62b134663d475931136c824cfb883ee1df0a7bd47fce353aa27b94 I0403 00:04:41.009000 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 72.150322ms to process 1 records I0403 00:04:41.009710 1 tasks_processing.go:74] worker 10 stopped. I0403 00:04:41.009726 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 74.55323ms to process 0 records I0403 00:04:41.015757 1 prometheus_rules.go:88] Prometheus rules successfully created I0403 00:04:41.016005 1 tasks_processing.go:74] worker 32 stopped. I0403 00:04:41.016006 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0403 00:04:41.016029 1 controller.go:212] Source scaController *sca.Controller is not ready I0403 00:04:41.016038 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0403 00:04:41.016043 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0403 00:04:41.016048 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0403 00:04:41.016078 1 controller.go:489] The operator is still being initialized I0403 00:04:41.016086 1 controller.go:512] The operator is healthy I0403 00:04:41.016315 1 recorder.go:75] Recording config/oauth with fingerprint=b3b84f3fe2937d7786036d91922c40303a64a198cb8074bbe6178004710fc1ec I0403 00:04:41.016334 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 79.440748ms to process 1 records I0403 00:04:41.021631 1 tasks_processing.go:74] worker 39 stopped. I0403 00:04:41.021829 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 87.460289ms to process 0 records I0403 00:04:41.023447 1 tasks_processing.go:74] worker 51 stopped. I0403 00:04:41.023516 1 recorder.go:75] Recording config/running_containers with fingerprint=bc586c835708f57e6c59bd38dcc797e0553684adcb36d48c3b9ba8b59950f5f2 I0403 00:04:41.023530 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 89.253554ms to process 1 records W0403 00:04:41.023850 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. E0403 00:04:41.024000 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%275e256864-4b65-4588-addf-ad86811dec29%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.20:32916->172.30.0.10:53: read: connection refused I0403 00:04:41.024015 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%275e256864-4b65-4588-addf-ad86811dec29%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.20:32916->172.30.0.10:53: read: connection refused I0403 00:04:41.026592 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0403 00:04:41.029392 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.20:41530->172.30.0.10:53: read: connection refused I0403 00:04:41.029403 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.20:41530->172.30.0.10:53: read: connection refused I0403 00:04:41.055877 1 tasks_processing.go:74] worker 63 stopped. E0403 00:04:41.055893 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0403 00:04:41.055900 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0403 00:04:41.055903 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0403 00:04:41.055914 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0403 00:04:41.055943 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0403 00:04:41.055949 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0403 00:04:41.055954 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0403 00:04:41.055958 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0403 00:04:41.055995 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0403 00:04:41.056003 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0403 00:04:41.056008 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 120.946185ms to process 7 records I0403 00:04:41.090299 1 base_controller.go:82] Caches are synced for LoggingSyncer I0403 00:04:41.090318 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0403 00:04:41.099097 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0403 00:04:41.119646 1 tasks_processing.go:74] worker 20 stopped. E0403 00:04:41.119667 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0403 00:04:41.119675 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2peb3v13tqorl99u0dpovqhdtbg0tg61-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2peb3v13tqorl99u0dpovqhdtbg0tg61-primary-cert-bundle-secret" not found I0403 00:04:41.119747 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=820ee3c681ab90f6eb7b873f37bcbee1da4ab27685c792e56b0f20a79edb68f8 I0403 00:04:41.119763 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 187.378336ms to process 1 records W0403 00:04:42.022283 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:04:42.044879 1 tasks_processing.go:74] worker 11 stopped. I0403 00:04:42.044901 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 1.108770185s to process 0 records I0403 00:04:42.053617 1 tasks_processing.go:74] worker 5 stopped. I0403 00:04:42.053700 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0403 00:04:42.053729 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.11869584s to process 1 records I0403 00:04:42.218936 1 gather_cluster_operator_pods_and_events.go:121] Found 17 pods with 19 containers I0403 00:04:42.218951 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1324517 bytes I0403 00:04:42.218981 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mx49x pod in namespace openshift-dns (previous: false). I0403 00:04:42.423194 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0403 00:04:42.446698 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mx49x pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mx49x\" is waiting to start: ContainerCreating" I0403 00:04:42.446721 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mx49x\" is waiting to start: ContainerCreating" I0403 00:04:42.446729 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mx49x pod in namespace openshift-dns (previous: false). I0403 00:04:42.644821 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mx49x pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mx49x\" is waiting to start: ContainerCreating" I0403 00:04:42.644839 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mx49x\" is waiting to start: ContainerCreating" I0403 00:04:42.644851 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-84lgd pod in namespace openshift-dns (previous: false). I0403 00:04:42.824702 1 tasks_processing.go:74] worker 36 stopped. I0403 00:04:42.824712 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:42.824728 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-f744s pod in namespace openshift-dns (previous: false). I0403 00:04:42.824758 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=edfe97e5cac69887d1d7298a8992912456772dad86eb43a4ab0e89ec083eee41 I0403 00:04:42.824793 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=65c3972cabaadcf202f77d1efb58ea053f23e8740d8769cf2f0383e819a3f59e I0403 00:04:42.824824 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0403 00:04:42.824853 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=fe00f4f3b667e90353bda4ec065e51f34ec5aae589532eda5f6f461e0551d8e3 I0403 00:04:42.824872 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0403 00:04:42.824895 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=ea5684bce484aeed271c3a8035948b354029edac9f4a31e78b3e334a8789740b I0403 00:04:42.824942 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=3378e32811df67d87a870482797dda9f146124010deb22a6b07bc22c3177040a I0403 00:04:42.824966 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b7c1b34eac634dcc7b2d2ddc1766f34726ed7af3c002e287b128b04b762fba55 I0403 00:04:42.824980 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=0a7b2da5f8ffd4ec5f69220db635710c3195ee3ef0b5e984f5472fa2d991904b I0403 00:04:42.824997 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=367c591ae72f5ff01e2689193475980198a36c2adff89b1a8048a9fe5a9960a7 I0403 00:04:42.825006 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0403 00:04:42.825023 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=4bb0b6bb7d3cf0836fc71f6f6ee424b2c65b6a6e90cde31ca26766c0f6618c58 I0403 00:04:42.825032 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0403 00:04:42.825047 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=a1a57af4c4041c05f550efea4a154f3167b79757f70202feca7b82a725b72be7 I0403 00:04:42.825058 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0403 00:04:42.825079 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=32d740ebf33c7f54fa706db7ee86cca7b44fb3706b6c500260beccec77e84f41 I0403 00:04:42.825088 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0403 00:04:42.825103 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=2fc6065382cae2ed3f910c7fcba7e5ff87925f856e51ca053d986397e512abcf I0403 00:04:42.825247 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=1bdd9c427f333deeac69c4600e50726910f283fed58e4c9077f41dcb7cf0530b I0403 00:04:42.825258 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0403 00:04:42.825265 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0403 00:04:42.825285 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0403 00:04:42.825306 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=1e97a6c7a768ee729a99cb4dfd127eb7a1fc7a878465767c668a66821ff67e53 I0403 00:04:42.825330 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=2d0c7fe5232c77f362bad80a263c3dafaf1a43dbfb48394254aaaef0643fb0bb I0403 00:04:42.825339 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0403 00:04:42.825354 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a38f692669e2295153fff6c76d209aa8dfb000a8550799dd627ffb1a2c047a07 I0403 00:04:42.825364 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0403 00:04:42.825376 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=661f50872fbfa4ba5f0e9428e504d3cd6600ddde3890bd0b00e43650b11b180a I0403 00:04:42.825391 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=0d230d9cf9c32c36ba38c2d4e3c33a59ea214e6c5c304dea4a686acddd986bad I0403 00:04:42.825404 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=1f2352fa1d1018900c81579193adeb0a9e0b4b7b28347cb725faf81686af4979 I0403 00:04:42.825419 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c745c93c82845f49ec7a71141ad0b777f81e551c0f7b0651f8d7bdddd3ad2f75 I0403 00:04:42.825432 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f158a78a8dc64028cbe1e663f0ffde6de0254e74e42a76d095f000280bdd818e I0403 00:04:42.825457 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=994ce1d3bb629865d811bd7b537bdd04d6b56323745aa00483b38fcc3176380e I0403 00:04:42.825473 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0403 00:04:42.825479 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0403 00:04:42.825485 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.890724416s to process 35 records W0403 00:04:43.022274 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:04:43.048763 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:43.048783 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-pp22d pod in namespace openshift-dns (previous: false). I0403 00:04:43.247780 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:43.247799 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for image-pruner container image-pruner-29586240-95grr pod in namespace openshift-image-registry (previous: false). I0403 00:04:43.425418 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5945cf9cb4-7hnnd pod in namespace openshift-image-registry (previous: false). I0403 00:04:43.618252 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:43.618272 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6986846679-86s68 pod in namespace openshift-image-registry (previous: false). I0403 00:04:43.824878 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6986846679-86s68 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6986846679-86s68\" is waiting to start: ContainerCreating" I0403 00:04:43.824899 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6986846679-86s68\" is waiting to start: ContainerCreating" I0403 00:04:43.824910 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6986846679-dkzth pod in namespace openshift-image-registry (previous: false). W0403 00:04:44.021902 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:04:44.032033 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6986846679-dkzth pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6986846679-dkzth\" is waiting to start: ContainerCreating" I0403 00:04:44.032051 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6986846679-dkzth\" is waiting to start: ContainerCreating" I0403 00:04:44.032063 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5n7hs pod in namespace openshift-image-registry (previous: false). I0403 00:04:44.226799 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:44.226819 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6dft8 pod in namespace openshift-image-registry (previous: false). I0403 00:04:44.425883 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:44.425902 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-7l8vs pod in namespace openshift-image-registry (previous: false). I0403 00:04:44.625351 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:04:44.625371 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5966c9995-kwgll pod in namespace openshift-ingress (previous: false). I0403 00:04:44.826826 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5966c9995-kwgll pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5966c9995-kwgll\" is waiting to start: ContainerCreating" I0403 00:04:44.826844 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5966c9995-kwgll\" is waiting to start: ContainerCreating" I0403 00:04:44.826855 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5966c9995-nrxkf pod in namespace openshift-ingress (previous: false). W0403 00:04:45.022674 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:04:45.023953 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5966c9995-nrxkf pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5966c9995-nrxkf\" is waiting to start: ContainerCreating" I0403 00:04:45.023971 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5966c9995-nrxkf\" is waiting to start: ContainerCreating" I0403 00:04:45.023986 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-75db7df7dc-crdxp pod in namespace openshift-ingress (previous: false). I0403 00:04:45.224892 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-75db7df7dc-crdxp pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-75db7df7dc-crdxp\" is waiting to start: ContainerCreating" I0403 00:04:45.224914 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-75db7df7dc-crdxp\" is waiting to start: ContainerCreating" I0403 00:04:45.224926 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5gh79 pod in namespace openshift-ingress-canary (previous: false). I0403 00:04:45.425406 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5gh79 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5gh79\" is waiting to start: ContainerCreating" I0403 00:04:45.425429 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5gh79\" is waiting to start: ContainerCreating" I0403 00:04:45.425444 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-czp5l pod in namespace openshift-kube-storage-version-migrator (previous: false). I0403 00:04:45.626563 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-czp5l pod in namespace openshift-kube-storage-version-migrator (previous: false). I0403 00:04:45.825555 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-gb6j5 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). W0403 00:04:46.018797 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0403 00:04:46.018825 1 tasks_processing.go:74] worker 8 stopped. E0403 00:04:46.018834 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0403 00:04:46.018846 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0403 00:04:46.018861 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0403 00:04:46.018871 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.082466077s to process 1 records I0403 00:04:46.026664 1 tasks_processing.go:74] worker 30 stopped. I0403 00:04:46.026760 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=de510d96c0a30720c92e48d4bb5b9e2b0285b0c3525786106d4070a01f7e0366 I0403 00:04:46.026800 1 recorder.go:75] Recording events/openshift-dns with fingerprint=a1a976d30e4d0fb7e1d9c3e272f26cf01f06eeb9ff337b15e42cc38ab45ead2f I0403 00:04:46.026893 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=07293e27426901e69a6cf702966c2ed80c055dee579ffb831b98cd024618167b I0403 00:04:46.026922 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=3e7ea7dadafd6fd9fe23c23a97aef68a0f9f26eeafa9465290a4d44cd5722fff I0403 00:04:46.026963 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=a91fc5a5b624d98a05c4e3770d9bca1ffbcba488dcb94c407f99594eee555377 I0403 00:04:46.026974 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=60cdff0d5fbf1a3820935322046dedb79940082113011b925173221f4e59435c I0403 00:04:46.026987 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=3eb0353f116645245e020ba0ebec5e1735449d920f1643d4fd44b9e8c49b31b1 I0403 00:04:46.027037 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=eaa9a5dfd1a4e16daa73360db4014a7eadb607c94999541150a96feb50796024 I0403 00:04:46.027052 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-pruner-29586240-95grr/image-pruner_current.log with fingerprint=34b2f945b39d440404586b4f1f6752f91f070fbe6991ad583d2624afd07c2e21 I0403 00:04:46.027065 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-czp5l/migrator_current.log with fingerprint=f85d5bfca53326a05e7c0ad8a4a41148b2f89e6542aa67583b9063483fa7d003 I0403 00:04:46.027072 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-czp5l/graceful-termination_current.log with fingerprint=4582f309d7cc4e6bb3fd5dda7e8bddd0ac8f1017190e13e6790f79fc1af612d0 I0403 00:04:46.027161 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-gb6j5/kube-storage-version-migrator-operator_current.log with fingerprint=5d822a3cc11c023e1c8a1237757582b20bb86802fc5206c95966d3aa66e0dbf0 I0403 00:04:46.027171 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.089987719s to process 12 records I0403 00:04:53.586574 1 tasks_processing.go:74] worker 41 stopped. I0403 00:04:53.586614 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0403 00:04:53.586627 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.653779648s to process 1 records I0403 00:04:53.979494 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:04:54.341853 1 tasks_processing.go:74] worker 54 stopped. I0403 00:04:54.342152 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=e03550ff5cb13d4cd718a41a9755571c983753e7ec8a789b8fb921884bbb0f64 I0403 00:04:54.342168 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.409576378s to process 1 records E0403 00:04:54.342245 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.41s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0403 00:04:54.343349 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0403 00:04:54.343363 1 periodic.go:209] Running workloads gatherer I0403 00:04:54.343379 1 tasks_processing.go:45] number of workers: 2 I0403 00:04:54.343386 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:04:54.343390 1 tasks_processing.go:71] worker 1 working on workload_info task. I0403 00:04:54.343453 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:04:54.343531 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0403 00:04:54.368070 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0403 00:04:54.370823 1 tasks_processing.go:74] worker 0 stopped. I0403 00:04:54.370842 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.269136ms to process 0 records I0403 00:04:54.376671 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0403 00:04:54.385289 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0403 00:04:54.394200 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (9ms) I0403 00:04:54.402594 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (8ms) I0403 00:04:54.411468 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (9ms) I0403 00:04:54.419959 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (8ms) I0403 00:04:54.428280 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (8ms) I0403 00:04:54.436842 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (9ms) I0403 00:04:54.445403 1 gather_workloads_info.go:387] No image sha256:fab570ecdc9c3620b032bc4c5b44240f5ebac0bb9e48dfeea32bcd36eb462e5a (9ms) I0403 00:04:54.454058 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (9ms) I0403 00:04:54.479383 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (25ms) I0403 00:04:54.576995 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (98ms) I0403 00:04:54.677628 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0403 00:04:54.777926 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0403 00:04:54.877091 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0403 00:04:54.980504 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (103ms) I0403 00:04:55.077765 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (97ms) I0403 00:04:55.177919 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0403 00:04:55.277432 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0403 00:04:55.296735 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:04:55.381821 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (104ms) I0403 00:04:55.477026 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (95ms) I0403 00:04:55.498864 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:04:55.578008 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0403 00:04:55.679339 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0403 00:04:55.781995 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (103ms) I0403 00:04:55.877493 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (95ms) I0403 00:04:55.977471 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0403 00:04:56.077724 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0403 00:04:56.176948 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0403 00:04:56.277845 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (101ms) I0403 00:04:56.379361 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0403 00:04:56.477831 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (98ms) I0403 00:04:56.581006 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (103ms) I0403 00:04:56.678711 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (98ms) I0403 00:04:56.678747 1 tasks_processing.go:74] worker 1 stopped. E0403 00:04:56.678757 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0403 00:04:56.679010 1 recorder.go:75] Recording config/workload_info with fingerprint=b90b6fa247a5a1454a9292c9874dab2e5f603b6781b7bbf2f4d9da3fa67c1b04 I0403 00:04:56.679025 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.335346384s to process 1 records E0403 00:04:56.679051 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.335s with: function \"workload_info\" failed with an error" I0403 00:04:56.680157 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0403 00:04:56.680169 1 periodic.go:209] Running conditional gatherer I0403 00:04:56.687269 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0403 00:04:56.694111 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.20:44460->172.30.0.10:53: read: connection refused E0403 00:04:56.694505 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:04:56.694599 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0403 00:04:56.702825 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0403 00:04:56.702841 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702847 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702851 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702854 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702857 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702861 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702864 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702867 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:04:56.702870 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0403 00:04:56.702885 1 tasks_processing.go:45] number of workers: 3 I0403 00:04:56.702895 1 tasks_processing.go:69] worker 2 listening for tasks. I0403 00:04:56.702899 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0403 00:04:56.702907 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:04:56.702918 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0403 00:04:56.702917 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:04:56.702924 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0403 00:04:56.702934 1 tasks_processing.go:74] worker 1 stopped. I0403 00:04:56.702991 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0403 00:04:56.703004 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 700ns to process 1 records I0403 00:04:56.703034 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0403 00:04:56.703042 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.381µs to process 1 records I0403 00:04:56.703048 1 tasks_processing.go:74] worker 0 stopped. I0403 00:04:56.703198 1 tasks_processing.go:74] worker 2 stopped. I0403 00:04:56.703211 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 269.141µs to process 0 records I0403 00:04:56.703233 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.20:44460->172.30.0.10:53: read: connection refused I0403 00:04:56.703250 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0403 00:04:56.747782 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e81d357d89e6bab50d3c2ccfd9ca9dfb46dca87596b986342c3add6676255432 I0403 00:04:56.747916 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-04-03-000456.tar.gz I0403 00:04:56.754359 1 diskrecorder.go:51] Wrote 105 records to disk in 6ms I0403 00:04:56.754396 1 periodic.go:278] Gathering cluster info every 2h0m0s I0403 00:04:56.754410 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0403 00:05:10.846006 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:06:00.424392 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="b35cb61bb98bae47d06e186677c7ad72885d0b47597aec616244bd4d71617fca") W0403 00:06:00.424424 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0403 00:06:00.424487 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0403 00:06:00.424497 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="7aed259976a6e0d6e084f542d45fd5dbe3f90f8438bb4c6ebc5ae1e7b1327e08") I0403 00:06:00.424519 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0403 00:06:00.424535 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0403 00:06:00.424548 1 base_controller.go:181] Shutting down ConfigController ... I0403 00:06:00.424563 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0403 00:06:00.424566 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0403 00:06:00.424570 1 base_controller.go:113] All ConfigController workers have been terminated I0403 00:06:00.424575 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="4d8b02846f0312611a943612c6a84f817ef8aa830e3fbb58bf6fcb873b669bc1") I0403 00:06:00.424574 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0403 00:06:00.424579 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0403 00:06:00.424588 1 periodic.go:170] Shutting down I0403 00:06:00.424584 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0403 00:06:00.424593 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0403 00:06:00.424626 1 base_controller.go:181] Shutting down LoggingSyncer ... I0403 00:06:00.424631 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0403 00:06:00.424628 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0403 00:06:00.424640 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0403 00:06:00.424644 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1942870887/tls.crt::/tmp/serving-cert-1942870887/tls.key" I0403 00:06:00.424652 1 secure_serving.go:258] Stopped listening on [::]:8443 I0403 00:06:00.424669 1 genericapiserver.go:600] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening"