W0416 14:16:33.320183 1 cmd.go:257] Using insecure, self-signed certificates I0416 14:16:33.713303 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:33.713617 1 observer_polling.go:159] Starting file observer I0416 14:16:34.464507 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0416 14:16:34.464694 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0416 14:16:34.465235 1 secure_serving.go:57] Forcing use of http/1.1 only W0416 14:16:34.465270 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. I0416 14:16:34.465271 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0416 14:16:34.465277 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0416 14:16:34.465298 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0416 14:16:34.465302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0416 14:16:34.465305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0416 14:16:34.465307 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0416 14:16:34.469397 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0416 14:16:34.469464 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"81e072f5-ec62-4dfc-bb84-faf05fad5c57", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0416 14:16:34.470615 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0416 14:16:34.470626 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0416 14:16:34.470635 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0416 14:16:34.470638 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0416 14:16:34.470632 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0416 14:16:34.470651 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0416 14:16:34.470931 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2557940050/tls.crt::/tmp/serving-cert-2557940050/tls.key" I0416 14:16:34.471575 1 secure_serving.go:213] Serving securely on [::]:8443 I0416 14:16:34.472319 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0416 14:16:34.474646 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0416 14:16:34.474671 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0416 14:16:34.474770 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0416 14:16:34.480104 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 14:16:34.480121 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0416 14:16:34.484914 1 secretconfigobserver.go:119] support secret does not exist I0416 14:16:34.489581 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 14:16:34.493960 1 secretconfigobserver.go:119] support secret does not exist I0416 14:16:34.496816 1 recorder.go:161] Pruning old reports every 7h12m15s, max age is 288h0m0s I0416 14:16:34.502036 1 periodic.go:209] Running clusterconfig gatherer I0416 14:16:34.502047 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0416 14:16:34.502069 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0416 14:16:34.502095 1 tasks_processing.go:45] number of workers: 64 I0416 14:16:34.502104 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0416 14:16:34.502114 1 insightsreport.go:296] Starting report retriever I0416 14:16:34.502120 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0416 14:16:34.502130 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 14:16:34.502129 1 tasks_processing.go:69] worker 3 listening for tasks. I0416 14:16:34.502138 1 tasks_processing.go:69] worker 2 listening for tasks. I0416 14:16:34.502139 1 tasks_processing.go:69] worker 17 listening for tasks. I0416 14:16:34.502140 1 tasks_processing.go:69] worker 10 listening for tasks. I0416 14:16:34.502145 1 tasks_processing.go:69] worker 7 listening for tasks. I0416 14:16:34.502150 1 tasks_processing.go:69] worker 8 listening for tasks. I0416 14:16:34.502148 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 14:16:34.502153 1 tasks_processing.go:69] worker 9 listening for tasks. I0416 14:16:34.502159 1 tasks_processing.go:69] worker 14 listening for tasks. I0416 14:16:34.502157 1 tasks_processing.go:69] worker 11 listening for tasks. I0416 14:16:34.502164 1 tasks_processing.go:69] worker 35 listening for tasks. I0416 14:16:34.502164 1 tasks_processing.go:69] worker 15 listening for tasks. I0416 14:16:34.502169 1 tasks_processing.go:69] worker 44 listening for tasks. I0416 14:16:34.502171 1 tasks_processing.go:69] worker 12 listening for tasks. I0416 14:16:34.502173 1 tasks_processing.go:69] worker 5 listening for tasks. I0416 14:16:34.502177 1 tasks_processing.go:69] worker 16 listening for tasks. I0416 14:16:34.502161 1 tasks_processing.go:69] worker 6 listening for tasks. I0416 14:16:34.502188 1 tasks_processing.go:69] worker 46 listening for tasks. I0416 14:16:34.502190 1 tasks_processing.go:69] worker 51 listening for tasks. I0416 14:16:34.502201 1 tasks_processing.go:69] worker 45 listening for tasks. I0416 14:16:34.502263 1 tasks_processing.go:71] worker 45 working on feature_gates task. I0416 14:16:34.502286 1 tasks_processing.go:71] worker 10 working on machines task. I0416 14:16:34.502306 1 tasks_processing.go:69] worker 4 listening for tasks. I0416 14:16:34.502310 1 tasks_processing.go:69] worker 26 listening for tasks. I0416 14:16:34.502317 1 tasks_processing.go:71] worker 4 working on image_registries task. I0416 14:16:34.502320 1 tasks_processing.go:69] worker 41 listening for tasks. I0416 14:16:34.502322 1 tasks_processing.go:69] worker 19 listening for tasks. I0416 14:16:34.502318 1 tasks_processing.go:69] worker 43 listening for tasks. I0416 14:16:34.502332 1 tasks_processing.go:69] worker 22 listening for tasks. I0416 14:16:34.502332 1 tasks_processing.go:69] worker 23 listening for tasks. I0416 14:16:34.502338 1 tasks_processing.go:69] worker 24 listening for tasks. I0416 14:16:34.502342 1 tasks_processing.go:69] worker 20 listening for tasks. I0416 14:16:34.502342 1 tasks_processing.go:69] worker 30 listening for tasks. I0416 14:16:34.502337 1 tasks_processing.go:69] worker 53 listening for tasks. I0416 14:16:34.502348 1 tasks_processing.go:69] worker 21 listening for tasks. I0416 14:16:34.502345 1 tasks_processing.go:71] worker 15 working on cluster_apiserver task. I0416 14:16:34.502354 1 tasks_processing.go:69] worker 25 listening for tasks. I0416 14:16:34.502360 1 tasks_processing.go:69] worker 60 listening for tasks. I0416 14:16:34.502361 1 tasks_processing.go:69] worker 28 listening for tasks. I0416 14:16:34.502366 1 tasks_processing.go:69] worker 47 listening for tasks. I0416 14:16:34.502366 1 tasks_processing.go:69] worker 42 listening for tasks. I0416 14:16:34.502366 1 tasks_processing.go:69] worker 37 listening for tasks. I0416 14:16:34.502371 1 tasks_processing.go:69] worker 29 listening for tasks. I0416 14:16:34.502373 1 tasks_processing.go:71] worker 35 working on version task. I0416 14:16:34.502381 1 tasks_processing.go:69] worker 48 listening for tasks. I0416 14:16:34.502384 1 tasks_processing.go:71] worker 1 working on machine_sets task. I0416 14:16:34.502392 1 tasks_processing.go:69] worker 57 listening for tasks. I0416 14:16:34.502394 1 tasks_processing.go:69] worker 62 listening for tasks. I0416 14:16:34.502392 1 tasks_processing.go:69] worker 58 listening for tasks. I0416 14:16:34.502391 1 tasks_processing.go:69] worker 56 listening for tasks. I0416 14:16:34.502401 1 tasks_processing.go:69] worker 61 listening for tasks. I0416 14:16:34.502356 1 tasks_processing.go:71] worker 8 working on machine_configs task. I0416 14:16:34.502413 1 tasks_processing.go:71] worker 44 working on openstack_dataplanedeployments task. I0416 14:16:34.502353 1 tasks_processing.go:71] worker 7 working on openstack_controlplanes task. I0416 14:16:34.502571 1 tasks_processing.go:69] worker 38 listening for tasks. I0416 14:16:34.502357 1 tasks_processing.go:69] worker 40 listening for tasks. I0416 14:16:34.502348 1 tasks_processing.go:69] worker 52 listening for tasks. I0416 14:16:34.502361 1 tasks_processing.go:71] worker 9 working on machine_autoscalers task. I0416 14:16:34.502590 1 tasks_processing.go:69] worker 63 listening for tasks. I0416 14:16:34.502602 1 tasks_processing.go:71] worker 2 working on monitoring_persistent_volumes task. I0416 14:16:34.502359 1 tasks_processing.go:71] worker 0 working on image_pruners task. I0416 14:16:34.502805 1 tasks_processing.go:71] worker 3 working on operators task. I0416 14:16:34.502366 1 tasks_processing.go:71] worker 14 working on oauths task. I0416 14:16:34.502872 1 tasks_processing.go:71] worker 12 working on storage_cluster task. I0416 14:16:34.502370 1 tasks_processing.go:71] worker 11 working on config_maps task. I0416 14:16:34.503136 1 tasks_processing.go:71] worker 5 working on machine_healthchecks task. I0416 14:16:34.503199 1 tasks_processing.go:69] worker 59 listening for tasks. I0416 14:16:34.503217 1 tasks_processing.go:71] worker 17 working on openstack_version task. I0416 14:16:34.503218 1 tasks_processing.go:69] worker 49 listening for tasks. I0416 14:16:34.503231 1 tasks_processing.go:71] worker 46 working on node_logs task. I0416 14:16:34.502354 1 tasks_processing.go:69] worker 27 listening for tasks. I0416 14:16:34.503241 1 tasks_processing.go:71] worker 51 working on dvo_metrics task. I0416 14:16:34.503269 1 tasks_processing.go:69] worker 32 listening for tasks. I0416 14:16:34.503270 1 tasks_processing.go:71] worker 6 working on install_plans task. I0416 14:16:34.503280 1 tasks_processing.go:69] worker 31 listening for tasks. I0416 14:16:34.503287 1 tasks_processing.go:69] worker 33 listening for tasks. I0416 14:16:34.502378 1 tasks_processing.go:69] worker 55 listening for tasks. I0416 14:16:34.502377 1 tasks_processing.go:69] worker 39 listening for tasks. I0416 14:16:34.502409 1 tasks_processing.go:71] worker 16 working on nodenetworkstates task. I0416 14:16:34.502372 1 tasks_processing.go:69] worker 54 listening for tasks. I0416 14:16:34.503507 1 tasks_processing.go:71] worker 54 working on lokistack task. I0416 14:16:34.503533 1 tasks_processing.go:71] worker 29 working on authentication task. I0416 14:16:34.503664 1 tasks_processing.go:71] worker 30 working on clusterroles task. I0416 14:16:34.503674 1 tasks_processing.go:71] worker 53 working on operators_pods_and_events task. I0416 14:16:34.503670 1 tasks_processing.go:71] worker 60 working on silenced_alerts task. I0416 14:16:34.503715 1 tasks_processing.go:71] worker 47 working on schedulers task. I0416 14:16:34.504051 1 tasks_processing.go:69] worker 50 listening for tasks. W0416 14:16:34.504067 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:34.504077 1 tasks_processing.go:69] worker 34 listening for tasks. I0416 14:16:34.504086 1 tasks_processing.go:69] worker 18 listening for tasks. I0416 14:16:34.504095 1 tasks_processing.go:69] worker 36 listening for tasks. I0416 14:16:34.504100 1 tasks_processing.go:69] worker 13 listening for tasks. I0416 14:16:34.504142 1 tasks_processing.go:71] worker 50 working on aggregated_monitoring_cr_names task. I0416 14:16:34.504164 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 88.396µs to process 0 records I0416 14:16:34.504177 1 tasks_processing.go:71] worker 52 working on sap_datahubs task. I0416 14:16:34.504191 1 tasks_processing.go:71] worker 21 working on container_runtime_configs task. I0416 14:16:34.504278 1 tasks_processing.go:71] worker 25 working on tsdb_status task. W0416 14:16:34.504306 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:34.504338 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 32.179µs to process 0 records I0416 14:16:34.504363 1 tasks_processing.go:71] worker 32 working on ceph_cluster task. I0416 14:16:34.504515 1 tasks_processing.go:71] worker 58 working on openstack_dataplanenodesets task. I0416 14:16:34.504626 1 tasks_processing.go:71] worker 34 working on validating_webhook_configurations task. I0416 14:16:34.504663 1 tasks_processing.go:71] worker 33 working on networks task. I0416 14:16:34.504711 1 tasks_processing.go:71] worker 63 working on pdbs task. I0416 14:16:34.504728 1 tasks_processing.go:71] worker 42 working on ingress task. I0416 14:16:34.504754 1 tasks_processing.go:71] worker 36 working on cost_management_metrics_configs task. I0416 14:16:34.504842 1 tasks_processing.go:71] worker 13 working on image task. I0416 14:16:34.504871 1 tasks_processing.go:71] worker 48 working on openshift_machine_api_events task. I0416 14:16:34.504916 1 tasks_processing.go:71] worker 49 working on certificate_signing_requests task. I0416 14:16:34.505008 1 tasks_processing.go:71] worker 31 working on nodes task. I0416 14:16:34.505027 1 tasks_processing.go:71] worker 56 working on support_secret task. I0416 14:16:34.505126 1 tasks_processing.go:71] worker 55 working on proxies task. I0416 14:16:34.505168 1 tasks_processing.go:71] worker 27 working on sap_pods task. I0416 14:16:34.503710 1 tasks_processing.go:71] worker 28 working on infrastructures task. I0416 14:16:34.505311 1 tasks_processing.go:71] worker 41 working on openshift_logging task. I0416 14:16:34.504524 1 tasks_processing.go:74] worker 25 stopped. I0416 14:16:34.504789 1 tasks_processing.go:71] worker 57 working on pod_network_connectivity_checks task. I0416 14:16:34.505341 1 tasks_processing.go:71] worker 37 working on ingress_certificates task. I0416 14:16:34.505345 1 tasks_processing.go:71] worker 40 working on service_accounts task. I0416 14:16:34.505346 1 tasks_processing.go:71] worker 22 working on sap_config task. I0416 14:16:34.504530 1 tasks_processing.go:71] worker 60 working on qemu_kubevirt_launcher_logs task. I0416 14:16:34.505556 1 tasks_processing.go:71] worker 23 working on container_images task. I0416 14:16:34.505315 1 tasks_processing.go:71] worker 62 working on crds task. I0416 14:16:34.505657 1 tasks_processing.go:71] worker 43 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0416 14:16:34.505658 1 tasks_processing.go:71] worker 20 working on olm_operators task. I0416 14:16:34.505179 1 tasks_processing.go:71] worker 59 working on storage_classes task. I0416 14:16:34.506137 1 tasks_processing.go:71] worker 39 working on nodenetworkconfigurationpolicies task. I0416 14:16:34.506152 1 tasks_processing.go:71] worker 24 working on machine_config_pools task. I0416 14:16:34.506162 1 tasks_processing.go:71] worker 38 working on mutating_webhook_configurations task. I0416 14:16:34.506231 1 tasks_processing.go:71] worker 61 working on metrics task. I0416 14:16:34.506239 1 tasks_processing.go:71] worker 18 working on overlapping_namespace_uids task. W0416 14:16:34.506289 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:34.506304 1 tasks_processing.go:74] worker 61 stopped. I0416 14:16:34.506314 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 57.081µs to process 0 records I0416 14:16:34.506319 1 tasks_processing.go:71] worker 26 working on active_alerts task. W0416 14:16:34.506343 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:34.506359 1 tasks_processing.go:74] worker 26 stopped. I0416 14:16:34.506369 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 30.152µs to process 0 records I0416 14:16:34.506143 1 tasks_processing.go:71] worker 19 working on jaegers task. I0416 14:16:34.507798 1 tasks_processing.go:74] worker 7 stopped. I0416 14:16:34.507813 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.308889ms to process 0 records I0416 14:16:34.507835 1 tasks_processing.go:74] worker 1 stopped. I0416 14:16:34.507848 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.440984ms to process 0 records I0416 14:16:34.507952 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0416 14:16:34.507970 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0416 14:16:34.507978 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 14:16:34.507983 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0416 14:16:34.507996 1 controller.go:489] The operator is still being initialized I0416 14:16:34.508001 1 controller.go:512] The operator is healthy I0416 14:16:34.509409 1 tasks_processing.go:74] worker 45 stopped. I0416 14:16:34.509613 1 recorder.go:75] Recording config/featuregate with fingerprint=853136612d424060352bda3c9e6b316b7bf4e9fe51407c2cc8ad24d003c5c22c I0416 14:16:34.509633 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 7.129243ms to process 1 records I0416 14:16:34.514584 1 tasks_processing.go:74] worker 12 stopped. I0416 14:16:34.514597 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 11.69547ms to process 0 records I0416 14:16:34.514636 1 tasks_processing.go:74] worker 9 stopped. I0416 14:16:34.514648 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.03864ms to process 0 records I0416 14:16:34.514747 1 tasks_processing.go:74] worker 10 stopped. E0416 14:16:34.514762 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0416 14:16:34.514772 1 gather.go:177] gatherer "clusterconfig" function "machines" took 12.433391ms to process 0 records I0416 14:16:34.515668 1 tasks_processing.go:74] worker 16 stopped. I0416 14:16:34.515684 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 12.258025ms to process 0 records I0416 14:16:34.515724 1 tasks_processing.go:74] worker 32 stopped. I0416 14:16:34.515735 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 11.35019ms to process 0 records E0416 14:16:34.515744 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0416 14:16:34.515753 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.59397ms to process 0 records I0416 14:16:34.515763 1 tasks_processing.go:74] worker 5 stopped. I0416 14:16:34.516523 1 tasks_processing.go:74] worker 21 stopped. I0416 14:16:34.516535 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 12.319352ms to process 0 records I0416 14:16:34.516732 1 tasks_processing.go:74] worker 15 stopped. I0416 14:16:34.516868 1 recorder.go:75] Recording config/apiserver with fingerprint=a467fa9e981f4bc995552bdadeeaf6a89f98f1b7685cdbfcbeca37ec87ed62b7 I0416 14:16:34.516880 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 14.365246ms to process 1 records I0416 14:16:34.517241 1 tasks_processing.go:74] worker 14 stopped. I0416 14:16:34.517501 1 recorder.go:75] Recording config/oauth with fingerprint=1221d4f40c2ecd019fd2c64eaa503114ed0769d39ae019438657093cd1f72549 I0416 14:16:34.517516 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 14.381489ms to process 1 records I0416 14:16:34.524792 1 tasks_processing.go:74] worker 44 stopped. I0416 14:16:34.524809 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 22.36815ms to process 0 records I0416 14:16:34.524881 1 tasks_processing.go:74] worker 39 stopped. I0416 14:16:34.524897 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 18.717563ms to process 0 records I0416 14:16:34.524906 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 21.659208ms to process 0 records I0416 14:16:34.524928 1 tasks_processing.go:74] worker 17 stopped. I0416 14:16:34.524997 1 tasks_processing.go:74] worker 28 stopped. I0416 14:16:34.526515 1 recorder.go:75] Recording config/infrastructure with fingerprint=7f031f1f13bc6de725fcfbd986768e3fe9c6cfe938371c10e4a0114ff72022e2 I0416 14:16:34.526536 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.573129ms to process 1 records E0416 14:16:34.526546 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0416 14:16:34.526553 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 19.612209ms to process 0 records I0416 14:16:34.526572 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 21.726439ms to process 0 records I0416 14:16:34.526592 1 tasks_processing.go:74] worker 57 stopped. I0416 14:16:34.526617 1 tasks_processing.go:74] worker 46 stopped. I0416 14:16:34.526793 1 tasks_processing.go:74] worker 0 stopped. I0416 14:16:34.526970 1 gather_logs.go:145] no pods in namespace were found I0416 14:16:34.527604 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=ec38356b0d9f50a1fe577f700ceae1e1f3d7abeb0b068662c977a0d03ea5383d I0416 14:16:34.527777 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 22.465094ms to process 1 records I0416 14:16:34.528062 1 tasks_processing.go:74] worker 63 stopped. I0416 14:16:34.528136 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=b2f386a1891e6bf8da2bb18e1875a3564a2922128b2f3a7ccf205ce5bd1f744f I0416 14:16:34.528212 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=c702222ce9c829af9d40d6f310bdd4b94d90c5a98341f39f75f007a97593744e I0416 14:16:34.528309 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=da8e496a3a1766074f3f1e02d4df7b071e1147de68bbc2deb907afd9132ee248 I0416 14:16:34.528352 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 20.561271ms to process 3 records I0416 14:16:34.529040 1 tasks_processing.go:74] worker 47 stopped. I0416 14:16:34.529121 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=f5875583ee99913e1c5ba08c9c71e9fdc81cba9a48bfac1f65112766c9f412c9 I0416 14:16:34.529146 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 21.403358ms to process 1 records I0416 14:16:34.529157 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 21.814942ms to process 0 records I0416 14:16:34.529162 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 20.925868ms to process 0 records I0416 14:16:34.529177 1 tasks_processing.go:74] worker 52 stopped. I0416 14:16:34.529190 1 tasks_processing.go:74] worker 27 stopped. I0416 14:16:34.529273 1 tasks_processing.go:74] worker 34 stopped. I0416 14:16:34.529383 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=bba8febed075516be1fb83b207a8d8c029959f90110d815d3aefdacd2bea25ed I0416 14:16:34.529479 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=96f4da2a276e59a46611654d5fa0705e8f684bf96c64093d6da9141834cdf442 I0416 14:16:34.529504 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=3012c0c02e5697e8373bc2507f68c997a3488d90bf520e8131e2659d6f541175 I0416 14:16:34.529527 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=9fa7b0aeefcbe7074ff6db3b057f7ffcfb337a34d0f504d80281a8ba9586dc48 I0416 14:16:34.529549 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=89d3fe00eec95bfac522e20f21235271b436490df18fcb1a09f4ff00c10c80bb I0416 14:16:34.529571 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=40f29850c1a241ea494b93d453187a50a14f9be5f2405f4fef07cd14bd281ff3 I0416 14:16:34.529599 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=493b86bdb0365ccf3c57788308ba82d7977506bb788a3774799b328398800717 I0416 14:16:34.529633 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=f7036246b917375ba0603e0c57a114d5b7e87b42f038ecb2b9288b0d8d03429e I0416 14:16:34.529657 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=889bd33365954a40bdea4e15c2e63fe1e2095a476e2b693f42b0dfc5870c2671 I0416 14:16:34.529682 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ebcaaa8f9347ad0e2e3fe521885733f91e879e598f37714b0c0e80977f39ef04 I0416 14:16:34.529704 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=baac86a4631a45feb051277c112a3f249501d1a91359c75b05691223f6506311 I0416 14:16:34.529712 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 21.538097ms to process 11 records I0416 14:16:34.529721 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 23.975805ms to process 0 records I0416 14:16:34.529727 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 21.311088ms to process 0 records I0416 14:16:34.529730 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 21.575468ms to process 0 records I0416 14:16:34.529734 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 22.527808ms to process 0 records I0416 14:16:34.529746 1 tasks_processing.go:74] worker 2 stopped. I0416 14:16:34.529754 1 tasks_processing.go:74] worker 22 stopped. I0416 14:16:34.529757 1 tasks_processing.go:74] worker 60 stopped. I0416 14:16:34.529763 1 tasks_processing.go:74] worker 58 stopped. I0416 14:16:34.529832 1 tasks_processing.go:74] worker 4 stopped. I0416 14:16:34.530048 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=011d8a2c010cc45e795cf9d3c5174ddde1ef902b2a75cf8db170c9b5f7281b91 I0416 14:16:34.530058 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 25.473717ms to process 1 records I0416 14:16:34.530066 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.089779ms to process 0 records I0416 14:16:34.530070 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 22.732995ms to process 0 records I0416 14:16:34.530077 1 tasks_processing.go:74] worker 19 stopped. I0416 14:16:34.530082 1 tasks_processing.go:74] worker 36 stopped. I0416 14:16:34.530394 1 tasks_processing.go:74] worker 54 stopped. I0416 14:16:34.530407 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 26.862142ms to process 0 records W0416 14:16:34.532405 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0416 14:16:34.533820 1 tasks_processing.go:74] worker 33 stopped. I0416 14:16:34.533934 1 recorder.go:75] Recording config/network with fingerprint=66d3d136a32ed23a4c3b42cdc1d55c3c310ff3c0a9bf5b326e0219a29069f3c5 I0416 14:16:34.533946 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.13788ms to process 1 records I0416 14:16:34.534375 1 tasks_processing.go:74] worker 29 stopped. I0416 14:16:34.534576 1 recorder.go:75] Recording config/authentication with fingerprint=4038c85c164f0297abf8250099cf5846c0552ed3b221f4f4dc163ccf0ac2b51b I0416 14:16:34.534591 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 30.831392ms to process 1 records I0416 14:16:34.534598 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 29.059512ms to process 0 records I0416 14:16:34.534614 1 tasks_processing.go:74] worker 41 stopped. I0416 14:16:34.534669 1 recorder.go:75] Recording config/image with fingerprint=4b34096472dfb0d4df7ed40af218047193391541d5b83f83c34e7411037b62d8 I0416 14:16:34.534678 1 gather.go:177] gatherer "clusterconfig" function "image" took 29.534274ms to process 1 records I0416 14:16:34.534687 1 tasks_processing.go:74] worker 13 stopped. I0416 14:16:34.534855 1 tasks_processing.go:74] worker 42 stopped. I0416 14:16:34.534987 1 recorder.go:75] Recording config/ingress with fingerprint=e8998d89890a14b2f6fbe974f9d319d9ad5f1bb1edccde3d0c2505a10dc3e6d6 I0416 14:16:34.535000 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 30.112459ms to process 1 records I0416 14:16:34.535367 1 tasks_processing.go:74] worker 59 stopped. I0416 14:16:34.535440 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=4ed5b97cd5bd457bfd128a371d839efbd45c2b1af3393e8ed1b7d1e64cd843f9 I0416 14:16:34.535455 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=994f587c0d0b3be631c1b69e2461cb4d6c285aeb162849869abd6ae0a8af6f7f I0416 14:16:34.535461 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.567179ms to process 2 records E0416 14:16:34.535468 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0416 14:16:34.535473 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 30.377771ms to process 0 records I0416 14:16:34.535488 1 tasks_processing.go:74] worker 56 stopped. I0416 14:16:34.536574 1 tasks_processing.go:74] worker 48 stopped. I0416 14:16:34.536586 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.689413ms to process 0 records I0416 14:16:34.536650 1 tasks_processing.go:74] worker 55 stopped. I0416 14:16:34.536698 1 recorder.go:75] Recording config/proxy with fingerprint=8d7ff815d2cf63f8e33539fd08ab6e52ca5648d918059229112bf414edf73ee1 I0416 14:16:34.536709 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 31.463098ms to process 1 records I0416 14:16:34.539161 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0416 14:16:34.539214 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0416 14:16:34.539338 1 operator.go:288] started I0416 14:16:34.539354 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0416 14:16:34.539815 1 tasks_processing.go:74] worker 38 stopped. I0416 14:16:34.539980 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=0f21b531f9dd801c8bc4cac9ad4854352a2842f1108fb56b5b6ea06705cf6a55 I0416 14:16:34.540026 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=04fd9f93b52c0c0bf897a065ba54d54543f3a3db7d1ee885c32ee50a97b7d1d0 I0416 14:16:34.540052 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=e0aea619c1d2ee5c693f3fe512068e2f8fbde4d0ff5bfa9f868c2842aac060c9 I0416 14:16:34.540060 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.639993ms to process 3 records I0416 14:16:34.541163 1 tasks_processing.go:74] worker 49 stopped. I0416 14:16:34.541177 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 36.178545ms to process 0 records I0416 14:16:34.544569 1 tasks_processing.go:74] worker 50 stopped. I0416 14:16:34.544585 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 40.410288ms to process 0 records I0416 14:16:34.545684 1 tasks_processing.go:74] worker 30 stopped. I0416 14:16:34.545897 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=8b66fa4869b8ae07f7e4702c7c50974640e27dbd14ba049de6cb2ab43d0ba0b2 I0416 14:16:34.546351 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=3d9804f898be34d8504b42bb903c4d8e12fc71b420f189984f2b41092e0e197d I0416 14:16:34.546378 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 41.997204ms to process 2 records I0416 14:16:34.547206 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=00df0529c6d5d4f375e9c72db065679c8d0a110e29a2a489b16770bfd4b7d826 I0416 14:16:34.547237 1 tasks_processing.go:74] worker 62 stopped. I0416 14:16:34.548064 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=675fef320746a595fbc30a40a2b92147524c0bc346e7c7b3171637b6dcf77d38 I0416 14:16:34.548086 1 gather.go:177] gatherer "clusterconfig" function "crds" took 40.562291ms to process 2 records I0416 14:16:34.548066 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0416 14:16:34.548099 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0416 14:16:34.548103 1 controller.go:212] Source scaController *sca.Controller is not ready I0416 14:16:34.548107 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0416 14:16:34.548110 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 14:16:34.548127 1 controller.go:489] The operator is still being initialized I0416 14:16:34.548139 1 controller.go:512] The operator is healthy I0416 14:16:34.551972 1 prometheus_rules.go:88] Prometheus rules successfully created I0416 14:16:34.554977 1 tasks_processing.go:74] worker 20 stopped. I0416 14:16:34.555056 1 recorder.go:75] Recording config/olm_operators with fingerprint=751474f4bd1c60cae30335195fb8082c504161cd90e01781eafe710711dea1f2 I0416 14:16:34.555074 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 49.199479ms to process 1 records E0416 14:16:34.556915 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27109e75d1-d37c-4054-a29a-fd34023e2e91%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:43198->172.30.0.10:53: read: connection refused I0416 14:16:34.556928 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27109e75d1-d37c-4054-a29a-fd34023e2e91%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:43198->172.30.0.10:53: read: connection refused I0416 14:16:34.567347 1 tasks_processing.go:74] worker 37 stopped. E0416 14:16:34.567362 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0416 14:16:34.567369 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pn9jasr4dm81q8eeal5uu838c0jp4o4-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pn9jasr4dm81q8eeal5uu838c0jp4o4-primary-cert-bundle-secret" not found I0416 14:16:34.567413 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=65dc47d03c71e00975368b9f6217a538c083e1034d9e541be5fe733028166551 I0416 14:16:34.567426 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 61.991065ms to process 1 records I0416 14:16:34.570488 1 tasks_processing.go:74] worker 11 stopped. E0416 14:16:34.570502 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0416 14:16:34.570507 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0416 14:16:34.570511 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0416 14:16:34.570520 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0416 14:16:34.570543 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0416 14:16:34.570549 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0416 14:16:34.570553 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0416 14:16:34.570557 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0416 14:16:34.570593 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0416 14:16:34.570601 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0416 14:16:34.570606 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 67.341825ms to process 7 records I0416 14:16:34.570975 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0416 14:16:34.570988 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0416 14:16:34.571024 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0416 14:16:34.575211 1 base_controller.go:82] Caches are synced for ConfigController I0416 14:16:34.575223 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0416 14:16:34.579906 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 14:16:34.621984 1 tasks_processing.go:74] worker 31 stopped. I0416 14:16:34.622361 1 recorder.go:75] Recording config/node/ip-10-0-0-10.ec2.internal with fingerprint=56fa7e44dfced81bb11936f95446e342329573f9ccfbd5e0dd8d41e09ba31cff I0416 14:16:34.622466 1 recorder.go:75] Recording config/node/ip-10-0-1-117.ec2.internal with fingerprint=07a15d884107cbd438c44e9a360b223e2ff953e0fccec7bb9aba7256d12cd745 I0416 14:16:34.622483 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 116.938827ms to process 2 records I0416 14:16:34.624017 1 tasks_processing.go:74] worker 18 stopped. I0416 14:16:34.624055 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0416 14:16:34.624074 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 117.738811ms to process 1 records I0416 14:16:34.626792 1 tasks_processing.go:74] worker 35 stopped. I0416 14:16:34.627141 1 recorder.go:75] Recording config/version with fingerprint=9b27d9e8ff4093b918dfb0ec9296b1f02500813d4edcf67aa839a4b5406ab4a6 I0416 14:16:34.627162 1 recorder.go:75] Recording config/id with fingerprint=7f591e638e23e670c7df68485b60bdf2efc3ee2824826475777e98d70ff60d5a I0416 14:16:34.627175 1 gather.go:177] gatherer "clusterconfig" function "version" took 124.399067ms to process 2 records I0416 14:16:34.634371 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0416 14:16:34.639376 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:40153->172.30.0.10:53: read: connection refused I0416 14:16:34.639392 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:40153->172.30.0.10:53: read: connection refused I0416 14:16:34.639411 1 base_controller.go:82] Caches are synced for LoggingSyncer I0416 14:16:34.639416 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0416 14:16:34.639612 1 tasks_processing.go:74] worker 23 stopped. I0416 14:16:34.640847 1 recorder.go:75] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-0-10.ec2.internal with fingerprint=1a1d12135d9c79cfba5703375b99a1b7c2aa90919584d457a15938e65f4b0bcb I0416 14:16:34.640927 1 recorder.go:75] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-1-117.ec2.internal with fingerprint=d15ce974768ef04b7340aa38cf7aefc81eccd9b3361af0c774aec88a1d8b4133 I0416 14:16:34.640970 1 recorder.go:75] Recording config/running_containers with fingerprint=c581dede552d820b0a8d642405f267598a38950e6d97c187b94b66bbf7337b17 I0416 14:16:34.640979 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 134.033777ms to process 3 records I0416 14:16:34.642547 1 tasks_processing.go:74] worker 43 stopped. I0416 14:16:34.642559 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 136.801114ms to process 0 records I0416 14:16:34.954839 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers I0416 14:16:34.954852 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes I0416 14:16:34.955127 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vh4dg pod in namespace openshift-dns (previous: false). I0416 14:16:35.179227 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vh4dg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vh4dg\" is waiting to start: ContainerCreating" I0416 14:16:35.179266 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vh4dg\" is waiting to start: ContainerCreating" I0416 14:16:35.179275 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vh4dg pod in namespace openshift-dns (previous: false). I0416 14:16:35.360942 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vh4dg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vh4dg\" is waiting to start: ContainerCreating" I0416 14:16:35.360958 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vh4dg\" is waiting to start: ContainerCreating" I0416 14:16:35.360984 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vwsmv pod in namespace openshift-dns (previous: false). W0416 14:16:35.528934 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0416 14:16:35.551099 1 tasks_processing.go:74] worker 24 stopped. I0416 14:16:35.551113 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 1.044929795s to process 0 records I0416 14:16:35.563885 1 tasks_processing.go:74] worker 8 stopped. I0416 14:16:35.563919 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0416 14:16:35.563931 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.061463433s to process 1 records I0416 14:16:35.585591 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vwsmv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vwsmv\" is waiting to start: ContainerCreating" I0416 14:16:35.585605 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vwsmv\" is waiting to start: ContainerCreating" I0416 14:16:35.585613 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vwsmv pod in namespace openshift-dns (previous: false). I0416 14:16:35.763746 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vwsmv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vwsmv\" is waiting to start: ContainerCreating" I0416 14:16:35.763765 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vwsmv\" is waiting to start: ContainerCreating" I0416 14:16:35.763774 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-jss7l pod in namespace openshift-dns (previous: false). I0416 14:16:35.950509 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0416 14:16:35.959888 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0416 14:16:35.959900 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-sn9l9 pod in namespace openshift-dns (previous: false). I0416 14:16:36.161733 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0416 14:16:36.161785 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5b8689f79f-z8tpz pod in namespace openshift-image-registry (previous: false). I0416 14:16:36.353644 1 tasks_processing.go:74] worker 3 stopped. I0416 14:16:36.353689 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=5873ad8b189666d44bf51424bd34a7cb8cbfb57a7b0614297adf1ce7634cb901 I0416 14:16:36.353714 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e7739f33bb438ea551606ef58b185c2e2d9470e0c3e5fda4d20e2f07d728b3e4 I0416 14:16:36.353743 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0416 14:16:36.353768 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=e4e6c7717874dcaa5f0cbc7e1f0ea883905ba1bb55521b7a55318b6c42d870e2 I0416 14:16:36.353801 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0416 14:16:36.353825 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=cdc42804c95da02ee63292c926d187ff6adceb2a65ab8234942b22ef8b6c550e I0416 14:16:36.353855 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=18551ca02af1b15f65e6b4a9aa1dc717a04ff38e4aeb8785cfb03024d33f358d I0416 14:16:36.353881 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=d3066a3ccbba22e12394be80e491f2b32af9739c2a5715a49c50cd1e5eb2ceea I0416 14:16:36.353895 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=309dd9035b23e89a3117eec62a0337aac6d3db54d4acdbd1b7d00b68eeacc255 I0416 14:16:36.353911 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=7aba0c6307bbd58bf57b4e842f196a7cb6962edaa56b4471d7ba0477e33fa74f I0416 14:16:36.353920 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0416 14:16:36.353936 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=274eb074d9ea1f5c8d60670fb735d20bce9ff813d8b746b5657cfdd79a19ce2d I0416 14:16:36.353946 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0416 14:16:36.353962 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=ffa5f1c3a0622b8de67d713f9bd0cc98bc5a55c33ccda2c5abb3f721128dd05d I0416 14:16:36.353972 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0416 14:16:36.353985 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=64d628aefd05c09cd69832d17e712828d0368ba3825609939fcd93f5e5929b83 I0416 14:16:36.353994 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0416 14:16:36.354010 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=dad8ba509818846a802f999e73594a75d93e5fde924954c0b87c5677f24c307c I0416 14:16:36.354131 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=11f253b7408be9dd204f09958297aedeb3c7b97a3e81cd8d65d2595145fa31fd I0416 14:16:36.354140 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0416 14:16:36.354147 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0416 14:16:36.354166 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0416 14:16:36.354188 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=f4786bda87a7d2f80446b0dbc587342cdecc43afb0e34326856e63ab169a35e7 I0416 14:16:36.354211 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=615abf38a603becb4a5772182aa0a87394dba0b193bb6774156be0db5376c1f1 I0416 14:16:36.354220 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0416 14:16:36.354236 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=84c452db04db1333ff0dc73b464decd98f59ac60f8f20ce302300ff2f42a352e I0416 14:16:36.354246 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0416 14:16:36.354272 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=e7ec71166fd508d5889be5d66a01a96093fc3e5f51a3eb13642501f84dffabef I0416 14:16:36.354288 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=3a52cc8aa233c87886ba41f6f09dbb974fd67e69c92c96068b3b8d1d291c0330 I0416 14:16:36.354300 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b7a8e3062a39d8f030cfcd91ece15c49ab03c81deb40318b20e5729f43be3c11 I0416 14:16:36.354316 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1762e9e63062abd3660de2368eccabb6e2ee5ce419da07bfcca1775ef7893c57 I0416 14:16:36.354330 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=49915f3d0b174e993d9f19c43b7353fbb408443c90110a8ef0dc8e6b757bd2dc I0416 14:16:36.354356 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=957c62aa2106cde803b86a9b1e21ff935c624c77d5d3770f0f485d3423bbc133 I0416 14:16:36.354371 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0416 14:16:36.354380 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0416 14:16:36.354387 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.850823408s to process 35 records I0416 14:16:36.355137 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0416 14:16:36.355193 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-657dccd6b4-gfzcs pod in namespace openshift-image-registry (previous: false). W0416 14:16:36.528771 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0416 14:16:36.563047 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-657dccd6b4-gfzcs pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-657dccd6b4-gfzcs\" is waiting to start: ContainerCreating" I0416 14:16:36.563070 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-657dccd6b4-gfzcs\" is waiting to start: ContainerCreating" I0416 14:16:36.563117 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-657dccd6b4-jdnwz pod in namespace openshift-image-registry (previous: false). I0416 14:16:36.759053 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-657dccd6b4-jdnwz pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-657dccd6b4-jdnwz\" is waiting to start: ContainerCreating" I0416 14:16:36.759068 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-657dccd6b4-jdnwz\" is waiting to start: ContainerCreating" I0416 14:16:36.759078 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-7dpjz pod in namespace openshift-image-registry (previous: false). I0416 14:16:36.959744 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0416 14:16:36.959759 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-92f4v pod in namespace openshift-image-registry (previous: false). I0416 14:16:37.162010 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0416 14:16:37.162024 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-85554bbb99-z244q pod in namespace openshift-ingress (previous: false). I0416 14:16:37.369063 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-85554bbb99-z244q pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-85554bbb99-z244q\" is waiting to start: ContainerCreating" I0416 14:16:37.369079 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-85554bbb99-z244q\" is waiting to start: ContainerCreating" I0416 14:16:37.369089 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f7cd6c948-5cfj6 pod in namespace openshift-ingress (previous: false). W0416 14:16:37.528602 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0416 14:16:37.562371 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f7cd6c948-5cfj6 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f7cd6c948-5cfj6\" is waiting to start: ContainerCreating" I0416 14:16:37.562389 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f7cd6c948-5cfj6\" is waiting to start: ContainerCreating" I0416 14:16:37.562400 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f7cd6c948-c9b88 pod in namespace openshift-ingress (previous: false). I0416 14:16:37.760530 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f7cd6c948-c9b88 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f7cd6c948-c9b88\" is waiting to start: ContainerCreating" I0416 14:16:37.760549 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f7cd6c948-c9b88\" is waiting to start: ContainerCreating" I0416 14:16:37.760584 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-gkrlh pod in namespace openshift-ingress-canary (previous: false). I0416 14:16:37.962878 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-gkrlh pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gkrlh\" is waiting to start: ContainerCreating" I0416 14:16:37.962896 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gkrlh\" is waiting to start: ContainerCreating" I0416 14:16:37.962924 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wfvzq pod in namespace openshift-ingress-canary (previous: false). I0416 14:16:38.161876 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-wfvzq pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wfvzq\" is waiting to start: ContainerCreating" I0416 14:16:38.161893 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wfvzq\" is waiting to start: ContainerCreating" I0416 14:16:38.161911 1 tasks_processing.go:74] worker 53 stopped. I0416 14:16:38.162034 1 recorder.go:75] Recording events/openshift-dns with fingerprint=3b14c3b14e9c704e93c005dd487639efdda10501254346e13b7ab047a665a87c I0416 14:16:38.162116 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=b9ecd4853026a7214fb89f40b51fe6454ec171c3c81d7460bbf0b680e21dc150 I0416 14:16:38.162147 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=fd41ad139d178a07774de1fa64749f5871084cb10e7579cdd1bfb8835790a3c2 I0416 14:16:38.162192 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=0f0bda355aaa59a20038ededc21fed694dd952d1baa322241664778360e05f5e I0416 14:16:38.162207 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=fa31887b03bc6ba55ee04ee947e8b3fab892ff483a6183957b0c554a8043f5ea I0416 14:16:38.162357 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-vh4dg with fingerprint=525299acb52842f5875f3027f913d91a7cbc69564d6fdd2331de5abe080a4900 I0416 14:16:38.162443 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-vwsmv with fingerprint=dba02165857557026cbce1593ea591d344f8ac6b90add09f3dde63e6163889af I0416 14:16:38.162530 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5b8689f79f-z8tpz with fingerprint=a55bff470eef5224bc8aec39e7dd22e2a732af33417f6346c65a1dda78ac6940 I0416 14:16:38.162635 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-657dccd6b4-gfzcs with fingerprint=e0c0721f078f1243b2ae8df45ee222a43090ff8b6619a3aee4d450a02c6c66e6 I0416 14:16:38.162726 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-657dccd6b4-jdnwz with fingerprint=d7d8013526778eacdd1883c3defa1aabf5390f09f5cea07f2f84bb00c8e6f1d2 I0416 14:16:38.162786 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-gkrlh with fingerprint=697f3f08add16079b8fcdcb2420b96710962fdaf34592068655f0812c7c9f519 I0416 14:16:38.162841 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-wfvzq with fingerprint=96992159792c48cb6b913fe5958ed44c2e77ecd2a90ebb441c00c9eeed582df2 I0416 14:16:38.162851 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.658224867s to process 12 records W0416 14:16:38.528341 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0416 14:16:39.528954 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0416 14:16:39.528979 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0416 14:16:39.528995 1 tasks_processing.go:74] worker 51 stopped. E0416 14:16:39.529004 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0416 14:16:39.529017 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0416 14:16:39.529032 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0416 14:16:39.529043 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.025720554s to process 1 records I0416 14:16:46.936452 1 tasks_processing.go:74] worker 6 stopped. I0416 14:16:46.936496 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0416 14:16:46.936509 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.433159402s to process 1 records I0416 14:16:46.968440 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 14:16:47.714356 1 tasks_processing.go:74] worker 40 stopped. I0416 14:16:47.714623 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=751aa8b7d1208af5fd734152a53c8f2354708612b0cd50cfd9c595651a5cc8c8 I0416 14:16:47.714640 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208990684s to process 1 records E0416 14:16:47.714701 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.212s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0416 14:16:47.715815 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0416 14:16:47.715830 1 periodic.go:209] Running workloads gatherer I0416 14:16:47.715845 1 tasks_processing.go:45] number of workers: 2 I0416 14:16:47.715856 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 14:16:47.715860 1 tasks_processing.go:71] worker 1 working on workload_info task. I0416 14:16:47.715867 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 14:16:47.715886 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0416 14:16:47.740170 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 20s for image data I0416 14:16:47.747658 1 tasks_processing.go:74] worker 0 stopped. I0416 14:16:47.747673 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 31.755882ms to process 0 records I0416 14:16:47.750619 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0416 14:16:47.761129 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (10ms) I0416 14:16:47.771149 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0416 14:16:47.781411 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (10ms) I0416 14:16:47.801812 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (20ms) I0416 14:16:47.823201 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (21ms) I0416 14:16:47.839007 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (16ms) I0416 14:16:47.853911 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (15ms) I0416 14:16:47.866962 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (13ms) I0416 14:16:47.878992 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (12ms) I0416 14:16:47.889719 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (11ms) I0416 14:16:47.958636 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (69ms) I0416 14:16:48.054888 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (96ms) I0416 14:16:48.163529 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (109ms) I0416 14:16:48.258656 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (95ms) I0416 14:16:48.359868 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (101ms) I0416 14:16:48.452301 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (92ms) I0416 14:16:48.551482 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (99ms) I0416 14:16:48.653921 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (102ms) I0416 14:16:48.751511 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (98ms) I0416 14:16:48.851192 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0416 14:16:48.951448 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0416 14:16:49.055036 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (104ms) I0416 14:16:49.151793 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (97ms) I0416 14:16:49.251077 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0416 14:16:49.352275 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (101ms) I0416 14:16:49.453308 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0416 14:16:49.554044 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (101ms) I0416 14:16:49.651200 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (97ms) I0416 14:16:49.751213 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0416 14:16:49.853427 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (102ms) I0416 14:16:49.952121 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0416 14:16:49.952148 1 tasks_processing.go:74] worker 1 stopped. E0416 14:16:49.952167 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0416 14:16:49.952522 1 recorder.go:75] Recording config/workload_info with fingerprint=d5469ab111f7a92913b6ecf0dbd83f7f533164b37d08e98f04db997d296f8370 I0416 14:16:49.952541 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.23628108s to process 1 records E0416 14:16:49.952566 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.236s with: function \"workload_info\" failed with an error" I0416 14:16:49.953664 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0416 14:16:49.953677 1 periodic.go:209] Running conditional gatherer I0416 14:16:49.961736 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0416 14:16:49.967821 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:36830->172.30.0.10:53: read: connection refused E0416 14:16:49.968045 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0416 14:16:49.968098 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0416 14:16:49.974930 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0416 14:16:49.974943 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974948 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974951 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974955 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974958 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974960 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974963 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974966 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0416 14:16:49.974968 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0416 14:16:49.974981 1 tasks_processing.go:45] number of workers: 3 I0416 14:16:49.974991 1 tasks_processing.go:69] worker 2 listening for tasks. I0416 14:16:49.974995 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0416 14:16:49.975000 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 14:16:49.975008 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 14:16:49.975011 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0416 14:16:49.975017 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0416 14:16:49.975026 1 tasks_processing.go:74] worker 0 stopped. I0416 14:16:49.975066 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0416 14:16:49.975078 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.106µs to process 1 records I0416 14:16:49.975138 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0416 14:16:49.975148 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.243µs to process 1 records I0416 14:16:49.975164 1 tasks_processing.go:74] worker 1 stopped. I0416 14:16:49.975221 1 tasks_processing.go:74] worker 2 stopped. I0416 14:16:49.975232 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 221.667µs to process 0 records I0416 14:16:49.975264 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:36830->172.30.0.10:53: read: connection refused I0416 14:16:49.975282 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0416 14:16:50.001676 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=ebe5ea03930379a5045cf3c35e828227e816b1796791e0dd06079699f25b545c I0416 14:16:50.001789 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-04-16-141650.tar.gz I0416 14:16:50.008551 1 diskrecorder.go:51] Wrote 107 records to disk in 6ms I0416 14:16:50.008578 1 periodic.go:278] Gathering cluster info every 2h0m0s I0416 14:16:50.008593 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0416 14:16:50.652191 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 14:16:50.855010 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 14:17:02.723218 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 14:17:38.714185 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="c1b11562f007874de4242d14b7cdc584474b7dd303c2aa9385d0c362864851cc") W0416 14:17:38.714216 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created I0416 14:17:38.714284 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0416 14:17:38.714310 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0416 14:17:38.714320 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="3b42a9c40c5a983e65a1cab7caa0c752b520793b0477d389823654cf07d4883c") I0416 14:17:38.714358 1 base_controller.go:181] Shutting down ConfigController ... I0416 14:17:38.714369 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="3d37e5ed2552519fae5739b7dec92a238bcbd049f8db61fd3773f5807a91a1fb") I0416 14:17:38.714384 1 periodic.go:170] Shutting down I0416 14:17:38.714399 1 base_controller.go:181] Shutting down LoggingSyncer ... I0416 14:17:38.714412 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ...