W0429 08:39:01.548816 1 cmd.go:257] Using insecure, self-signed certificates I0429 08:39:02.479959 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:02.480293 1 observer_polling.go:159] Starting file observer I0429 08:39:02.982068 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0429 08:39:02.982252 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0429 08:39:02.982794 1 secure_serving.go:57] Forcing use of http/1.1 only W0429 08:39:02.982818 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0429 08:39:02.982824 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0429 08:39:02.982843 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0429 08:39:02.982846 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0429 08:39:02.982849 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0429 08:39:02.982852 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0429 08:39:02.982848 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0429 08:39:02.988201 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0429 08:39:02.988238 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"3327c3fe-def6-410c-a8cb-8ece821f1543", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0429 08:39:02.988738 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0429 08:39:02.988753 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0429 08:39:02.988755 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0429 08:39:02.988755 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0429 08:39:02.988766 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0429 08:39:02.988769 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0429 08:39:02.989052 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-496421800/tls.crt::/tmp/serving-cert-496421800/tls.key" I0429 08:39:02.989253 1 secure_serving.go:213] Serving securely on [::]:8443 I0429 08:39:02.989278 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0429 08:39:02.999137 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0429 08:39:02.999160 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0429 08:39:02.999261 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0429 08:39:03.004971 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0429 08:39:03.004992 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0429 08:39:03.011114 1 secretconfigobserver.go:119] support secret does not exist I0429 08:39:03.016479 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0429 08:39:03.021782 1 secretconfigobserver.go:119] support secret does not exist I0429 08:39:03.024245 1 recorder.go:176] Pruning old reports every 6h30m59s, max age is 288h0m0s I0429 08:39:03.030491 1 periodic.go:216] Running clusterconfig gatherer I0429 08:39:03.030507 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0429 08:39:03.030523 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0429 08:39:03.030544 1 tasks_processing.go:45] number of workers: 64 I0429 08:39:03.030547 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0429 08:39:03.030554 1 insightsreport.go:296] Starting report retriever I0429 08:39:03.030559 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0429 08:39:03.030574 1 tasks_processing.go:69] worker 8 listening for tasks. I0429 08:39:03.030583 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 08:39:03.030591 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 08:39:03.030597 1 tasks_processing.go:69] worker 28 listening for tasks. I0429 08:39:03.030599 1 tasks_processing.go:69] worker 2 listening for tasks. I0429 08:39:03.030607 1 tasks_processing.go:69] worker 9 listening for tasks. I0429 08:39:03.030608 1 tasks_processing.go:69] worker 3 listening for tasks. I0429 08:39:03.030613 1 tasks_processing.go:71] worker 9 working on container_runtime_configs task. I0429 08:39:03.030615 1 tasks_processing.go:71] worker 2 working on pdbs task. I0429 08:39:03.030623 1 tasks_processing.go:69] worker 5 listening for tasks. I0429 08:39:03.030623 1 tasks_processing.go:69] worker 48 listening for tasks. I0429 08:39:03.030633 1 tasks_processing.go:69] worker 7 listening for tasks. I0429 08:39:03.030637 1 tasks_processing.go:69] worker 29 listening for tasks. I0429 08:39:03.030641 1 tasks_processing.go:69] worker 58 listening for tasks. I0429 08:39:03.030643 1 tasks_processing.go:69] worker 30 listening for tasks. I0429 08:39:03.030641 1 tasks_processing.go:69] worker 6 listening for tasks. I0429 08:39:03.030651 1 tasks_processing.go:69] worker 31 listening for tasks. I0429 08:39:03.030649 1 tasks_processing.go:69] worker 54 listening for tasks. I0429 08:39:03.030655 1 tasks_processing.go:69] worker 55 listening for tasks. I0429 08:39:03.030656 1 tasks_processing.go:69] worker 32 listening for tasks. I0429 08:39:03.030661 1 tasks_processing.go:69] worker 56 listening for tasks. I0429 08:39:03.030661 1 tasks_processing.go:69] worker 33 listening for tasks. I0429 08:39:03.030665 1 tasks_processing.go:69] worker 34 listening for tasks. I0429 08:39:03.030664 1 tasks_processing.go:69] worker 53 listening for tasks. I0429 08:39:03.030669 1 tasks_processing.go:69] worker 57 listening for tasks. I0429 08:39:03.030671 1 tasks_processing.go:69] worker 63 listening for tasks. I0429 08:39:03.030673 1 tasks_processing.go:69] worker 50 listening for tasks. I0429 08:39:03.030682 1 tasks_processing.go:69] worker 51 listening for tasks. I0429 08:39:03.030672 1 tasks_processing.go:69] worker 35 listening for tasks. I0429 08:39:03.030690 1 tasks_processing.go:69] worker 44 listening for tasks. I0429 08:39:03.030676 1 tasks_processing.go:69] worker 59 listening for tasks. I0429 08:39:03.030680 1 tasks_processing.go:69] worker 37 listening for tasks. I0429 08:39:03.030696 1 tasks_processing.go:69] worker 52 listening for tasks. I0429 08:39:03.030685 1 tasks_processing.go:69] worker 43 listening for tasks. I0429 08:39:03.030676 1 tasks_processing.go:69] worker 36 listening for tasks. I0429 08:39:03.030688 1 tasks_processing.go:69] worker 18 listening for tasks. I0429 08:39:03.030695 1 tasks_processing.go:69] worker 49 listening for tasks. I0429 08:39:03.030706 1 tasks_processing.go:69] worker 20 listening for tasks. I0429 08:39:03.030710 1 tasks_processing.go:69] worker 61 listening for tasks. I0429 08:39:03.030713 1 tasks_processing.go:71] worker 0 working on image_registries task. I0429 08:39:03.030698 1 tasks_processing.go:69] worker 45 listening for tasks. I0429 08:39:03.030717 1 tasks_processing.go:69] worker 22 listening for tasks. I0429 08:39:03.030721 1 tasks_processing.go:69] worker 13 listening for tasks. I0429 08:39:03.030719 1 tasks_processing.go:69] worker 62 listening for tasks. I0429 08:39:03.030721 1 tasks_processing.go:69] worker 15 listening for tasks. I0429 08:39:03.030729 1 tasks_processing.go:69] worker 16 listening for tasks. I0429 08:39:03.030729 1 tasks_processing.go:69] worker 14 listening for tasks. I0429 08:39:03.030727 1 tasks_processing.go:69] worker 21 listening for tasks. I0429 08:39:03.030718 1 tasks_processing.go:69] worker 23 listening for tasks. I0429 08:39:03.030739 1 tasks_processing.go:71] worker 28 working on image task. I0429 08:39:03.030742 1 tasks_processing.go:69] worker 26 listening for tasks. I0429 08:39:03.030740 1 tasks_processing.go:69] worker 24 listening for tasks. I0429 08:39:03.030745 1 tasks_processing.go:69] worker 27 listening for tasks. I0429 08:39:03.030742 1 tasks_processing.go:69] worker 25 listening for tasks. I0429 08:39:03.030700 1 tasks_processing.go:69] worker 42 listening for tasks. I0429 08:39:03.030704 1 tasks_processing.go:69] worker 11 listening for tasks. I0429 08:39:03.030705 1 tasks_processing.go:69] worker 60 listening for tasks. I0429 08:39:03.030707 1 tasks_processing.go:69] worker 47 listening for tasks. I0429 08:39:03.030711 1 tasks_processing.go:69] worker 12 listening for tasks. I0429 08:39:03.030710 1 tasks_processing.go:69] worker 19 listening for tasks. I0429 08:39:03.030697 1 tasks_processing.go:69] worker 10 listening for tasks. I0429 08:39:03.030712 1 tasks_processing.go:69] worker 38 listening for tasks. I0429 08:39:03.030703 1 tasks_processing.go:69] worker 46 listening for tasks. I0429 08:39:03.030722 1 tasks_processing.go:69] worker 39 listening for tasks. I0429 08:39:03.030730 1 tasks_processing.go:69] worker 41 listening for tasks. I0429 08:39:03.030731 1 tasks_processing.go:69] worker 17 listening for tasks. I0429 08:39:03.030734 1 tasks_processing.go:71] worker 8 working on dvo_metrics task. I0429 08:39:03.030617 1 tasks_processing.go:69] worker 4 listening for tasks. I0429 08:39:03.030816 1 tasks_processing.go:71] worker 58 working on monitoring_persistent_volumes task. I0429 08:39:03.030821 1 tasks_processing.go:71] worker 4 working on version task. I0429 08:39:03.030839 1 tasks_processing.go:71] worker 6 working on nodenetworkconfigurationpolicies task. I0429 08:39:03.030843 1 tasks_processing.go:71] worker 33 working on tsdb_status task. I0429 08:39:03.030845 1 tasks_processing.go:71] worker 5 working on jaegers task. I0429 08:39:03.030853 1 tasks_processing.go:71] worker 7 working on openstack_dataplanenodesets task. I0429 08:39:03.030737 1 tasks_processing.go:71] worker 1 working on operators task. I0429 08:39:03.030878 1 tasks_processing.go:71] worker 34 working on machine_config_pools task. I0429 08:39:03.030905 1 tasks_processing.go:71] worker 62 working on storage_classes task. I0429 08:39:03.030818 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0429 08:39:03.030972 1 tasks_processing.go:71] worker 42 working on aggregated_monitoring_cr_names task. I0429 08:39:03.030741 1 tasks_processing.go:69] worker 40 listening for tasks. I0429 08:39:03.030823 1 tasks_processing.go:71] worker 17 working on openstack_controlplanes task. I0429 08:39:03.031018 1 tasks_processing.go:71] worker 31 working on operators_pods_and_events task. I0429 08:39:03.031050 1 tasks_processing.go:71] worker 55 working on infrastructures task. I0429 08:39:03.031094 1 tasks_processing.go:71] worker 29 working on sap_config task. I0429 08:39:03.031150 1 tasks_processing.go:71] worker 27 working on networks task. I0429 08:39:03.030816 1 tasks_processing.go:71] worker 56 working on openshift_machine_api_events task. I0429 08:39:03.030823 1 tasks_processing.go:71] worker 3 working on qemu_kubevirt_launcher_logs task. I0429 08:39:03.030822 1 tasks_processing.go:71] worker 30 working on oauths task. I0429 08:39:03.031150 1 tasks_processing.go:71] worker 40 working on authentication task. I0429 08:39:03.031009 1 tasks_processing.go:71] worker 54 working on service_accounts task. I0429 08:39:03.031051 1 tasks_processing.go:71] worker 46 working on sap_pods task. W0429 08:39:03.030872 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:03.031425 1 tasks_processing.go:71] worker 33 working on machine_healthchecks task. I0429 08:39:03.031077 1 tasks_processing.go:71] worker 63 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0429 08:39:03.031059 1 tasks_processing.go:71] worker 38 working on sap_datahubs task. I0429 08:39:03.031070 1 tasks_processing.go:71] worker 53 working on image_pruners task. I0429 08:39:03.031608 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 572.734µs to process 0 records I0429 08:39:03.031066 1 tasks_processing.go:71] worker 52 working on node_logs task. I0429 08:39:03.031082 1 tasks_processing.go:71] worker 39 working on machine_configs task. I0429 08:39:03.031086 1 tasks_processing.go:71] worker 41 working on ceph_cluster task. I0429 08:39:03.031094 1 tasks_processing.go:71] worker 44 working on storage_cluster task. I0429 08:39:03.031090 1 tasks_processing.go:71] worker 35 working on validating_webhook_configurations task. I0429 08:39:03.031101 1 tasks_processing.go:71] worker 37 working on mutating_webhook_configurations task. I0429 08:39:03.031103 1 tasks_processing.go:71] worker 20 working on silenced_alerts task. I0429 08:39:03.031962 1 tasks_processing.go:71] worker 19 working on nodes task. I0429 08:39:03.031098 1 tasks_processing.go:71] worker 59 working on support_secret task. W0429 08:39:03.031987 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:03.032000 1 tasks_processing.go:71] worker 20 working on openshift_logging task. I0429 08:39:03.031107 1 tasks_processing.go:71] worker 32 working on install_plans task. I0429 08:39:03.032030 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 29.873µs to process 0 records I0429 08:39:03.031110 1 tasks_processing.go:71] worker 43 working on cluster_apiserver task. I0429 08:39:03.031113 1 tasks_processing.go:71] worker 60 working on ingress_certificates task. I0429 08:39:03.031117 1 tasks_processing.go:71] worker 36 working on cost_management_metrics_configs task. I0429 08:39:03.031117 1 tasks_processing.go:71] worker 11 working on lokistack task. I0429 08:39:03.031123 1 tasks_processing.go:71] worker 23 working on config_maps task. I0429 08:39:03.031127 1 tasks_processing.go:71] worker 15 working on pod_network_connectivity_checks task. I0429 08:39:03.031131 1 tasks_processing.go:71] worker 16 working on machine_sets task. I0429 08:39:03.031129 1 tasks_processing.go:71] worker 49 working on openstack_version task. I0429 08:39:03.031123 1 tasks_processing.go:71] worker 18 working on active_alerts task. W0429 08:39:03.032531 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:03.032544 1 tasks_processing.go:74] worker 18 stopped. I0429 08:39:03.032555 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 32.035µs to process 0 records I0429 08:39:03.031137 1 tasks_processing.go:71] worker 24 working on openstack_dataplanedeployments task. I0429 08:39:03.031134 1 tasks_processing.go:71] worker 14 working on schedulers task. I0429 08:39:03.031138 1 tasks_processing.go:71] worker 21 working on nodenetworkstates task. I0429 08:39:03.031159 1 tasks_processing.go:71] worker 12 working on ingress task. I0429 08:39:03.031166 1 tasks_processing.go:71] worker 25 working on crds task. I0429 08:39:03.031177 1 tasks_processing.go:71] worker 45 working on machine_autoscalers task. I0429 08:39:03.031180 1 tasks_processing.go:71] worker 47 working on proxies task. I0429 08:39:03.031183 1 tasks_processing.go:71] worker 61 working on node_features task. I0429 08:39:03.031187 1 tasks_processing.go:71] worker 22 working on machines task. I0429 08:39:03.031193 1 tasks_processing.go:71] worker 13 working on container_images task. I0429 08:39:03.031074 1 tasks_processing.go:71] worker 57 working on clusterroles task. I0429 08:39:03.031082 1 tasks_processing.go:71] worker 50 working on olm_operators task. I0429 08:39:03.031086 1 tasks_processing.go:71] worker 51 working on feature_gates task. I0429 08:39:03.031055 1 tasks_processing.go:71] worker 10 working on certificate_signing_requests task. I0429 08:39:03.031142 1 tasks_processing.go:71] worker 26 working on metrics task. W0429 08:39:03.034578 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:03.034593 1 tasks_processing.go:74] worker 26 stopped. I0429 08:39:03.034606 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 37.719µs to process 0 records I0429 08:39:03.036011 1 tasks_processing.go:74] worker 7 stopped. I0429 08:39:03.036025 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.148396ms to process 0 records I0429 08:39:03.036035 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 5.402293ms to process 0 records I0429 08:39:03.036039 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 5.17002ms to process 0 records I0429 08:39:03.036044 1 tasks_processing.go:74] worker 5 stopped. I0429 08:39:03.036047 1 tasks_processing.go:74] worker 9 stopped. I0429 08:39:03.036347 1 tasks_processing.go:74] worker 6 stopped. I0429 08:39:03.036358 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 5.494446ms to process 0 records I0429 08:39:03.037319 1 tasks_processing.go:74] worker 34 stopped. I0429 08:39:03.037331 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 6.42939ms to process 0 records I0429 08:39:03.037664 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0429 08:39:03.037683 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0429 08:39:03.037690 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0429 08:39:03.037694 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0429 08:39:03.037704 1 tasks_processing.go:74] worker 2 stopped. I0429 08:39:03.037716 1 controller.go:531] The operator is still being initialized I0429 08:39:03.037726 1 controller.go:554] The operator is healthy I0429 08:39:03.037868 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=3091437b8592d4ef87710393af94288919d4c6922ea93459be67c85e9e7e9fe3 I0429 08:39:03.037889 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=568414145fd0a272a7f9f90852dd96f3df7e409d7b811f39723197ad2432d617 I0429 08:39:03.037904 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ae7ea0fc32a39afd5b418bb31b07a73c2caaf94d87bdec24e258f1788c61ac2f I0429 08:39:03.037910 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 7.076666ms to process 3 records I0429 08:39:03.041640 1 tasks_processing.go:74] worker 29 stopped. I0429 08:39:03.041648 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 10.485ms to process 0 records I0429 08:39:03.041720 1 tasks_processing.go:74] worker 17 stopped. I0429 08:39:03.041733 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 10.696792ms to process 0 records E0429 08:39:03.041748 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0429 08:39:03.041757 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 10.302359ms to process 0 records I0429 08:39:03.041759 1 tasks_processing.go:74] worker 33 stopped. I0429 08:39:03.041763 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 9.940416ms to process 0 records I0429 08:39:03.041767 1 tasks_processing.go:74] worker 41 stopped. I0429 08:39:03.043348 1 tasks_processing.go:74] worker 28 stopped. I0429 08:39:03.043422 1 recorder.go:75] Recording config/image with fingerprint=1ddad6ed10b3ef83ae87a2a1fbb4134706a2ed1f674abe4bf917b234b401edcb I0429 08:39:03.043434 1 gather.go:177] gatherer "clusterconfig" function "image" took 12.596338ms to process 1 records I0429 08:39:03.045518 1 tasks_processing.go:74] worker 55 stopped. I0429 08:39:03.046007 1 recorder.go:75] Recording config/infrastructure with fingerprint=ee46223809581a8f740c8fc22c3331cb7b289f36e23fe761a6768047d6df8a30 I0429 08:39:03.046020 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 14.410904ms to process 1 records I0429 08:39:03.053102 1 tasks_processing.go:74] worker 58 stopped. I0429 08:39:03.053114 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 22.271631ms to process 0 records I0429 08:39:03.053868 1 tasks_processing.go:74] worker 15 stopped. E0429 08:39:03.053880 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0429 08:39:03.053887 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 21.52173ms to process 0 records I0429 08:39:03.053941 1 tasks_processing.go:74] worker 49 stopped. I0429 08:39:03.053956 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 21.486713ms to process 0 records I0429 08:39:03.060490 1 tasks_processing.go:74] worker 30 stopped. I0429 08:39:03.060675 1 gather_logs.go:145] no pods in namespace were found I0429 08:39:03.060788 1 recorder.go:75] Recording config/oauth with fingerprint=ca6268630021470125725166abbd3cfc0e233e9321947b37a8794e22bf6e1146 I0429 08:39:03.060807 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 29.161219ms to process 1 records I0429 08:39:03.060815 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 28.29589ms to process 0 records I0429 08:39:03.060821 1 tasks_processing.go:74] worker 11 stopped. I0429 08:39:03.060896 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=9e3e1a6a42caf12a69e8ae7d9f113584145626e686071a698c5ca0199cc427f0 I0429 08:39:03.060917 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=58d6ba82d23d22fb8545628541f90ccb31ac4c74af87886e27d31ecdb3c987df I0429 08:39:03.060918 1 tasks_processing.go:74] worker 62 stopped. I0429 08:39:03.060926 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.640741ms to process 2 records I0429 08:39:03.060935 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 28.438095ms to process 0 records E0429 08:39:03.060941 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0429 08:39:03.060949 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 28.677239ms to process 0 records I0429 08:39:03.060949 1 tasks_processing.go:74] worker 36 stopped. I0429 08:39:03.060953 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 29.40294ms to process 0 records I0429 08:39:03.060956 1 tasks_processing.go:74] worker 59 stopped. I0429 08:39:03.060957 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 28.802413ms to process 0 records I0429 08:39:03.060960 1 tasks_processing.go:74] worker 20 stopped. I0429 08:39:03.060973 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 29.433092ms to process 0 records I0429 08:39:03.060975 1 tasks_processing.go:74] worker 3 stopped. I0429 08:39:03.060984 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 28.443937ms to process 0 records I0429 08:39:03.060987 1 tasks_processing.go:74] worker 46 stopped. I0429 08:39:03.060993 1 tasks_processing.go:74] worker 16 stopped. I0429 08:39:03.060993 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 29.375408ms to process 0 records I0429 08:39:03.060998 1 tasks_processing.go:74] worker 38 stopped. I0429 08:39:03.061076 1 tasks_processing.go:74] worker 37 stopped. I0429 08:39:03.061202 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=3f1a1a73056cbf75fc17e95a6100bf1376eba974b837b4f6451d7f190457270f I0429 08:39:03.061317 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=d213b73e15c38aef21d33211893c0756f5edd9961e6c6c40ef3278b9bf14c891 I0429 08:39:03.061370 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=40a52e960561abdb15c9c97e4cdf352b1ad3c159055b27b5f7efa17b82d74475 I0429 08:39:03.061381 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 29.012066ms to process 3 records E0429 08:39:03.061440 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0429 08:39:03.061522 1 tasks_processing.go:74] worker 27 stopped. I0429 08:39:03.061567 1 recorder.go:75] Recording config/network with fingerprint=05ab3cd870e784dfead1f4fc822160d3f352adb1253d1f7aa9ce447e3b0bc074 I0429 08:39:03.061581 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.776705ms to process 1 records I0429 08:39:03.061675 1 tasks_processing.go:74] worker 43 stopped. I0429 08:39:03.061753 1 recorder.go:75] Recording config/apiserver with fingerprint=c67a57588beb5aa0d652a0564235f2ee947274291e5a0dd87ae17c78635878c8 I0429 08:39:03.061770 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 28.990521ms to process 1 records I0429 08:39:03.061853 1 tasks_processing.go:74] worker 53 stopped. I0429 08:39:03.062070 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=997b440a49b92c2807742c229d454812a8ec243c193eb97ce3027a80c82d71a2 I0429 08:39:03.062087 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 29.614309ms to process 1 records I0429 08:39:03.062101 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 29.267792ms to process 0 records I0429 08:39:03.062107 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 28.700969ms to process 0 records I0429 08:39:03.062112 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 28.754296ms to process 0 records I0429 08:39:03.062116 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 28.691197ms to process 0 records I0429 08:39:03.062119 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 28.013157ms to process 0 records I0429 08:39:03.062120 1 tasks_processing.go:74] worker 44 stopped. E0429 08:39:03.062123 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0429 08:39:03.062131 1 tasks_processing.go:74] worker 39 stopped. I0429 08:39:03.062137 1 tasks_processing.go:74] worker 24 stopped. I0429 08:39:03.062142 1 tasks_processing.go:74] worker 61 stopped. I0429 08:39:03.062147 1 tasks_processing.go:74] worker 21 stopped. I0429 08:39:03.062148 1 tasks_processing.go:74] worker 45 stopped. I0429 08:39:03.062158 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0429 08:39:03.062179 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 29.764378ms to process 1 records I0429 08:39:03.062285 1 tasks_processing.go:74] worker 40 stopped. I0429 08:39:03.062461 1 recorder.go:75] Recording config/authentication with fingerprint=2807b51fd7c1f48dbec2ab5bb526e204a1fb066cfeccbd70a407dd4490d40b12 I0429 08:39:03.062476 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 30.182347ms to process 1 records E0429 08:39:03.062486 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0429 08:39:03.062498 1 gather.go:177] gatherer "clusterconfig" function "machines" took 27.969176ms to process 0 records I0429 08:39:03.062564 1 tasks_processing.go:74] worker 22 stopped. I0429 08:39:03.062622 1 tasks_processing.go:74] worker 0 stopped. I0429 08:39:03.063211 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=d2197d33a8891ce6e98d423a19c9762c572ace5aeddc97aadb8efd8faa78fe4a I0429 08:39:03.063422 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.923747ms to process 1 records I0429 08:39:03.067002 1 tasks_processing.go:74] worker 56 stopped. I0429 08:39:03.067021 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 35.744386ms to process 0 records I0429 08:39:03.067132 1 tasks_processing.go:74] worker 47 stopped. I0429 08:39:03.067215 1 recorder.go:75] Recording config/proxy with fingerprint=6c3d09faee713e4c46b2df578b4a6caf5352df1b32aa0afa8443c4495807def8 I0429 08:39:03.067232 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 34.307811ms to process 1 records I0429 08:39:03.067317 1 tasks_processing.go:74] worker 48 stopped. I0429 08:39:03.067347 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0429 08:39:03.067359 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.347044ms to process 1 records W0429 08:39:03.067945 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 08:39:03.070058 1 tasks_processing.go:74] worker 12 stopped. I0429 08:39:03.070208 1 recorder.go:75] Recording config/ingress with fingerprint=9c2ab21b81a80f55795cf0a2222332920b83616cede8b72d096d7f39013242b9 I0429 08:39:03.070221 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 37.336722ms to process 1 records I0429 08:39:03.070788 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0429 08:39:03.070871 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0429 08:39:03.070937 1 operator.go:328] started I0429 08:39:03.070950 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0429 08:39:03.072202 1 tasks_processing.go:74] worker 51 stopped. I0429 08:39:03.072314 1 recorder.go:75] Recording config/featuregate with fingerprint=6892f040e314b57d683ff9c21798a4593c6823fe70881a8017a505eb4949c087 I0429 08:39:03.072326 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 38.115026ms to process 1 records I0429 08:39:03.073039 1 tasks_processing.go:74] worker 14 stopped. I0429 08:39:03.073096 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=89ce16fd35d0d678ce2f95dc7f3770ab3ffa82881c8cd4fce97e4336c59b327c I0429 08:39:03.073107 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 40.378749ms to process 1 records I0429 08:39:03.074441 1 tasks_processing.go:74] worker 52 stopped. I0429 08:39:03.074453 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 42.751768ms to process 0 records I0429 08:39:03.074560 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=59557c4119249ebb46c426dc43d5307275c6dab4ec8ec57d0661e3c70794e2c7 I0429 08:39:03.074594 1 tasks_processing.go:74] worker 35 stopped. I0429 08:39:03.074635 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=1b3f2f9d001c0c17a1dae0e891029926caeb1f05426301854ec9b5b53b514c2b I0429 08:39:03.074658 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a59733cde5c1c2caf40b967a25b74df130b588027f0380df9d9578d60e5c6bfe I0429 08:39:03.074693 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=8f09f62eaf406313591bcab90fc54964030f077dc67824ef313da59e262c98e3 I0429 08:39:03.074722 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1ad27c65876916d3922e51167e9ca5273053931821d7a2d94f2239bd4b5fa1fe I0429 08:39:03.074750 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=349340ed11d0c269f499607c3f68a31bd3174f4cb7e1f9b33e510c325c50cc0c I0429 08:39:03.074787 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=e1bfa9674a16886453f03864217ae7d58cd0e11ce958f3a089ca0bc0b050d755 I0429 08:39:03.074858 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=65b7135f3029f43ab5b5e144e8d0a988d8b9f335fd12aad49a071ed9f2e9dc37 I0429 08:39:03.074890 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=8867d25472f5666f05923e6e6e6d2c3d625cfe555a80c4563b9a64a28ce44548 I0429 08:39:03.074935 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ca3345fce4f58cb235387d913f33dbb09829b7e4da5883b66c8335acb96a97a2 I0429 08:39:03.074964 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=488905fbd05d155e4acd24ce3fd3fd301bfd0af2c372ca16e40e99ae841083f7 I0429 08:39:03.074972 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 42.514183ms to process 11 records I0429 08:39:03.074982 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 40.586919ms to process 0 records I0429 08:39:03.074993 1 tasks_processing.go:74] worker 50 stopped. I0429 08:39:03.075052 1 tasks_processing.go:74] worker 19 stopped. I0429 08:39:03.075341 1 recorder.go:75] Recording config/node/ip-10-0-0-38.ec2.internal with fingerprint=760d653d2280858b5bf21e7fb3a6593a5a4651160f1790f32da1dbfb02d3c1d0 I0429 08:39:03.075427 1 recorder.go:75] Recording config/node/ip-10-0-1-240.ec2.internal with fingerprint=64e9239fbf2b1c0677cfbfee259d91e02f9da66b9d67fdae420c40ed016be8a7 I0429 08:39:03.075480 1 recorder.go:75] Recording config/node/ip-10-0-2-176.ec2.internal with fingerprint=bb9f2501cbb32245c2b6d623ffe3f0aad1282f8c05dfb938e722eead4773f0b0 I0429 08:39:03.075489 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 42.829117ms to process 3 records I0429 08:39:03.076549 1 tasks_processing.go:74] worker 10 stopped. I0429 08:39:03.076566 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 42.25248ms to process 0 records I0429 08:39:03.084690 1 tasks_processing.go:74] worker 42 stopped. I0429 08:39:03.084703 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.7088ms to process 0 records I0429 08:39:03.087278 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0429 08:39:03.087405 1 tasks_processing.go:74] worker 25 stopped. I0429 08:39:03.087409 1 controller.go:254] Source scaController *sca.Controller is not ready I0429 08:39:03.087491 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0429 08:39:03.087520 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0429 08:39:03.087557 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0429 08:39:03.087622 1 controller.go:531] The operator is still being initialized I0429 08:39:03.087650 1 controller.go:554] The operator is healthy I0429 08:39:03.088816 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0429 08:39:03.088959 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0429 08:39:03.088971 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0429 08:39:03.089034 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=04a9a16b8a5cabbbf33d4eec16763668b8c3f1d51f3baff815c16c7afc272352 I0429 08:39:03.089847 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=ce7358749502e0f39da03c3f6bcb93bf41e23cb52f033ab023d5cfd4faf27551 I0429 08:39:03.089874 1 gather.go:177] gatherer "clusterconfig" function "crds" took 54.659571ms to process 2 records I0429 08:39:03.089961 1 tasks_processing.go:74] worker 57 stopped. I0429 08:39:03.090162 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=d5d683c2da0f284b3f954d171e0bb307ce16a95facea8e5027ccb03714ab405e I0429 08:39:03.090322 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=a65e6b7e3184e006af4834b0ce69f52404db81abf91250818bc11fd5ce537846 I0429 08:39:03.090338 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 54.882849ms to process 2 records I0429 08:39:03.091466 1 prometheus_rules.go:88] Prometheus rules successfully created I0429 08:39:03.095606 1 tasks_processing.go:74] worker 63 stopped. I0429 08:39:03.095619 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 64.137177ms to process 0 records E0429 08:39:03.097618 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27b6dbc20b-4b61-4869-b129-eabfca9d3c9d%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:48118->172.30.0.10:53: read: connection refused I0429 08:39:03.097631 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27b6dbc20b-4b61-4869-b129-eabfca9d3c9d%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:48118->172.30.0.10:53: read: connection refused I0429 08:39:03.099600 1 base_controller.go:82] Caches are synced for ConfigController I0429 08:39:03.099612 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0429 08:39:03.105738 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 08:39:03.107954 1 tasks_processing.go:74] worker 23 stopped. E0429 08:39:03.107967 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0429 08:39:03.107972 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0429 08:39:03.107976 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0429 08:39:03.107984 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0429 08:39:03.108015 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0429 08:39:03.108022 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0429 08:39:03.108026 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0429 08:39:03.108030 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0429 08:39:03.108078 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0429 08:39:03.108086 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0429 08:39:03.108092 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 75.675827ms to process 7 records I0429 08:39:03.109633 1 tasks_processing.go:74] worker 60 stopped. E0429 08:39:03.109645 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0429 08:39:03.109650 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pvn461a2e3dg73kigr9ohvaqf1urjn8-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pvn461a2e3dg73kigr9ohvaqf1urjn8-primary-cert-bundle-secret" not found I0429 08:39:03.109691 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=140f6588b05dec4818abe53ff5d4de6541e268cba807e591b6499ecf83f945a2 I0429 08:39:03.109701 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 77.524681ms to process 1 records I0429 08:39:03.152086 1 tasks_processing.go:74] worker 4 stopped. I0429 08:39:03.152311 1 recorder.go:75] Recording config/version with fingerprint=d4fd49e55cbcf66aa2151f8fec74bf311151f33bd96183c1b3dc0a5f5d63ddec I0429 08:39:03.152323 1 recorder.go:75] Recording config/id with fingerprint=864dc45730338f64308ca1d78d7f2c4249705f4d96c7f4b9c9e9b48c737c80ae I0429 08:39:03.152329 1 gather.go:177] gatherer "clusterconfig" function "version" took 121.239049ms to process 2 records I0429 08:39:03.162594 1 tasks_processing.go:74] worker 13 stopped. I0429 08:39:03.163771 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-7brmw with fingerprint=9f55782c7414f0a16923ca59c9b77c89059e8ba82826ecd6fe3427649f413a27 I0429 08:39:03.163860 1 recorder.go:75] Recording config/running_containers with fingerprint=a71759bf11ef46636396ce63a6afae0396408b0ed0deb3220d81516ec8e911a3 I0429 08:39:03.163870 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 128.969948ms to process 2 records I0429 08:39:03.171205 1 base_controller.go:82] Caches are synced for LoggingSyncer I0429 08:39:03.171216 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0429 08:39:03.184470 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0429 08:39:03.187617 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:49443->172.30.0.10:53: read: connection refused I0429 08:39:03.187634 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:49443->172.30.0.10:53: read: connection refused W0429 08:39:04.064792 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 08:39:04.262882 1 gather_cluster_operator_pods_and_events.go:121] Found 16 pods with 18 containers I0429 08:39:04.262899 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1398101 bytes I0429 08:39:04.263269 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hxggd pod in namespace openshift-dns (previous: false). I0429 08:39:04.488627 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxggd pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hxggd\" is waiting to start: ContainerCreating" I0429 08:39:04.488644 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hxggd\" is waiting to start: ContainerCreating" I0429 08:39:04.488652 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hxggd pod in namespace openshift-dns (previous: false). I0429 08:39:04.497971 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0429 08:39:04.667238 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxggd pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hxggd\" is waiting to start: ContainerCreating" I0429 08:39:04.667256 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hxggd\" is waiting to start: ContainerCreating" I0429 08:39:04.667266 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5lwms pod in namespace openshift-dns (previous: false). I0429 08:39:04.929550 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:04.929571 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ct7bz pod in namespace openshift-dns (previous: false). W0429 08:39:05.065158 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 08:39:05.102735 1 tasks_processing.go:74] worker 1 stopped. I0429 08:39:05.102784 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=7ab8311a3e3fb32e6c636f9b6528bfd9e9705037ae290f1896b7ddae7649f033 I0429 08:39:05.102821 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=fa72a2b2107bd06da1c04cd329ded7adaf36c459206b98ae97a0093f1910f3be I0429 08:39:05.102872 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0429 08:39:05.102899 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=98007b402fa756b6f484bc115a327e93163a35556c259966da15eb9cdae2b9d2 I0429 08:39:05.102915 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0429 08:39:05.102956 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=a5268704cde36139671bca97c7dcd0e4bcf8e9a61cce1c281a5b955fdeb7eaf0 I0429 08:39:05.102987 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=69e66a2bdca62814c67ef5487ecc117baa723192ef702c807f4ef977cfa219eb I0429 08:39:05.103010 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=4e11dbff1f27464b0d68dd8534219a08294c385954f9ab78bafd7daba65f59c8 I0429 08:39:05.103024 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=96be4d71d1ccccc681b9ec414f4c8689b3e0971a9a2d370e169663f754bd3d31 I0429 08:39:05.103040 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=8de35744c217f8e26804265ad70d3e58fc89d268412eba689f3df5b5e0b4cc25 I0429 08:39:05.103049 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0429 08:39:05.103065 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=327fc5156a5e2cee881741452c6334039207e224d02b4fd0fcf71bfdfa50f6ec I0429 08:39:05.103076 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0429 08:39:05.103091 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=ffa58707645395641dca241e0aea2e76096a2bafa830da2c1d0f6a2a07b92fc9 I0429 08:39:05.103101 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0429 08:39:05.103122 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d3d345b7c3772ac76950eeb6c6e1575675d230ee7ac406a0ad18c33b29824ae3 I0429 08:39:05.103131 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0429 08:39:05.103149 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=441e64f7934be3f19109125792d006a0259137a476e74dd9b585d97321869da5 I0429 08:39:05.103304 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=17eeff6a02f7a0f0796f67ec4e47f9b5f172d5e14615858fd1844b8aad0d18cc I0429 08:39:05.103314 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0429 08:39:05.103322 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0429 08:39:05.103342 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0429 08:39:05.103364 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=5b4858f970c8d096c23bfd55fc53978072d3e5d3372a34b7ed33e6cb8230048f I0429 08:39:05.103387 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=c038c4471f71ba2911f75fa3f41d17bdeb7417db5b705710fba2a49ea907e219 I0429 08:39:05.103396 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0429 08:39:05.103411 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=5ede2676a6504de095f45a7c6292f11334132bd1bef0a9f6433e1abda1f36de8 I0429 08:39:05.103421 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0429 08:39:05.103434 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=6f218bd76098e5a02f8a0b932ee41c9db916bf2a0d7f76f4bfc1f63eb5e11151 I0429 08:39:05.103449 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=0c22d162795867a48ed017a49fde73ddc70404117a0e40b6a0b67014f2ad5eb2 I0429 08:39:05.103466 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a5bdeabf448f5cacc6853ab3709bdd609d830de1c73beb881b0d96a53fb455ac I0429 08:39:05.103481 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=dc4bbacc7c76e0030d5d43c3a5b7b918a0d5359d4552be2375f924998c4a4687 I0429 08:39:05.103501 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=1e49d8254848797d54aaaeda2bacb239a6f65a98762c833c6f9e31abf878b922 I0429 08:39:05.103511 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0429 08:39:05.103535 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=49d1d98c6d2684eed8e52059cda1bc32589b9e22f4119b770c1f0dca6b44deb6 I0429 08:39:05.103550 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0429 08:39:05.103559 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0429 08:39:05.103565 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.07184322s to process 36 records I0429 08:39:05.117468 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:05.117483 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mq7mq pod in namespace openshift-dns (previous: false). I0429 08:39:05.268752 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:05.268770 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-84cdb56c78-7fcwk pod in namespace openshift-image-registry (previous: false). I0429 08:39:05.462846 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:05.462865 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-c64d887fc-nvgqf pod in namespace openshift-image-registry (previous: false). I0429 08:39:05.667941 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-c64d887fc-nvgqf pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-c64d887fc-nvgqf\" is waiting to start: ContainerCreating" I0429 08:39:05.667958 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-c64d887fc-nvgqf\" is waiting to start: ContainerCreating" I0429 08:39:05.667969 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-c64d887fc-tbtcv pod in namespace openshift-image-registry (previous: false). I0429 08:39:05.865725 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:05.865743 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8kb7c pod in namespace openshift-image-registry (previous: false). W0429 08:39:06.064082 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 08:39:06.072045 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:06.072061 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-clwvz pod in namespace openshift-image-registry (previous: false). I0429 08:39:06.268153 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:06.268168 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-cxhq5 pod in namespace openshift-image-registry (previous: false). I0429 08:39:06.471574 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:06.471587 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-675b7c69bc-txw8m pod in namespace openshift-ingress (previous: false). I0429 08:39:06.670047 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-675b7c69bc-txw8m pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-675b7c69bc-txw8m\" is waiting to start: ContainerCreating" I0429 08:39:06.670063 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-675b7c69bc-txw8m\" is waiting to start: ContainerCreating" I0429 08:39:06.670074 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-798868845-gcjzd pod in namespace openshift-ingress (previous: false). I0429 08:39:06.864384 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 08:39:06.864405 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-798868845-mtmkt pod in namespace openshift-ingress (previous: false). W0429 08:39:07.064096 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 08:39:07.071353 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-798868845-mtmkt pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-798868845-mtmkt\" is waiting to start: ContainerCreating" I0429 08:39:07.071372 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-798868845-mtmkt\" is waiting to start: ContainerCreating" I0429 08:39:07.071383 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-lrtr5 pod in namespace openshift-ingress-canary (previous: false). I0429 08:39:07.266891 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-skz8z pod in namespace openshift-kube-storage-version-migrator (previous: false). I0429 08:39:07.468482 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-skz8z pod in namespace openshift-kube-storage-version-migrator (previous: false). I0429 08:39:07.668407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-7sdzj pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0429 08:39:07.871507 1 tasks_processing.go:74] worker 31 stopped. I0429 08:39:07.871600 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=3fc6c275af3fd053d5fea96be4b6b2e51630fdf1ccb04333e63b2ae18a6a7007 I0429 08:39:07.871637 1 recorder.go:75] Recording events/openshift-dns with fingerprint=8e40380f32f1599ab1b390ec76bd988bd9545e2068a7c56422633c791856e419 I0429 08:39:07.871718 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=ca741442c87e0b613d5ef75234754b0cd9d7c3ca48c2f57fb28ad14ede6db7b9 I0429 08:39:07.871745 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=edfb5cf056be5bcbbe12a685110083049afbe79c7bb5dd58c99f1977e1100228 I0429 08:39:07.871788 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=491c7904097d19698b801b2c521acce1ba1c8853be0a01419b0f49836922b3a9 I0429 08:39:07.871808 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=1fa5f93257459ce6a74e7718930e664094c8efb57b006545b54a482a86cca56e I0429 08:39:07.871821 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=b51c3ad6450fbef3b3658c923b5ebd74dafce2a06f970464667cb381d61aba15 I0429 08:39:07.871883 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=f164cf73060f3236a59733951e82890ca8ffdca05c1e1e24f6ad5e4961d2d82c I0429 08:39:07.871891 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-lrtr5/serve-healthcheck-canary_current.log with fingerprint=787b631159ad151a6d57ef69362d2dc1668fb1aa5503557233c6eddbcf2da123 I0429 08:39:07.871904 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-skz8z/migrator_current.log with fingerprint=b3cccca9266943897a4e43a571454fa1b40b7242e8b5bc83265419aa83eadd63 I0429 08:39:07.871912 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-skz8z/graceful-termination_current.log with fingerprint=45132bede18b607e1923d18ed1224cf589a2f4c89b4349334dd3542376a33f22 I0429 08:39:07.871978 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-7sdzj/kube-storage-version-migrator-operator_current.log with fingerprint=4d6f089c48d51b28a62045735fa9747d25dd5dcdf165a0099de056741ede476e I0429 08:39:07.871987 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.840470476s to process 12 records W0429 08:39:08.061030 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0429 08:39:08.061053 1 tasks_processing.go:74] worker 8 stopped. E0429 08:39:08.061064 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0429 08:39:08.061074 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0429 08:39:08.061088 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0429 08:39:08.061099 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.030263595s to process 1 records I0429 08:39:15.457952 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 08:39:15.761421 1 tasks_processing.go:74] worker 32 stopped. I0429 08:39:15.761461 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0429 08:39:15.761474 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.729384636s to process 1 records I0429 08:39:15.965954 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 08:39:16.160863 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 08:39:16.440400 1 tasks_processing.go:74] worker 54 stopped. I0429 08:39:16.440659 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0429 08:39:16.440675 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.409027921s to process 1 records E0429 08:39:16.440730 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.41s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0429 08:39:16.441846 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0429 08:39:16.441861 1 periodic.go:216] Running workloads gatherer I0429 08:39:16.441875 1 tasks_processing.go:45] number of workers: 2 I0429 08:39:16.441887 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 08:39:16.441888 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 08:39:16.441891 1 tasks_processing.go:71] worker 1 working on workload_info task. I0429 08:39:16.441901 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0429 08:39:16.481473 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0429 08:39:16.487815 1 tasks_processing.go:74] worker 0 stopped. I0429 08:39:16.487849 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 45.835782ms to process 0 records I0429 08:39:16.492586 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (12ms) I0429 08:39:16.504542 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (12ms) I0429 08:39:16.516441 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (12ms) I0429 08:39:16.528779 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (12ms) I0429 08:39:16.540470 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (12ms) I0429 08:39:16.555046 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (15ms) I0429 08:39:16.569441 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (14ms) I0429 08:39:16.581447 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (12ms) I0429 08:39:16.593663 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (12ms) I0429 08:39:16.615306 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (22ms) I0429 08:39:16.628701 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (13ms) I0429 08:39:16.692648 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (64ms) I0429 08:39:16.792442 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0429 08:39:16.893463 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (101ms) I0429 08:39:16.993128 1 gather_workloads_info.go:387] No image sha256:d9ed66918db4dfba8bd354c9ede4d676449fa0eccef649b3d8945cc1da1c60e3 (100ms) I0429 08:39:17.093491 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (100ms) I0429 08:39:17.193427 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0429 08:39:17.293244 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (100ms) I0429 08:39:17.392886 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0429 08:39:17.492679 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0429 08:39:17.593054 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0429 08:39:17.694951 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (102ms) I0429 08:39:17.800646 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (106ms) I0429 08:39:17.895431 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (95ms) I0429 08:39:18.012485 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (117ms) I0429 08:39:18.098843 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (86ms) I0429 08:39:18.192446 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (94ms) I0429 08:39:18.293256 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (101ms) I0429 08:39:18.393444 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0429 08:39:18.493198 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0429 08:39:18.593376 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0429 08:39:18.693167 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (100ms) I0429 08:39:18.792964 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (100ms) I0429 08:39:18.892944 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0429 08:39:18.892974 1 tasks_processing.go:74] worker 1 stopped. E0429 08:39:18.892984 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0429 08:39:18.893239 1 recorder.go:75] Recording config/workload_info with fingerprint=02ab313908cea6a53a3421134b0f0899200e1d4d3d7e9a5ddb0d430a07ab90cd I0429 08:39:18.893255 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.45106418s to process 1 records E0429 08:39:18.893278 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.451s with: function \"workload_info\" failed with an error" I0429 08:39:18.894375 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0429 08:39:18.894390 1 periodic.go:216] Running conditional gatherer I0429 08:39:18.901802 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0429 08:39:18.908601 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.17:35112->172.30.0.10:53: read: connection refused E0429 08:39:18.908946 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 08:39:18.909002 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0429 08:39:18.916232 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0429 08:39:18.916244 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916249 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916252 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916255 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916258 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916268 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916271 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916274 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 08:39:18.916277 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0429 08:39:18.916290 1 tasks_processing.go:45] number of workers: 3 I0429 08:39:18.916296 1 tasks_processing.go:69] worker 2 listening for tasks. I0429 08:39:18.916301 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0429 08:39:18.916303 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 08:39:18.916315 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0429 08:39:18.916318 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 08:39:18.916321 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0429 08:39:18.916327 1 tasks_processing.go:74] worker 1 stopped. I0429 08:39:18.916376 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0429 08:39:18.916390 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 900ns to process 1 records I0429 08:39:18.916419 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0429 08:39:18.916427 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.296µs to process 1 records I0429 08:39:18.916432 1 tasks_processing.go:74] worker 0 stopped. I0429 08:39:18.916559 1 tasks_processing.go:74] worker 2 stopped. I0429 08:39:18.916571 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 228.604µs to process 0 records I0429 08:39:18.916590 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.17:35112->172.30.0.10:53: read: connection refused I0429 08:39:18.916607 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0429 08:39:18.945135 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=52c6ada6ef505adc18d959bd4db2abad4404f7a03f2aecf9220363067a2ee96c I0429 08:39:18.945277 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-04-29-083918.tar.gz I0429 08:39:18.951991 1 diskrecorder.go:51] Wrote 107 records to disk in 6ms I0429 08:39:18.952018 1 periodic.go:285] Gathering cluster info every 2h0m0s I0429 08:39:18.952039 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0429 08:39:30.294248 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 08:40:07.480661 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="da733bc0bb8056db3f3c2dc99a2868018198c17c323f3b34b6b460838ad02ace") W0429 08:40:07.480693 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0429 08:40:07.480736 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="89c927c9e691715ad0b8c9a244e5df6cf6c3f3993500a6dd8e53c47f8af06a4b") I0429 08:40:07.480765 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"