W0430 13:50:05.047426 1 cmd.go:257] Using insecure, self-signed certificates I0430 13:50:06.174740 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:06.175167 1 observer_polling.go:159] Starting file observer I0430 13:50:06.499950 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0430 13:50:06.500158 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0430 13:50:06.500716 1 secure_serving.go:57] Forcing use of http/1.1 only W0430 13:50:06.500741 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0430 13:50:06.500748 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. I0430 13:50:06.500745 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0430 13:50:06.500757 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0430 13:50:06.500761 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0430 13:50:06.500766 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0430 13:50:06.500770 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0430 13:50:06.504916 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0430 13:50:06.504984 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"46ff1ca6-e08f-4bf1-b26a-bda03838fb7a", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0430 13:50:06.505391 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0430 13:50:06.505406 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0430 13:50:06.505406 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0430 13:50:06.505424 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:50:06.505428 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:50:06.505419 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0430 13:50:06.507036 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3722036813/tls.crt::/tmp/serving-cert-3722036813/tls.key" I0430 13:50:06.507687 1 secure_serving.go:213] Serving securely on [::]:8443 I0430 13:50:06.507717 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0430 13:50:06.513137 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0430 13:50:06.513165 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:50:06.513288 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0430 13:50:06.520249 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:50:06.520272 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:50:06.525981 1 secretconfigobserver.go:119] support secret does not exist I0430 13:50:06.532689 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:50:06.537974 1 secretconfigobserver.go:119] support secret does not exist I0430 13:50:06.538478 1 recorder.go:161] Pruning old reports every 8h13m56s, max age is 288h0m0s I0430 13:50:06.543358 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0430 13:50:06.543363 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0430 13:50:06.543380 1 insightsreport.go:296] Starting report retriever I0430 13:50:06.543380 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0430 13:50:06.543387 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0430 13:50:06.543399 1 periodic.go:209] Running clusterconfig gatherer I0430 13:50:06.543443 1 tasks_processing.go:45] number of workers: 64 I0430 13:50:06.543469 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:50:06.543476 1 tasks_processing.go:69] worker 6 listening for tasks. I0430 13:50:06.543485 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:50:06.543486 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:50:06.543492 1 tasks_processing.go:69] worker 20 listening for tasks. I0430 13:50:06.543497 1 tasks_processing.go:69] worker 3 listening for tasks. I0430 13:50:06.543501 1 tasks_processing.go:71] worker 20 working on cluster_apiserver task. I0430 13:50:06.543505 1 tasks_processing.go:69] worker 4 listening for tasks. I0430 13:50:06.543507 1 tasks_processing.go:69] worker 42 listening for tasks. I0430 13:50:06.543503 1 tasks_processing.go:69] worker 13 listening for tasks. I0430 13:50:06.543504 1 tasks_processing.go:69] worker 21 listening for tasks. I0430 13:50:06.543496 1 tasks_processing.go:71] worker 2 working on proxies task. I0430 13:50:06.543515 1 tasks_processing.go:69] worker 22 listening for tasks. I0430 13:50:06.543515 1 tasks_processing.go:69] worker 5 listening for tasks. I0430 13:50:06.543521 1 tasks_processing.go:69] worker 8 listening for tasks. I0430 13:50:06.543516 1 tasks_processing.go:69] worker 7 listening for tasks. I0430 13:50:06.543529 1 tasks_processing.go:69] worker 9 listening for tasks. I0430 13:50:06.543523 1 tasks_processing.go:69] worker 23 listening for tasks. I0430 13:50:06.543530 1 tasks_processing.go:69] worker 17 listening for tasks. I0430 13:50:06.543540 1 tasks_processing.go:69] worker 11 listening for tasks. I0430 13:50:06.543544 1 tasks_processing.go:69] worker 12 listening for tasks. I0430 13:50:06.543535 1 tasks_processing.go:69] worker 10 listening for tasks. I0430 13:50:06.543551 1 tasks_processing.go:69] worker 14 listening for tasks. I0430 13:50:06.543553 1 tasks_processing.go:69] worker 16 listening for tasks. I0430 13:50:06.543495 1 tasks_processing.go:69] worker 40 listening for tasks. I0430 13:50:06.543558 1 tasks_processing.go:69] worker 24 listening for tasks. I0430 13:50:06.543556 1 tasks_processing.go:69] worker 54 listening for tasks. I0430 13:50:06.543564 1 tasks_processing.go:69] worker 43 listening for tasks. I0430 13:50:06.543554 1 tasks_processing.go:69] worker 19 listening for tasks. I0430 13:50:06.543569 1 tasks_processing.go:69] worker 25 listening for tasks. I0430 13:50:06.543569 1 tasks_processing.go:69] worker 18 listening for tasks. I0430 13:50:06.543578 1 tasks_processing.go:69] worker 26 listening for tasks. I0430 13:50:06.543570 1 tasks_processing.go:69] worker 15 listening for tasks. I0430 13:50:06.543583 1 tasks_processing.go:71] worker 18 working on feature_gates task. I0430 13:50:06.543586 1 tasks_processing.go:69] worker 27 listening for tasks. I0430 13:50:06.543562 1 tasks_processing.go:69] worker 60 listening for tasks. I0430 13:50:06.543586 1 tasks_processing.go:69] worker 59 listening for tasks. I0430 13:50:06.543592 1 tasks_processing.go:69] worker 46 listening for tasks. I0430 13:50:06.543573 1 tasks_processing.go:69] worker 44 listening for tasks. I0430 13:50:06.543590 1 tasks_processing.go:71] worker 25 working on dvo_metrics task. I0430 13:50:06.543601 1 tasks_processing.go:69] worker 53 listening for tasks. I0430 13:50:06.543600 1 tasks_processing.go:69] worker 51 listening for tasks. I0430 13:50:06.543606 1 tasks_processing.go:69] worker 30 listening for tasks. I0430 13:50:06.543577 1 tasks_processing.go:69] worker 56 listening for tasks. I0430 13:50:06.543611 1 tasks_processing.go:71] worker 42 working on clusterroles task. I0430 13:50:06.543616 1 tasks_processing.go:69] worker 48 listening for tasks. I0430 13:50:06.543609 1 tasks_processing.go:71] worker 16 working on oauths task. I0430 13:50:06.543623 1 tasks_processing.go:71] worker 24 working on machines task. I0430 13:50:06.543626 1 tasks_processing.go:69] worker 63 listening for tasks. I0430 13:50:06.543619 1 tasks_processing.go:69] worker 52 listening for tasks. I0430 13:50:06.543623 1 tasks_processing.go:69] worker 57 listening for tasks. I0430 13:50:06.543630 1 tasks_processing.go:71] worker 5 working on sap_config task. I0430 13:50:06.543641 1 tasks_processing.go:69] worker 34 listening for tasks. I0430 13:50:06.543642 1 tasks_processing.go:71] worker 43 working on qemu_kubevirt_launcher_logs task. I0430 13:50:06.543641 1 tasks_processing.go:69] worker 62 listening for tasks. I0430 13:50:06.543649 1 tasks_processing.go:69] worker 33 listening for tasks. I0430 13:50:06.543650 1 tasks_processing.go:69] worker 39 listening for tasks. I0430 13:50:06.543653 1 tasks_processing.go:71] worker 7 working on openstack_controlplanes task. I0430 13:50:06.543656 1 tasks_processing.go:71] worker 9 working on openstack_version task. I0430 13:50:06.543657 1 tasks_processing.go:71] worker 8 working on container_runtime_configs task. I0430 13:50:06.543655 1 tasks_processing.go:69] worker 36 listening for tasks. I0430 13:50:06.543690 1 tasks_processing.go:71] worker 0 working on ingress_certificates task. I0430 13:50:06.543701 1 tasks_processing.go:69] worker 35 listening for tasks. I0430 13:50:06.543709 1 tasks_processing.go:71] worker 17 working on schedulers task. I0430 13:50:06.543625 1 tasks_processing.go:69] worker 32 listening for tasks. I0430 13:50:06.543588 1 tasks_processing.go:69] worker 50 listening for tasks. I0430 13:50:06.543594 1 tasks_processing.go:69] worker 28 listening for tasks. I0430 13:50:06.543568 1 tasks_processing.go:69] worker 55 listening for tasks. I0430 13:50:06.543740 1 tasks_processing.go:71] worker 1 working on crds task. I0430 13:50:06.543747 1 tasks_processing.go:71] worker 13 working on ceph_cluster task. I0430 13:50:06.543773 1 tasks_processing.go:71] worker 12 working on machine_healthchecks task. I0430 13:50:06.543792 1 tasks_processing.go:71] worker 15 working on pdbs task. I0430 13:50:06.543797 1 tasks_processing.go:71] worker 14 working on image task. I0430 13:50:06.543580 1 tasks_processing.go:69] worker 45 listening for tasks. I0430 13:50:06.544085 1 tasks_processing.go:71] worker 60 working on openshift_machine_api_events task. I0430 13:50:06.544160 1 tasks_processing.go:71] worker 45 working on openshift_logging task. I0430 13:50:06.544205 1 tasks_processing.go:71] worker 59 working on overlapping_namespace_uids task. I0430 13:50:06.544239 1 tasks_processing.go:71] worker 30 working on storage_classes task. I0430 13:50:06.544287 1 tasks_processing.go:71] worker 32 working on infrastructures task. I0430 13:50:06.544346 1 tasks_processing.go:71] worker 62 working on machine_config_pools task. I0430 13:50:06.544348 1 tasks_processing.go:71] worker 33 working on openstack_dataplanedeployments task. I0430 13:50:06.544417 1 tasks_processing.go:71] worker 35 working on aggregated_monitoring_cr_names task. I0430 13:50:06.544214 1 tasks_processing.go:71] worker 44 working on active_alerts task. I0430 13:50:06.544086 1 tasks_processing.go:71] worker 51 working on support_secret task. I0430 13:50:06.544165 1 tasks_processing.go:71] worker 56 working on metrics task. W0430 13:50:06.544771 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:06.544789 1 tasks_processing.go:71] worker 56 working on nodenetworkconfigurationpolicies task. I0430 13:50:06.543783 1 tasks_processing.go:71] worker 55 working on certificate_signing_requests task. I0430 13:50:06.543607 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0430 13:50:06.543642 1 tasks_processing.go:69] worker 38 listening for tasks. I0430 13:50:06.544294 1 tasks_processing.go:71] worker 50 working on config_maps task. I0430 13:50:06.545087 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 35.172µs to process 0 records I0430 13:50:06.543501 1 tasks_processing.go:69] worker 41 listening for tasks. I0430 13:50:06.543600 1 tasks_processing.go:69] worker 29 listening for tasks. I0430 13:50:06.545350 1 tasks_processing.go:71] worker 38 working on silenced_alerts task. I0430 13:50:06.545432 1 tasks_processing.go:71] worker 41 working on mutating_webhook_configurations task. I0430 13:50:06.545608 1 tasks_processing.go:71] worker 29 working on monitoring_persistent_volumes task. I0430 13:50:06.544137 1 tasks_processing.go:71] worker 46 working on jaegers task. W0430 13:50:06.544532 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:06.545928 1 tasks_processing.go:71] worker 44 working on image_pruners task. W0430 13:50:06.545448 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:06.543792 1 tasks_processing.go:71] worker 10 working on sap_datahubs task. I0430 13:50:06.543602 1 tasks_processing.go:71] worker 3 working on image_registries task. I0430 13:50:06.543608 1 tasks_processing.go:69] worker 47 listening for tasks. I0430 13:50:06.543603 1 tasks_processing.go:69] worker 58 listening for tasks. I0430 13:50:06.543613 1 tasks_processing.go:71] worker 54 working on container_images task. I0430 13:50:06.543617 1 tasks_processing.go:71] worker 40 working on ingress task. I0430 13:50:06.545996 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.410017ms to process 0 records I0430 13:50:06.543619 1 tasks_processing.go:69] worker 31 listening for tasks. I0430 13:50:06.546019 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 561.443µs to process 0 records I0430 13:50:06.543634 1 tasks_processing.go:69] worker 61 listening for tasks. I0430 13:50:06.543635 1 tasks_processing.go:69] worker 37 listening for tasks. I0430 13:50:06.546034 1 tasks_processing.go:71] worker 38 working on networks task. I0430 13:50:06.543731 1 tasks_processing.go:71] worker 6 working on machine_autoscalers task. I0430 13:50:06.543787 1 tasks_processing.go:71] worker 26 working on install_plans task. I0430 13:50:06.543597 1 tasks_processing.go:71] worker 23 working on cost_management_metrics_configs task. I0430 13:50:06.543862 1 tasks_processing.go:71] worker 27 working on node_logs task. I0430 13:50:06.543864 1 tasks_processing.go:71] worker 57 working on pod_network_connectivity_checks task. I0430 13:50:06.543866 1 tasks_processing.go:71] worker 52 working on tsdb_status task. I0430 13:50:06.543859 1 tasks_processing.go:71] worker 11 working on version task. I0430 13:50:06.543868 1 tasks_processing.go:71] worker 53 working on nodenetworkstates task. I0430 13:50:06.543862 1 tasks_processing.go:71] worker 22 working on olm_operators task. I0430 13:50:06.543862 1 tasks_processing.go:71] worker 21 working on sap_pods task. I0430 13:50:06.543863 1 tasks_processing.go:71] worker 19 working on machine_sets task. I0430 13:50:06.544167 1 tasks_processing.go:71] worker 36 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0430 13:50:06.544166 1 tasks_processing.go:71] worker 48 working on nodes task. I0430 13:50:06.544243 1 tasks_processing.go:71] worker 34 working on operators_pods_and_events task. I0430 13:50:06.544311 1 tasks_processing.go:71] worker 28 working on machine_configs task. I0430 13:50:06.544297 1 tasks_processing.go:71] worker 63 working on openstack_dataplanenodesets task. I0430 13:50:06.543585 1 tasks_processing.go:69] worker 49 listening for tasks. I0430 13:50:06.544543 1 tasks_processing.go:71] worker 39 working on lokistack task. I0430 13:50:06.546640 1 tasks_processing.go:71] worker 58 working on service_accounts task. I0430 13:50:06.546678 1 tasks_processing.go:71] worker 47 working on validating_webhook_configurations task. W0430 13:50:06.546733 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:06.546768 1 tasks_processing.go:74] worker 52 stopped. I0430 13:50:06.546781 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 700.175µs to process 0 records I0430 13:50:06.546799 1 tasks_processing.go:71] worker 31 working on authentication task. I0430 13:50:06.546931 1 tasks_processing.go:71] worker 61 working on operators task. I0430 13:50:06.546942 1 tasks_processing.go:74] worker 37 stopped. I0430 13:50:06.547863 1 tasks_processing.go:74] worker 49 stopped. I0430 13:50:06.549229 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0430 13:50:06.549246 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:50:06.549252 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:50:06.549254 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:50:06.549275 1 controller.go:489] The operator is still being initialized I0430 13:50:06.549281 1 controller.go:512] The operator is healthy I0430 13:50:06.549583 1 tasks_processing.go:74] worker 20 stopped. I0430 13:50:06.549737 1 recorder.go:75] Recording config/apiserver with fingerprint=5e23f0e5c5c57a9767cfffae04e36f9c8bcc44c3bc13e176a62c9f0b173092e9 I0430 13:50:06.549750 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 6.068327ms to process 1 records I0430 13:50:06.572601 1 tasks_processing.go:74] worker 7 stopped. I0430 13:50:06.572623 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 28.931457ms to process 0 records I0430 13:50:06.572794 1 tasks_processing.go:74] worker 13 stopped. I0430 13:50:06.572809 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 29.035235ms to process 0 records I0430 13:50:06.572858 1 tasks_processing.go:74] worker 2 stopped. I0430 13:50:06.572962 1 recorder.go:75] Recording config/proxy with fingerprint=8cfcaba74c604fcf8e6171c34a2c61343e865f0649298a9dfe6bf4a3d27b6f32 I0430 13:50:06.572980 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 29.336003ms to process 1 records E0430 13:50:06.572997 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0430 13:50:06.573008 1 gather.go:177] gatherer "clusterconfig" function "machines" took 29.286601ms to process 0 records I0430 13:50:06.573070 1 tasks_processing.go:74] worker 24 stopped. I0430 13:50:06.573111 1 recorder.go:75] Recording config/featuregate with fingerprint=3030ecd04f2846e1063c2ec978c96ff4d60a9a1b2901c7870aaba60e8816183a I0430 13:50:06.573121 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.409874ms to process 1 records I0430 13:50:06.573130 1 tasks_processing.go:74] worker 18 stopped. I0430 13:50:06.585857 1 tasks_processing.go:74] worker 33 stopped. I0430 13:50:06.585880 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 41.465945ms to process 0 records I0430 13:50:06.585890 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 42.201728ms to process 0 records I0430 13:50:06.585897 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 41.077284ms to process 0 records I0430 13:50:06.585902 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 41.68202ms to process 0 records I0430 13:50:06.585907 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 42.225113ms to process 0 records I0430 13:50:06.585912 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 40.89143ms to process 0 records I0430 13:50:06.585919 1 tasks_processing.go:74] worker 4 stopped. I0430 13:50:06.585917 1 tasks_processing.go:74] worker 56 stopped. I0430 13:50:06.585924 1 tasks_processing.go:74] worker 8 stopped. I0430 13:50:06.585922 1 tasks_processing.go:74] worker 12 stopped. I0430 13:50:06.585933 1 tasks_processing.go:74] worker 45 stopped. I0430 13:50:06.585921 1 tasks_processing.go:74] worker 9 stopped. E0430 13:50:06.585931 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0430 13:50:06.585953 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 42.125231ms to process 0 records I0430 13:50:06.585972 1 tasks_processing.go:74] worker 39 stopped. I0430 13:50:06.585984 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 39.633899ms to process 0 records I0430 13:50:06.585996 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 42.333249ms to process 0 records E0430 13:50:06.586006 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0430 13:50:06.586012 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 41.394756ms to process 0 records I0430 13:50:06.586016 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 41.839077ms to process 0 records I0430 13:50:06.586018 1 tasks_processing.go:74] worker 5 stopped. I0430 13:50:06.586021 1 tasks_processing.go:74] worker 60 stopped. I0430 13:50:06.586020 1 tasks_processing.go:74] worker 51 stopped. I0430 13:50:06.586032 1 tasks_processing.go:74] worker 15 stopped. I0430 13:50:06.586155 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=da07b31790fbcf2b6d55e032f17e13191ef7358fc7522625c5092ca335d94b64 I0430 13:50:06.586180 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=81326e4ea1818eeb7d40829a271c9f613918adc6e2763aa00e95fc6aa2e853c4 I0430 13:50:06.586195 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f3412f9f10f961894cc5025815a0de208ee75aecbdf479e5c81b9a8bb5d673e5 I0430 13:50:06.586203 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 42.232071ms to process 3 records I0430 13:50:06.586294 1 tasks_processing.go:74] worker 14 stopped. I0430 13:50:06.586322 1 recorder.go:75] Recording config/image with fingerprint=ffa43f45307e5b5e570c31d8a8bd1662ac06a35eeb9661309b4c4e3d4c4acee9 I0430 13:50:06.586333 1 gather.go:177] gatherer "clusterconfig" function "image" took 42.270814ms to process 1 records I0430 13:50:06.586422 1 tasks_processing.go:74] worker 16 stopped. I0430 13:50:06.586516 1 recorder.go:75] Recording config/oauth with fingerprint=80704eacde2edda4b01d358f95cd555d9e0e5db924dbcdb1b60714de27f6f4ff I0430 13:50:06.586526 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 42.678904ms to process 1 records I0430 13:50:06.591768 1 tasks_processing.go:74] worker 57 stopped. E0430 13:50:06.591781 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0430 13:50:06.591789 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 45.70332ms to process 0 records I0430 13:50:06.591880 1 tasks_processing.go:74] worker 17 stopped. I0430 13:50:06.591959 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=9b37f4d65a579b46c1073809aa97b5952f1122174d02855239710ac38d3d44b6 I0430 13:50:06.591977 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 48.163351ms to process 1 records I0430 13:50:06.592103 1 tasks_processing.go:74] worker 40 stopped. I0430 13:50:06.592281 1 recorder.go:75] Recording config/ingress with fingerprint=7814cceed0ce8f43bbdda65ac1fbce82db95db8b99d675e9fd53595b7eca8995 I0430 13:50:06.592301 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 46.091932ms to process 1 records I0430 13:50:06.592343 1 tasks_processing.go:74] worker 21 stopped. I0430 13:50:06.592356 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 46.262407ms to process 0 records I0430 13:50:06.592385 1 tasks_processing.go:74] worker 10 stopped. I0430 13:50:06.592394 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 46.399763ms to process 0 records I0430 13:50:06.592526 1 tasks_processing.go:74] worker 32 stopped. I0430 13:50:06.594063 1 recorder.go:75] Recording config/infrastructure with fingerprint=b0bdabbf97865171fe18f1979fd637627095593e8bc4c34173fee5e9b58df5ff I0430 13:50:06.594090 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 48.183133ms to process 1 records I0430 13:50:06.594179 1 tasks_processing.go:74] worker 38 stopped. I0430 13:50:06.594375 1 gather_logs.go:145] no pods in namespace were found I0430 13:50:06.594518 1 recorder.go:75] Recording config/network with fingerprint=747abce2c39abe312753616073c764e329fceacb555548437cbd43b30f167dfd I0430 13:50:06.594540 1 gather.go:177] gatherer "clusterconfig" function "networks" took 47.456473ms to process 1 records I0430 13:50:06.594550 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 47.886329ms to process 0 records I0430 13:50:06.594564 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 48.262564ms to process 0 records I0430 13:50:06.594571 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 48.268471ms to process 0 records I0430 13:50:06.594578 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 50.739414ms to process 0 records I0430 13:50:06.594585 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 48.389115ms to process 0 records I0430 13:50:06.594599 1 tasks_processing.go:74] worker 29 stopped. I0430 13:50:06.594614 1 tasks_processing.go:74] worker 43 stopped. I0430 13:50:06.594619 1 tasks_processing.go:74] worker 19 stopped. I0430 13:50:06.594627 1 tasks_processing.go:74] worker 23 stopped. I0430 13:50:06.594586 1 tasks_processing.go:74] worker 53 stopped. I0430 13:50:06.594662 1 tasks_processing.go:74] worker 31 stopped. I0430 13:50:06.594973 1 recorder.go:75] Recording config/authentication with fingerprint=58808f4cbcf3f08f45c29460af24b6b5765f1b4af5db68f1fe8e0cca66b3731b I0430 13:50:06.594997 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 47.770733ms to process 1 records I0430 13:50:06.595066 1 tasks_processing.go:74] worker 44 stopped. I0430 13:50:06.596095 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3329967eea77eba16916aee58c2396bb05d9546721c171902e4ca29a6aa5d48e I0430 13:50:06.596119 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 48.864494ms to process 1 records I0430 13:50:06.596131 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 48.575919ms to process 0 records I0430 13:50:06.596138 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 49.135584ms to process 0 records I0430 13:50:06.596145 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 49.017935ms to process 0 records I0430 13:50:06.596151 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 49.763353ms to process 0 records I0430 13:50:06.596149 1 tasks_processing.go:74] worker 63 stopped. I0430 13:50:06.596162 1 tasks_processing.go:74] worker 46 stopped. I0430 13:50:06.596164 1 tasks_processing.go:74] worker 6 stopped. I0430 13:50:06.596171 1 tasks_processing.go:74] worker 27 stopped. I0430 13:50:06.596238 1 tasks_processing.go:74] worker 30 stopped. I0430 13:50:06.596238 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=315a78981903966e533f5c0c15264b4b7ccdb54b56d818b5a6abc57fe52a9457 I0430 13:50:06.596325 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=bc273b07229753d6f21babc27d637ec567a52ea00bbac557ec8a3862b80daa46 I0430 13:50:06.596339 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 51.760133ms to process 2 records I0430 13:50:06.596738 1 tasks_processing.go:74] worker 41 stopped. I0430 13:50:06.597016 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e9d96174378874f2623f71845fe70a1651e0610885bf73a56deb9f52ff48d1e5 I0430 13:50:06.597115 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=361778d88e1ed45e3587716d7787198dedd5e17ac4815b48fedea832eeb01799 I0430 13:50:06.597162 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f3837df51e2f2fa7803ed8c64821c77510c3e5ab845ea6c369b131b6beee7bc6 I0430 13:50:06.597201 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 51.259595ms to process 3 records I0430 13:50:06.597400 1 tasks_processing.go:74] worker 3 stopped. I0430 13:50:06.597926 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7d9f8088ac6d279e18ac489c5236ab3c0a003f0e0eed018589fadc4de6dcde4f I0430 13:50:06.597948 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 51.405614ms to process 1 records I0430 13:50:06.597972 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0430 13:50:06.597981 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 53.197367ms to process 1 records I0430 13:50:06.598034 1 tasks_processing.go:74] worker 59 stopped. I0430 13:50:06.598110 1 tasks_processing.go:74] worker 47 stopped. I0430 13:50:06.598129 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=3422c80aab3f7a9a4e95d3a74e2cb7ddf6e7cd73e8a1104cdb48189c9159c6ad I0430 13:50:06.598254 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=7431557df5e19d6ff9c7fafd6a07a39a5f5b4626eb53a1292d0ad548b15bd033 I0430 13:50:06.598290 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a8c91f41f82d0350821eeb7850c870e3ffb6e9afa13dfe3a165a9e55dea7fcb0 I0430 13:50:06.598331 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=bb536ad714a3ef04a4b04b04c35a4abe5299a91751124caa103ad698dcba55d6 I0430 13:50:06.598371 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=12fb4e8bda542e61c128bc43f42ec1aa58364b3096fac890c33189f81d7afef3 I0430 13:50:06.598411 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=1fa9d6fce42f8c85a6faeee25efe36b36e9253910aa34a54326d33d7cf1efd41 I0430 13:50:06.598436 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6e313a3f4f1b1d4c1b332e8dcffac27fdd1144b7e5999bfca83b52a0d4ef98f2 I0430 13:50:06.598469 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=9f1ad28fa548f3fb558fb853620dcd6f7f77cec4e79368dfb3e218a19c146bd4 I0430 13:50:06.598498 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=65087bf9415e0fc0146df978ed2186d424c4fe8b2458adc0bf8f6ba9f4ad151d I0430 13:50:06.598540 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=00abf918273187424eeb63650bc53b373e4270ea8b95d6dae1a3f4a7a3484199 I0430 13:50:06.598563 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=8d4187a67d3a246a2250cb1ea015bb3e1d86da8b31b7cab73dbbc2f7b38cff44 I0430 13:50:06.598571 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 50.911183ms to process 11 records I0430 13:50:06.598666 1 tasks_processing.go:74] worker 48 stopped. I0430 13:50:06.598909 1 recorder.go:75] Recording config/node/ip-10-0-0-16.ec2.internal with fingerprint=f8400e9a401821a1ecd93b88064eb5fcc98c9fe35c5d9f7dec4883646765fe03 I0430 13:50:06.598973 1 recorder.go:75] Recording config/node/ip-10-0-1-128.ec2.internal with fingerprint=9f8091ecfad6723649c0d5db18cb4497f8d9a576b5af189a9120f98566ca77cc I0430 13:50:06.599048 1 recorder.go:75] Recording config/node/ip-10-0-2-26.ec2.internal with fingerprint=da9479fd9ace2269051a3f0aa6bf6369aa8b8e552fed7c7d9ab9657f2db844c2 I0430 13:50:06.599060 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 51.525102ms to process 3 records I0430 13:50:06.599068 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 53.484946ms to process 0 records I0430 13:50:06.599076 1 tasks_processing.go:74] worker 55 stopped. W0430 13:50:06.599097 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:50:06.605758 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:50:06.606122 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:50:06.606153 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0430 13:50:06.608989 1 tasks_processing.go:74] worker 35 stopped. I0430 13:50:06.609006 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.517837ms to process 0 records I0430 13:50:06.609390 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0430 13:50:06.609391 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0430 13:50:06.609483 1 operator.go:288] started I0430 13:50:06.609519 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0430 13:50:06.611935 1 tasks_processing.go:74] worker 54 stopped. I0430 13:50:06.612000 1 recorder.go:75] Recording config/running_containers with fingerprint=256b123bae1316d8c7f295497575b18d2bc01b2b1060060fb5d4d576879c9709 I0430 13:50:06.612018 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 65.923498ms to process 1 records I0430 13:50:06.612395 1 tasks_processing.go:74] worker 1 stopped. I0430 13:50:06.612942 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=31c6b6abdc98d235c460b0786c44af8caef513f6811812b2cba8ab14eb110d98 I0430 13:50:06.613138 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=ef8fdcf6b4145e7e9294b530909a8085f97add0af1f6ea610ae12de46d98cb8b I0430 13:50:06.613148 1 gather.go:177] gatherer "clusterconfig" function "crds" took 68.635239ms to process 2 records I0430 13:50:06.614289 1 base_controller.go:82] Caches are synced for ConfigController I0430 13:50:06.614301 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0430 13:50:06.625507 1 prometheus_rules.go:88] Prometheus rules successfully created I0430 13:50:06.625702 1 controller.go:212] Source scaController *sca.Controller is not ready I0430 13:50:06.625717 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0430 13:50:06.625722 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:50:06.625725 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:50:06.625728 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:50:06.625750 1 controller.go:489] The operator is still being initialized I0430 13:50:06.625761 1 controller.go:512] The operator is healthy I0430 13:50:06.629443 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:50:06.630377 1 tasks_processing.go:74] worker 42 stopped. I0430 13:50:06.630714 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=e67923c68de2e7fb854181479d5c6718386500002ae3a85a2ebf6d28a03ce7da I0430 13:50:06.630894 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=48e4dca0bf453d5bc740bd39658335a0883b760481ad0ce14393c48917e90edd I0430 13:50:06.630910 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 86.747186ms to process 2 records I0430 13:50:06.632768 1 tasks_processing.go:74] worker 22 stopped. I0430 13:50:06.632853 1 recorder.go:75] Recording config/olm_operators with fingerprint=d9ab0d8de0068e9f517545d870f6ef9efe2e7ed18b6eae9535568cac0bbc7295 I0430 13:50:06.632865 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 86.678544ms to process 1 records E0430 13:50:06.635552 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278680ef80-cc81-4b9f-a122-75c7af45a6d8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:36543->172.30.0.10:53: read: connection refused I0430 13:50:06.635566 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278680ef80-cc81-4b9f-a122-75c7af45a6d8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:36543->172.30.0.10:53: read: connection refused I0430 13:50:06.642684 1 tasks_processing.go:74] worker 0 stopped. E0430 13:50:06.642706 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0430 13:50:06.642716 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q0gm1uuhr9q3qc032e51jb7af5qc9os-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q0gm1uuhr9q3qc032e51jb7af5qc9os-primary-cert-bundle-secret" not found I0430 13:50:06.642801 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=f93e89d23f94610067d5a826688e6175bfc862920dc3b59a9065d370942476a1 I0430 13:50:06.642820 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 98.973962ms to process 1 records I0430 13:50:06.644650 1 tasks_processing.go:74] worker 36 stopped. I0430 13:50:06.644667 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 98.55465ms to process 0 records I0430 13:50:06.647419 1 tasks_processing.go:74] worker 50 stopped. E0430 13:50:06.647437 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0430 13:50:06.647448 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0430 13:50:06.647453 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0430 13:50:06.647469 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0430 13:50:06.647516 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0430 13:50:06.647528 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0430 13:50:06.647535 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0430 13:50:06.647542 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0430 13:50:06.647630 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0430 13:50:06.647644 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0430 13:50:06.647653 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 102.307871ms to process 7 records I0430 13:50:06.678988 1 tasks_processing.go:74] worker 11 stopped. I0430 13:50:06.679530 1 recorder.go:75] Recording config/version with fingerprint=95ac8a998ef5e5ff7d17d2d72d87a585c644ec4ebafcb7bf4ed5915c96f69391 I0430 13:50:06.679547 1 recorder.go:75] Recording config/id with fingerprint=6301b038b93b53a544ec61393302ac53f3e025c51afb76f88c772b6d5257de53 I0430 13:50:06.679554 1 gather.go:177] gatherer "clusterconfig" function "version" took 132.905409ms to process 2 records I0430 13:50:06.691521 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0430 13:50:06.695793 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:39277->172.30.0.10:53: read: connection refused I0430 13:50:06.695807 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.14:39277->172.30.0.10:53: read: connection refused I0430 13:50:06.709623 1 base_controller.go:82] Caches are synced for LoggingSyncer I0430 13:50:06.709640 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0430 13:50:07.016215 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0430 13:50:07.016231 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0430 13:50:07.017065 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hxhbp pod in namespace openshift-dns (previous: false). I0430 13:50:07.249080 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxhbp pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:50:07.249100 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:50:07.249109 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hxhbp pod in namespace openshift-dns (previous: false). I0430 13:50:07.422194 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hxhbp pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:50:07.422216 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hxhbp\" is waiting to start: ContainerCreating" I0430 13:50:07.422244 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vs4hv pod in namespace openshift-dns (previous: false). W0430 13:50:07.596172 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:50:07.615261 1 tasks_processing.go:74] worker 62 stopped. I0430 13:50:07.615276 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 1.070889734s to process 0 records I0430 13:50:07.641989 1 tasks_processing.go:74] worker 28 stopped. I0430 13:50:07.642007 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vs4hv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:50:07.642018 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:50:07.642025 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0430 13:50:07.642026 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vs4hv pod in namespace openshift-dns (previous: false). I0430 13:50:07.642038 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.095750268s to process 1 records I0430 13:50:07.820558 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vs4hv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:50:07.820578 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vs4hv\" is waiting to start: ContainerCreating" I0430 13:50:07.820608 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xpcrr pod in namespace openshift-dns (previous: false). I0430 13:50:08.038556 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0430 13:50:08.055489 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xpcrr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:50:08.055508 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:50:08.055517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xpcrr pod in namespace openshift-dns (previous: false). I0430 13:50:08.221453 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xpcrr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:50:08.221471 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xpcrr\" is waiting to start: ContainerCreating" I0430 13:50:08.221481 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9m58w pod in namespace openshift-dns (previous: false). I0430 13:50:08.421091 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:08.421109 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dnwvx pod in namespace openshift-dns (previous: false). W0430 13:50:08.596068 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:50:08.621417 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:08.621433 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ms2bk pod in namespace openshift-dns (previous: false). I0430 13:50:08.640394 1 tasks_processing.go:74] worker 61 stopped. I0430 13:50:08.640446 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=fbc31afd1b1ffa01dc739c93fc04736bb376d6290925d315eefae4c46eda42c3 I0430 13:50:08.640485 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e3a89984d78a02e2c9e89966c0a47c45d73c7c01e3d2f1df2973c1b028462955 I0430 13:50:08.640520 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0430 13:50:08.640547 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=ce227c29e2c77ee16199680e9802e63d40bbed2807e0f5557e90cc75483daeea I0430 13:50:08.640565 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0430 13:50:08.640604 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=44458f660ace2445cbf4d01e0349ed12484c8ec9976fc06c7f65c50ab0664c8a I0430 13:50:08.640634 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=cffbd42c1217799fe83257961f28bc819f7bfa0808752f59e3e4d390907ab54d I0430 13:50:08.640657 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ad2407658907f2e2b96089a2a7c4d2d6e6f8395465ecfef043f0e6adf1da888b I0430 13:50:08.640671 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=5d8b38b670088b72593dca365b1cc93dc17fce163798cb1862f5464116b3d480 I0430 13:50:08.640688 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=3431c9c4793c6c2777e7ff96b263a48a059019724b0b49fa57e623c750c0c4d0 I0430 13:50:08.640697 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0430 13:50:08.640712 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=14031e64d1249671b372ec459ffd6eec741ddfb6eb983b911ebbc7a88322d14b I0430 13:50:08.640722 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0430 13:50:08.640737 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d9ca7c4807cca14670bf11e6be7aa6e12a0d46dae325b12275205c6d28cadaef I0430 13:50:08.640746 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0430 13:50:08.640758 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=98fea20604986607c9ce20076271a3be62bea1af56bc96e45885e723529e2b42 I0430 13:50:08.640768 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0430 13:50:08.640783 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=dd163689b34ec851d6d3ee59e81f1ae00981410ab7deba75157cb95679d071d8 I0430 13:50:08.640926 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=daa14c903e78101532d82512f96810e9c6d2195ddb125a0b9fd05d2a504ef190 I0430 13:50:08.640937 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0430 13:50:08.640944 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0430 13:50:08.640979 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0430 13:50:08.641007 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=a9530e48be38d575b76bc28b26fe93cf04bcd9b00a16f5274739664261a685c2 I0430 13:50:08.641031 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=5bd607a9ea4ba96908b0199427eefa19fef29f45a870ac46f87ddb050ac026d2 I0430 13:50:08.641041 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0430 13:50:08.641056 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=dfc17a2ad408556184831815cb84746f75f1f37ce35148da45cefd4e6e3dcbc5 I0430 13:50:08.641089 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0430 13:50:08.641105 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=1e4473b9291f6c3ab7efe66728cc8aecf5c747e30d1979de25006428f0020c7d I0430 13:50:08.641121 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=cd81cb96043d74beaa87f1f0bb84dce229fcaf28913265c0fcd78f7310f13995 I0430 13:50:08.641137 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=34b047648e5bd4395a49a08a55b1953b237902f708fe1514f29d054b46cc39ee I0430 13:50:08.641153 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=088c41359f0b6a1d5b7d6e580eaaf56108934639d57ddb0cc2bda76f4a6e1b4e I0430 13:50:08.641173 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=58075691871e8f9acdb52bd0e1347e8a6069d3055af8a20617ba8ed1c5d25ce4 I0430 13:50:08.641182 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0430 13:50:08.641205 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=10b2ec297fa46045af78f09d3a8f57a738239c3dc249f236690346a9fbada7f8 I0430 13:50:08.641222 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0430 13:50:08.641229 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0430 13:50:08.641237 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.093442158s to process 36 records I0430 13:50:08.821607 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:08.821665 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-69c9db5fb5-cttv9 pod in namespace openshift-image-registry (previous: false). I0430 13:50:09.022801 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-69c9db5fb5-cttv9 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-69c9db5fb5-cttv9\" is waiting to start: ContainerCreating" I0430 13:50:09.022819 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-69c9db5fb5-cttv9\" is waiting to start: ContainerCreating" I0430 13:50:09.022886 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-69c9db5fb5-skv7k pod in namespace openshift-image-registry (previous: false). I0430 13:50:09.221552 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-69c9db5fb5-skv7k pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-69c9db5fb5-skv7k\" is waiting to start: ContainerCreating" I0430 13:50:09.221568 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-69c9db5fb5-skv7k\" is waiting to start: ContainerCreating" I0430 13:50:09.221601 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-855c69fbc8-9vp59 pod in namespace openshift-image-registry (previous: false). I0430 13:50:09.421108 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-855c69fbc8-9vp59 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-855c69fbc8-9vp59\" is waiting to start: ContainerCreating" I0430 13:50:09.421126 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-855c69fbc8-9vp59\" is waiting to start: ContainerCreating" I0430 13:50:09.421137 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8m27p pod in namespace openshift-image-registry (previous: false). W0430 13:50:09.596059 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:50:09.622572 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:09.622591 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fcwck pod in namespace openshift-image-registry (previous: false). I0430 13:50:09.823389 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:09.823407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t58lt pod in namespace openshift-image-registry (previous: false). I0430 13:50:10.025634 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:50:10.025656 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577cb9985d-7tml7 pod in namespace openshift-ingress (previous: false). I0430 13:50:10.221450 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-577cb9985d-7tml7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-577cb9985d-7tml7\" is waiting to start: ContainerCreating" I0430 13:50:10.221467 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-577cb9985d-7tml7\" is waiting to start: ContainerCreating" I0430 13:50:10.221477 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577cb9985d-wpjhj pod in namespace openshift-ingress (previous: false). I0430 13:50:10.422874 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-577cb9985d-wpjhj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-577cb9985d-wpjhj\" is waiting to start: ContainerCreating" I0430 13:50:10.422892 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-577cb9985d-wpjhj\" is waiting to start: ContainerCreating" I0430 13:50:10.422904 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c89887b6f-5sr27 pod in namespace openshift-ingress (previous: false). W0430 13:50:10.596077 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:50:10.624935 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6c89887b6f-5sr27 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6c89887b6f-5sr27\" is waiting to start: ContainerCreating" I0430 13:50:10.624955 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6c89887b6f-5sr27\" is waiting to start: ContainerCreating" I0430 13:50:10.624986 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-4l6zm pod in namespace openshift-ingress-canary (previous: false). I0430 13:50:10.826569 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-4l6zm pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-4l6zm\" is waiting to start: ContainerCreating" I0430 13:50:10.826587 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-4l6zm\" is waiting to start: ContainerCreating" I0430 13:50:10.826620 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sndx9 pod in namespace openshift-ingress-canary (previous: false). I0430 13:50:11.026775 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-sndx9 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-sndx9\" is waiting to start: ContainerCreating" I0430 13:50:11.026793 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-sndx9\" is waiting to start: ContainerCreating" I0430 13:50:11.026830 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tcd4j pod in namespace openshift-ingress-canary (previous: false). I0430 13:50:11.222527 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-tcd4j pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tcd4j\" is waiting to start: ContainerCreating" I0430 13:50:11.222544 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tcd4j\" is waiting to start: ContainerCreating" I0430 13:50:11.222564 1 tasks_processing.go:74] worker 34 stopped. I0430 13:50:11.222656 1 recorder.go:75] Recording events/openshift-dns with fingerprint=67492e6138c2a32983d00f52c81abe58bb663ae1711cc8070cbff1a05f1ced61 I0430 13:50:11.222742 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=196fa334c87cbfc3e6ed62553dd71ffbb43147778815586d18dfb73026a410c7 I0430 13:50:11.222770 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=5d2fa1fe263d5a4837c97407db812d983e49692bd3a4dde9e5af625f99786ef5 I0430 13:50:11.222814 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=002df4ef5a62266cd70a7485289ec2d5bc60a773ca1590405064e6328cabbb01 I0430 13:50:11.222832 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=11ff6f5cb7644e3f32ee3d463769ba2da4e6446d6050c300b16375ea3d091c1b I0430 13:50:11.224158 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-hxhbp with fingerprint=cfbbb7712ebf13e182a6aad903b0801e5e88e0425a1908b879b7e49087cd2b26 I0430 13:50:11.224248 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-vs4hv with fingerprint=845ea4c9318a151acc70b9be3b60c94c4c4b93dfd205df8e9b87587a9cc0451c I0430 13:50:11.224320 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-xpcrr with fingerprint=8845419b0f0f73e80d0ce09dfd1d4b60a9d80e167e76896008a82cb2d1a8dab9 I0430 13:50:11.224423 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-69c9db5fb5-cttv9 with fingerprint=084fe4ba2dad92d4985e8d452d0c289e845616e6d75faf484fa95c6620079a76 I0430 13:50:11.224514 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-69c9db5fb5-skv7k with fingerprint=6216a3c45dfcdc8069b12cf57e2b5257c32bbe205334f7e7322c54516f0dccac I0430 13:50:11.224601 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-855c69fbc8-9vp59 with fingerprint=5841052b6616c7ce4597bb1ac1a122755c1b3ea79a460e5fb935222ab5e967bf I0430 13:50:11.224664 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-4l6zm with fingerprint=570815f171f791756b365040fe4ea64d43d8862b1c26f21cb06a8ed54ec02ae0 I0430 13:50:11.224718 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-sndx9 with fingerprint=20ac3265d065f799348f3c5a1a9385cc752055c5aa8d6d74e48a0cb7bcb5d86c I0430 13:50:11.224772 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-tcd4j with fingerprint=ac8c7d2a0265a5a0283c84ca721d01e9b51ba2f93967d641d6f3eb08dc13337c I0430 13:50:11.224782 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.676372069s to process 14 records W0430 13:50:11.593070 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:50:11.593099 1 tasks_processing.go:74] worker 25 stopped. E0430 13:50:11.593111 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:50:11.593122 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0430 13:50:11.593137 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0430 13:50:11.593146 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.049487378s to process 1 records I0430 13:50:18.503091 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:50:19.271825 1 tasks_processing.go:74] worker 26 stopped. I0430 13:50:19.271890 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0430 13:50:19.271904 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.725762842s to process 1 records I0430 13:50:19.839361 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:50:19.952985 1 tasks_processing.go:74] worker 58 stopped. I0430 13:50:19.953239 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=5bfe903b1da30878a989600cf95950087bbfed0fc0418c904f1a71b56765f5ff I0430 13:50:19.953256 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406320664s to process 1 records E0430 13:50:19.953317 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.409s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0430 13:50:19.954447 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0430 13:50:19.954468 1 periodic.go:209] Running workloads gatherer I0430 13:50:19.954488 1 tasks_processing.go:45] number of workers: 2 I0430 13:50:19.954501 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:50:19.954507 1 tasks_processing.go:71] worker 1 working on workload_info task. I0430 13:50:19.954514 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:50:19.954528 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0430 13:50:19.980067 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0430 13:50:19.981661 1 tasks_processing.go:74] worker 0 stopped. I0430 13:50:19.981674 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.118321ms to process 0 records I0430 13:50:19.990037 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0430 13:50:19.999395 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0430 13:50:20.009212 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (10ms) I0430 13:50:20.018505 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (9ms) I0430 13:50:20.031059 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (13ms) I0430 13:50:20.040548 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (9ms) I0430 13:50:20.042902 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:50:20.049513 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (9ms) I0430 13:50:20.058248 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (9ms) I0430 13:50:20.066460 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (8ms) I0430 13:50:20.075215 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (9ms) I0430 13:50:20.089033 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (14ms) I0430 13:50:20.189795 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0430 13:50:20.289874 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0430 13:50:20.390528 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0430 13:50:20.490268 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0430 13:50:20.589820 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0430 13:50:20.689983 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0430 13:50:20.790542 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0430 13:50:20.889770 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (99ms) I0430 13:50:20.992401 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (103ms) I0430 13:50:21.089760 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (97ms) I0430 13:50:21.190144 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0430 13:50:21.292655 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (102ms) I0430 13:50:21.389391 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (97ms) I0430 13:50:21.489742 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0430 13:50:21.589466 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0430 13:50:21.690064 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms) I0430 13:50:21.789880 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0430 13:50:21.890201 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0430 13:50:21.993729 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (104ms) I0430 13:50:22.091414 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (98ms) I0430 13:50:22.206514 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (115ms) I0430 13:50:22.292019 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (85ms) I0430 13:50:22.292054 1 tasks_processing.go:74] worker 1 stopped. E0430 13:50:22.292067 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0430 13:50:22.292369 1 recorder.go:75] Recording config/workload_info with fingerprint=599fda6b2a0bb844fa91adc36f87eb690722eff1d249fa846fefa7dacb4143ff I0430 13:50:22.292390 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.337537853s to process 1 records E0430 13:50:22.292423 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.337s with: function \"workload_info\" failed with an error" I0430 13:50:22.293527 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0430 13:50:22.293540 1 periodic.go:209] Running conditional gatherer I0430 13:50:22.299399 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0430 13:50:22.305591 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.14:37465->172.30.0.10:53: read: connection refused E0430 13:50:22.305867 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:50:22.305933 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0430 13:50:22.312446 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0430 13:50:22.312460 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312466 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312469 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312472 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312475 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312479 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312483 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312488 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:50:22.312492 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0430 13:50:22.312509 1 tasks_processing.go:45] number of workers: 3 I0430 13:50:22.312515 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:50:22.312519 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0430 13:50:22.312586 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:50:22.312594 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0430 13:50:22.312606 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0430 13:50:22.312609 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:50:22.312616 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 778ns to process 1 records I0430 13:50:22.312619 1 tasks_processing.go:74] worker 0 stopped. I0430 13:50:22.312606 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0430 13:50:22.312630 1 tasks_processing.go:74] worker 1 stopped. I0430 13:50:22.312662 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0430 13:50:22.312672 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 388ns to process 1 records I0430 13:50:22.312873 1 tasks_processing.go:74] worker 2 stopped. I0430 13:50:22.312885 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 262.704µs to process 0 records I0430 13:50:22.312913 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.14:37465->172.30.0.10:53: read: connection refused I0430 13:50:22.312930 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0430 13:50:22.336651 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=dd34ab71270ceb06a1735574e3bf51036931243d8324b9bc90496274da96de9a I0430 13:50:22.336786 1 diskrecorder.go:70] Writing 109 records to /var/lib/insights-operator/insights-2026-04-30-135022.tar.gz I0430 13:50:22.343328 1 diskrecorder.go:51] Wrote 109 records to disk in 6ms I0430 13:50:22.343358 1 periodic.go:278] Gathering cluster info every 2h0m0s I0430 13:50:22.343374 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0430 13:50:33.377982 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:51:21.176184 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="ccb0ab602fec9eed9b680021dd475f2097a35bb1740bd237cda23c9392b0271c") W0430 13:51:21.176223 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0430 13:51:21.176267 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="7453246694eea2e93abf230d4390af67fbfaea5b9f072436c9bf229ec64f67a1") I0430 13:51:21.176342 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="55efd714b3b0b3abdc8516eb8e71b73279490e7c42d2e81100c74b329836a1b9") I0430 13:51:21.176351 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0430 13:51:21.176362 1 base_controller.go:181] Shutting down LoggingSyncer ... I0430 13:51:21.176407 1 periodic.go:170] Shutting down I0430 13:51:21.176417 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0430 13:51:21.176421 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0430 13:51:21.176361 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0430 13:51:21.176427 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0430 13:51:21.176436 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0430 13:51:21.176435 1 base_controller.go:181] Shutting down ConfigController ... I0430 13:51:21.176452 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0430 13:51:21.176453 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0430 13:51:21.176464 1 base_controller.go:113] All ConfigController workers have been terminated I0430 13:51:21.176465 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-3722036813/tls.crt::/tmp/serving-cert-3722036813/tls.key" I0430 13:51:21.176477 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"