W1002 02:24:11.983020 1 cmd.go:257] Using insecure, self-signed certificates I1002 02:24:12.213116 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:12.213423 1 observer_polling.go:159] Starting file observer W1002 02:24:12.241089 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1002 02:24:12.520525 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1002 02:24:12.520717 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1002 02:24:12.521131 1 secure_serving.go:57] Forcing use of http/1.1 only W1002 02:24:12.521149 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:24:12.521154 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:24:12.521158 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1002 02:24:12.521160 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1002 02:24:12.521162 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1002 02:24:12.521163 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1002 02:24:12.521299 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1002 02:24:12.525965 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1002 02:24:12.525984 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1002 02:24:12.527425 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1002 02:24:12.527450 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1002 02:24:12.527476 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1002 02:24:12.527461 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1002 02:24:12.527681 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:24:12.527987 1 secure_serving.go:213] Serving securely on [::]:8443 I1002 02:24:12.527600 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:24:12.528008 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1350018675/tls.crt::/tmp/serving-cert-1350018675/tls.key" I1002 02:24:12.528739 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1002 02:24:12.529780 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18da95340743ba26 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-02 02:24:12.525910566 +0000 UTC m=+0.577289891,LastTimestamp:2026-10-02 02:24:12.525910566 +0000 UTC m=+0.577289891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1002 02:24:12.531691 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1002 02:24:12.531718 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:24:12.531802 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1002 02:24:12.537013 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:24:12.537028 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:24:12.541916 1 secretconfigobserver.go:119] support secret does not exist I1002 02:24:12.546849 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:24:12.551888 1 secretconfigobserver.go:119] support secret does not exist I1002 02:24:12.554331 1 recorder.go:156] Pruning old reports every 8h5m33s, max age is 288h0m0s I1002 02:24:12.559603 1 periodic.go:212] Running clusterconfig gatherer I1002 02:24:12.559615 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1002 02:24:12.559621 1 insightsreport.go:296] Starting report retriever I1002 02:24:12.559625 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1002 02:24:12.559643 1 tasks_processing.go:45] number of workers: 64 I1002 02:24:12.559661 1 tasks_processing.go:69] worker 4 listening for tasks. I1002 02:24:12.559602 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1002 02:24:12.559676 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1002 02:24:12.559688 1 tasks_processing.go:71] worker 4 working on cluster_apiserver task. I1002 02:24:12.559696 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:24:12.559699 1 tasks_processing.go:69] worker 34 listening for tasks. I1002 02:24:12.559703 1 tasks_processing.go:71] worker 34 working on proxies task. I1002 02:24:12.559704 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:24:12.559710 1 tasks_processing.go:69] worker 3 listening for tasks. I1002 02:24:12.559714 1 tasks_processing.go:69] worker 49 listening for tasks. I1002 02:24:12.559715 1 tasks_processing.go:69] worker 56 listening for tasks. I1002 02:24:12.559719 1 tasks_processing.go:69] worker 50 listening for tasks. I1002 02:24:12.559724 1 tasks_processing.go:69] worker 51 listening for tasks. I1002 02:24:12.559725 1 tasks_processing.go:69] worker 35 listening for tasks. I1002 02:24:12.559730 1 tasks_processing.go:69] worker 52 listening for tasks. I1002 02:24:12.559733 1 tasks_processing.go:69] worker 36 listening for tasks. I1002 02:24:12.559736 1 tasks_processing.go:69] worker 53 listening for tasks. I1002 02:24:12.559741 1 tasks_processing.go:69] worker 55 listening for tasks. I1002 02:24:12.559738 1 tasks_processing.go:69] worker 60 listening for tasks. I1002 02:24:12.559745 1 tasks_processing.go:69] worker 19 listening for tasks. I1002 02:24:12.559742 1 tasks_processing.go:69] worker 37 listening for tasks. I1002 02:24:12.559691 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:24:12.559750 1 tasks_processing.go:69] worker 5 listening for tasks. I1002 02:24:12.559754 1 tasks_processing.go:69] worker 6 listening for tasks. I1002 02:24:12.559756 1 tasks_processing.go:69] worker 57 listening for tasks. I1002 02:24:12.559753 1 tasks_processing.go:69] worker 54 listening for tasks. I1002 02:24:12.559760 1 tasks_processing.go:69] worker 7 listening for tasks. I1002 02:24:12.559760 1 tasks_processing.go:69] worker 61 listening for tasks. I1002 02:24:12.559762 1 tasks_processing.go:69] worker 40 listening for tasks. I1002 02:24:12.559763 1 tasks_processing.go:69] worker 59 listening for tasks. I1002 02:24:12.559766 1 tasks_processing.go:69] worker 8 listening for tasks. I1002 02:24:12.559748 1 tasks_processing.go:69] worker 38 listening for tasks. I1002 02:24:12.559768 1 tasks_processing.go:69] worker 62 listening for tasks. I1002 02:24:12.559769 1 tasks_processing.go:69] worker 63 listening for tasks. I1002 02:24:12.559771 1 tasks_processing.go:69] worker 14 listening for tasks. I1002 02:24:12.559756 1 tasks_processing.go:69] worker 39 listening for tasks. I1002 02:24:12.559774 1 tasks_processing.go:69] worker 10 listening for tasks. I1002 02:24:12.559776 1 tasks_processing.go:69] worker 15 listening for tasks. I1002 02:24:12.559764 1 tasks_processing.go:69] worker 58 listening for tasks. I1002 02:24:12.559776 1 tasks_processing.go:69] worker 46 listening for tasks. I1002 02:24:12.559782 1 tasks_processing.go:69] worker 16 listening for tasks. I1002 02:24:12.559781 1 tasks_processing.go:69] worker 13 listening for tasks. I1002 02:24:12.559786 1 tasks_processing.go:69] worker 9 listening for tasks. I1002 02:24:12.559770 1 tasks_processing.go:69] worker 41 listening for tasks. I1002 02:24:12.559785 1 tasks_processing.go:69] worker 20 listening for tasks. I1002 02:24:12.559790 1 tasks_processing.go:69] worker 43 listening for tasks. I1002 02:24:12.559791 1 tasks_processing.go:69] worker 44 listening for tasks. I1002 02:24:12.559793 1 tasks_processing.go:69] worker 21 listening for tasks. I1002 02:24:12.559775 1 tasks_processing.go:69] worker 45 listening for tasks. I1002 02:24:12.559795 1 tasks_processing.go:69] worker 18 listening for tasks. I1002 02:24:12.559796 1 tasks_processing.go:69] worker 12 listening for tasks. I1002 02:24:12.559798 1 tasks_processing.go:69] worker 28 listening for tasks. I1002 02:24:12.559793 1 tasks_processing.go:69] worker 31 listening for tasks. I1002 02:24:12.559800 1 tasks_processing.go:69] worker 30 listening for tasks. I1002 02:24:12.559801 1 tasks_processing.go:69] worker 25 listening for tasks. I1002 02:24:12.559804 1 tasks_processing.go:69] worker 22 listening for tasks. I1002 02:24:12.559804 1 tasks_processing.go:69] worker 11 listening for tasks. I1002 02:24:12.559807 1 tasks_processing.go:71] worker 3 working on openshift_logging task. I1002 02:24:12.559809 1 tasks_processing.go:71] worker 2 working on certificate_signing_requests task. I1002 02:24:12.559810 1 tasks_processing.go:71] worker 56 working on openstack_version task. I1002 02:24:12.559814 1 tasks_processing.go:71] worker 50 working on image_pruners task. I1002 02:24:12.559811 1 tasks_processing.go:69] worker 26 listening for tasks. I1002 02:24:12.559818 1 tasks_processing.go:71] worker 0 working on machine_autoscalers task. I1002 02:24:12.559820 1 tasks_processing.go:71] worker 52 working on crds task. I1002 02:24:12.559822 1 tasks_processing.go:71] worker 26 working on storage_cluster task. I1002 02:24:12.559823 1 tasks_processing.go:71] worker 41 working on openstack_dataplanenodesets task. I1002 02:24:12.559832 1 tasks_processing.go:71] worker 13 working on container_runtime_configs task. I1002 02:24:12.559859 1 tasks_processing.go:71] worker 18 working on nodenetworkconfigurationpolicies task. I1002 02:24:12.559892 1 tasks_processing.go:71] worker 45 working on silenced_alerts task. I1002 02:24:12.559809 1 tasks_processing.go:71] worker 51 working on sap_config task. I1002 02:24:12.559881 1 tasks_processing.go:71] worker 36 working on authentication task. I1002 02:24:12.560170 1 tasks_processing.go:71] worker 46 working on tsdb_status task. I1002 02:24:12.559819 1 tasks_processing.go:71] worker 9 working on infrastructures task. I1002 02:24:12.560294 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I1002 02:24:12.559699 1 tasks_processing.go:71] worker 1 working on image task. I1002 02:24:12.559816 1 tasks_processing.go:71] worker 11 working on service_accounts task. I1002 02:24:12.559893 1 tasks_processing.go:71] worker 6 working on config_maps task. I1002 02:24:12.561110 1 tasks_processing.go:71] worker 15 working on nodes task. I1002 02:24:12.559814 1 tasks_processing.go:71] worker 61 working on ingress task. I1002 02:24:12.561238 1 tasks_processing.go:71] worker 10 working on oauths task. I1002 02:24:12.560346 1 tasks_processing.go:71] worker 8 working on jaegers task. I1002 02:24:12.559782 1 tasks_processing.go:69] worker 42 listening for tasks. I1002 02:24:12.559783 1 tasks_processing.go:69] worker 47 listening for tasks. I1002 02:24:12.559787 1 tasks_processing.go:69] worker 17 listening for tasks. I1002 02:24:12.559792 1 tasks_processing.go:69] worker 29 listening for tasks. I1002 02:24:12.559798 1 tasks_processing.go:69] worker 24 listening for tasks. I1002 02:24:12.559802 1 tasks_processing.go:69] worker 33 listening for tasks. I1002 02:24:12.559803 1 tasks_processing.go:69] worker 23 listening for tasks. I1002 02:24:12.559807 1 tasks_processing.go:71] worker 49 working on image_registries task. I1002 02:24:12.561579 1 tasks_processing.go:71] worker 63 working on storage_classes task. I1002 02:24:12.561631 1 tasks_processing.go:71] worker 47 working on container_images task. I1002 02:24:12.561732 1 tasks_processing.go:71] worker 29 working on olm_operators task. W1002 02:24:12.560398 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:12.561872 1 tasks_processing.go:71] worker 45 working on operators_pods_and_events task. I1002 02:24:12.559783 1 tasks_processing.go:69] worker 48 listening for tasks. I1002 02:24:12.559776 1 tasks_processing.go:69] worker 27 listening for tasks. I1002 02:24:12.559872 1 tasks_processing.go:71] worker 25 working on machine_configs task. I1002 02:24:12.562033 1 tasks_processing.go:71] worker 17 working on support_secret task. I1002 02:24:12.559874 1 tasks_processing.go:71] worker 22 working on sap_pods task. I1002 02:24:12.562311 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.881662ms to process 0 records I1002 02:24:12.562318 1 tasks_processing.go:71] worker 24 working on machine_healthchecks task. I1002 02:24:12.559808 1 tasks_processing.go:69] worker 32 listening for tasks. I1002 02:24:12.559812 1 tasks_processing.go:71] worker 37 working on machine_config_pools task. I1002 02:24:12.561613 1 tasks_processing.go:71] worker 42 working on active_alerts task. I1002 02:24:12.559816 1 tasks_processing.go:71] worker 35 working on overlapping_namespace_uids task. I1002 02:24:12.559879 1 tasks_processing.go:71] worker 12 working on node_logs task. I1002 02:24:12.559876 1 tasks_processing.go:71] worker 31 working on machines task. I1002 02:24:12.559884 1 tasks_processing.go:71] worker 57 working on openstack_dataplanedeployments task. I1002 02:24:12.559888 1 tasks_processing.go:71] worker 5 working on dvo_metrics task. I1002 02:24:12.559884 1 tasks_processing.go:71] worker 21 working on openstack_controlplanes task. I1002 02:24:12.559888 1 tasks_processing.go:71] worker 28 working on operators task. I1002 02:24:12.559891 1 tasks_processing.go:71] worker 44 working on mutating_webhook_configurations task. I1002 02:24:12.559895 1 tasks_processing.go:71] worker 54 working on machine_sets task. I1002 02:24:12.559895 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I1002 02:24:12.559902 1 tasks_processing.go:71] worker 14 working on clusterroles task. I1002 02:24:12.559901 1 tasks_processing.go:71] worker 53 working on aggregated_monitoring_cr_names task. I1002 02:24:12.559902 1 tasks_processing.go:71] worker 43 working on lokistack task. I1002 02:24:12.559905 1 tasks_processing.go:71] worker 40 working on cost_management_metrics_configs task. I1002 02:24:12.559909 1 tasks_processing.go:71] worker 59 working on pod_network_connectivity_checks task. I1002 02:24:12.559907 1 tasks_processing.go:71] worker 60 working on networks task. I1002 02:24:12.559909 1 tasks_processing.go:71] worker 39 working on pdbs task. I1002 02:24:12.559912 1 tasks_processing.go:71] worker 62 working on monitoring_persistent_volumes task. I1002 02:24:12.559911 1 tasks_processing.go:71] worker 58 working on install_plans task. I1002 02:24:12.559911 1 tasks_processing.go:71] worker 19 working on metrics task. I1002 02:24:12.560103 1 tasks_processing.go:71] worker 38 working on feature_gates task. W1002 02:24:12.560236 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:12.560531 1 tasks_processing.go:71] worker 7 working on openshift_machine_api_events task. I1002 02:24:12.561624 1 tasks_processing.go:71] worker 23 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1002 02:24:12.562330 1 tasks_processing.go:71] worker 27 working on nodenetworkstates task. I1002 02:24:12.562874 1 tasks_processing.go:74] worker 46 stopped. I1002 02:24:12.562887 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 2.659236ms to process 0 records I1002 02:24:12.562333 1 tasks_processing.go:71] worker 48 working on schedulers task. W1002 02:24:12.563109 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:12.563120 1 tasks_processing.go:74] worker 42 stopped. I1002 02:24:12.563127 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 21.487µs to process 0 records I1002 02:24:12.562337 1 tasks_processing.go:71] worker 33 working on version task. I1002 02:24:12.559876 1 tasks_processing.go:71] worker 30 working on ceph_cluster task. I1002 02:24:12.562578 1 tasks_processing.go:74] worker 32 stopped. I1002 02:24:12.559876 1 tasks_processing.go:71] worker 55 working on validating_webhook_configurations task. W1002 02:24:12.564385 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:12.564394 1 tasks_processing.go:74] worker 19 stopped. I1002 02:24:12.564401 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.299244ms to process 0 records I1002 02:24:12.564894 1 tasks_processing.go:74] worker 18 stopped. I1002 02:24:12.564908 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.995537ms to process 0 records I1002 02:24:12.565674 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1002 02:24:12.565689 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:24:12.565693 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:24:12.565695 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:24:12.565704 1 controller.go:458] The operator is still being initialized I1002 02:24:12.565711 1 controller.go:481] The operator is healthy I1002 02:24:12.566951 1 tasks_processing.go:74] worker 56 stopped. I1002 02:24:12.566960 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 7.132461ms to process 0 records I1002 02:24:12.566975 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 7.134853ms to process 0 records I1002 02:24:12.566982 1 tasks_processing.go:74] worker 0 stopped. I1002 02:24:12.567121 1 tasks_processing.go:74] worker 34 stopped. I1002 02:24:12.567200 1 recorder.go:70] Recording config/proxy with fingerprint=1c1927938019278db540ae5147048e1693c1ca9d5e127472a029be88b1775746 I1002 02:24:12.567215 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 7.408705ms to process 1 records I1002 02:24:12.582284 1 tasks_processing.go:74] worker 3 stopped. I1002 02:24:12.582297 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 22.468984ms to process 0 records I1002 02:24:12.582304 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 22.204905ms to process 0 records I1002 02:24:12.582309 1 tasks_processing.go:74] worker 51 stopped. I1002 02:24:12.582454 1 tasks_processing.go:74] worker 1 stopped. I1002 02:24:12.582556 1 recorder.go:70] Recording config/image with fingerprint=8e036cd3a4f6efc85011060d4864ac42a3d242b49fbe32387ceaea31f570d750 I1002 02:24:12.582568 1 gather.go:177] gatherer "clusterconfig" function "image" took 21.872354ms to process 1 records I1002 02:24:12.582624 1 tasks_processing.go:74] worker 36 stopped. I1002 02:24:12.582807 1 recorder.go:70] Recording config/authentication with fingerprint=f06c099a2a620245319272e4388b82663b2fbfad066d6c2a3095353e488dfdcb I1002 02:24:12.582816 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 22.517812ms to process 1 records I1002 02:24:12.585304 1 tasks_processing.go:74] worker 61 stopped. I1002 02:24:12.585408 1 recorder.go:70] Recording config/ingress with fingerprint=c78cbf6a07ff6458d28172734de05fea4e1606edb13f070ab705f1ec439b8d5e I1002 02:24:12.585417 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.082629ms to process 1 records I1002 02:24:12.595328 1 tasks_processing.go:74] worker 17 stopped. E1002 02:24:12.595339 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1002 02:24:12.595347 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 33.282746ms to process 0 records I1002 02:24:12.595518 1 tasks_processing.go:74] worker 9 stopped. I1002 02:24:12.596005 1 recorder.go:70] Recording config/infrastructure with fingerprint=9e6e40d5346f3938414f980953a87bf328a5805d8ddda17a116ba286bc951c12 I1002 02:24:12.596016 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 35.238165ms to process 1 records I1002 02:24:12.600710 1 tasks_processing.go:74] worker 24 stopped. E1002 02:24:12.600719 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1002 02:24:12.600725 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 38.34698ms to process 0 records I1002 02:24:12.600932 1 tasks_processing.go:74] worker 10 stopped. I1002 02:24:12.601093 1 recorder.go:70] Recording config/oauth with fingerprint=e3c6d554ddc7ee2f6f364e90d28746da9297cc0f51b0bf3550f2ec62a0c1e3ae I1002 02:24:12.601102 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 39.678237ms to process 1 records I1002 02:24:12.609005 1 tasks_processing.go:74] worker 41 stopped. I1002 02:24:12.609013 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 49.176153ms to process 0 records I1002 02:24:12.609022 1 tasks_processing.go:74] worker 26 stopped. I1002 02:24:12.609026 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 49.193127ms to process 0 records I1002 02:24:12.609036 1 tasks_processing.go:74] worker 57 stopped. I1002 02:24:12.609048 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 46.296924ms to process 0 records I1002 02:24:12.612997 1 tasks_processing.go:74] worker 27 stopped. I1002 02:24:12.613004 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 50.267816ms to process 0 records I1002 02:24:12.613322 1 tasks_processing.go:74] worker 8 stopped. I1002 02:24:12.613333 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 52.04139ms to process 0 records I1002 02:24:12.613618 1 tasks_processing.go:74] worker 22 stopped. I1002 02:24:12.613628 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 51.361877ms to process 0 records I1002 02:24:12.613653 1 tasks_processing.go:74] worker 13 stopped. I1002 02:24:12.613668 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 53.802674ms to process 0 records I1002 02:24:12.613687 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 50.621493ms to process 0 records I1002 02:24:12.613711 1 tasks_processing.go:74] worker 21 stopped. I1002 02:24:12.613773 1 tasks_processing.go:74] worker 63 stopped. I1002 02:24:12.613870 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=d176451c27c07eed23e81de7782cefad236b13436593f2bbecda42821cb58e11 I1002 02:24:12.613890 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=ee786debaea90c2f1d08c84fe10afbe33025431dbed722ec6a95b5b41f3b4ddd I1002 02:24:12.613899 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 52.026177ms to process 2 records I1002 02:24:12.615856 1 tasks_processing.go:74] worker 59 stopped. E1002 02:24:12.615864 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1002 02:24:12.615870 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 52.838805ms to process 0 records I1002 02:24:12.616979 1 tasks_processing.go:74] worker 40 stopped. I1002 02:24:12.617066 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 53.967329ms to process 0 records I1002 02:24:12.618379 1 tasks_processing.go:74] worker 20 stopped. I1002 02:24:12.618393 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 55.265786ms to process 0 records I1002 02:24:12.618401 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 55.482904ms to process 0 records I1002 02:24:12.618404 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 55.140513ms to process 0 records I1002 02:24:12.618408 1 tasks_processing.go:74] worker 30 stopped. I1002 02:24:12.618414 1 tasks_processing.go:74] worker 7 stopped. I1002 02:24:12.618593 1 tasks_processing.go:74] worker 29 stopped. I1002 02:24:12.618601 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 56.8499ms to process 0 records I1002 02:24:12.618615 1 tasks_processing.go:74] worker 37 stopped. I1002 02:24:12.618628 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 55.582131ms to process 0 records E1002 02:24:12.618637 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1002 02:24:12.618661 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1002 02:24:12.618674 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 56.709719ms to process 1 records I1002 02:24:12.618680 1 tasks_processing.go:74] worker 25 stopped. I1002 02:24:12.618770 1 tasks_processing.go:74] worker 31 stopped. E1002 02:24:12.618782 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1002 02:24:12.618792 1 gather.go:177] gatherer "clusterconfig" function "machines" took 55.673939ms to process 0 records I1002 02:24:12.618873 1 tasks_processing.go:74] worker 4 stopped. I1002 02:24:12.619024 1 recorder.go:70] Recording config/apiserver with fingerprint=fb63e88df9072fa4d4e5633c61c2e4c9a8da476d2fad19dd0aa9c1436161e8b2 I1002 02:24:12.619040 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 59.17609ms to process 1 records I1002 02:24:12.619092 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=a22659498950297a3b3180541074c25cfc8eaa2a59d89cc16a661a42e830172c I1002 02:24:12.619100 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 55.854183ms to process 1 records I1002 02:24:12.619105 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 55.820373ms to process 0 records I1002 02:24:12.619132 1 tasks_processing.go:74] worker 48 stopped. I1002 02:24:12.619147 1 tasks_processing.go:74] worker 54 stopped. I1002 02:24:12.619171 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=2aef1419e5779d108987e20b1e62b7252b1972830c6c4cd31f0197a221e4c5fe I1002 02:24:12.619187 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=4735f39ad61d55b3ae9d2a0c3eb87644c65dc51625f259e3b1f7c49d58daae8a I1002 02:24:12.619205 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=761194418a908a273e9bead1e398111a5bc42c430e2330fd3b68f029508a6d12 I1002 02:24:12.619211 1 tasks_processing.go:74] worker 39 stopped. I1002 02:24:12.619221 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 56.001463ms to process 3 records I1002 02:24:12.619309 1 tasks_processing.go:74] worker 50 stopped. I1002 02:24:12.619518 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=73056e46637c030e00d08a17d683aa9b42d2caf7020f92682716e48abcda1f0b I1002 02:24:12.619533 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 59.212197ms to process 1 records I1002 02:24:12.619779 1 tasks_processing.go:74] worker 35 stopped. I1002 02:24:12.619797 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1002 02:24:12.619805 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 57.036335ms to process 1 records I1002 02:24:12.620335 1 tasks_processing.go:74] worker 62 stopped. I1002 02:24:12.620346 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 57.548634ms to process 0 records I1002 02:24:12.620363 1 tasks_processing.go:74] worker 43 stopped. I1002 02:24:12.620374 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 57.354153ms to process 0 records I1002 02:24:12.620393 1 tasks_processing.go:74] worker 44 stopped. I1002 02:24:12.621051 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=bb58d173a030a218fbbcba8cc9e16f0100b80629e1caa556220df9a394c6dc2d I1002 02:24:12.621112 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=5cc726d9103b7e1d55c61791b79957771eb8a48338eb5c16d3f7183cb18d1a02 I1002 02:24:12.621146 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1e86da1f4367512228bbb2569da30f192e64bcf64c34ba1cab8a8937ec06401b I1002 02:24:12.621187 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 57.284544ms to process 3 records I1002 02:24:12.621354 1 tasks_processing.go:74] worker 38 stopped. I1002 02:24:12.621365 1 recorder.go:70] Recording config/featuregate with fingerprint=9bd50247fd2a323538e67e8ff79c7cad1488b9ca410667cb82ef3473b4871a4e I1002 02:24:12.621405 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 58.056168ms to process 1 records I1002 02:24:12.621692 1 tasks_processing.go:74] worker 55 stopped. I1002 02:24:12.621694 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1d0bf9432951c87b68db1f78e1b008e00a2a9da4c2571e6f5c7ae83edf3b3f98 I1002 02:24:12.622463 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=362067e6651f60ac884876fefead9444ab89b919987b6ca9cd862c42333e9086 I1002 02:24:12.622644 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=95e32757f69a592def8aaccb2804d03ccb3c2b9a038ee3520eabe04e4f3bbe58 I1002 02:24:12.622718 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e3d590dd9b57ca252d7e33220c546e27123082dabd64dc77386bb157fb60f0f5 I1002 02:24:12.622782 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=c0bf28e9be27670169a5244894773dcb4659dabb0a3318fcf90a6b98c0322343 I1002 02:24:12.622842 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=4dfec7efb35390af81de39922ca314c67164d19b3b519393697b9df3e805804d I1002 02:24:12.622869 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a9930f0de0f84f5ed6df53eb9914d2c4e3938c98edb9a4a2c4c6d3ecfbc4ffeb W1002 02:24:12.623419 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:24:12.623403 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=84f9cecd1256e955c20bd8bddedb21dd6bc1ea5445e7fa5ea1fc6a6352c4f3bf I1002 02:24:12.623467 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0a12d060160668db1ecbbb07bc187ea5863e76af1d9bd1ca80c5c96cbcfb460c I1002 02:24:12.623528 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4106781c6311d64ae2f682c0e9450b7101b1b7542695ed249ff5854e848cf898 I1002 02:24:12.623556 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2bf7713a3b20be119d1302c0e5e4b1b8e1ed07ccb565123279c7d3a8619fcc07 I1002 02:24:12.623576 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 57.492475ms to process 11 records I1002 02:24:12.623661 1 tasks_processing.go:74] worker 49 stopped. I1002 02:24:12.624340 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=2e654be0d7a80a5e678c28c9560abc59fc037f154a0c52d6eb31bf960396fce4 I1002 02:24:12.624356 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 60.28804ms to process 1 records I1002 02:24:12.624368 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 63.744585ms to process 0 records I1002 02:24:12.624381 1 tasks_processing.go:74] worker 2 stopped. I1002 02:24:12.628199 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:24:12.628201 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:24:12.628272 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1002 02:24:12.630923 1 tasks_processing.go:74] worker 15 stopped. I1002 02:24:12.631184 1 recorder.go:70] Recording config/node/ip-10-0-133-218.ec2.internal with fingerprint=dfd8f9941991653778cb4e57421a05b731e12a1dc89ea821f74db81ebe288a0e I1002 02:24:12.631238 1 recorder.go:70] Recording config/node/ip-10-0-145-223.ec2.internal with fingerprint=d45e4dbf651279abf2d5b59286cae3b4f00b95d0ef75225dcecde64ac062c18b I1002 02:24:12.631293 1 recorder.go:70] Recording config/node/ip-10-0-171-12.ec2.internal with fingerprint=826e797df07137344691cc360d9fa7b16d37cc6f8fa7c7343b8a9d0a132dd1e0 I1002 02:24:12.631300 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 69.793067ms to process 3 records I1002 02:24:12.631390 1 tasks_processing.go:74] worker 60 stopped. I1002 02:24:12.631491 1 recorder.go:70] Recording config/network with fingerprint=f71d3492375ea4ea835772c193c57b91b10e73162759dca7649c345425d32d51 I1002 02:24:12.631517 1 gather.go:177] gatherer "clusterconfig" function "networks" took 68.370634ms to process 1 records I1002 02:24:12.632689 1 base_controller.go:82] Caches are synced for ConfigController I1002 02:24:12.632699 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1002 02:24:12.663027 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1002 02:24:12.663042 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W1002 02:24:12.663181 1 operator.go:287] started I1002 02:24:12.663206 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1002 02:24:12.684284 1 prometheus_rules.go:88] Prometheus rules successfully created I1002 02:24:12.686712 1 tasks_processing.go:74] worker 47 stopped. I1002 02:24:12.687857 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-qbqh6 with fingerprint=4af3dd5b05897f8007385ecda8ecc8cf406b4e3b81ee1fb562ba397f951ebcdc I1002 02:24:12.687903 1 recorder.go:70] Recording config/running_containers with fingerprint=a5a7b0123716ab0de5846d8522d4fba4bf3e4e7d5080401e77cdf8437bf93919 I1002 02:24:12.687912 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 125.057078ms to process 2 records I1002 02:24:12.707589 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:24:12.707784 1 tasks_processing.go:74] worker 12 stopped. I1002 02:24:12.707797 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 144.750241ms to process 0 records I1002 02:24:12.708389 1 tasks_processing.go:74] worker 14 stopped. I1002 02:24:12.708542 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=e904a6e1320d7d958a497bdf72620cba460589e8c7a9279c8fcb68d01aca74ca I1002 02:24:12.708787 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8053526fe1fc6fd62d0eaf2a99d374fa75e3ccb0937b0208b06d6a9ea2b4d22e I1002 02:24:12.708839 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 145.649097ms to process 2 records I1002 02:24:12.709242 1 tasks_processing.go:74] worker 52 stopped. I1002 02:24:12.710424 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e68fc0d094c8d0314b6571c486d5f1fe8badc7efee8e9601058dc87c7c0b9c97 I1002 02:24:12.710597 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9561deb29f50d39ccce6b65e1264f08dce6246ae598bf8315d5a13b8a92fbfcc I1002 02:24:12.710610 1 gather.go:177] gatherer "clusterconfig" function "crds" took 149.4142ms to process 2 records I1002 02:24:12.716647 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:24:12.716659 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:24:12.716663 1 controller.go:203] Source scaController *sca.Controller is not ready I1002 02:24:12.716666 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1002 02:24:12.716668 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:24:12.716700 1 controller.go:458] The operator is still being initialized I1002 02:24:12.716706 1 controller.go:481] The operator is healthy I1002 02:24:12.719974 1 tasks_processing.go:74] worker 53 stopped. I1002 02:24:12.719992 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 157.093648ms to process 0 records E1002 02:24:12.723734 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27afa81bf2-1160-4bc2-bd26-c69620c4d01c%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:52544->172.30.0.10:53: read: connection refused I1002 02:24:12.723745 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27afa81bf2-1160-4bc2-bd26-c69620c4d01c%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:52544->172.30.0.10:53: read: connection refused I1002 02:24:12.739995 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W1002 02:24:12.742263 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:47289->172.30.0.10:53: read: connection refused I1002 02:24:12.742273 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:47289->172.30.0.10:53: read: connection refused I1002 02:24:12.748045 1 tasks_processing.go:74] worker 33 stopped. I1002 02:24:12.748414 1 recorder.go:70] Recording config/version with fingerprint=49fe24824053ba6eb9f8bb2f7376b8217084c3d83e7f1cd308df0b3a97eebc10 I1002 02:24:12.748436 1 recorder.go:70] Recording config/id with fingerprint=a18f192a26cfb4192e145c8c39c788e996419c7e042eaf12fd970fe148197eca I1002 02:24:12.748443 1 gather.go:177] gatherer "clusterconfig" function "version" took 184.902831ms to process 2 records I1002 02:24:12.763682 1 base_controller.go:82] Caches are synced for LoggingSyncer I1002 02:24:12.763692 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1002 02:24:12.769981 1 tasks_processing.go:74] worker 6 stopped. E1002 02:24:12.769996 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1002 02:24:12.770006 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1002 02:24:12.770009 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1002 02:24:12.770016 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1002 02:24:12.770045 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1002 02:24:12.770051 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1002 02:24:12.770055 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1002 02:24:12.770059 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1002 02:24:12.770078 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1002 02:24:12.770086 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1002 02:24:12.770090 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 208.872276ms to process 7 records I1002 02:24:12.776650 1 tasks_processing.go:74] worker 23 stopped. I1002 02:24:12.776664 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 213.610841ms to process 0 records I1002 02:24:12.819197 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1002 02:24:12.823099 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1002 02:24:12.868081 1 tasks_processing.go:74] worker 16 stopped. E1002 02:24:12.868097 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1002 02:24:12.868105 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t6c64unp49hmnk1vhu8d86e9f8mboal-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t6c64unp49hmnk1vhu8d86e9f8mboal-primary-cert-bundle-secret" not found I1002 02:24:12.868176 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=a3a240ab9b48b3e5f187a38ef37cb701b3c8b659bab34a584a4e2c4374c47b65 I1002 02:24:12.868188 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 307.536866ms to process 1 records I1002 02:24:13.343225 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1002 02:24:13.544285 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1002 02:24:13.622357 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:24:13.826121 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I1002 02:24:13.826136 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I1002 02:24:13.826617 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7z6q2 pod in namespace openshift-dns (previous: false). I1002 02:24:14.057111 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7z6q2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7z6q2\" is waiting to start: ContainerCreating" I1002 02:24:14.057126 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7z6q2\" is waiting to start: ContainerCreating" I1002 02:24:14.057133 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7z6q2 pod in namespace openshift-dns (previous: false). I1002 02:24:14.236195 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7z6q2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7z6q2\" is waiting to start: ContainerCreating" I1002 02:24:14.236213 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7z6q2\" is waiting to start: ContainerCreating" I1002 02:24:14.236223 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-fqx86 pod in namespace openshift-dns (previous: false). I1002 02:24:14.344717 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I1002 02:24:14.463056 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fqx86 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-fqx86\" is waiting to start: ContainerCreating" I1002 02:24:14.463073 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-fqx86\" is waiting to start: ContainerCreating" I1002 02:24:14.463079 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-fqx86 pod in namespace openshift-dns (previous: false). W1002 02:24:14.622148 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:24:14.632841 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fqx86 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-fqx86\" is waiting to start: ContainerCreating" I1002 02:24:14.632854 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-fqx86\" is waiting to start: ContainerCreating" I1002 02:24:14.632863 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qjqjx pod in namespace openshift-dns (previous: false). I1002 02:24:14.890039 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qjqjx pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qjqjx\" is waiting to start: ContainerCreating" I1002 02:24:14.890056 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qjqjx\" is waiting to start: ContainerCreating" I1002 02:24:14.890064 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qjqjx pod in namespace openshift-dns (previous: false). I1002 02:24:14.946885 1 tasks_processing.go:74] worker 28 stopped. I1002 02:24:14.946932 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=89b7160a8ad4d3df99289ca2c2d3779d3b2a0be8f6c63502f9e9b1df4c6026f7 I1002 02:24:14.946964 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=713a914d15ae001f25c00445af682894b53428f141214b8ef16164b18088eaaa I1002 02:24:14.946997 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1002 02:24:14.947020 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=e1c2cefc72c9b8b8c00d36966e2117f827b3a32d2f51912c1cb7ceb6883f40b3 I1002 02:24:14.947038 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1002 02:24:14.947057 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=8ce4e6d9f1f1f2cd8019611a5679617cb98e1921ff1d46616ab656d878b66ef8 I1002 02:24:14.947080 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=2ffe7bfe13139b9c17e40295de5bca0713c10612b781254ec7e4751a0a192bf1 I1002 02:24:14.947101 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=24bb368ef7f0c5ad2b09263aa488e1e65d6d9b24e79b5c45114e4d8d81573900 I1002 02:24:14.947122 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=9b466c6210c6895b24e6904ed7893282e660dcd77fabb32b36ae53345b9a6393 I1002 02:24:14.947141 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I1002 02:24:14.947156 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=9e35588817be81a177abb7ce3de6f2be0a7409b80a2a84ef3d9703b37f378d59 I1002 02:24:14.947165 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1002 02:24:14.947177 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=3edecfcb5db65eeb33bd6ca44a57a402eb9492f2bdbcf2c4f9481b18ac1b6777 I1002 02:24:14.947188 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1002 02:24:14.947199 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=3dc581a62c7eb8c0b13286d98ccb1b51662e59be154c55006ab4e842153c9bf5 I1002 02:24:14.947208 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1002 02:24:14.947221 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=f6b73f9a6f01417b721156eed8f533a6b13e68acb79a3e133fb086cda97cbd2d I1002 02:24:14.947230 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1002 02:24:14.947241 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=dbc57d54390b99c8ef7b9c3947ee1d4d216a43e3789e0d5642b3692f8d592de8 I1002 02:24:14.947312 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=d956ed28f8888cb6ce2724933cfcee50aec8c56a981a9f2ff714bcd91c65a3ca I1002 02:24:14.947332 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1002 02:24:14.947349 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=9f99be3a239f52d7a521a9f700a689e6b2d0752d643bda231e904de90e43487b I1002 02:24:14.947365 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=23f2f356b1bc2bcad16eebdb9f1ad4e616ed4fc945160ea8af24821c709cc68f I1002 02:24:14.947374 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1002 02:24:14.947386 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=31cd2abb774142738d44cad0bd7d3d5aa33cee346362e2cf417466a763b72722 I1002 02:24:14.947400 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1002 02:24:14.947411 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=b33ef30c3a94758edbadc3c020b69399220f9d68a6c23fbd94c77f3f3089d07f I1002 02:24:14.947425 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=cf4a94cb190ab9a7fe19f7bccc641b319ee305b4632ce97bae87b775cb61a796 I1002 02:24:14.947437 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f5208c2d544eb006ef618402af30a30f05165ce1fd703dca1358375c4df9bff9 I1002 02:24:14.947453 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=29b2b4a83ab1b2ac905688ed8b1499ca489d97fd6a3eb54ce2bbb4dbdde36c69 I1002 02:24:14.947468 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=8e774e16a07630a3b52cd0e39ba2050a9b067988f6d23cc9c2886beb9f1feb90 I1002 02:24:14.947477 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1002 02:24:14.947494 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=bfa45d663313af5668c83a3b16c30e32552350ba48c05234f4d46d9628403448 I1002 02:24:14.947527 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1002 02:24:14.947536 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1002 02:24:14.947542 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.384125643s to process 35 records I1002 02:24:15.031180 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qjqjx pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qjqjx\" is waiting to start: ContainerCreating" I1002 02:24:15.031195 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qjqjx\" is waiting to start: ContainerCreating" I1002 02:24:15.031204 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4zkvh pod in namespace openshift-dns (previous: false). I1002 02:24:15.232314 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:15.232330 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9lvtx pod in namespace openshift-dns (previous: false). I1002 02:24:15.431974 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:15.431990 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-n75fn pod in namespace openshift-dns (previous: false). W1002 02:24:15.621395 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:24:15.631285 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:15.631299 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-64fcd56989-jzv8h pod in namespace openshift-image-registry (previous: false). I1002 02:24:15.831881 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-64fcd56989-jzv8h pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-64fcd56989-jzv8h\" is waiting to start: ContainerCreating" I1002 02:24:15.831898 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-64fcd56989-jzv8h\" is waiting to start: ContainerCreating" I1002 02:24:15.831907 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-64fcd56989-kxgzd pod in namespace openshift-image-registry (previous: false). I1002 02:24:16.038850 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-64fcd56989-kxgzd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-64fcd56989-kxgzd\" is waiting to start: ContainerCreating" I1002 02:24:16.038867 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-64fcd56989-kxgzd\" is waiting to start: ContainerCreating" I1002 02:24:16.038876 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-77c9f8554b-2pmgd pod in namespace openshift-image-registry (previous: false). I1002 02:24:16.233410 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-77c9f8554b-2pmgd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-77c9f8554b-2pmgd\" is waiting to start: ContainerCreating" I1002 02:24:16.233436 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-77c9f8554b-2pmgd\" is waiting to start: ContainerCreating" I1002 02:24:16.233446 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-cbqlw pod in namespace openshift-image-registry (previous: false). I1002 02:24:16.433150 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:16.433165 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dchrp pod in namespace openshift-image-registry (previous: false). W1002 02:24:16.621765 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:24:16.631844 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:16.631856 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sz4vm pod in namespace openshift-image-registry (previous: false). I1002 02:24:16.831786 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:24:16.831803 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-79778b7dc-7mrw4 pod in namespace openshift-ingress (previous: false). I1002 02:24:17.032152 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-79778b7dc-7mrw4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-79778b7dc-7mrw4\" is waiting to start: ContainerCreating" I1002 02:24:17.032168 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-79778b7dc-7mrw4\" is waiting to start: ContainerCreating" I1002 02:24:17.032177 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-79778b7dc-c4l9v pod in namespace openshift-ingress (previous: false). I1002 02:24:17.241935 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-79778b7dc-c4l9v pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-79778b7dc-c4l9v\" is waiting to start: ContainerCreating" I1002 02:24:17.241950 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-79778b7dc-c4l9v\" is waiting to start: ContainerCreating" I1002 02:24:17.241959 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-847988ccf-77h98 pod in namespace openshift-ingress (previous: false). I1002 02:24:17.446980 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-847988ccf-77h98 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-847988ccf-77h98\" is waiting to start: ContainerCreating" I1002 02:24:17.446995 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-847988ccf-77h98\" is waiting to start: ContainerCreating" I1002 02:24:17.447004 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-b8hvr pod in namespace openshift-ingress-canary (previous: false). W1002 02:24:17.619055 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:24:17.619089 1 tasks_processing.go:74] worker 5 stopped. E1002 02:24:17.619111 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:24:17.619121 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W1002 02:24:17.619135 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I1002 02:24:17.619144 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.056190757s to process 1 records I1002 02:24:17.631712 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-b8hvr pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-b8hvr\" is waiting to start: ContainerCreating" I1002 02:24:17.631728 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-b8hvr\" is waiting to start: ContainerCreating" I1002 02:24:17.631738 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-rbx75 pod in namespace openshift-ingress-canary (previous: false). I1002 02:24:17.832297 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-rbx75 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rbx75\" is waiting to start: ContainerCreating" I1002 02:24:17.832313 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rbx75\" is waiting to start: ContainerCreating" I1002 02:24:17.832324 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wgvjz pod in namespace openshift-ingress-canary (previous: false). I1002 02:24:18.071062 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-wgvjz pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wgvjz\" is waiting to start: ContainerCreating" I1002 02:24:18.071081 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wgvjz\" is waiting to start: ContainerCreating" I1002 02:24:18.071095 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-ht6ph pod in namespace openshift-kube-storage-version-migrator (previous: false). I1002 02:24:18.234379 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-ht6ph pod in namespace openshift-kube-storage-version-migrator (previous: false). I1002 02:24:18.431462 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-rrbdv pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I1002 02:24:18.635946 1 tasks_processing.go:74] worker 45 stopped. I1002 02:24:18.636026 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=8b2d59449151fb0691b4171786945672121a5b17981b8853f622615c4cb636d1 I1002 02:24:18.636061 1 recorder.go:70] Recording events/openshift-dns with fingerprint=f61d7619043dca9192660121a214822cea912742b21032f812c6bbe09a0ae4d6 I1002 02:24:18.636110 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=a7cc34ea3a6b67c829fe9e64e217faf9a455547ac799724b97bff84059fc30bc I1002 02:24:18.636128 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=5efe365ec78bd5a3298bd8381b2c01297d7503e4f9ed9a40129bbc2d6c9c334a I1002 02:24:18.636157 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=00ab77c86a6244f897c14c256aab09549d93204cda2406f4f9de24862c31637d I1002 02:24:18.636170 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=233bb72379477bf387f864cf5ac40be1bf31eb49423d3c0bb3986f406b2bd616 I1002 02:24:18.636181 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=f5721cb0fde1cfbaa6a38fb2a92bc352be134d8ae4c9431b62e29d58f187c0e5 I1002 02:24:18.636210 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=19bb2b2f6460b637544f10ea8b4bfa7bdd9e956fc04325e6944cd143f1febc0f I1002 02:24:18.636219 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-ht6ph/migrator_current.log with fingerprint=e84e1fb69f2a3e80113e7cc04062fcc9a4002a977c0448cac7fbd39924c55405 I1002 02:24:18.636224 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-ht6ph/graceful-termination_current.log with fingerprint=ff0ce9f798423bfdf7bc19a9887904420e3db4ab23d84762574ee4a35e095f30 I1002 02:24:18.636246 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-rrbdv/kube-storage-version-migrator-operator_current.log with fingerprint=bbe5b24149474b04d0215b082bed255d399f3769c0390f011942ffed13b3eb7b I1002 02:24:18.636254 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.07405927s to process 11 records I1002 02:24:23.953185 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:24:25.630011 1 tasks_processing.go:74] worker 58 stopped. I1002 02:24:25.630050 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1002 02:24:25.630061 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.066965316s to process 1 records I1002 02:24:26.171530 1 tasks_processing.go:74] worker 11 stopped. I1002 02:24:26.171753 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=0e15902d75958c6ece09dbb74d031a849762e6d8787c810476e01f34a975078d I1002 02:24:26.171768 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.610459596s to process 1 records E1002 02:24:26.171817 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.612s with: function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1002 02:24:26.172914 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1002 02:24:26.172926 1 periodic.go:212] Running workloads gatherer I1002 02:24:26.172938 1 tasks_processing.go:45] number of workers: 2 I1002 02:24:26.172945 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:24:26.172948 1 tasks_processing.go:71] worker 1 working on workload_info task. I1002 02:24:26.172952 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:24:26.173020 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1002 02:24:26.196155 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I1002 02:24:26.207850 1 tasks_processing.go:74] worker 0 stopped. I1002 02:24:26.207864 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.816534ms to process 0 records I1002 02:24:26.208307 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (13ms) I1002 02:24:26.218813 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (10ms) I1002 02:24:26.229454 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (11ms) I1002 02:24:26.239097 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (10ms) I1002 02:24:26.251257 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (12ms) I1002 02:24:26.261086 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (10ms) I1002 02:24:26.270665 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (10ms) I1002 02:24:26.280654 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (10ms) I1002 02:24:26.289996 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (9ms) I1002 02:24:26.299542 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (10ms) I1002 02:24:26.309996 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (10ms) I1002 02:24:26.406032 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (96ms) I1002 02:24:26.507858 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (102ms) I1002 02:24:26.598315 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:24:26.605877 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (98ms) I1002 02:24:26.708923 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (103ms) I1002 02:24:26.798276 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:24:26.808181 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (99ms) I1002 02:24:26.912619 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (104ms) I1002 02:24:27.006070 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (93ms) I1002 02:24:27.108947 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (103ms) I1002 02:24:27.207343 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (98ms) I1002 02:24:27.310748 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (103ms) I1002 02:24:27.406379 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (96ms) I1002 02:24:27.515716 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (109ms) I1002 02:24:27.605388 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (90ms) I1002 02:24:27.707533 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (102ms) I1002 02:24:27.806033 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (98ms) I1002 02:24:27.910030 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (104ms) I1002 02:24:28.009564 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I1002 02:24:28.106809 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (97ms) I1002 02:24:28.206258 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms) I1002 02:24:28.306567 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I1002 02:24:28.306593 1 tasks_processing.go:74] worker 1 stopped. E1002 02:24:28.306602 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I1002 02:24:28.306816 1 recorder.go:70] Recording config/workload_info with fingerprint=e64d4101f9efd79a0afa3c803221a850a532f052b8705e525cef6c8440ec3af0 I1002 02:24:28.306828 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.133639289s to process 1 records E1002 02:24:28.306849 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.133s with: function \"workload_info\" failed with an error" I1002 02:24:28.307942 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I1002 02:24:28.307953 1 periodic.go:212] Running conditional gatherer I1002 02:24:28.321045 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1002 02:24:28.325779 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.9:34273->172.30.0.10:53: read: connection refused E1002 02:24:28.326006 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1002 02:24:28.326054 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1002 02:24:28.336710 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1002 02:24:28.336721 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336726 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336728 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336731 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336733 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336735 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336737 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336739 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:24:28.336741 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1002 02:24:28.336753 1 tasks_processing.go:45] number of workers: 3 I1002 02:24:28.336759 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:24:28.336762 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1002 02:24:28.336767 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:24:28.336778 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1002 02:24:28.336780 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:24:28.336784 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1002 02:24:28.336786 1 tasks_processing.go:74] worker 1 stopped. I1002 02:24:28.336853 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I1002 02:24:28.336863 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 625ns to process 1 records I1002 02:24:28.336885 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I1002 02:24:28.336893 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.12µs to process 1 records I1002 02:24:28.336897 1 tasks_processing.go:74] worker 0 stopped. I1002 02:24:28.337006 1 tasks_processing.go:74] worker 2 stopped. I1002 02:24:28.337017 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 217.116µs to process 0 records I1002 02:24:28.337031 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.9:34273->172.30.0.10:53: read: connection refused I1002 02:24:28.337041 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I1002 02:24:28.360077 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=45729ad918cac0d40ae673e1707fabc114b65e7cd0e04c57113bbc4b83f3ff72 I1002 02:24:28.360191 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-10-02-022428.tar.gz I1002 02:24:28.365659 1 diskrecorder.go:51] Wrote 105 records to disk in 5ms I1002 02:24:28.365683 1 periodic.go:281] Gathering cluster info every 2h0m0s I1002 02:24:28.365695 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1002 02:24:40.931426 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:25:17.214612 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="594167436c3631ea464374656133d481da84309a53b565e8367a89cc59413f81") W1002 02:25:17.214641 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I1002 02:25:17.214673 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="2b56c6a97a60e1ef003f4b20d69965c02e072a0f7684ab7b1f5e01ba6302fdb7") I1002 02:25:17.214719 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="dde747175b5643d86d809480ebdff0cc9721749553e08322ff5d1cfff593545b") I1002 02:25:17.214769 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I1002 02:25:17.214793 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I1002 02:25:17.214816 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I1002 02:25:17.214817 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I1002 02:25:17.214831 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1002 02:25:17.214833 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I1002 02:25:17.214849 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1002 02:25:17.214871 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I1002 02:25:17.214871 1 base_controller.go:181] Shutting down LoggingSyncer ... I1002 02:25:17.214884 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1350018675/tls.crt::/tmp/serving-cert-1350018675/tls.key" I1002 02:25:17.214844 1 secure_serving.go:258] Stopped listening on [::]:8443 I1002 02:25:17.214895 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I1002 02:25:17.214929 1 genericapiserver.go:713] [graceful-termination] apiserver is exiting