W0702 22:39:02.063634 1 cmd.go:257] Using insecure, self-signed certificates I0702 22:39:02.184605 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:02.184915 1 observer_polling.go:159] Starting file observer I0702 22:39:02.839636 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 22:39:02.839888 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 22:39:02.840633 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 22:39:02.840892 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 22:39:02.840982 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 22:39:02.840995 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 22:39:02.841002 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 22:39:02.841007 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 22:39:02.841020 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 22:39:02.841024 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 22:39:02.844680 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0702 22:39:02.844760 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"eb404700-9fcc-49b0-9d51-c2b0aa04de03", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 22:39:02.846800 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0702 22:39:02.846863 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 22:39:02.846816 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 22:39:02.846838 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 22:39:02.846953 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 22:39:02.847016 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 22:39:02.847124 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-371290177/tls.crt::/tmp/serving-cert-371290177/tls.key" I0702 22:39:02.847615 1 secure_serving.go:213] Serving securely on [::]:8443 I0702 22:39:02.847687 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0702 22:39:02.850310 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 22:39:02.850336 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 22:39:02.850780 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0702 22:39:02.856228 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:39:02.856250 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 22:39:02.861380 1 secretconfigobserver.go:119] support secret does not exist I0702 22:39:02.866388 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:39:02.870695 1 secretconfigobserver.go:119] support secret does not exist I0702 22:39:02.873996 1 recorder.go:161] Pruning old reports every 6h9m45s, max age is 288h0m0s I0702 22:39:02.879126 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 22:39:02.879151 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 22:39:02.879151 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 22:39:02.879166 1 insightsreport.go:296] Starting report retriever I0702 22:39:02.879175 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 22:39:02.879180 1 periodic.go:209] Running clusterconfig gatherer I0702 22:39:02.879233 1 tasks_processing.go:45] number of workers: 32 I0702 22:39:02.879273 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 22:39:02.879277 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 22:39:02.879283 1 tasks_processing.go:71] worker 8 working on dvo_metrics task. I0702 22:39:02.879285 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 22:39:02.879289 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 22:39:02.879295 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 22:39:02.879290 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:39:02.879300 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:39:02.879305 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 22:39:02.879310 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 22:39:02.879303 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 22:39:02.879307 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 22:39:02.879313 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 22:39:02.879318 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 22:39:02.879321 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 22:39:02.879321 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 22:39:02.879328 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 22:39:02.879329 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 22:39:02.879330 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 22:39:02.879336 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 22:39:02.879337 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 22:39:02.879344 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 22:39:02.879346 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 22:39:02.879340 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 22:39:02.879354 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 22:39:02.879355 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 22:39:02.879357 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 22:39:02.879343 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 22:39:02.879347 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 22:39:02.879364 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 22:39:02.879350 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 22:39:02.879354 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 22:39:02.879278 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 22:39:02.879449 1 tasks_processing.go:71] worker 31 working on storage_classes task. I0702 22:39:02.879509 1 tasks_processing.go:71] worker 25 working on version task. I0702 22:39:02.879518 1 tasks_processing.go:71] worker 29 working on monitoring_persistent_volumes task. I0702 22:39:02.879530 1 tasks_processing.go:71] worker 20 working on install_plans task. I0702 22:39:02.879545 1 tasks_processing.go:71] worker 11 working on cluster_apiserver task. I0702 22:39:02.879609 1 tasks_processing.go:71] worker 19 working on machine_autoscalers task. I0702 22:39:02.879769 1 tasks_processing.go:71] worker 30 working on aggregated_monitoring_cr_names task. I0702 22:39:02.879780 1 tasks_processing.go:71] worker 28 working on oauths task. I0702 22:39:02.879785 1 tasks_processing.go:71] worker 13 working on container_runtime_configs task. I0702 22:39:02.879792 1 tasks_processing.go:71] worker 12 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 22:39:02.879798 1 tasks_processing.go:71] worker 23 working on image_pruners task. I0702 22:39:02.879802 1 tasks_processing.go:71] worker 4 working on operators task. I0702 22:39:02.879805 1 tasks_processing.go:71] worker 3 working on lokistack task. I0702 22:39:02.879810 1 tasks_processing.go:71] worker 22 working on metrics task. W0702 22:39:02.880397 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:02.880431 1 tasks_processing.go:71] worker 22 working on sap_pods task. I0702 22:39:02.880457 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 50.652µs to process 0 records I0702 22:39:02.879816 1 tasks_processing.go:71] worker 5 working on openstack_controlplanes task. I0702 22:39:02.879819 1 tasks_processing.go:71] worker 2 working on machine_healthchecks task. I0702 22:39:02.879824 1 tasks_processing.go:71] worker 9 working on machine_sets task. I0702 22:39:02.879825 1 tasks_processing.go:71] worker 18 working on openstack_dataplanedeployments task. I0702 22:39:02.879829 1 tasks_processing.go:71] worker 27 working on ceph_cluster task. I0702 22:39:02.879834 1 tasks_processing.go:71] worker 6 working on container_images task. I0702 22:39:02.879834 1 tasks_processing.go:71] worker 0 working on active_alerts task. W0702 22:39:02.881374 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:02.881387 1 tasks_processing.go:71] worker 0 working on overlapping_namespace_uids task. I0702 22:39:02.879835 1 tasks_processing.go:71] worker 21 working on pod_network_connectivity_checks task. I0702 22:39:02.881449 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 35.186µs to process 0 records I0702 22:39:02.879839 1 tasks_processing.go:71] worker 14 working on operators_pods_and_events task. I0702 22:39:02.879841 1 tasks_processing.go:71] worker 24 working on support_secret task. I0702 22:39:02.879843 1 tasks_processing.go:71] worker 26 working on networks task. I0702 22:39:02.879841 1 tasks_processing.go:71] worker 16 working on openshift_machine_api_events task. I0702 22:39:02.879844 1 tasks_processing.go:71] worker 15 working on certificate_signing_requests task. I0702 22:39:02.879851 1 tasks_processing.go:71] worker 17 working on nodenetworkconfigurationpolicies task. I0702 22:39:02.879851 1 tasks_processing.go:71] worker 10 working on crds task. I0702 22:39:02.879853 1 tasks_processing.go:71] worker 1 working on cost_management_metrics_configs task. I0702 22:39:02.879858 1 tasks_processing.go:71] worker 7 working on feature_gates task. I0702 22:39:02.882517 1 tasks_processing.go:71] worker 19 working on machine_config_pools task. I0702 22:39:02.882560 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 2.892473ms to process 0 records I0702 22:39:02.883968 1 tasks_processing.go:71] worker 13 working on proxies task. I0702 22:39:02.883977 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 3.9778ms to process 0 records I0702 22:39:02.886228 1 tasks_processing.go:71] worker 22 working on openstack_dataplanenodesets task. I0702 22:39:02.886300 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.759215ms to process 0 records I0702 22:39:02.886343 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 5.165941ms to process 0 records I0702 22:39:02.886451 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.789122ms to process 0 records I0702 22:39:02.886483 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.280587ms to process 0 records I0702 22:39:02.886490 1 tasks_processing.go:71] worker 27 working on machine_configs task. I0702 22:39:02.886505 1 tasks_processing.go:71] worker 5 working on silenced_alerts task. W0702 22:39:02.886611 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:02.886527 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.020867ms to process 0 records I0702 22:39:02.886531 1 tasks_processing.go:71] worker 18 working on validating_webhook_configurations task. E0702 22:39:02.886988 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 22:39:02.887000 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 4.864234ms to process 0 records I0702 22:39:02.887011 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 382.919µs to process 0 records I0702 22:39:02.887038 1 tasks_processing.go:71] worker 5 working on node_logs task. I0702 22:39:02.886536 1 tasks_processing.go:71] worker 3 working on sap_config task. I0702 22:39:02.887270 1 tasks_processing.go:71] worker 21 working on image_registries task. I0702 22:39:02.886691 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0702 22:39:02.887391 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0702 22:39:02.887421 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0702 22:39:02.887447 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 22:39:02.887487 1 controller.go:489] The operator is still being initialized I0702 22:39:02.887515 1 controller.go:512] The operator is healthy I0702 22:39:02.887501 1 tasks_processing.go:71] worker 23 working on authentication task. I0702 22:39:02.887864 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=f8ec9577b27a9f3040e66e6dcfec2102b43b7f2a55884971123a6f943b04092f I0702 22:39:02.887882 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 7.367687ms to process 1 records I0702 22:39:02.887959 1 tasks_processing.go:71] worker 31 working on machines task. I0702 22:39:02.888037 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=2b257c33ea40e6436feeb140340f463aac872383fa196446f1d0bdeecc492173 I0702 22:39:02.888112 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=14389d5200f2f1fde795b0f6daa5c65cc9ddd513365e9a05343a55b47bebeae1 I0702 22:39:02.888145 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 8.222621ms to process 2 records I0702 22:39:02.888165 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 7.013629ms to process 0 records E0702 22:39:02.888174 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 22:39:02.888181 1 tasks_processing.go:71] worker 9 working on ingress_certificates task. I0702 22:39:02.888185 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 7.385962ms to process 0 records I0702 22:39:02.888199 1 tasks_processing.go:71] worker 2 working on olm_operators task. I0702 22:39:02.888313 1 tasks_processing.go:71] worker 11 working on storage_cluster task. I0702 22:39:02.888496 1 recorder.go:75] Recording config/apiserver with fingerprint=84bd926a51e255118d370ea5a8b9243c0f37b5d0ec91f3a33e43b6a5e5de431a I0702 22:39:02.888513 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 8.754794ms to process 1 records I0702 22:39:02.889523 1 tasks_processing.go:71] worker 28 working on nodenetworkstates task. I0702 22:39:02.889795 1 recorder.go:75] Recording config/oauth with fingerprint=dc5f7100d8d7ee890c29be50f2d3e249795e49d132dab731062dc7449d2c99e5 I0702 22:39:02.889814 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 9.550745ms to process 1 records I0702 22:39:02.890192 1 tasks_processing.go:71] worker 17 working on config_maps task. I0702 22:39:02.890204 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 8.205979ms to process 0 records I0702 22:39:02.890565 1 tasks_processing.go:71] worker 24 working on infrastructures task. E0702 22:39:02.890580 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 22:39:02.890593 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 8.8843ms to process 0 records I0702 22:39:02.891975 1 tasks_processing.go:71] worker 22 working on mutating_webhook_configurations task. I0702 22:39:02.891980 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.681135ms to process 0 records I0702 22:39:02.891994 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 9.79615ms to process 0 records I0702 22:39:02.892004 1 tasks_processing.go:71] worker 1 working on openshift_logging task. I0702 22:39:02.892533 1 tasks_processing.go:71] worker 26 working on clusterroles task. I0702 22:39:02.892755 1 recorder.go:75] Recording config/network with fingerprint=f7eaa288c8a007e6ea35cedf410f4f3c74c99e9929936b4d3809dedab2431650 I0702 22:39:02.892770 1 gather.go:177] gatherer "clusterconfig" function "networks" took 10.838317ms to process 1 records I0702 22:39:02.895025 1 tasks_processing.go:71] worker 29 working on image task. I0702 22:39:02.895091 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 15.494387ms to process 0 records I0702 22:39:02.896163 1 tasks_processing.go:71] worker 16 working on schedulers task. I0702 22:39:02.896193 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 14.408562ms to process 0 records I0702 22:39:02.896943 1 tasks_processing.go:71] worker 3 working on jaegers task. I0702 22:39:02.897130 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 9.68394ms to process 0 records I0702 22:39:02.897223 1 recorder.go:75] Recording config/proxy with fingerprint=cb69511e1239be5609cf5bd736aeb98932f4711d3de8828bbd8ec6a8a3f0ae87 I0702 22:39:02.897239 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 13.10327ms to process 1 records I0702 22:39:02.897456 1 tasks_processing.go:71] worker 13 working on pdbs task. I0702 22:39:02.897704 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.166959ms to process 0 records I0702 22:39:02.897826 1 tasks_processing.go:71] worker 19 working on tsdb_status task. W0702 22:39:02.898528 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:39:02.898555 1 tasks_processing.go:71] worker 0 working on nodes task. I0702 22:39:02.898584 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 22:39:02.898600 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 17.159082ms to process 1 records W0702 22:39:02.899159 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:02.899181 1 tasks_processing.go:71] worker 19 working on ingress task. I0702 22:39:02.899327 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.301853ms to process 0 records I0702 22:39:02.901972 1 tasks_processing.go:71] worker 7 working on sap_datahubs task. I0702 22:39:02.902121 1 recorder.go:75] Recording config/featuregate with fingerprint=0efbef9113980e65d3fd62ff3e98db563f1820fa1b1195d195430a7faaf3a7b0 I0702 22:39:02.902148 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 19.655318ms to process 1 records I0702 22:39:02.902157 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 20.174843ms to process 0 records I0702 22:39:02.902165 1 tasks_processing.go:71] worker 15 working on service_accounts task. I0702 22:39:02.902775 1 tasks_processing.go:71] worker 31 working on qemu_kubevirt_launcher_logs task. E0702 22:39:02.902812 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 22:39:02.902835 1 gather.go:177] gatherer "clusterconfig" function "machines" took 14.793378ms to process 0 records I0702 22:39:02.903651 1 tasks_processing.go:71] worker 5 working on openstack_version task. I0702 22:39:02.903705 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 16.591909ms to process 0 records I0702 22:39:02.903767 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 15.389111ms to process 0 records I0702 22:39:02.903786 1 tasks_processing.go:74] worker 11 stopped. I0702 22:39:02.904009 1 tasks_processing.go:74] worker 28 stopped. I0702 22:39:02.904024 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 14.471807ms to process 0 records I0702 22:39:02.904314 1 tasks_processing.go:74] worker 1 stopped. I0702 22:39:02.904329 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.295147ms to process 0 records I0702 22:39:02.905155 1 tasks_processing.go:74] worker 3 stopped. I0702 22:39:02.905174 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 8.124865ms to process 0 records I0702 22:39:02.905404 1 tasks_processing.go:74] worker 23 stopped. I0702 22:39:02.905705 1 recorder.go:75] Recording config/authentication with fingerprint=39b9f7932a7bf6fc3f2b04683ed98723d8ddba0b8751c32d4af09ecc71b5f8d7 I0702 22:39:02.905719 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 17.730663ms to process 1 records I0702 22:39:02.905807 1 tasks_processing.go:74] worker 21 stopped. I0702 22:39:02.906144 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=690828a2e1981d18fd2ca058a54d644c09fdd2665a9dde5baa6bf0198ccd78b4 I0702 22:39:02.906159 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 18.280683ms to process 1 records I0702 22:39:02.909014 1 tasks_processing.go:74] worker 7 stopped. I0702 22:39:02.909067 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 7.022624ms to process 0 records I0702 22:39:02.909284 1 tasks_processing.go:74] worker 5 stopped. I0702 22:39:02.909301 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.611873ms to process 0 records I0702 22:39:02.909560 1 tasks_processing.go:74] worker 18 stopped. I0702 22:39:02.909777 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b26e87898c951aa2e50ed358f940c6152d11f1a77e5e4735db0f39892c31906e I0702 22:39:02.909863 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e9a1b8c43d332dc86b659316c23ac1ca607bdff3ed2b883afa6fe48eb359d698 I0702 22:39:02.909893 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=45d131a3e980d5438732d4e0cdf13cb71bf932a590ddec2286054f56a12bb3a7 I0702 22:39:02.909963 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=07e192cf522bb8810d2deb00fb98eff184225c7171f8d6dedc3bba0eba3dafe6 I0702 22:39:02.910019 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7cdbe332184bad4e59ca8e02feb7b50e1213791cd26da62d7df09a6894af5565 I0702 22:39:02.910069 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=6df0b30ac98b218260b0eade1973f34528f6025d9ee470d0a8d881f5378d0c9b I0702 22:39:02.910126 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=587585fe4dce3a4551b838c854dd19db86589e3fa3b8010fa81f344d5de0acd4 I0702 22:39:02.910193 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=7fef6be94e7f25afadf73a88b7e4cadb30fa5143b321cceab2e0a8cfdf966299 I0702 22:39:02.910247 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f24932e3959e3997f004af36b6d899f3ebedb4783ce8c401ce9fd1365f83f941 I0702 22:39:02.910334 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=b16e448c119de23c84d1c2c77890a8d0e8c98f471297e5168c0fe93c73d13fa9 I0702 22:39:02.910387 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=487765b4b6028ed7ec511cb165b65113219a55b5fa96b350600f571440887cd5 I0702 22:39:02.910398 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 22.561802ms to process 11 records I0702 22:39:02.917260 1 tasks_processing.go:74] worker 24 stopped. I0702 22:39:02.917679 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s W0702 22:39:02.917759 1 operator.go:288] started I0702 22:39:02.917756 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0702 22:39:02.917907 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0702 22:39:02.918107 1 recorder.go:75] Recording config/infrastructure with fingerprint=8164da93bc930326fe8f6f3fdc2541207160089631adf4fde83828ae2cc2d768 I0702 22:39:02.918169 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 26.682211ms to process 1 records I0702 22:39:02.918303 1 recorder.go:75] Recording config/image with fingerprint=fb6bf725372a93c77479246de45daecdc12f4e8db08218764f266a69d23c9bc7 I0702 22:39:02.918332 1 gather.go:177] gatherer "clusterconfig" function "image" took 22.385102ms to process 1 records I0702 22:39:02.918403 1 tasks_processing.go:74] worker 29 stopped. I0702 22:39:02.918423 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=b99fa0e3b224c8f20e87c5694f49f0dcbf4d1bfb559efe828826f252baf3077b I0702 22:39:02.918490 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 21.459438ms to process 1 records I0702 22:39:02.918430 1 tasks_processing.go:74] worker 16 stopped. I0702 22:39:02.918648 1 tasks_processing.go:74] worker 10 stopped. I0702 22:39:02.919200 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d9b6a3c7f90f072f8628a9d0cbd597f140f11344fd66c13b070d169fc81254e0 I0702 22:39:02.919576 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=b2a8671aeecf8390cc0f7bb9a0208111b58c1bdd83a0cef596bd476bc8cdee49 I0702 22:39:02.919622 1 gather.go:177] gatherer "clusterconfig" function "crds" took 35.739184ms to process 2 records I0702 22:39:02.919746 1 tasks_processing.go:74] worker 13 stopped. I0702 22:39:02.919758 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=0c5357bcf25ab4bc629af5f63a9f971609ea933a43ef50ef76b76369f736178f I0702 22:39:02.919842 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=2394157d80f5826a70c1a9df0673b4be9c8c39a4d5997c9cca537d9517117620 I0702 22:39:02.919884 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=b725bd621d396adb79dc810c454bd4f7af88d4e4154c6cad934412893f6c8d49 I0702 22:39:02.919894 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 20.866656ms to process 3 records I0702 22:39:02.919942 1 tasks_processing.go:74] worker 22 stopped. I0702 22:39:02.920067 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=0054103ead006b75f52c699ceca0424f15b3f991e094390e4434e29aad575283 I0702 22:39:02.920124 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=f90edcb2beb8288eb2201c6443d4054e05dab2b9ce3dcce5e4e6998caeb802a7 I0702 22:39:02.920174 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=417a912b4dc24ba4629ec35853835651db4d80780ba8ecbb77b089d9277adb6c I0702 22:39:02.920184 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.62354ms to process 3 records I0702 22:39:02.920194 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 39.418459ms to process 0 records I0702 22:39:02.920252 1 recorder.go:75] Recording config/olm_operators with fingerprint=498fb7313358d9f191b8326decc053d0e542adc15cce83693eb291bda5a0e52c I0702 22:39:02.920315 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 31.697883ms to process 1 records I0702 22:39:02.920275 1 tasks_processing.go:74] worker 30 stopped. I0702 22:39:02.920284 1 tasks_processing.go:74] worker 2 stopped. I0702 22:39:02.928434 1 tasks_processing.go:74] worker 6 stopped. I0702 22:39:02.930242 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-wjfl7 with fingerprint=8daec70672226c582c072e3902e8ae1e475f42aaed11ce65d44cc248e5746c0f I0702 22:39:02.930317 1 recorder.go:75] Recording config/running_containers with fingerprint=d9a993a010b72f7d3d1a6b04796783a6bdee4f91150c6cc4c6489cfb540204e8 I0702 22:39:02.930373 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 47.208105ms to process 2 records I0702 22:39:02.932639 1 tasks_processing.go:74] worker 12 stopped. I0702 22:39:02.932696 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 52.569228ms to process 0 records I0702 22:39:02.940882 1 controller.go:212] Source scaController *sca.Controller is not ready I0702 22:39:02.940900 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0702 22:39:02.940905 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 22:39:02.940909 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0702 22:39:02.940913 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0702 22:39:02.940952 1 controller.go:489] The operator is still being initialized I0702 22:39:02.940961 1 controller.go:512] The operator is healthy I0702 22:39:02.941643 1 tasks_processing.go:74] worker 26 stopped. I0702 22:39:02.941933 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=bc61f2329c514bff531716848964a245f54d00b1173ca05a03fb30a434734c31 I0702 22:39:02.942085 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b4139ce2e122fe0cdd008f4c8bb577f8d6d4e33d94ad82ad46db58730180851d I0702 22:39:02.942103 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 49.08641ms to process 2 records I0702 22:39:02.943264 1 tasks_processing.go:74] worker 19 stopped. I0702 22:39:02.943422 1 recorder.go:75] Recording config/ingress with fingerprint=633a11353999acd66043865808cc4b9549e3312d28fcc6663f4e23afb3fcfb71 I0702 22:39:02.943437 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 44.068141ms to process 1 records I0702 22:39:02.946954 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 22:39:02.947046 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 22:39:02.947081 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file E0702 22:39:02.949573 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2749fecacb-5122-420b-aa90-3aff9e288ff6%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:47183->172.30.0.10:53: read: connection refused I0702 22:39:02.949587 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2749fecacb-5122-420b-aa90-3aff9e288ff6%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:47183->172.30.0.10:53: read: connection refused I0702 22:39:02.951489 1 base_controller.go:82] Caches are synced for ConfigController I0702 22:39:02.951501 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0702 22:39:02.957782 1 prometheus_rules.go:88] Prometheus rules successfully created I0702 22:39:02.983672 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:39:02.994600 1 gather_logs.go:145] no pods in namespace were found I0702 22:39:02.994654 1 tasks_processing.go:74] worker 31 stopped. I0702 22:39:02.994667 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 91.826364ms to process 0 records I0702 22:39:02.995436 1 tasks_processing.go:74] worker 25 stopped. I0702 22:39:02.995876 1 recorder.go:75] Recording config/version with fingerprint=ef67de0df26513a6726a2cbe63fc470d0709f9a12c802267a7f2f250593db0be I0702 22:39:02.995895 1 recorder.go:75] Recording config/id with fingerprint=759be319f9c500cf003149f99b632ec47813685ff497c136d73c4737e09bd2bb I0702 22:39:02.995905 1 gather.go:177] gatherer "clusterconfig" function "version" took 115.904601ms to process 2 records I0702 22:39:03.002891 1 tasks_processing.go:74] worker 0 stopped. I0702 22:39:03.003427 1 recorder.go:75] Recording config/node/ip-10-0-0-73.ec2.internal with fingerprint=eabe676fdc99174b4c543e8303b54590d3f566c2242e2f9c06bd0213b6b41936 I0702 22:39:03.003522 1 recorder.go:75] Recording config/node/ip-10-0-1-148.ec2.internal with fingerprint=d7f108caeb6c3f0c480caf2d6d2538905f6ee8cdc45c7710b222e8a7b52a1055 I0702 22:39:03.003607 1 recorder.go:75] Recording config/node/ip-10-0-2-115.ec2.internal with fingerprint=1a1d450ab20f4c53621e7c00d708b1708fd7c05fb95066ce8ab4dd392e530b26 I0702 22:39:03.003622 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 104.313405ms to process 3 records E0702 22:39:03.003636 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 22:39:03.003643 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 22:39:03.003649 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 22:39:03.003660 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0702 22:39:03.003686 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=2b7e7d968c1ca0e033f2ae1514829fefa6008cf7d89addbe266d351cfb9cca19 I0702 22:39:03.003707 1 tasks_processing.go:74] worker 17 stopped. I0702 22:39:03.003727 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 22:39:03.003738 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0702 22:39:03.003745 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0702 22:39:03.003797 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 22:39:03.003810 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 22:39:03.003818 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 113.350524ms to process 7 records I0702 22:39:03.007016 1 tasks_processing.go:74] worker 27 stopped. I0702 22:39:03.007050 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 22:39:03.007061 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 120.462595ms to process 1 records I0702 22:39:03.018168 1 base_controller.go:82] Caches are synced for LoggingSyncer I0702 22:39:03.018236 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0702 22:39:03.019332 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0702 22:39:03.024905 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:42556->172.30.0.10:53: read: connection refused I0702 22:39:03.024976 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:42556->172.30.0.10:53: read: connection refused I0702 22:39:03.025856 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0702 22:39:03.066026 1 tasks_processing.go:74] worker 9 stopped. E0702 22:39:03.066048 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 22:39:03.066057 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ra9b4t6gmck2s07741sa8pg3h1hfp8l-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ra9b4t6gmck2s07741sa8pg3h1hfp8l-primary-cert-bundle-secret" not found I0702 22:39:03.066139 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=63a98da93adeb7d352f32552335d1ba220700c500688a86c747fac4369295bc1 I0702 22:39:03.066154 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 177.821404ms to process 1 records I0702 22:39:03.314302 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0702 22:39:03.314317 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0702 22:39:03.314557 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-l7g5t pod in namespace openshift-dns (previous: false). I0702 22:39:03.542540 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l7g5t pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-l7g5t\" is waiting to start: ContainerCreating" I0702 22:39:03.542561 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-l7g5t\" is waiting to start: ContainerCreating" I0702 22:39:03.542569 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-l7g5t pod in namespace openshift-dns (previous: false). I0702 22:39:03.719635 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l7g5t pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-l7g5t\" is waiting to start: ContainerCreating" I0702 22:39:03.719653 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-l7g5t\" is waiting to start: ContainerCreating" I0702 22:39:03.719684 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qr52n pod in namespace openshift-dns (previous: false). W0702 22:39:03.896499 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:39:03.950495 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qr52n pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qr52n\" is waiting to start: ContainerCreating" I0702 22:39:03.950514 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qr52n\" is waiting to start: ContainerCreating" I0702 22:39:03.950523 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qr52n pod in namespace openshift-dns (previous: false). I0702 22:39:04.121826 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qr52n pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qr52n\" is waiting to start: ContainerCreating" I0702 22:39:04.121846 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qr52n\" is waiting to start: ContainerCreating" I0702 22:39:04.121875 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-t574k pod in namespace openshift-dns (previous: false). I0702 22:39:04.416606 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0702 22:39:04.488481 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t574k pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-t574k\" is waiting to start: ContainerCreating" I0702 22:39:04.488499 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-t574k\" is waiting to start: ContainerCreating" I0702 22:39:04.488507 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-t574k pod in namespace openshift-dns (previous: false). I0702 22:39:04.532016 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t574k pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-t574k\" is waiting to start: ContainerCreating" I0702 22:39:04.532031 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-t574k\" is waiting to start: ContainerCreating" I0702 22:39:04.532040 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9cs87 pod in namespace openshift-dns (previous: false). I0702 22:39:04.723295 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:04.723313 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-cjw9v pod in namespace openshift-dns (previous: false). I0702 22:39:04.739957 1 tasks_processing.go:74] worker 4 stopped. I0702 22:39:04.740013 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=3486505f005f9aea8b1d79d622c15503f9e9127869c4587fa16134113d87f27f I0702 22:39:04.740049 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=8a7359a0c7b1eb6f8ce183a6eb8662dfa597904e6d998fb61fe9a108a3336ec3 I0702 22:39:04.740080 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 22:39:04.740106 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=c8bd3e1b8c571067dcff4b2991e9b1d2cf79e288c4fe698874c957ce61c4f089 I0702 22:39:04.740137 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 22:39:04.740159 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=fd4eb79cd5ef029376f576323d766ef641d5f45cda5a0fed7c2c1d7910460b60 I0702 22:39:04.740189 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=eb7e5131d186e54ef6a7e93ca2cd05ce982e412567f3d3c144850aa4e889f05d I0702 22:39:04.740214 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ef39dfa4a8a9246fbb33acd5c5c48a75ab540d7e226c7cd2195232fd6c8b65b4 I0702 22:39:04.740229 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=02dc96f28cffb4d2a630ec59646edede555ad3cf772e14365c43ff42f50591c5 I0702 22:39:04.740248 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=f98e408198127fee2e26cc49fba4732d082e50b7f7ad63e883de74175e914e35 I0702 22:39:04.740257 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 22:39:04.740273 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=c3104a8dc91bbbca66bcd9b2458d7b61731ff0e65b09913ce504fa9a1ab5514a I0702 22:39:04.740285 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 22:39:04.740300 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=cb47132a7869448b14f76557d621e66d4c46c7890d0ca4f13d66851866d04add I0702 22:39:04.740309 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 22:39:04.740321 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d90da573f189744d094567d23877522c9cc93a07ef56a22d0f88c5a848ec0ed7 I0702 22:39:04.740330 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 22:39:04.740346 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=e34dbb817eda419b973f1333043e8f9a941f69204512adf7bbf780c9a86e99d4 I0702 22:39:04.740472 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=441de39c2bc1afe7e5dbda999eddd16e0b37398429eb4db453d3cd96c73684c9 I0702 22:39:04.740481 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0702 22:39:04.740489 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0702 22:39:04.740510 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 22:39:04.740531 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=88de80b853b1076be739badcc7f227c2ba3fed16cee61024bb9e407adf402d1d I0702 22:39:04.740554 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=3a81b669c75e1a036235f746dc0b131089f88b689708760a5a05b44bf1b31ea8 I0702 22:39:04.740563 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 22:39:04.740580 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=9d613cb2802b4e0c7ad17c567f70780ae4402a6c5281ee24902097e7d5cc711c I0702 22:39:04.740589 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 22:39:04.740603 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ae256d3a7efe5ed34318fac0d106e05c761f9d4a50e92558303313148635c4fb I0702 22:39:04.740620 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=a7bbc60d94bdf3be3fc8cb80b33a71d54122cfd361b4c522518db3dd43dfc44e I0702 22:39:04.740635 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f1ba0580f2d9c6c2eaca064a468e42c79775e0420d2728d5d407a825a6109a09 I0702 22:39:04.740650 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=0206b97b6eb98a1ac1965d53113c926c18bc4003588d0caa8b290c1d113d3636 I0702 22:39:04.740664 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=e70a4269490517aedf9a91b584fec9fe7d63aab86e3769cd996d5d6809aadb7e I0702 22:39:04.740690 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=b8c8e4732fe245e9301764c70d5258e5185c43c1d80bf9391b0864a7bb93cbe0 I0702 22:39:04.740706 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 22:39:04.740714 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 22:39:04.740721 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.859693188s to process 35 records W0702 22:39:04.895967 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:39:04.919597 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:04.919611 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-gvcjm pod in namespace openshift-dns (previous: false). I0702 22:39:05.120896 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:05.120971 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6d78f467fd-cdkjm pod in namespace openshift-image-registry (previous: false). I0702 22:39:05.320973 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6d78f467fd-cdkjm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6d78f467fd-cdkjm\" is waiting to start: ContainerCreating" I0702 22:39:05.320989 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6d78f467fd-cdkjm\" is waiting to start: ContainerCreating" I0702 22:39:05.321024 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7cd56cd94f-g2t6w pod in namespace openshift-image-registry (previous: false). I0702 22:39:05.520393 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7cd56cd94f-g2t6w pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7cd56cd94f-g2t6w\" is waiting to start: ContainerCreating" I0702 22:39:05.520413 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7cd56cd94f-g2t6w\" is waiting to start: ContainerCreating" I0702 22:39:05.520484 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7cd56cd94f-jphkw pod in namespace openshift-image-registry (previous: false). I0702 22:39:05.719726 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7cd56cd94f-jphkw pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7cd56cd94f-jphkw\" is waiting to start: ContainerCreating" I0702 22:39:05.719743 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7cd56cd94f-jphkw\" is waiting to start: ContainerCreating" I0702 22:39:05.719754 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bgvcg pod in namespace openshift-image-registry (previous: false). W0702 22:39:05.896481 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:39:05.921349 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:05.921369 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gbsxm pod in namespace openshift-image-registry (previous: false). I0702 22:39:06.119947 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:06.119966 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-m227b pod in namespace openshift-image-registry (previous: false). I0702 22:39:06.319463 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 22:39:06.319513 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-59d5696fcf-s7n7q pod in namespace openshift-ingress (previous: false). I0702 22:39:06.520095 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-59d5696fcf-s7n7q pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-59d5696fcf-s7n7q\" is waiting to start: ContainerCreating" I0702 22:39:06.520113 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-59d5696fcf-s7n7q\" is waiting to start: ContainerCreating" I0702 22:39:06.520161 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-99496c6c6-h9jl4 pod in namespace openshift-ingress (previous: false). I0702 22:39:06.734124 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-99496c6c6-h9jl4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-99496c6c6-h9jl4\" is waiting to start: ContainerCreating" I0702 22:39:06.734142 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-99496c6c6-h9jl4\" is waiting to start: ContainerCreating" I0702 22:39:06.734180 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-99496c6c6-nbmwn pod in namespace openshift-ingress (previous: false). W0702 22:39:06.896785 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:39:06.920168 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-99496c6c6-nbmwn pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-99496c6c6-nbmwn\" is waiting to start: ContainerCreating" I0702 22:39:06.920185 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-99496c6c6-nbmwn\" is waiting to start: ContainerCreating" I0702 22:39:06.920221 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-cxsq2 pod in namespace openshift-ingress-canary (previous: false). I0702 22:39:07.120900 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-cxsq2 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-cxsq2\" is waiting to start: ContainerCreating" I0702 22:39:07.120917 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-cxsq2\" is waiting to start: ContainerCreating" I0702 22:39:07.120967 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-g8z48 pod in namespace openshift-ingress-canary (previous: false). I0702 22:39:07.322757 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-g8z48 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-g8z48\" is waiting to start: ContainerCreating" I0702 22:39:07.322773 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-g8z48\" is waiting to start: ContainerCreating" I0702 22:39:07.322800 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xv84w pod in namespace openshift-ingress-canary (previous: false). I0702 22:39:07.520032 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-xv84w pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xv84w\" is waiting to start: ContainerCreating" I0702 22:39:07.520049 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xv84w\" is waiting to start: ContainerCreating" I0702 22:39:07.520065 1 tasks_processing.go:74] worker 14 stopped. I0702 22:39:07.520140 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=6741db0389e203339400cc4cb8d86c89e481e0b71a0880675ee59bf28e0a7567 I0702 22:39:07.520190 1 recorder.go:75] Recording events/openshift-dns with fingerprint=e5efe51f31ac63a2ecc6438b6dcf532eeca2dfb12256347a8887ca03bc41a668 I0702 22:39:07.520276 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0e6b3afbacd6a480bdae6eed33313b8317baca92e5ccc5131f4bbe2311cf5772 I0702 22:39:07.520303 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=9ad14524f4725fbf0345f6c0a0033a1a76fbaef74ca686ec534f7e54baab3c1d I0702 22:39:07.520347 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=76acae6d686e2fdbeaa95c1069fd12c4b625e2568fcbc6589c7b8ee43366bb30 I0702 22:39:07.520363 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=c16435b7157b222d948bf1c345d77e0bafd39fb9a8270bbc5bb5e628eaf024f4 I0702 22:39:07.520493 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-l7g5t with fingerprint=b133e664322f66b6287dd63ad940a1ea03a096440b78aa0cf19c5901647a68f9 I0702 22:39:07.520609 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-qr52n with fingerprint=2456716151d5b1195a93b2f1ef51d3f1efe726ba62e0ac77804cfd775a1e2368 I0702 22:39:07.520680 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-t574k with fingerprint=5eaa429419a582c1e826ddae53f08963c9ace864fbb73fdac84925a6ec44cc1d I0702 22:39:07.520785 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6d78f467fd-cdkjm with fingerprint=48cc9a546dec49aef3d6392a3c1874f1caff68ec867af6df46353626a0fe26fd I0702 22:39:07.520879 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7cd56cd94f-g2t6w with fingerprint=0b3253d5c99ee5185be967bc9a8979d819ac7e23a6d95be162f3c42565c4f255 I0702 22:39:07.520990 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7cd56cd94f-jphkw with fingerprint=c44c344124ac9bcfaa451735256b0d43b6f5efd268cc3ad65495ce2e70131de5 I0702 22:39:07.521082 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-59d5696fcf-s7n7q with fingerprint=f36a61399a7ada5f264ba24cb0c3709455b00a3cb5abf1a480c0c7a800df7680 I0702 22:39:07.521167 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-99496c6c6-h9jl4 with fingerprint=ef9d999c39bf1403956674cefd79688d3f7f9c4fb48954333297749b409ef630 I0702 22:39:07.521253 1 recorder.go:75] Recording config/pod/openshift-ingress/router-default-99496c6c6-nbmwn with fingerprint=83ee6e223f1673ffd87021661f804aa45cd464eaab9680124dcccee552d96cae I0702 22:39:07.521307 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-cxsq2 with fingerprint=c574a9b778fd2c66168eb0110391d8c6c4307cb9ac21ae8968c76c35f0515069 I0702 22:39:07.521359 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-g8z48 with fingerprint=d85bb63ad7d328a7e79358464a5a90687066d24f3da09278f600bd008c4f2c2c I0702 22:39:07.521411 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-xv84w with fingerprint=d12b39b7c4715867b8c7ff7c12ec3c4eb07ec98d02ab8d06f836d1b939e1633e I0702 22:39:07.521420 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.638596966s to process 18 records W0702 22:39:07.898428 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 22:39:07.898471 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 22:39:07.898495 1 tasks_processing.go:74] worker 8 stopped. E0702 22:39:07.898511 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 22:39:07.898527 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0702 22:39:07.898553 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0702 22:39:07.898571 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.019196417s to process 1 records I0702 22:39:15.503473 1 tasks_processing.go:74] worker 20 stopped. I0702 22:39:15.503515 1 recorder.go:75] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0702 22:39:15.503527 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.6239244s to process 1 records I0702 22:39:16.080298 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:39:16.309518 1 tasks_processing.go:74] worker 15 stopped. I0702 22:39:16.309797 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=a7a4de02df1cc1abdf9107bf21a9d837b0f58083251a7f44b02bf3cc6249ecc3 I0702 22:39:16.309818 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.40733799s to process 1 records E0702 22:39:16.309886 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.43s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0702 22:39:16.310958 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0702 22:39:16.310972 1 periodic.go:209] Running workloads gatherer I0702 22:39:16.310991 1 tasks_processing.go:45] number of workers: 2 I0702 22:39:16.311002 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:39:16.311008 1 tasks_processing.go:71] worker 1 working on workload_info task. I0702 22:39:16.311015 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:39:16.311030 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0702 22:39:16.335322 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0702 22:39:16.338516 1 tasks_processing.go:74] worker 0 stopped. I0702 22:39:16.338530 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.47084ms to process 0 records I0702 22:39:16.343759 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0702 22:39:16.353222 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0702 22:39:16.361969 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (9ms) I0702 22:39:16.370886 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (9ms) I0702 22:39:16.379344 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (8ms) I0702 22:39:16.387939 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (9ms) I0702 22:39:16.397124 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (9ms) I0702 22:39:16.405965 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (9ms) I0702 22:39:16.415238 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (9ms) I0702 22:39:16.423692 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (8ms) I0702 22:39:16.444674 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (21ms) I0702 22:39:16.544401 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0702 22:39:16.645547 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0702 22:39:16.746244 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (101ms) I0702 22:39:16.846494 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0702 22:39:16.944902 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (98ms) I0702 22:39:17.069558 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (125ms) I0702 22:39:17.157265 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (88ms) I0702 22:39:17.249118 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (92ms) I0702 22:39:17.344910 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (96ms) I0702 22:39:17.444865 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0702 22:39:17.545382 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0702 22:39:17.645232 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0702 22:39:17.745225 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms) I0702 22:39:17.845657 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0702 22:39:17.876430 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:39:17.946937 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0702 22:39:18.044917 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (98ms) I0702 22:39:18.068811 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:39:18.144307 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0702 22:39:18.245830 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0702 22:39:18.343837 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (98ms) I0702 22:39:18.445486 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (102ms) I0702 22:39:18.544273 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0702 22:39:18.645743 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0702 22:39:18.645779 1 tasks_processing.go:74] worker 1 stopped. E0702 22:39:18.645800 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0702 22:39:18.646171 1 recorder.go:75] Recording config/workload_info with fingerprint=e4cc65506b40fe6e1d150b6120a4cf8aaf95b95493665da6162bf26d6467972f I0702 22:39:18.646189 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.33476201s to process 1 records E0702 22:39:18.646214 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.335s with: function \"workload_info\" failed with an error" I0702 22:39:18.647313 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0702 22:39:18.647325 1 periodic.go:209] Running conditional gatherer I0702 22:39:18.655639 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0702 22:39:18.662134 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:35119->172.30.0.10:53: read: connection refused E0702 22:39:18.662384 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 22:39:18.662439 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0702 22:39:18.669506 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0702 22:39:18.669520 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669526 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669529 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669533 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669536 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669539 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669542 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669545 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 22:39:18.669548 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0702 22:39:18.669564 1 tasks_processing.go:45] number of workers: 3 I0702 22:39:18.669575 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 22:39:18.669580 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 22:39:18.669585 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:39:18.669596 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0702 22:39:18.669601 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0702 22:39:18.669604 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:39:18.669615 1 tasks_processing.go:74] worker 1 stopped. I0702 22:39:18.669665 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0702 22:39:18.669677 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.031µs to process 1 records I0702 22:39:18.669719 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0702 22:39:18.669728 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.136µs to process 1 records I0702 22:39:18.669733 1 tasks_processing.go:74] worker 0 stopped. I0702 22:39:18.670060 1 tasks_processing.go:74] worker 2 stopped. I0702 22:39:18.670284 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 451.52µs to process 0 records I0702 22:39:18.670341 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:35119->172.30.0.10:53: read: connection refused I0702 22:39:18.670381 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0702 22:39:18.695372 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=5ecc4b8200865c2dfb2f0793a24257f428ae214699b95443355748413771b367 I0702 22:39:18.695521 1 diskrecorder.go:70] Writing 113 records to /var/lib/insights-operator/insights-2026-07-02-223918.tar.gz I0702 22:39:18.703101 1 diskrecorder.go:51] Wrote 113 records to disk in 7ms I0702 22:39:18.703129 1 periodic.go:278] Gathering cluster info every 2h0m0s I0702 22:39:18.703151 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 22:39:32.013750 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:40:27.185662 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="59c1eb3a0269632cdbd8d08931b7f9cfac80c305797e61b57909692b464e5ae4") W0702 22:40:27.185695 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0702 22:40:27.185755 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="47de48104926963fe632d198c2d2867b21d980fe1ebbeaa0c6d45bc6347f710c") I0702 22:40:27.185762 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0702 22:40:27.185804 1 periodic.go:170] Shutting down I0702 22:40:27.185835 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0702 22:40:27.185847 1 base_controller.go:181] Shutting down LoggingSyncer ... I0702 22:40:27.185861 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="d19f7fa1f838c2303ea224d80e85563db2e8a747d41171a6954b14ff7a2cdb1c") I0702 22:40:27.185863 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0702 22:40:27.185870 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0702 22:40:27.185901 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"