W0702 02:07:16.934781 1 cmd.go:257] Using insecure, self-signed certificates I0702 02:07:17.546141 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:17.546463 1 observer_polling.go:159] Starting file observer I0702 02:07:18.210336 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 02:07:18.210577 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 02:07:18.211072 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 02:07:18.211090 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:07:18.211096 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:07:18.211100 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 02:07:18.211102 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 02:07:18.211104 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 02:07:18.211107 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 02:07:18.211179 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 02:07:18.214526 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0702 02:07:18.214669 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"1e2bc19f-f827-4de2-b9d0-e590773cc764", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 02:07:18.216834 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 02:07:18.216803 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0702 02:07:18.216854 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:07:18.216857 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 02:07:18.216832 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 02:07:18.216899 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:07:18.217213 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2840578972/tls.crt::/tmp/serving-cert-2840578972/tls.key" I0702 02:07:18.217423 1 secure_serving.go:213] Serving securely on [::]:8443 I0702 02:07:18.217451 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0702 02:07:18.220412 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 02:07:18.220432 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:07:18.220597 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0702 02:07:18.225257 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:07:18.225276 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:07:18.230276 1 secretconfigobserver.go:119] support secret does not exist I0702 02:07:18.234739 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:07:18.240243 1 secretconfigobserver.go:119] support secret does not exist I0702 02:07:18.241699 1 recorder.go:161] Pruning old reports every 6h39m38s, max age is 288h0m0s I0702 02:07:18.245763 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 02:07:18.245774 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 02:07:18.245779 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 02:07:18.245787 1 insightsreport.go:296] Starting report retriever I0702 02:07:18.245793 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 02:07:18.245832 1 periodic.go:209] Running clusterconfig gatherer I0702 02:07:18.245887 1 tasks_processing.go:45] number of workers: 32 I0702 02:07:18.245912 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:07:18.245922 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 02:07:18.245921 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 02:07:18.245927 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 02:07:18.245933 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:07:18.245934 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:07:18.245934 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 02:07:18.245943 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 02:07:18.245943 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 02:07:18.245946 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 02:07:18.245947 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 02:07:18.245949 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 02:07:18.245954 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 02:07:18.245955 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 02:07:18.245962 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 02:07:18.246019 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 02:07:18.246368 1 tasks_processing.go:71] worker 15 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 02:07:18.246377 1 tasks_processing.go:71] worker 6 working on lokistack task. I0702 02:07:18.246377 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 02:07:18.246390 1 tasks_processing.go:71] worker 22 working on openstack_version task. I0702 02:07:18.246394 1 tasks_processing.go:71] worker 4 working on jaegers task. I0702 02:07:18.246411 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 02:07:18.246481 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 02:07:18.246400 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 02:07:18.246423 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 02:07:18.246427 1 tasks_processing.go:71] worker 1 working on pdbs task. I0702 02:07:18.246667 1 tasks_processing.go:71] worker 21 working on nodenetworkconfigurationpolicies task. I0702 02:07:18.246892 1 tasks_processing.go:71] worker 17 working on image_registries task. I0702 02:07:18.246996 1 tasks_processing.go:71] worker 18 working on install_plans task. I0702 02:07:18.246431 1 tasks_processing.go:71] worker 2 working on storage_classes task. I0702 02:07:18.246435 1 tasks_processing.go:71] worker 5 working on image task. I0702 02:07:18.246438 1 tasks_processing.go:71] worker 11 working on tsdb_status task. W0702 02:07:18.247466 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:18.247482 1 tasks_processing.go:71] worker 11 working on machine_sets task. I0702 02:07:18.246442 1 tasks_processing.go:71] worker 14 working on ingress_certificates task. I0702 02:07:18.247874 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 72.498µs to process 0 records I0702 02:07:18.246443 1 tasks_processing.go:71] worker 7 working on dvo_metrics task. I0702 02:07:18.246439 1 tasks_processing.go:71] worker 8 working on ingress task. I0702 02:07:18.246446 1 tasks_processing.go:71] worker 13 working on machine_configs task. I0702 02:07:18.246447 1 tasks_processing.go:71] worker 10 working on clusterroles task. I0702 02:07:18.246450 1 tasks_processing.go:71] worker 9 working on feature_gates task. I0702 02:07:18.246456 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 02:07:18.248993 1 tasks_processing.go:71] worker 28 working on nodenetworkstates task. I0702 02:07:18.246456 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 02:07:18.246462 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 02:07:18.246465 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 02:07:18.246465 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 02:07:18.246463 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 02:07:18.246471 1 tasks_processing.go:71] worker 0 working on validating_webhook_configurations task. I0702 02:07:18.246473 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 02:07:18.246472 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 02:07:18.246473 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 02:07:18.246389 1 tasks_processing.go:71] worker 12 working on certificate_signing_requests task. I0702 02:07:18.246485 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 02:07:18.246485 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 02:07:18.246487 1 tasks_processing.go:71] worker 16 working on openstack_controlplanes task. I0702 02:07:18.246494 1 tasks_processing.go:71] worker 3 working on ceph_cluster task. I0702 02:07:18.249103 1 tasks_processing.go:71] worker 31 working on operators task. I0702 02:07:18.249281 1 tasks_processing.go:71] worker 26 working on cluster_apiserver task. I0702 02:07:18.249336 1 tasks_processing.go:71] worker 19 working on metrics task. W0702 02:07:18.249367 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:18.249382 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I0702 02:07:18.249163 1 tasks_processing.go:71] worker 29 working on cost_management_metrics_configs task. I0702 02:07:18.249516 1 tasks_processing.go:71] worker 30 working on machines task. I0702 02:07:18.249606 1 tasks_processing.go:71] worker 20 working on mutating_webhook_configurations task. I0702 02:07:18.249702 1 tasks_processing.go:71] worker 23 working on openshift_machine_api_events task. I0702 02:07:18.249729 1 tasks_processing.go:71] worker 24 working on monitoring_persistent_volumes task. I0702 02:07:18.249171 1 tasks_processing.go:71] worker 25 working on silenced_alerts task. W0702 02:07:18.249861 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:18.249869 1 tasks_processing.go:71] worker 27 working on openstack_dataplanedeployments task. I0702 02:07:18.249871 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 30.829µs to process 0 records I0702 02:07:18.250143 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 3.048429ms to process 0 records I0702 02:07:18.250154 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 38.237µs to process 0 records I0702 02:07:18.250163 1 tasks_processing.go:71] worker 25 working on nodes task. I0702 02:07:18.250219 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 3.445384ms to process 0 records I0702 02:07:18.250240 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 3.812469ms to process 0 records I0702 02:07:18.250254 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 3.847067ms to process 0 records I0702 02:07:18.250317 1 tasks_processing.go:71] worker 4 working on machine_healthchecks task. I0702 02:07:18.250332 1 tasks_processing.go:71] worker 22 working on config_maps task. I0702 02:07:18.250349 1 tasks_processing.go:71] worker 21 working on sap_pods task. I0702 02:07:18.250409 1 tasks_processing.go:71] worker 6 working on authentication task. I0702 02:07:18.251301 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0702 02:07:18.251320 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:07:18.251328 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:07:18.251332 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:07:18.251352 1 controller.go:489] The operator is still being initialized I0702 02:07:18.251360 1 controller.go:512] The operator is healthy I0702 02:07:18.252603 1 tasks_processing.go:71] worker 28 working on container_images task. I0702 02:07:18.252617 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 3.497303ms to process 0 records I0702 02:07:18.252840 1 tasks_processing.go:71] worker 19 working on crds task. I0702 02:07:18.252851 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 3.446304ms to process 0 records I0702 02:07:18.256913 1 tasks_processing.go:71] worker 1 working on oauths task. I0702 02:07:18.257132 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=cfd0708309f653524ca3788e2add01e69718c9486c0d2419f76341cbd7f174ad I0702 02:07:18.257167 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=c2241406c631b9cfec3bd40ea060690a781c677b5c34a8b607b05d87e6cde818 I0702 02:07:18.257193 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=53c53508c18d66cfdaca1c21882172bd5aae108571f057c49ec6f3b7f52ffc9b I0702 02:07:18.257205 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 10.19887ms to process 3 records I0702 02:07:18.257292 1 tasks_processing.go:71] worker 5 working on qemu_kubevirt_launcher_logs task. I0702 02:07:18.257307 1 recorder.go:75] Recording config/image with fingerprint=315991c02358ef1d0cf46a2f6b32b08c58b865728b4cac79504c193f2df94c26 I0702 02:07:18.257316 1 gather.go:177] gatherer "clusterconfig" function "image" took 9.722057ms to process 1 records I0702 02:07:18.257817 1 tasks_processing.go:71] worker 17 working on service_accounts task. I0702 02:07:18.258320 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f3623859b87dc14104c35260c8817883d000db9b40662dbaae2ae1e4dfb268d0 I0702 02:07:18.258335 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 10.871153ms to process 1 records I0702 02:07:18.266336 1 tasks_processing.go:71] worker 11 working on machine_autoscalers task. I0702 02:07:18.266349 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 18.843367ms to process 0 records I0702 02:07:18.266363 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.458289ms to process 0 records I0702 02:07:18.266375 1 tasks_processing.go:71] worker 27 working on schedulers task. I0702 02:07:18.266582 1 tasks_processing.go:71] worker 8 working on storage_cluster task. I0702 02:07:18.266744 1 recorder.go:75] Recording config/ingress with fingerprint=24bfa7e6e8865e2a467a03b249de6a9a221c55d60d37870980ba8ee767cab1f3 I0702 02:07:18.266760 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 18.497451ms to process 1 records I0702 02:07:18.266853 1 tasks_processing.go:71] worker 9 working on openstack_dataplanenodesets task. I0702 02:07:18.266883 1 recorder.go:75] Recording config/featuregate with fingerprint=3b1c50dad5997330a98e3d78d27dd83b1aac913a708ae56c770329fc032973b4 I0702 02:07:18.266897 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 17.859512ms to process 1 records I0702 02:07:18.276891 1 tasks_processing.go:71] worker 3 working on sap_datahubs task. I0702 02:07:18.276907 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 27.205484ms to process 0 records I0702 02:07:18.276919 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 27.390579ms to process 0 records I0702 02:07:18.277060 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.405827ms to process 0 records I0702 02:07:18.277081 1 tasks_processing.go:71] worker 16 working on pod_network_connectivity_checks task. I0702 02:07:18.277085 1 tasks_processing.go:71] worker 29 working on infrastructures task. I0702 02:07:18.277099 1 tasks_processing.go:71] worker 30 working on sap_config task. E0702 02:07:18.277162 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 02:07:18.277178 1 gather.go:177] gatherer "clusterconfig" function "machines" took 27.562776ms to process 0 records E0702 02:07:18.277192 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 02:07:18.277204 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 26.859458ms to process 0 records I0702 02:07:18.277362 1 tasks_processing.go:71] worker 4 working on active_alerts task. I0702 02:07:18.277372 1 tasks_processing.go:71] worker 6 working on overlapping_namespace_uids task. W0702 02:07:18.277404 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:18.277567 1 recorder.go:75] Recording config/authentication with fingerprint=dd5faae88dac3b96ffca25adf0ef9587920e55b1fa6c718b5334a598c05a2d66 I0702 02:07:18.277584 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 26.908075ms to process 1 records I0702 02:07:18.277592 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 78.528µs to process 0 records I0702 02:07:18.277600 1 tasks_processing.go:71] worker 4 working on aggregated_monitoring_cr_names task. I0702 02:07:18.277892 1 tasks_processing.go:71] worker 2 working on support_secret task. I0702 02:07:18.277984 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=ec3cea0c97be87c5f22dc778d776c7abbf259f5cd9f06c58753c4d66a92b9281 I0702 02:07:18.278014 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=fd651e1c5403d124961ff592555748374ecb7f6c793e342fea400eb91388e180 I0702 02:07:18.278023 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 30.781962ms to process 2 records I0702 02:07:18.278751 1 tasks_processing.go:71] worker 21 working on image_pruners task. I0702 02:07:18.278785 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 28.381284ms to process 0 records I0702 02:07:18.279272 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 29.071357ms to process 0 records I0702 02:07:18.279405 1 tasks_processing.go:71] worker 23 working on operators_pods_and_events task. I0702 02:07:18.280390 1 tasks_processing.go:71] worker 26 working on proxies task. I0702 02:07:18.280820 1 recorder.go:75] Recording config/apiserver with fingerprint=63144dac3220583540dbda1c88d4f60a71e0bb7a4657396248ef9fab88c6b46c I0702 02:07:18.280878 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 31.047536ms to process 1 records I0702 02:07:18.283001 1 tasks_processing.go:71] worker 12 working on machine_config_pools task. I0702 02:07:18.283013 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 32.740812ms to process 0 records I0702 02:07:18.283661 1 tasks_processing.go:71] worker 24 working on node_logs task. I0702 02:07:18.283702 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 33.912814ms to process 0 records I0702 02:07:18.284187 1 tasks_processing.go:71] worker 9 working on openshift_logging task. I0702 02:07:18.284288 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 17.30285ms to process 0 records I0702 02:07:18.284444 1 tasks_processing.go:71] worker 0 working on networks task. W0702 02:07:18.284508 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:07:18.284632 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=dcb558c7e627e472b3e924d493202f1df131b49b9d10a0f135da3a3e90a8c298 I0702 02:07:18.284799 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=073df077c5a98e0f3bbcd1a9e989b50cf9a662313b2f94e7d480e63a1f471d07 I0702 02:07:18.284840 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=50f1e40b09391bf52b7df85aecc92ad9e92796f6fc18974604eb36c6443870d1 I0702 02:07:18.284885 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=49cd6e4c388cbbe409476857d4501b324ca63644be00e2fa6d2b01faa8dc0285 I0702 02:07:18.284924 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1bab4da4951f49bff05a4f03f9c97e9a174bc41c9e68ee269cb13f8a01fc64e8 I0702 02:07:18.284964 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=084af63fd28ebe07ab3461dac11f616886f29f5dd0e6fb09deeeae1e80179285 I0702 02:07:18.284999 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=751ced596e4a90f862c4d6e31682a767e3803f411e6d4aafea01705a686ebc3c I0702 02:07:18.284997 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0702 02:07:18.285043 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=cca3505f418b4d113bf4ba245e19409857cdcf8ad2de47f97e56a1577bb7b6c1 I0702 02:07:18.285001 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0702 02:07:18.285173 1 operator.go:288] started I0702 02:07:18.285225 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0702 02:07:18.285082 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0bf837fdc81dadd9664334804b0fa76fc1ea1b5029a68f56946012d224651b7e I0702 02:07:18.285327 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=a5566b781cec9199c433342f106feb95de356b06b5e18af11a5a712d8c14ad49 I0702 02:07:18.285368 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2ad4c96b3cd51c6fabb0fdc6323a906a5a4ef59015c40fc9dadae4f16c6ca25a I0702 02:07:18.285381 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 35.088827ms to process 11 records I0702 02:07:18.285447 1 tasks_processing.go:71] worker 20 working on olm_operators task. I0702 02:07:18.285521 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=3083503066a3b5e1c9550a2ce787608e13373b2d7c85613acb108a99909723f2 I0702 02:07:18.285562 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=d6baf2c3c34f0ed11d662e76a6a4c5842e0247eeedf900b1a8a7c0af0233b411 I0702 02:07:18.285596 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f301e6b9c24beccc6dfc30ef22c0ea882566b08bc5938b5795e94f3889bad737 I0702 02:07:18.285609 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 34.874109ms to process 3 records I0702 02:07:18.285691 1 tasks_processing.go:71] worker 1 working on version task. I0702 02:07:18.285810 1 recorder.go:75] Recording config/oauth with fingerprint=94f0010b97170ecf8ecd7b6d23eba539e509d0262b1a5751eeb897e49f5f1eef I0702 02:07:18.285823 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 27.566449ms to process 1 records I0702 02:07:18.285837 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 18.157347ms to process 0 records I0702 02:07:18.285844 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 18.007039ms to process 0 records I0702 02:07:18.285915 1 tasks_processing.go:74] worker 11 stopped. I0702 02:07:18.285926 1 tasks_processing.go:74] worker 8 stopped. I0702 02:07:18.285996 1 tasks_processing.go:74] worker 25 stopped. I0702 02:07:18.286206 1 recorder.go:75] Recording config/node/ip-10-0-0-79.ec2.internal with fingerprint=67b81d790bdd87ce25476d3690f1f66628496c77d909880e4b4d2ac9ba9cca4d I0702 02:07:18.286264 1 recorder.go:75] Recording config/node/ip-10-0-1-114.ec2.internal with fingerprint=3dcc53dc93d3f402f966bb7adbf2c663e4bcc10b7e9199664c8388fe8f12adf9 I0702 02:07:18.286323 1 recorder.go:75] Recording config/node/ip-10-0-2-221.ec2.internal with fingerprint=15b418eba6389ac7385e20682f9f716e283e59382d0c1008b7f72557b2c8bc03 I0702 02:07:18.286338 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 34.618895ms to process 3 records I0702 02:07:18.287831 1 tasks_processing.go:74] worker 16 stopped. E0702 02:07:18.287843 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 02:07:18.287901 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 10.738228ms to process 0 records I0702 02:07:18.287911 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 10.932771ms to process 0 records I0702 02:07:18.287917 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 10.737364ms to process 0 records I0702 02:07:18.287925 1 tasks_processing.go:74] worker 30 stopped. I0702 02:07:18.287930 1 tasks_processing.go:74] worker 3 stopped. I0702 02:07:18.288035 1 tasks_processing.go:74] worker 27 stopped. I0702 02:07:18.288102 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=ecfe9d2e34410f6744a0c0541911d43b089f2ee7a55671e56a123e6d3648e06c I0702 02:07:18.288136 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 21.640034ms to process 1 records I0702 02:07:18.291519 1 tasks_processing.go:74] worker 2 stopped. E0702 02:07:18.291531 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 02:07:18.291538 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 13.552995ms to process 0 records I0702 02:07:18.296945 1 tasks_processing.go:74] worker 9 stopped. I0702 02:07:18.296959 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.741087ms to process 0 records I0702 02:07:18.297183 1 tasks_processing.go:74] worker 29 stopped. I0702 02:07:18.297738 1 recorder.go:75] Recording config/infrastructure with fingerprint=b8e9db542a5225116c2430545ac0d7ad275c122278ff3a4593a812ef73888147 I0702 02:07:18.297756 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 20.081628ms to process 1 records I0702 02:07:18.297848 1 tasks_processing.go:74] worker 10 stopped. I0702 02:07:18.297943 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=68807db132fb4402f781d0f07e3d71e4ef470acaae88d63936e9c7998b51270e I0702 02:07:18.298093 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=99b7f0fef29990f930213e9cf12581abf3748cc8343a735276abb6fd47b5c5ec I0702 02:07:18.298108 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 48.622934ms to process 2 records I0702 02:07:18.298224 1 tasks_processing.go:74] worker 21 stopped. I0702 02:07:18.298267 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3aa38e6c538ba8ef6f0bd058632b477d74b3ec32d3399afa325ee345065b5f8f I0702 02:07:18.298281 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 18.546565ms to process 1 records I0702 02:07:18.298503 1 tasks_processing.go:74] worker 26 stopped. I0702 02:07:18.298588 1 recorder.go:75] Recording config/proxy with fingerprint=b44f18091abfc53c0d6ce16c665e24b68df1ade87898a2ce2705c7335d9b13e6 I0702 02:07:18.298605 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 18.055253ms to process 1 records I0702 02:07:18.300967 1 tasks_processing.go:74] worker 19 stopped. I0702 02:07:18.301440 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e04bcfa562cf95287b7cdecc7923529106c6c76aed3e4ae263946d5ccd55ae77 I0702 02:07:18.301645 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d0e976d02420653cb8b5b083262f93c526d95a30a385d2ea8c9669ee7deddd04 I0702 02:07:18.301655 1 gather.go:177] gatherer "clusterconfig" function "crds" took 48.106762ms to process 2 records I0702 02:07:18.305910 1 tasks_processing.go:74] worker 12 stopped. I0702 02:07:18.305927 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 22.886576ms to process 0 records I0702 02:07:18.306040 1 tasks_processing.go:74] worker 15 stopped. I0702 02:07:18.306051 1 prometheus_rules.go:88] Prometheus rules successfully created I0702 02:07:18.306055 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 59.658743ms to process 0 records I0702 02:07:18.306152 1 tasks_processing.go:74] worker 0 stopped. I0702 02:07:18.306333 1 recorder.go:75] Recording config/network with fingerprint=05eedd313cbb74e0f9e6078a1affb2412fd9e08f99b39f4b6f993d0d1a1d85d4 I0702 02:07:18.306351 1 gather.go:177] gatherer "clusterconfig" function "networks" took 21.655767ms to process 1 records I0702 02:07:18.306365 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 20.706954ms to process 0 records I0702 02:07:18.306371 1 tasks_processing.go:74] worker 20 stopped. I0702 02:07:18.306458 1 controller.go:212] Source scaController *sca.Controller is not ready I0702 02:07:18.306495 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0702 02:07:18.306500 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:07:18.306504 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:07:18.306508 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:07:18.306547 1 controller.go:489] The operator is still being initialized I0702 02:07:18.306558 1 controller.go:512] The operator is healthy I0702 02:07:18.310831 1 tasks_processing.go:74] worker 4 stopped. I0702 02:07:18.310897 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 33.221149ms to process 0 records E0702 02:07:18.314938 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271f1b1aa0-98eb-4f1b-b150-ad61cdc00ef0%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:49203->172.30.0.10:53: read: connection refused I0702 02:07:18.314953 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271f1b1aa0-98eb-4f1b-b150-ad61cdc00ef0%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:49203->172.30.0.10:53: read: connection refused I0702 02:07:18.315549 1 tasks_processing.go:74] worker 22 stopped. E0702 02:07:18.315565 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 02:07:18.315571 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 02:07:18.315575 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 02:07:18.315583 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0702 02:07:18.315614 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0702 02:07:18.315621 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 02:07:18.315625 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0702 02:07:18.315629 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0702 02:07:18.315667 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 02:07:18.315675 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 02:07:18.315680 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 65.206193ms to process 7 records E0702 02:07:18.315691 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 02:07:18.315698 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r9nbgn6pfcnkmq08cm2r044mkhpiuqc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r9nbgn6pfcnkmq08cm2r044mkhpiuqc-primary-cert-bundle-secret" not found I0702 02:07:18.315743 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=8b576dc77d1d3407e68f955f62654c9606d4b9ae1a6440dfdd8d449709f5f596 I0702 02:07:18.315753 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 67.856989ms to process 1 records I0702 02:07:18.315760 1 tasks_processing.go:74] worker 14 stopped. I0702 02:07:18.317676 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 02:07:18.317684 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:07:18.317709 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:07:18.320901 1 base_controller.go:82] Caches are synced for ConfigController I0702 02:07:18.320913 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0702 02:07:18.324385 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:07:18.355369 1 tasks_processing.go:74] worker 1 stopped. I0702 02:07:18.355500 1 gather_logs.go:145] no pods in namespace were found I0702 02:07:18.355697 1 recorder.go:75] Recording config/version with fingerprint=b0a8042996e3aa87b577184426a09adc1168e2fa817e49ea1c525b28a762e16a I0702 02:07:18.355711 1 recorder.go:75] Recording config/id with fingerprint=6d3ed58630cd6ff943529256f4a48ed8c42354c26bf61edd0ff3d6213ae67fc7 I0702 02:07:18.355717 1 gather.go:177] gatherer "clusterconfig" function "version" took 69.660766ms to process 2 records I0702 02:07:18.355728 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 98.210758ms to process 0 records I0702 02:07:18.355734 1 tasks_processing.go:74] worker 5 stopped. I0702 02:07:18.364238 1 tasks_processing.go:74] worker 6 stopped. I0702 02:07:18.364273 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 02:07:18.364284 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 86.849548ms to process 1 records I0702 02:07:18.372358 1 tasks_processing.go:74] worker 28 stopped. I0702 02:07:18.372428 1 recorder.go:75] Recording config/running_containers with fingerprint=bbbcec7c803cbb58813b754529b36684fc57c653df59ae18b5b15dbe9fa6d28c I0702 02:07:18.372441 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 119.728476ms to process 1 records I0702 02:07:18.373137 1 tasks_processing.go:74] worker 24 stopped. I0702 02:07:18.373154 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 89.460495ms to process 0 records I0702 02:07:18.376707 1 tasks_processing.go:74] worker 13 stopped. I0702 02:07:18.376732 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 02:07:18.376741 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 128.305863ms to process 1 records I0702 02:07:18.384466 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0702 02:07:18.385282 1 base_controller.go:82] Caches are synced for LoggingSyncer I0702 02:07:18.385293 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0702 02:07:18.388061 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:33609->172.30.0.10:53: read: connection refused I0702 02:07:18.388074 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:33609->172.30.0.10:53: read: connection refused W0702 02:07:19.282185 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:07:19.505592 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0702 02:07:19.505609 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0702 02:07:19.506086 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-4c8tl pod in namespace openshift-dns (previous: false). I0702 02:07:19.713959 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0702 02:07:19.735542 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4c8tl pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-4c8tl\" is waiting to start: ContainerCreating" I0702 02:07:19.735567 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-4c8tl\" is waiting to start: ContainerCreating" I0702 02:07:19.735580 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-4c8tl pod in namespace openshift-dns (previous: false). I0702 02:07:19.909956 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4c8tl pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-4c8tl\" is waiting to start: ContainerCreating" I0702 02:07:19.909981 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-4c8tl\" is waiting to start: ContainerCreating" I0702 02:07:19.909997 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dgmj6 pod in namespace openshift-dns (previous: false). I0702 02:07:20.133219 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dgmj6 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dgmj6\" is waiting to start: ContainerCreating" I0702 02:07:20.133237 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dgmj6\" is waiting to start: ContainerCreating" I0702 02:07:20.133245 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dgmj6 pod in namespace openshift-dns (previous: false). W0702 02:07:20.281718 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:07:20.319688 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dgmj6 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dgmj6\" is waiting to start: ContainerCreating" I0702 02:07:20.319707 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dgmj6\" is waiting to start: ContainerCreating" I0702 02:07:20.319721 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-l7g4h pod in namespace openshift-dns (previous: false). I0702 02:07:20.323509 1 tasks_processing.go:74] worker 31 stopped. I0702 02:07:20.323616 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=a6347b3f01adfb7a66a509ceab983b22631d2568f9e61e3d0d806e30a494a292 I0702 02:07:20.323665 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c5d42566b4f361466b307ff4cacff5dab0c72cfaa864ff962258b1f400654ebe I0702 02:07:20.323708 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 02:07:20.323752 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=e09a4f1f2ce1e8c08aa2e2a93200e596728c57da667be04a8c79dcb2d42dd08a I0702 02:07:20.323782 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 02:07:20.323821 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=505b70b3b518c40189ae96e30b1704d7ea95cfb3cd0ae8d6ee9a9c32bac0cec7 I0702 02:07:20.323876 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=3d74af20cb85d4caba0c1bd8d84df5a4eab2dee7973971f331defb14a5a1abb2 I0702 02:07:20.323910 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=54ca560c3e30704909261e9b12ec323cbae44e1a50969fef672903b6d60d509b I0702 02:07:20.323933 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=e6b59c3ec3109ccd6152b2d2499f1c7ecc4c548a29d0cd2016e30ddd17a1ced5 I0702 02:07:20.323963 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=b2fea8c716d8bb89aa0b4a9125158ee1c1b0102f6b719678e2aa5003237f4fc0 I0702 02:07:20.323979 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 02:07:20.324021 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=af20e22a6bdbc32b55719492ad22af27c4b5c453f5fa087052552553c1a0e5ad I0702 02:07:20.324045 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 02:07:20.324071 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=1a06572b6ebc518af34635ae10753f1d193c273b5acb41fc20c88e5bb4c69c47 I0702 02:07:20.324085 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 02:07:20.324130 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=955bbfd07f2ad08b422d813fcf97e3002016c09aabbfe524dbd7961fe23387d3 I0702 02:07:20.324146 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 02:07:20.324174 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=97238637505b0e0c8b005b48ad2d8dd7413154c7e78f1b403bb4c70f1dddde24 I0702 02:07:20.324322 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b274030c232e92c656abaf014b6502efb5508f3922e1edef9bde5f194eb2fa6a I0702 02:07:20.324338 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0702 02:07:20.324351 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0702 02:07:20.324380 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 02:07:20.324411 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=12bdb4ee13154b95e236751710e02bf2853faca917bc1cb735c3d089bde26154 I0702 02:07:20.324446 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=d9f69fee9c2c023f65d52ff6e5ade59ef512cf871dcee2caddc9b54347cb2dc9 I0702 02:07:20.324461 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 02:07:20.324488 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=55487114cbb36a8d88c3a2067302a82aef5c61920cb99e263d2ab4c3dce4825a I0702 02:07:20.324504 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 02:07:20.324527 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ce62e8aa051f0157d57dae133b98639e543c3e5bbe8e5be6218677f6b3b90758 I0702 02:07:20.324553 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=375f7236516b98d9982615438bf2630e0c10817f119a9c6f59d7c51a199bed72 I0702 02:07:20.324577 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=65b7ab7fb8adaf1674cdf362ed7146adcd349b512597b7d0d9705c26dc1016a3 I0702 02:07:20.324603 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=d5a56978555aebfada11411a69eb126f53b184af59ffbf7177ac59a7fdc5c5dc I0702 02:07:20.324633 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=5e84d960dc729e68679c148d7a46ee7d15161c4fa5a66523bfab2307724c2f24 I0702 02:07:20.324648 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0702 02:07:20.324684 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=80d559c0986b109bd316b550fbfc1e191b40b74b103bb531b455d8d9371238eb I0702 02:07:20.324709 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 02:07:20.324722 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 02:07:20.324734 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.074294185s to process 36 records I0702 02:07:20.533001 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l7g4h pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-l7g4h\" is waiting to start: ContainerCreating" I0702 02:07:20.533020 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-l7g4h\" is waiting to start: ContainerCreating" I0702 02:07:20.533027 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-l7g4h pod in namespace openshift-dns (previous: false). I0702 02:07:20.710932 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l7g4h pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-l7g4h\" is waiting to start: ContainerCreating" I0702 02:07:20.710957 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-l7g4h\" is waiting to start: ContainerCreating" I0702 02:07:20.710970 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5czw2 pod in namespace openshift-dns (previous: false). I0702 02:07:20.909819 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:20.909840 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-r62lq pod in namespace openshift-dns (previous: false). I0702 02:07:21.110903 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:21.110925 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-spxqs pod in namespace openshift-dns (previous: false). W0702 02:07:21.282016 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:07:21.310861 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:21.310933 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-64c6ff4f56-zlvt4 pod in namespace openshift-image-registry (previous: false). I0702 02:07:21.510059 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-64c6ff4f56-zlvt4 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-64c6ff4f56-zlvt4\" is waiting to start: ContainerCreating" I0702 02:07:21.510077 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-64c6ff4f56-zlvt4\" is waiting to start: ContainerCreating" I0702 02:07:21.510143 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8574f47d5f-6226l pod in namespace openshift-image-registry (previous: false). I0702 02:07:21.710540 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8574f47d5f-6226l pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8574f47d5f-6226l\" is waiting to start: ContainerCreating" I0702 02:07:21.710557 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8574f47d5f-6226l\" is waiting to start: ContainerCreating" I0702 02:07:21.710606 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8574f47d5f-rbl5l pod in namespace openshift-image-registry (previous: false). I0702 02:07:21.911176 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8574f47d5f-rbl5l pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8574f47d5f-rbl5l\" is waiting to start: ContainerCreating" I0702 02:07:21.911193 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8574f47d5f-rbl5l\" is waiting to start: ContainerCreating" I0702 02:07:21.911215 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dsds4 pod in namespace openshift-image-registry (previous: false). I0702 02:07:22.110487 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:22.110505 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fcwt6 pod in namespace openshift-image-registry (previous: false). W0702 02:07:22.281992 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:07:22.311576 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:22.311593 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gr9zz pod in namespace openshift-image-registry (previous: false). I0702 02:07:22.509934 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:07:22.509955 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-c75579bbc-2lckb pod in namespace openshift-ingress (previous: false). I0702 02:07:22.710613 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-c75579bbc-2lckb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-c75579bbc-2lckb\" is waiting to start: ContainerCreating" I0702 02:07:22.710635 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-c75579bbc-2lckb\" is waiting to start: ContainerCreating" I0702 02:07:22.710648 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-c75579bbc-gkwxx pod in namespace openshift-ingress (previous: false). I0702 02:07:22.909323 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-c75579bbc-gkwxx pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-c75579bbc-gkwxx\" is waiting to start: ContainerCreating" I0702 02:07:22.909342 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-c75579bbc-gkwxx\" is waiting to start: ContainerCreating" I0702 02:07:22.909356 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-cb4f45b89-cg5b7 pod in namespace openshift-ingress (previous: false). I0702 02:07:23.109714 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-cb4f45b89-cg5b7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-cb4f45b89-cg5b7\" is waiting to start: ContainerCreating" I0702 02:07:23.109731 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-cb4f45b89-cg5b7\" is waiting to start: ContainerCreating" I0702 02:07:23.109742 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-6lw7f pod in namespace openshift-ingress-canary (previous: false). W0702 02:07:23.281936 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 02:07:23.281962 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 02:07:23.281977 1 tasks_processing.go:74] worker 7 stopped. E0702 02:07:23.281988 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 02:07:23.281998 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0702 02:07:23.282011 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0702 02:07:23.282021 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.033906219s to process 1 records I0702 02:07:23.310559 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-6lw7f pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-6lw7f\" is waiting to start: ContainerCreating" I0702 02:07:23.310575 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-6lw7f\" is waiting to start: ContainerCreating" I0702 02:07:23.310590 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-d6rqb pod in namespace openshift-ingress-canary (previous: false). I0702 02:07:23.510373 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-d6rqb pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-d6rqb\" is waiting to start: ContainerCreating" I0702 02:07:23.510393 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-d6rqb\" is waiting to start: ContainerCreating" I0702 02:07:23.510404 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qxsj7 pod in namespace openshift-ingress-canary (previous: false). I0702 02:07:23.719578 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-qxsj7 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qxsj7\" is waiting to start: ContainerCreating" I0702 02:07:23.719597 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qxsj7\" is waiting to start: ContainerCreating" I0702 02:07:23.719612 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-9c9pg pod in namespace openshift-kube-storage-version-migrator (previous: false). I0702 02:07:23.923338 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-9c9pg pod in namespace openshift-kube-storage-version-migrator (previous: false). I0702 02:07:24.110534 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-2p48b pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0702 02:07:24.314161 1 tasks_processing.go:74] worker 23 stopped. I0702 02:07:24.314263 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=c933685a87674a8156147cf0d5b96a60885c94727256e9c9dafa58637401d353 I0702 02:07:24.314320 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ece363f3dc404e5bc8d41364d3a9585a5d3dd23bff02b65c8542b2e7faca0bc9 I0702 02:07:24.314449 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=eac4238faa1c6fdae454e9d2e68c50a4190a5262d46567beb5b74d48a106807d I0702 02:07:24.314479 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=f2deaf3a74681241b222afadc60881cff44f7c5806bd756db9f8008bbb7181e6 I0702 02:07:24.314533 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=af6a86f826e4729233efdfb61d2e3ce0b7c50e8b41ea366a78c22528943b78ae I0702 02:07:24.314551 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=6e034ef86833696a18ec64711aa1fbd30ab018674816663c4bd458cb98183962 I0702 02:07:24.314562 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=1086b66421f5bec8fe9f6f89d249fbf91a72ef262e3a5001d0cd904aa813d250 I0702 02:07:24.314614 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=1e9e8f23feda7e94682c0b80e00d464f373ea7404dce8abcaa4c534075558701 I0702 02:07:24.316002 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-64c6ff4f56-zlvt4 with fingerprint=575bec92c4417b0efdd31a7f255bedb2978dd63c0df3bc67003cb6dcf1552f89 I0702 02:07:24.316150 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-8574f47d5f-6226l with fingerprint=4109662cecc08acb756da405d29afbbd579b12d395ac4d5ac930838985459a30 I0702 02:07:24.316253 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-8574f47d5f-rbl5l with fingerprint=8d03d99908391663c2946901227cb46c3a6b92ec6078d115e02dfe48a4d6f99e I0702 02:07:24.316269 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-9c9pg/migrator_current.log with fingerprint=a81697b37bec357e49e3d806e2c484ea030906b760820704c5726186b363f2fb I0702 02:07:24.316274 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-9c9pg/graceful-termination_current.log with fingerprint=a4b5b94e36b67714656911884721d475b5efc1b3633cdb66240b5c10a5afb879 I0702 02:07:24.316358 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-2p48b/kube-storage-version-migrator-operator_current.log with fingerprint=1d8426878a5e527aa2004ce0317822e61062f4592a2937874db65277eb3644f1 I0702 02:07:24.316370 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.034710575s to process 14 records I0702 02:07:30.751179 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:07:31.089450 1 tasks_processing.go:74] worker 18 stopped. I0702 02:07:31.089486 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0702 02:07:31.089497 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.842390244s to process 1 records I0702 02:07:31.862892 1 tasks_processing.go:74] worker 17 stopped. I0702 02:07:31.863338 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=9d475996b970b5499163b99cb7866431c26bc05ed77261e8b402c7515458063c I0702 02:07:31.863362 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605051469s to process 1 records E0702 02:07:31.863446 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.617s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0702 02:07:31.864554 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0702 02:07:31.864569 1 periodic.go:209] Running workloads gatherer I0702 02:07:31.864581 1 tasks_processing.go:45] number of workers: 2 I0702 02:07:31.864587 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:07:31.864591 1 tasks_processing.go:71] worker 1 working on workload_info task. I0702 02:07:31.864664 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:07:31.864746 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0702 02:07:31.889363 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0702 02:07:31.890994 1 tasks_processing.go:74] worker 0 stopped. I0702 02:07:31.891012 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.230312ms to process 0 records I0702 02:07:31.896134 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0702 02:07:31.903464 1 gather_workloads_info.go:387] No image sha256:80748ba08e1c264a8c105e7f607eff386a66378e024443a844993ee9292858c1 (7ms) I0702 02:07:31.914836 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (11ms) I0702 02:07:31.925189 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (10ms) I0702 02:07:31.936016 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (11ms) I0702 02:07:31.943880 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (8ms) I0702 02:07:31.951319 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (7ms) I0702 02:07:31.958155 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (7ms) I0702 02:07:31.964959 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (7ms) I0702 02:07:31.972152 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (7ms) I0702 02:07:31.996015 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (24ms) I0702 02:07:32.096254 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0702 02:07:32.196759 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0702 02:07:32.297220 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0702 02:07:32.396385 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0702 02:07:32.497168 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (101ms) I0702 02:07:32.596991 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0702 02:07:32.697195 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0702 02:07:32.796786 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0702 02:07:32.897207 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0702 02:07:32.996646 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms) I0702 02:07:33.099360 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (103ms) I0702 02:07:33.116381 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:07:33.196430 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (97ms) I0702 02:07:33.312482 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (116ms) I0702 02:07:33.391710 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:07:33.427706 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (115ms) I0702 02:07:33.535670 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (108ms) I0702 02:07:33.604733 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (69ms) I0702 02:07:33.698288 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (94ms) I0702 02:07:33.797065 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0702 02:07:33.897021 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0702 02:07:33.999290 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (102ms) I0702 02:07:34.097414 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (98ms) I0702 02:07:34.198824 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (101ms) I0702 02:07:34.198857 1 tasks_processing.go:74] worker 1 stopped. E0702 02:07:34.198868 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0702 02:07:34.199230 1 recorder.go:75] Recording config/workload_info with fingerprint=39ccb327d9797fa39eda5de9d091637f72dd22b9d27df852f82cd4a80a916c54 I0702 02:07:34.199246 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.334258351s to process 1 records E0702 02:07:34.199272 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.334s with: function \"workload_info\" failed with an error" I0702 02:07:34.200378 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0702 02:07:34.200393 1 periodic.go:209] Running conditional gatherer I0702 02:07:34.206291 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0702 02:07:34.214915 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:49937->172.30.0.10:53: read: connection refused E0702 02:07:34.215187 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:07:34.215249 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0702 02:07:34.221694 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0702 02:07:34.221709 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221714 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221718 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221721 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221723 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221726 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221729 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221731 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0702 02:07:34.221734 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0702 02:07:34.221748 1 tasks_processing.go:45] number of workers: 3 I0702 02:07:34.221759 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:07:34.221763 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0702 02:07:34.221779 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:07:34.221776 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:07:34.221798 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 02:07:34.221801 1 tasks_processing.go:74] worker 0 stopped. I0702 02:07:34.221806 1 tasks_processing.go:71] worker 1 working on rapid_container_logs task. I0702 02:07:34.221824 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0702 02:07:34.221836 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 877ns to process 1 records I0702 02:07:34.221894 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0702 02:07:34.221922 1 tasks_processing.go:74] worker 2 stopped. I0702 02:07:34.221928 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.557µs to process 1 records I0702 02:07:34.222059 1 tasks_processing.go:74] worker 1 stopped. I0702 02:07:34.222070 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 247.473µs to process 0 records I0702 02:07:34.222090 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:49937->172.30.0.10:53: read: connection refused I0702 02:07:34.222107 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0702 02:07:34.242961 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e6d2225591e812efaff19dbea6b3138b0c39ee6d23a56db54bb9e98f7dc5e3b5 I0702 02:07:34.243095 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-07-02-020734.tar.gz I0702 02:07:34.249809 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0702 02:07:34.249843 1 periodic.go:278] Gathering cluster info every 2h0m0s I0702 02:07:34.249858 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 02:07:45.018050 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:08:42.547733 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="c40c830e8077b8fa023b0d88fa021f01e9a7f1b393e1f8c305175627c4da1dd6") W0702 02:08:42.547768 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0702 02:08:42.547820 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="ecdc6e90fce8443196e4f14a30ebb0e83548fd416f9a01b81d752bf94724eac3") I0702 02:08:42.547832 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0702 02:08:42.547857 1 base_controller.go:181] Shutting down ConfigController ... I0702 02:08:42.547865 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0702 02:08:42.547894 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0702 02:08:42.547901 1 periodic.go:170] Shutting down I0702 02:08:42.547911 1 base_controller.go:181] Shutting down LoggingSyncer ... I0702 02:08:42.547925 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0702 02:08:42.547923 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="ebd27fb33da8587cdda1acdadc7d7d9a932796b7ed2181ed1f9a9f75cdd48738") I0702 02:08:42.547932 1 base_controller.go:113] All ConfigController workers have been terminated I0702 02:08:42.547941 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"