W0507 15:31:32.153273 1 cmd.go:257] Using insecure, self-signed certificates I0507 15:31:32.435314 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:32.435654 1 observer_polling.go:159] Starting file observer I0507 15:31:33.141149 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 15:31:33.141331 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 15:31:33.141922 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 15:31:33.141951 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 15:31:33.141957 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 15:31:33.141963 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 15:31:33.141968 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 15:31:33.141971 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 15:31:33.141977 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 15:31:33.142012 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 15:31:33.150056 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0507 15:31:33.150131 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"17e067cc-3108-4f1c-9be4-29ff95f4b933", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0507 15:31:33.154432 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 15:31:33.154448 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 15:31:33.154510 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 15:31:33.154508 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 15:31:33.154558 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 15:31:33.154535 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 15:31:33.154803 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4233024300/tls.crt::/tmp/serving-cert-4233024300/tls.key" I0507 15:31:33.155097 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 15:31:33.155128 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 15:31:33.162247 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 15:31:33.162272 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 15:31:33.162392 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 15:31:33.182732 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 15:31:33.182750 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 15:31:33.200192 1 secretconfigobserver.go:119] support secret does not exist I0507 15:31:33.209229 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 15:31:33.216191 1 secretconfigobserver.go:119] support secret does not exist I0507 15:31:33.217868 1 recorder.go:176] Pruning old reports every 5h16m4s, max age is 288h0m0s I0507 15:31:33.224738 1 periodic.go:216] Running clusterconfig gatherer I0507 15:31:33.224745 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 15:31:33.224766 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 15:31:33.224785 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 15:31:33.224790 1 insightsreport.go:296] Starting report retriever I0507 15:31:33.224793 1 tasks_processing.go:45] number of workers: 64 I0507 15:31:33.224796 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 15:31:33.224814 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 15:31:33.224831 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 15:31:33.224836 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 15:31:33.224848 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 15:31:33.224857 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 15:31:33.224868 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 15:31:33.224875 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 15:31:33.224879 1 tasks_processing.go:71] worker 5 working on support_secret task. I0507 15:31:33.224880 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 15:31:33.224885 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 15:31:33.224892 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 15:31:33.224902 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 15:31:33.224909 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 15:31:33.224912 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 15:31:33.224925 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 15:31:33.224933 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 15:31:33.224989 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 15:31:33.225006 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 15:31:33.225013 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 15:31:33.225021 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 15:31:33.225026 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 15:31:33.225028 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 15:31:33.225036 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 15:31:33.224879 1 tasks_processing.go:71] worker 4 working on machine_config_pools task. I0507 15:31:33.225413 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 15:31:33.225471 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 15:31:33.225488 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 15:31:33.225470 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 15:31:33.225470 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 15:31:33.225589 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 15:31:33.225471 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 15:31:33.225481 1 tasks_processing.go:71] worker 2 working on ceph_cluster task. I0507 15:31:33.225689 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 15:31:33.225736 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 15:31:33.225777 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 15:31:33.225522 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 15:31:33.225880 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 15:31:33.225896 1 tasks_processing.go:71] worker 43 working on operators_pods_and_events task. I0507 15:31:33.225901 1 tasks_processing.go:71] worker 11 working on ingress_certificates task. I0507 15:31:33.225927 1 tasks_processing.go:71] worker 58 working on networks task. I0507 15:31:33.225938 1 tasks_processing.go:71] worker 3 working on storage_classes task. I0507 15:31:33.226020 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 15:31:33.226043 1 tasks_processing.go:71] worker 23 working on machine_autoscalers task. I0507 15:31:33.225430 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 15:31:33.226069 1 tasks_processing.go:71] worker 45 working on olm_operators task. I0507 15:31:33.225437 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 15:31:33.225872 1 tasks_processing.go:71] worker 50 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 15:31:33.226159 1 tasks_processing.go:71] worker 10 working on install_plans task. I0507 15:31:33.226255 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 15:31:33.226278 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 15:31:33.226287 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 15:31:33.226294 1 tasks_processing.go:71] worker 63 working on nodenetworkconfigurationpolicies task. I0507 15:31:33.226387 1 tasks_processing.go:71] worker 54 working on machine_sets task. I0507 15:31:33.226390 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 15:31:33.226404 1 tasks_processing.go:71] worker 29 working on nodenetworkstates task. I0507 15:31:33.226413 1 tasks_processing.go:71] worker 18 working on node_logs task. I0507 15:31:33.226435 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 15:31:33.226531 1 tasks_processing.go:71] worker 35 working on openstack_controlplanes task. I0507 15:31:33.226546 1 tasks_processing.go:71] worker 6 working on config_maps task. I0507 15:31:33.226564 1 tasks_processing.go:71] worker 38 working on crds task. I0507 15:31:33.226591 1 tasks_processing.go:71] worker 48 working on validating_webhook_configurations task. I0507 15:31:33.226690 1 tasks_processing.go:71] worker 13 working on openshift_logging task. I0507 15:31:33.226749 1 tasks_processing.go:71] worker 56 working on metrics task. W0507 15:31:33.226791 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:33.226799 1 tasks_processing.go:71] worker 59 working on schedulers task. I0507 15:31:33.226804 1 tasks_processing.go:71] worker 56 working on silenced_alerts task. W0507 15:31:33.226823 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:33.226865 1 tasks_processing.go:71] worker 8 working on sap_datahubs task. I0507 15:31:33.226912 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 33.97µs to process 0 records I0507 15:31:33.226939 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 60.224µs to process 0 records I0507 15:31:33.226950 1 tasks_processing.go:71] worker 56 working on version task. I0507 15:31:33.226995 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 15:31:33.227008 1 tasks_processing.go:71] worker 22 working on image_pruners task. I0507 15:31:33.227018 1 tasks_processing.go:71] worker 7 working on container_images task. I0507 15:31:33.227078 1 tasks_processing.go:71] worker 37 working on machine_configs task. I0507 15:31:33.227630 1 tasks_processing.go:71] worker 17 working on image_registries task. I0507 15:31:33.227786 1 tasks_processing.go:71] worker 46 working on ingress task. I0507 15:31:33.227873 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 15:31:33.227944 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 15:31:33.225529 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 15:31:33.227789 1 tasks_processing.go:71] worker 16 working on node_features task. I0507 15:31:33.228066 1 tasks_processing.go:71] worker 49 working on tsdb_status task. I0507 15:31:33.228078 1 tasks_processing.go:71] worker 39 working on openstack_version task. I0507 15:31:33.228090 1 tasks_processing.go:71] worker 30 working on sap_config task. I0507 15:31:33.225898 1 tasks_processing.go:71] worker 55 working on cluster_apiserver task. W0507 15:31:33.228102 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:33.228115 1 tasks_processing.go:71] worker 49 working on dvo_metrics task. I0507 15:31:33.228148 1 tasks_processing.go:71] worker 21 working on operators task. I0507 15:31:33.228167 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 34.011µs to process 0 records I0507 15:31:33.228175 1 tasks_processing.go:71] worker 57 working on certificate_signing_requests task. I0507 15:31:33.228081 1 tasks_processing.go:71] worker 24 working on openstack_dataplanenodesets task. I0507 15:31:33.225579 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 15:31:33.228263 1 tasks_processing.go:71] worker 62 working on active_alerts task. W0507 15:31:33.228284 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:33.225579 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 15:31:33.228297 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 25.501µs to process 0 records I0507 15:31:33.225590 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 15:31:33.228311 1 tasks_processing.go:71] worker 42 working on machine_healthchecks task. I0507 15:31:33.228352 1 tasks_processing.go:71] worker 41 working on machines task. I0507 15:31:33.226830 1 tasks_processing.go:71] worker 12 working on overlapping_namespace_uids task. I0507 15:31:33.228373 1 tasks_processing.go:71] worker 14 working on mutating_webhook_configurations task. I0507 15:31:33.225605 1 tasks_processing.go:71] worker 0 working on jaegers task. I0507 15:31:33.225021 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 15:31:33.228480 1 tasks_processing.go:71] worker 62 working on cost_management_metrics_configs task. I0507 15:31:33.228502 1 tasks_processing.go:71] worker 36 working on storage_cluster task. I0507 15:31:33.225601 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 15:31:33.225535 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 15:31:33.225682 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 15:31:33.228531 1 tasks_processing.go:71] worker 34 working on infrastructures task. I0507 15:31:33.225617 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 15:31:33.228541 1 tasks_processing.go:71] worker 51 working on clusterroles task. I0507 15:31:33.225748 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 15:31:33.225754 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 15:31:33.225756 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 15:31:33.225737 1 tasks_processing.go:71] worker 1 working on feature_gates task. I0507 15:31:33.228648 1 tasks_processing.go:71] worker 26 working on lokistack task. I0507 15:31:33.228532 1 tasks_processing.go:71] worker 25 working on sap_pods task. I0507 15:31:33.228673 1 tasks_processing.go:71] worker 28 working on oauths task. I0507 15:31:33.228680 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I0507 15:31:33.225765 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 15:31:33.228698 1 tasks_processing.go:71] worker 20 working on aggregated_monitoring_cr_names task. I0507 15:31:33.225827 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 15:31:33.225838 1 tasks_processing.go:71] worker 32 working on nodes task. I0507 15:31:33.225762 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 15:31:33.225856 1 tasks_processing.go:71] worker 31 working on openstack_dataplanedeployments task. I0507 15:31:33.225842 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 15:31:33.226850 1 tasks_processing.go:71] worker 9 working on authentication task. I0507 15:31:33.225524 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 15:31:33.228060 1 tasks_processing.go:71] worker 60 working on pod_network_connectivity_checks task. I0507 15:31:33.228881 1 tasks_processing.go:71] worker 44 working on service_accounts task. I0507 15:31:33.228899 1 tasks_processing.go:71] worker 27 working on openshift_machine_api_events task. I0507 15:31:33.228905 1 tasks_processing.go:71] worker 33 working on qemu_kubevirt_launcher_logs task. I0507 15:31:33.228895 1 tasks_processing.go:71] worker 52 working on image task. I0507 15:31:33.225687 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 15:31:33.228941 1 tasks_processing.go:74] worker 15 stopped. I0507 15:31:33.225048 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 15:31:33.228950 1 tasks_processing.go:74] worker 53 stopped. I0507 15:31:33.228054 1 tasks_processing.go:71] worker 61 working on monitoring_persistent_volumes task. I0507 15:31:33.229979 1 tasks_processing.go:71] worker 40 working on proxies task. I0507 15:31:33.230226 1 tasks_processing.go:71] worker 47 working on pdbs task. I0507 15:31:33.230497 1 tasks_processing.go:74] worker 4 stopped. I0507 15:31:33.230540 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.085858ms to process 0 records I0507 15:31:33.232476 1 tasks_processing.go:74] worker 29 stopped. I0507 15:31:33.232489 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 6.062734ms to process 0 records I0507 15:31:33.232519 1 tasks_processing.go:74] worker 5 stopped. E0507 15:31:33.232532 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 15:31:33.232540 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 7.627973ms to process 0 records I0507 15:31:33.233200 1 tasks_processing.go:74] worker 35 stopped. I0507 15:31:33.233211 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 6.655123ms to process 0 records I0507 15:31:33.233218 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 7.513698ms to process 0 records I0507 15:31:33.233223 1 tasks_processing.go:74] worker 2 stopped. I0507 15:31:33.233405 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0507 15:31:33.233422 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 15:31:33.233426 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 15:31:33.233429 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 15:31:33.233443 1 controller.go:531] The operator is still being initialized I0507 15:31:33.233451 1 controller.go:554] The operator is healthy I0507 15:31:33.233977 1 tasks_processing.go:74] worker 13 stopped. I0507 15:31:33.233987 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 7.216514ms to process 0 records I0507 15:31:33.235609 1 tasks_processing.go:74] worker 58 stopped. I0507 15:31:33.235780 1 recorder.go:75] Recording config/network with fingerprint=9bde99fe4d466ee4b4dd1f84e9047a896144aa9309d16014567cf82814921429 I0507 15:31:33.235793 1 gather.go:177] gatherer "clusterconfig" function "networks" took 9.666631ms to process 1 records I0507 15:31:33.238647 1 tasks_processing.go:74] worker 63 stopped. I0507 15:31:33.238658 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 12.342448ms to process 0 records I0507 15:31:33.238947 1 tasks_processing.go:74] worker 24 stopped. I0507 15:31:33.238957 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 10.72094ms to process 0 records I0507 15:31:33.241375 1 tasks_processing.go:74] worker 26 stopped. I0507 15:31:33.241384 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 12.710327ms to process 0 records I0507 15:31:33.243289 1 tasks_processing.go:74] worker 23 stopped. I0507 15:31:33.243303 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 17.234516ms to process 0 records I0507 15:31:33.244122 1 tasks_processing.go:74] worker 19 stopped. I0507 15:31:33.244136 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.433603ms to process 0 records I0507 15:31:33.244148 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 15.384456ms to process 0 records E0507 15:31:33.244157 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 15:31:33.244165 1 tasks_processing.go:74] worker 31 stopped. I0507 15:31:33.244167 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 15.306554ms to process 0 records I0507 15:31:33.244175 1 tasks_processing.go:74] worker 60 stopped. I0507 15:31:33.244927 1 tasks_processing.go:74] worker 39 stopped. I0507 15:31:33.244940 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 16.834247ms to process 0 records I0507 15:31:33.244968 1 tasks_processing.go:74] worker 8 stopped. I0507 15:31:33.244982 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 18.051692ms to process 0 records E0507 15:31:33.245027 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0507 15:31:33.245040 1 tasks_processing.go:74] worker 16 stopped. I0507 15:31:33.245045 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 16.964193ms to process 0 records I0507 15:31:33.245069 1 tasks_processing.go:74] worker 41 stopped. E0507 15:31:33.245077 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 15:31:33.245084 1 gather.go:177] gatherer "clusterconfig" function "machines" took 16.702844ms to process 0 records I0507 15:31:33.246621 1 tasks_processing.go:74] worker 40 stopped. I0507 15:31:33.246721 1 recorder.go:75] Recording config/proxy with fingerprint=f4c0ecb951368b9b23c0d1b701779930472eec6bbd2e1b5195e476f1aff2ab86 I0507 15:31:33.246739 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.630099ms to process 1 records I0507 15:31:33.247372 1 tasks_processing.go:74] worker 17 stopped. I0507 15:31:33.247780 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=5133735c7c91db33cec81ff3ed928f3a92ae0d6127db5316c976a9930f4e92eb I0507 15:31:33.247794 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 19.717219ms to process 1 records I0507 15:31:33.251953 1 tasks_processing.go:74] worker 62 stopped. I0507 15:31:33.251969 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.458356ms to process 0 records I0507 15:31:33.251978 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 23.467608ms to process 0 records I0507 15:31:33.251982 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 23.453992ms to process 0 records I0507 15:31:33.251986 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 25.569792ms to process 0 records I0507 15:31:33.251989 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 23.876098ms to process 0 records I0507 15:31:33.251994 1 tasks_processing.go:74] worker 30 stopped. I0507 15:31:33.251997 1 tasks_processing.go:74] worker 0 stopped. I0507 15:31:33.252000 1 tasks_processing.go:74] worker 36 stopped. I0507 15:31:33.252003 1 tasks_processing.go:74] worker 54 stopped. I0507 15:31:33.253200 1 tasks_processing.go:74] worker 55 stopped. I0507 15:31:33.253321 1 recorder.go:75] Recording config/apiserver with fingerprint=ddecfb1c15970a1d1ee7a09ae6558aa23a49e8db4cb058ba386d766bd8551078 I0507 15:31:33.253355 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 25.090487ms to process 1 records I0507 15:31:33.255133 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 15:31:33.255146 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 15:31:33.255133 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 15:31:33.255904 1 tasks_processing.go:74] worker 22 stopped. I0507 15:31:33.256002 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=dda7856dba53a3232632da8be3969a910648d3b728d61e67348ae2d03abb2419 I0507 15:31:33.256015 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 28.881578ms to process 1 records I0507 15:31:33.257295 1 tasks_processing.go:74] worker 34 stopped. I0507 15:31:33.257812 1 recorder.go:75] Recording config/infrastructure with fingerprint=d48a8c0fa2796f52b6eee0c1f5fb079c03c40d4a45c03c3384b133d4db402dc8 I0507 15:31:33.257826 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 28.752756ms to process 1 records I0507 15:31:33.257837 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 28.692023ms to process 0 records I0507 15:31:33.257853 1 tasks_processing.go:74] worker 25 stopped. I0507 15:31:33.257927 1 tasks_processing.go:74] worker 28 stopped. I0507 15:31:33.258006 1 recorder.go:75] Recording config/oauth with fingerprint=51e5b8122a36557951c8e641768d2be9320e80814ed49cbb880eb0501f007187 I0507 15:31:33.258016 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 28.746068ms to process 1 records I0507 15:31:33.258107 1 tasks_processing.go:74] worker 42 stopped. E0507 15:31:33.258122 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 15:31:33.258134 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 29.783204ms to process 0 records I0507 15:31:33.258159 1 tasks_processing.go:74] worker 1 stopped. I0507 15:31:33.258280 1 recorder.go:75] Recording config/featuregate with fingerprint=823a88d6aa97a97d8029898b391c802421c3332b9af934f1fac69e29454a747b I0507 15:31:33.258296 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.567545ms to process 1 records I0507 15:31:33.259518 1 tasks_processing.go:74] worker 52 stopped. I0507 15:31:33.259648 1 recorder.go:75] Recording config/image with fingerprint=ea2faf56e5686bde5ac27d736704944a32fb27c2ece91525a708abab8476c32a I0507 15:31:33.259665 1 gather.go:177] gatherer "clusterconfig" function "image" took 30.589249ms to process 1 records E0507 15:31:33.259676 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0507 15:31:33.259691 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 15:31:33.259699 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 32.419056ms to process 1 records I0507 15:31:33.259756 1 tasks_processing.go:74] worker 37 stopped. I0507 15:31:33.259829 1 tasks_processing.go:74] worker 48 stopped. I0507 15:31:33.259854 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=8c003a4f9b2d2665a4b43b745e83bf1c61814efa4c50dcb3523300f39b2edb35 I0507 15:31:33.259932 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=eca68d7f5a9a224ae22f9b5523548c5cf06d3916d7bbdc656478eb95f0ea2d37 I0507 15:31:33.259951 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=f81a5a9c656eba4a9132381738d092f6bc4f69ec85a000bce1b70c12e2d0dbf5 I0507 15:31:33.259980 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a783b4b351ed99dbab8f1b3ccafa45f82bd3884d6b6d45a643b5da5314cd2ed0 I0507 15:31:33.260014 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=524af989b29ce449f386ec43ec4cbdce70bc7202f977f855e251c261cf538e13 I0507 15:31:33.260046 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=69ecdb76058b26e717d87b9c66a181b14acadd532ec282973250d016fd526f00 I0507 15:31:33.260075 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=fe610acbabc2d31683345b822e2fac015ca2fc89036fb9bf5206e61bafdc8112 I0507 15:31:33.260114 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=b4be9cb42112807e97f6256596433cbb25adea02901bcef2a9366b13604c716d I0507 15:31:33.260144 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=1b2e919ad6c3374b9129d2ff7b8f7c76fef1e9d180cadd46f81b49fda03aa87c I0507 15:31:33.260176 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=c9f2857e49e4a2d4834c16671317174edd06ff5160bac685c3109b273e1e13d0 I0507 15:31:33.260206 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=bcf08d86fbfd8e56f1f206fe50a42d4cb20399788b708ccb37ebee15c8973827 I0507 15:31:33.260213 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.981112ms to process 11 records I0507 15:31:33.260269 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=3a0d1144092804ab393c4e27ed637bf3e2f6bf35b2cbc8105c0632a97a05fc2f I0507 15:31:33.260282 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=390754dbdf1275a0a59d0c41cead147ece448091a6d89a1f63ab50c9a665cdbd I0507 15:31:33.260288 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 33.675194ms to process 2 records I0507 15:31:33.260292 1 tasks_processing.go:74] worker 3 stopped. I0507 15:31:33.260366 1 tasks_processing.go:74] worker 9 stopped. I0507 15:31:33.260442 1 recorder.go:75] Recording config/authentication with fingerprint=f5b07d89dbcbd70b7dfdcd9e905ca41d9be6074bdc94a9653d6de6056614ca65 I0507 15:31:33.260450 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 31.10178ms to process 1 records I0507 15:31:33.262834 1 base_controller.go:82] Caches are synced for ConfigController I0507 15:31:33.262845 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 15:31:33.267213 1 gather_logs.go:145] no pods in namespace were found I0507 15:31:33.267231 1 tasks_processing.go:74] worker 33 stopped. I0507 15:31:33.267238 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 38.310361ms to process 0 records I0507 15:31:33.268024 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 15:31:33.268031 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0507 15:31:33.268194 1 operator.go:328] started I0507 15:31:33.268207 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 15:31:33.273425 1 tasks_processing.go:74] worker 59 stopped. I0507 15:31:33.273503 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=de70359c3621f910864b3c800c1ce6f7d840e9d4fe98d123bea31d72a2632697 I0507 15:31:33.273521 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 46.610984ms to process 1 records I0507 15:31:33.273561 1 tasks_processing.go:74] worker 46 stopped. I0507 15:31:33.273765 1 recorder.go:75] Recording config/ingress with fingerprint=e0b83900347754faac5c5c8b4dd27d0263a5e51064720d8d82cde4d8d3c6a7e3 I0507 15:31:33.273781 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 45.708371ms to process 1 records I0507 15:31:33.273795 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 47.618593ms to process 0 records I0507 15:31:33.273803 1 tasks_processing.go:74] worker 45 stopped. W0507 15:31:33.277822 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 15:31:33.279077 1 tasks_processing.go:74] worker 47 stopped. I0507 15:31:33.279176 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=36f64131390d738f44ed7f7f90676c7b84c3824975367e9e4d1e855bbe354d97 I0507 15:31:33.279206 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=2221f12e806d20108654c5ae23458e72180e183a41149621e1b6785de4cccf7f I0507 15:31:33.279236 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=09c075c8942af8fe51e79071a8e70874899bb0f8677267178818ab6184c15fff I0507 15:31:33.279267 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 48.83707ms to process 3 records I0507 15:31:33.280985 1 tasks_processing.go:74] worker 27 stopped. I0507 15:31:33.281001 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 52.069726ms to process 0 records I0507 15:31:33.282974 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:31:33.283010 1 tasks_processing.go:74] worker 14 stopped. I0507 15:31:33.283203 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=95f84c009d470812f3032c3fc8e3c7258d4e6106b957373451884e30247b3b06 I0507 15:31:33.283276 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=abe9a85d8a8d7a50f5068103378a211cbc31823b838d50df2bffa7773e6a4e55 I0507 15:31:33.283358 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1115a413f86964ddf473dec7e9367041b2caeac3d406348e376f0a9903c970a0 I0507 15:31:33.283378 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 54.620599ms to process 3 records I0507 15:31:33.283915 1 tasks_processing.go:74] worker 38 stopped. I0507 15:31:33.285793 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=c2dfc8de79ee43025abee4e48b9cce4555ff1a9a4fee65b19356de7ecac8f68b I0507 15:31:33.285842 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 15:31:33.285866 1 controller.go:254] Source scaController *sca.Controller is not ready I0507 15:31:33.285873 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0507 15:31:33.285877 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 15:31:33.285880 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 15:31:33.286133 1 controller.go:531] The operator is still being initialized I0507 15:31:33.286148 1 controller.go:554] The operator is healthy I0507 15:31:33.286814 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9592206a7f14e5021496dc3c072386404bdade260348d9e1e60a196f47b7adcc I0507 15:31:33.286867 1 gather.go:177] gatherer "clusterconfig" function "crds" took 57.315921ms to process 2 records I0507 15:31:33.286900 1 tasks_processing.go:74] worker 12 stopped. I0507 15:31:33.286995 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 15:31:33.287090 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 56.606384ms to process 1 records I0507 15:31:33.287112 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 58.39613ms to process 0 records I0507 15:31:33.287120 1 tasks_processing.go:74] worker 57 stopped. I0507 15:31:33.288176 1 tasks_processing.go:74] worker 51 stopped. I0507 15:31:33.288624 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=72f77585572601b0f4a15e5dc3afabad6498d02704836401d57588d944f1c5d7 I0507 15:31:33.289080 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=318dde077b1d1d92bbf7bb2d7dbb360781d316368ae5f94b8c9b5f14be9487bb I0507 15:31:33.289097 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 59.621542ms to process 2 records I0507 15:31:33.289107 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 60.098268ms to process 0 records I0507 15:31:33.289113 1 tasks_processing.go:74] worker 61 stopped. I0507 15:31:33.290480 1 prometheus_rules.go:88] Prometheus rules successfully created I0507 15:31:33.292984 1 tasks_processing.go:74] worker 20 stopped. I0507 15:31:33.293008 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.268049ms to process 0 records I0507 15:31:33.294059 1 tasks_processing.go:74] worker 7 stopped. I0507 15:31:33.294136 1 recorder.go:75] Recording config/running_containers with fingerprint=471c28de0ae3047d6f090f0d72076bd30bcdaa24cd47a0413ab08a0be5758d1e I0507 15:31:33.294148 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 67.024537ms to process 1 records E0507 15:31:33.299441 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%273515d16e-f7aa-4d98-a80d-106de21e1eeb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.22:59703->172.30.0.10:53: read: connection refused I0507 15:31:33.299458 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%273515d16e-f7aa-4d98-a80d-106de21e1eeb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.22:59703->172.30.0.10:53: read: connection refused I0507 15:31:33.301775 1 tasks_processing.go:74] worker 50 stopped. I0507 15:31:33.301788 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 75.64517ms to process 0 records I0507 15:31:33.311812 1 tasks_processing.go:74] worker 18 stopped. I0507 15:31:33.311828 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 85.384361ms to process 0 records I0507 15:31:33.312005 1 tasks_processing.go:74] worker 32 stopped. I0507 15:31:33.312314 1 recorder.go:75] Recording config/node/ip-10-0-0-54.ec2.internal with fingerprint=7b05fd367743dd9fec4db025035e335258e84f4094764a60af4b07d6251e035d I0507 15:31:33.312390 1 recorder.go:75] Recording config/node/ip-10-0-1-119.ec2.internal with fingerprint=d3a90d7963f2191480c60c8cddf2033960643f772725900eaac6bf56ac858526 I0507 15:31:33.312400 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 83.278993ms to process 2 records I0507 15:31:33.312976 1 tasks_processing.go:74] worker 6 stopped. E0507 15:31:33.312991 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 15:31:33.313000 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 15:31:33.313007 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 15:31:33.313014 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0507 15:31:33.313050 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 15:31:33.313057 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 15:31:33.313062 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0507 15:31:33.313066 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 15:31:33.313103 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 15:31:33.313110 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 15:31:33.313115 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 86.410068ms to process 7 records I0507 15:31:33.323557 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0507 15:31:33.327106 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.22:49119->172.30.0.10:53: read: connection refused I0507 15:31:33.327120 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.22:49119->172.30.0.10:53: read: connection refused I0507 15:31:33.346882 1 tasks_processing.go:74] worker 56 stopped. I0507 15:31:33.347151 1 recorder.go:75] Recording config/version with fingerprint=db3cf3f8b8ee13dc46e5986b34d460e7d2c377c46239757216a62d2bc6ed19a1 I0507 15:31:33.347165 1 recorder.go:75] Recording config/id with fingerprint=3f7f3410ce48a30a799fbf9df08364cf10d9c416bb8b9e15343094fdd554e716 I0507 15:31:33.347171 1 gather.go:177] gatherer "clusterconfig" function "version" took 119.916256ms to process 2 records I0507 15:31:33.369253 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 15:31:33.369266 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 15:31:33.396149 1 tasks_processing.go:74] worker 11 stopped. E0507 15:31:33.396167 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 15:31:33.396173 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q55t83gi7r3iblf5ke81p881m72e003-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q55t83gi7r3iblf5ke81p881m72e003-primary-cert-bundle-secret" not found I0507 15:31:33.396244 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=db13ba8b40125ce0bcadd673e4a98890ec3a1ecc3f26a2db2ddc95504ff1ddce I0507 15:31:33.396260 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 170.230333ms to process 1 records W0507 15:31:34.277745 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 15:31:34.481135 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers I0507 15:31:34.481149 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes I0507 15:31:34.483517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mtm7b pod in namespace openshift-dns (previous: false). I0507 15:31:34.681469 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mtm7b pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mtm7b\" is waiting to start: ContainerCreating" I0507 15:31:34.681492 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mtm7b\" is waiting to start: ContainerCreating" I0507 15:31:34.681500 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mtm7b pod in namespace openshift-dns (previous: false). I0507 15:31:34.704577 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0507 15:31:34.891132 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mtm7b pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mtm7b\" is waiting to start: ContainerCreating" I0507 15:31:34.891152 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mtm7b\" is waiting to start: ContainerCreating" I0507 15:31:34.891162 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6bppx pod in namespace openshift-dns (previous: false). I0507 15:31:35.094958 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:35.094981 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-w8h8w pod in namespace openshift-dns (previous: false). W0507 15:31:35.276836 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 15:31:35.281682 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:35.281699 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5849cb56c9-n9285 pod in namespace openshift-image-registry (previous: false). I0507 15:31:35.308018 1 tasks_processing.go:74] worker 21 stopped. I0507 15:31:35.308075 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=9ac8fa3a9645b695e94ebe0daab91d059bead7ded9a513d32be26c994e7a1b05 I0507 15:31:35.308117 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=69e159744c202713f3bc8388c73657e471bf5ecdc29a25026d2b162689d165d3 I0507 15:31:35.308147 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 15:31:35.308174 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=0bf5d50b5c63615245eec2a733eeca86a912ad30e28106886b014cf148fd00dc I0507 15:31:35.308190 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 15:31:35.308214 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=5127141fef81a1bbb9ed842c6aded6afe386ee0aedaea2280e03d239349e943e I0507 15:31:35.308246 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=6d421f5e4153a4c790fb68d06e5f65a28f21dbe0414bd0be042f4c2ad1c03e21 I0507 15:31:35.308297 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b3bb3f39a771d35377e3425e357524fe990a5961cf216a58b707502cc23e3c9b I0507 15:31:35.308313 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=0116d6b99dee7700497b402e129b59203bfa36fa5c4327415e3c235bc5d5179d I0507 15:31:35.308353 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a44d1db13d0266918aa57ab2b0a563e07f193360bba9f147496f6620946957b1 I0507 15:31:35.308366 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 15:31:35.308382 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=08bac2b31b0cde115e34937d0874c035a051e61d2f8f32e964a0dbd1e1fb9ca5 I0507 15:31:35.308393 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 15:31:35.308410 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=ea3c62a6495623f5d1fa3b385f93fe4fe88c28cebf9db6fbf34cf018999a6be3 I0507 15:31:35.308424 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 15:31:35.308452 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=586c4f9bf4cc2117cadd41bf5c6fda88713992ceae41c3ead0a8ee44fda4eb23 I0507 15:31:35.308462 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 15:31:35.308478 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=d59bdd2df867c522894fc631d0ff07b55b0309f296a04d5d5c268b69061e7385 I0507 15:31:35.308638 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=8ddab80ee7e2e9ed3d44ab704b7ccceaf8763015be888c35c604a1bd37cf544f I0507 15:31:35.308653 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 15:31:35.308660 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 15:31:35.308684 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 15:31:35.308710 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=59dcd55be26381044814819bfd291fc3c64ed55ce9ef73455f89e0f1ca19e491 I0507 15:31:35.308732 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=11af788ebb2ce71fad2a8f2978c1657b15e1454183c5df2d9c50ecdbea24c7d0 I0507 15:31:35.308744 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 15:31:35.308759 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=1daefaab451886f5369332778b44b422f9c545cfa3931572aa453e722b243a19 I0507 15:31:35.308769 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 15:31:35.308781 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c8e82f92ab1b3d3f3f19c1212b950b77d51fe8f50b343edfbdeead56bf8c318c I0507 15:31:35.308795 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=573cda3004c0c4101ff9bce54b55a501d8140569323f3e8ab37217ac13ffc924 I0507 15:31:35.308812 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=bee6032215603f2779fa978b359c4f5a59f5e33eb5876911dd05aa5c179e6249 I0507 15:31:35.308828 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=04e25ecb96ee8d49d5be79558732acb9e1f766bbbdf40e9281d38eaea15a9929 I0507 15:31:35.308850 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=040d5c314228b2e38c22b6cb6067dba9f5fe74768223fd3e16995aa70d0316eb I0507 15:31:35.308859 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0507 15:31:35.308890 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=e599e15d8b988bd5041480e6004f24d3ea3e8edfbebd951b5005ef5e82600818 I0507 15:31:35.308906 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 15:31:35.308915 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 15:31:35.308922 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.079848248s to process 36 records I0507 15:31:35.476478 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:35.476496 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5849cb56c9-wswmc pod in namespace openshift-image-registry (previous: false). I0507 15:31:35.681856 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5849cb56c9-wswmc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5849cb56c9-wswmc\" is waiting to start: ContainerCreating" I0507 15:31:35.681874 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5849cb56c9-wswmc\" is waiting to start: ContainerCreating" I0507 15:31:35.681885 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5df8c6556-6kws4 pod in namespace openshift-image-registry (previous: false). I0507 15:31:35.877778 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:35.877798 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-k2mm6 pod in namespace openshift-image-registry (previous: false). I0507 15:31:36.082246 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:36.082270 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sgpsh pod in namespace openshift-image-registry (previous: false). W0507 15:31:36.277305 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 15:31:36.284866 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:36.284882 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-789c55876f-9lbjc pod in namespace openshift-ingress (previous: false). I0507 15:31:36.478522 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 15:31:36.478546 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-789c55876f-jb6dr pod in namespace openshift-ingress (previous: false). I0507 15:31:36.682126 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-789c55876f-jb6dr pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-789c55876f-jb6dr\" is waiting to start: ContainerCreating" I0507 15:31:36.682145 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-789c55876f-jb6dr\" is waiting to start: ContainerCreating" I0507 15:31:36.682162 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-dd4fb9b7f-gkbhw pod in namespace openshift-ingress (previous: false). I0507 15:31:36.881993 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-dd4fb9b7f-gkbhw pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-dd4fb9b7f-gkbhw\" is waiting to start: ContainerCreating" I0507 15:31:36.882018 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-dd4fb9b7f-gkbhw\" is waiting to start: ContainerCreating" I0507 15:31:36.882031 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5v67m pod in namespace openshift-ingress-canary (previous: false). I0507 15:31:37.082308 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-k47c6 pod in namespace openshift-kube-storage-version-migrator (previous: false). W0507 15:31:37.277544 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 15:31:37.281979 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-k47c6 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0507 15:31:37.481569 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-phjpp pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0507 15:31:37.686511 1 tasks_processing.go:74] worker 43 stopped. I0507 15:31:37.686620 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=86a3df22f883e3181a2fbc1be82be10be3ae8d8f0ba5eb2dbc0785715ccfaf61 I0507 15:31:37.686668 1 recorder.go:75] Recording events/openshift-dns with fingerprint=3120a68731c2aa1b2c8a7188e97f83b99f8d7e00c027a83b3bdfedef65d5ec91 I0507 15:31:37.686754 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=b18add59b5dd79b8a7ee7e93cc812602664c0b135828f2a3b6a99e0b9c000add I0507 15:31:37.686796 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=eb75e40cfe794adfad975d9fc933d39b20bad5da6022c23b424eff006fe5e3fe I0507 15:31:37.686851 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=fa33cfa20c3d7a021638a1bcedd58dc07d3c83754f72d7a15e0fe308c2aec38d I0507 15:31:37.686884 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=2b90a04d313ed0e48604a60d9d44bf9987372f260bd93ca6ac3ff6a8428f3c08 I0507 15:31:37.686910 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=e87548f1da4d89ba4037a84a08aefc291155cdb457d6a4a02a7810b02a73f599 I0507 15:31:37.686974 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=8c38638bc8d8d86c4e0a59c7ed3b3f94051330b6caa6c587e805b1e0aa60a327 I0507 15:31:37.686985 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5v67m/serve-healthcheck-canary_current.log with fingerprint=15c782585b6e217133cf15d105d5103abe4e30041ec99ed59134b7ba1d9a0f8b I0507 15:31:37.687005 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-k47c6/migrator_current.log with fingerprint=6f40632244366047d1a5b6522eac0fec649395e64b16bd78ac27b04a24176d1d I0507 15:31:37.687015 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-k47c6/graceful-termination_current.log with fingerprint=530d144ccddc17cb9587365490f5faaa5d99460b42de457b068204dcd8ba7a09 I0507 15:31:37.687102 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-phjpp/kube-storage-version-migrator-operator_current.log with fingerprint=95506784683dd8f8f24de8431febe8cd57483a78219f7f8f260e62c4ddfbdde3 I0507 15:31:37.687116 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.460590166s to process 12 records W0507 15:31:38.277354 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 15:31:38.277387 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 15:31:38.277408 1 tasks_processing.go:74] worker 49 stopped. E0507 15:31:38.277421 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 15:31:38.277435 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0507 15:31:38.277455 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0507 15:31:38.277472 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.049278779s to process 1 records I0507 15:31:45.859466 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:31:45.895408 1 tasks_processing.go:74] worker 10 stopped. I0507 15:31:45.895448 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0507 15:31:45.895461 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.669220069s to process 1 records I0507 15:31:46.639372 1 tasks_processing.go:74] worker 44 stopped. I0507 15:31:46.639635 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0507 15:31:46.639653 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.410459562s to process 1 records E0507 15:31:46.639713 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.414s with: function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 15:31:46.640819 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 15:31:46.640835 1 periodic.go:216] Running workloads gatherer I0507 15:31:46.640850 1 tasks_processing.go:45] number of workers: 2 I0507 15:31:46.640863 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 15:31:46.640867 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0507 15:31:46.640876 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 15:31:46.640954 1 tasks_processing.go:71] worker 0 working on workload_info task. I0507 15:31:46.678234 1 tasks_processing.go:74] worker 1 stopped. I0507 15:31:46.678252 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 37.352748ms to process 0 records I0507 15:31:46.720708 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:31:46.763127 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0507 15:31:46.774022 1 gather_workloads_info.go:387] No image sha256:c886c2a85f0c920fcd6927a7c76644a422cf77f07b185120a8021e0e98d6acb9 (12ms) I0507 15:31:46.784911 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (11ms) I0507 15:31:46.796315 1 gather_workloads_info.go:387] No image sha256:9116c1445f630c8d1b298a3e65eda911050b7fd8a5bde7ee253fcb285ab2a89c (11ms) I0507 15:31:46.806893 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (11ms) I0507 15:31:46.817167 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (10ms) I0507 15:31:46.827711 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (11ms) I0507 15:31:46.838848 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (11ms) I0507 15:31:46.849154 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (10ms) I0507 15:31:46.860047 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (11ms) I0507 15:31:46.870273 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (10ms) I0507 15:31:46.880321 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (10ms) I0507 15:31:46.923743 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:31:46.980248 1 gather_workloads_info.go:387] No image sha256:dcb3f93d34aa0fdab33eb37949adfaa8fdd11ff3479363bb7735c5ba3eb345ce (100ms) I0507 15:31:47.074865 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (95ms) I0507 15:31:47.173836 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (99ms) I0507 15:31:47.275232 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (101ms) I0507 15:31:47.375632 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0507 15:31:47.474143 1 gather_workloads_info.go:387] No image sha256:d9ed66918db4dfba8bd354c9ede4d676449fa0eccef649b3d8945cc1da1c60e3 (98ms) I0507 15:31:47.575080 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (101ms) I0507 15:31:47.676380 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0507 15:31:47.774418 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (98ms) I0507 15:31:47.873539 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (99ms) I0507 15:31:47.973902 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0507 15:31:48.074471 1 gather_workloads_info.go:387] No image sha256:f4115eca8ea784ac6037602a303fac7fb808d98f4b5120a27bee140df60c3664 (101ms) I0507 15:31:48.174108 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (100ms) I0507 15:31:48.274298 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0507 15:31:48.375662 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0507 15:31:48.475095 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (99ms) I0507 15:31:48.574234 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (99ms) I0507 15:31:48.673894 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0507 15:31:48.774656 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (101ms) I0507 15:31:48.877545 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (103ms) I0507 15:31:48.973922 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (96ms) I0507 15:31:49.074099 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (100ms) I0507 15:31:49.175181 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (101ms) I0507 15:31:49.275152 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (100ms) I0507 15:31:49.374930 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0507 15:31:49.475796 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (101ms) I0507 15:31:49.575496 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0507 15:31:49.675282 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0507 15:31:49.774638 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0507 15:31:49.774672 1 tasks_processing.go:74] worker 0 stopped. E0507 15:31:49.774682 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0507 15:31:49.774961 1 recorder.go:75] Recording config/workload_info with fingerprint=f0f014cd13388326c69047b586fb49aa101ef7975bfe196f42726f377f979202 I0507 15:31:49.774979 1 gather.go:177] gatherer "workloads" function "workload_info" took 3.133702991s to process 1 records E0507 15:31:49.775003 1 periodic.go:254] "Unhandled Error" err="workloads failed after 3.134s with: function \"workload_info\" failed with an error" I0507 15:31:49.776108 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 15:31:49.776123 1 periodic.go:216] Running conditional gatherer I0507 15:31:49.783299 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0507 15:31:49.790070 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.22:38571->172.30.0.10:53: read: connection refused E0507 15:31:49.790322 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 15:31:49.790396 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 15:31:49.797484 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0507 15:31:49.797497 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797502 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797506 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797509 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797511 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797514 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797518 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797520 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 15:31:49.797523 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 15:31:49.797569 1 tasks_processing.go:45] number of workers: 3 I0507 15:31:49.797589 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 15:31:49.797596 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 15:31:49.797601 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 15:31:49.797611 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 15:31:49.797614 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 15:31:49.797617 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 15:31:49.797623 1 tasks_processing.go:74] worker 1 stopped. I0507 15:31:49.797719 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0507 15:31:49.797738 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.092µs to process 1 records I0507 15:31:49.797785 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0507 15:31:49.797797 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 828ns to process 1 records I0507 15:31:49.797805 1 tasks_processing.go:74] worker 0 stopped. I0507 15:31:49.797925 1 tasks_processing.go:74] worker 2 stopped. I0507 15:31:49.797936 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 300.802µs to process 0 records I0507 15:31:49.797953 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.22:38571->172.30.0.10:53: read: connection refused I0507 15:31:49.797968 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0507 15:31:49.825207 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=7154605f57340593862fb74699666c5b209feedbd56e2a7e9d4009d2f577f6f0 I0507 15:31:49.825413 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-05-07-153149.tar.gz I0507 15:31:49.832150 1 diskrecorder.go:51] Wrote 105 records to disk in 6ms I0507 15:31:49.832187 1 periodic.go:285] Gathering cluster info every 2h0m0s I0507 15:31:49.832210 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 15:31:57.970603 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:33:02.436360 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="17899a1cfcb1f3139280124d83869af62ff1341cca4f432d2bb32704a178812b") W0507 15:33:02.436393 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0507 15:33:02.436450 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="8d0cfb6dabd3efb8c72f470a5c0465203eb154e32196ce8dbb9d7df271ff94ae") I0507 15:33:02.436487 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="b690696ed7655c5c5ea47874482b8cd48d01ef37e8544d65d4ba3eafca5cae6b") I0507 15:33:02.436515 1 periodic.go:177] Shutting down