I0430 13:46:23.860536       1 cmd.go:253] Using service-serving-cert provided certificates
I0430 13:46:23.860980       1 observer_polling.go:159] Starting file observer
I0430 13:46:25.215319       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0430 13:46:25.215511       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0430 13:46:25.216081       1 secure_serving.go:57] Forcing use of http/1.1 only
W0430 13:46:25.216103       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0430 13:46:25.216108       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0430 13:46:25.216112       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0430 13:46:25.216115       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0430 13:46:25.216117       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0430 13:46:25.216120       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0430 13:46:25.216176       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0430 13:46:25.220552       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0430 13:46:25.220564       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c52bbdd4-8da9-4e16-87ee-e20bc29b9ed1", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0430 13:46:25.222603       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0430 13:46:25.222615       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0430 13:46:25.222627       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0430 13:46:25.222665       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0430 13:46:25.222645       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0430 13:46:25.222685       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0430 13:46:25.222960       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key"
I0430 13:46:25.223246       1 secure_serving.go:213] Serving securely on [::]:8443
I0430 13:46:25.223275       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0430 13:46:25.231831       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0430 13:46:25.231856       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0430 13:46:25.231974       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0430 13:46:25.240300       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0430 13:46:25.240321       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0430 13:46:25.247934       1 secretconfigobserver.go:119] support secret does not exist
I0430 13:46:25.254476       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0430 13:46:25.261204       1 secretconfigobserver.go:119] support secret does not exist
I0430 13:46:25.264283       1 recorder.go:176] Pruning old reports every 7h39m42s, max age is 288h0m0s
I0430 13:46:25.272874       1 operator.go:356] The last pod state is unhealthy
I0430 13:46:25.322884       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0430 13:46:25.322899       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0430 13:46:25.322906       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0430 13:46:25.332050       1 base_controller.go:82] Caches are synced for ConfigController 
I0430 13:46:25.332063       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0430 13:46:25.339503       1 configmapobserver.go:84] configmaps "insights-config" not found
I0430 13:46:45.275242       1 operator.go:356] The last pod state is unhealthy
I0430 13:47:05.274271       1 operator.go:356] The last pod state is unhealthy
I0430 13:47:25.273359       1 operator.go:356] The last pod state is unhealthy
I0430 13:47:45.274080       1 operator.go:356] The last pod state is unhealthy
I0430 13:48:05.273301       1 operator.go:356] The last pod state is unhealthy
I0430 13:48:25.273140       1 operator.go:356] The last pod state is unhealthy
I0430 13:48:45.272581       1 operator.go:356] The last pod state is unhealthy
I0430 13:49:05.283025       1 operator.go:356] The last pod state is unhealthy
I0430 13:49:25.273693       1 operator.go:356] The last pod state is unhealthy
I0430 13:49:45.274027       1 operator.go:356] The last pod state is unhealthy
I0430 13:50:05.273636       1 operator.go:356] The last pod state is unhealthy
I0430 13:50:25.272622       1 operator.go:356] The last pod state is unhealthy
I0430 13:50:45.275924       1 operator.go:356] The last pod state is unhealthy
I0430 13:51:05.274609       1 operator.go:356] The last pod state is unhealthy
I0430 13:51:25.270147       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0430 13:51:25.272229       1 operator.go:356] The last pod state is unhealthy
I0430 13:51:25.276462       1 secretconfigobserver.go:119] support secret does not exist
I0430 13:51:30.679533       1 operator.go:288] Unable to check insights-operator pod status. Setting initial delay to 14m51.784755815s
I0430 13:51:30.679618       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0430 13:51:30.679640       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 16m21s
I0430 13:51:30.679680       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0430 13:51:30.679708       1 insightsreport.go:296] Starting report retriever
I0430 13:51:30.679716       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0430 13:51:30.688506       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0430 13:51:30.688531       1 controller.go:368] The initial operator extension status is healthy
I0430 13:51:30.688543       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:51:30.688548       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:51:30.688553       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:51:30.688576       1 controller.go:531] The operator is still being initialized
I0430 13:51:30.688584       1 controller.go:554] The operator is healthy
I0430 13:51:30.688665       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0430 13:51:30.688704       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
W0430 13:51:30.688892       1 operator.go:328] started
I0430 13:51:30.688921       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0430 13:51:30.698203       1 controller.go:254] Source scaController *sca.Controller is not ready
I0430 13:51:30.698215       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0430 13:51:30.698220       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:51:30.698224       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:51:30.698228       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:51:30.698251       1 controller.go:531] The operator is still being initialized
I0430 13:51:30.698265       1 controller.go:554] The operator is healthy
I0430 13:51:30.709751       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0430 13:51:30.789030       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0430 13:51:30.789056       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0430 13:51:30.799691       1 cluster_transfer.go:102] no available accepted cluster transfer
I0430 13:51:30.799713       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer
I0430 13:51:30.881603       1 sca.go:266] etc-pki-entitlement secret successfully created
I0430 13:51:30.881622       1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated
I0430 13:53:30.697407       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:53:30.697427       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:53:30.697431       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:53:30.697452       1 controller.go:531] The operator is still being initialized
I0430 13:53:30.697458       1 controller.go:554] The operator is healthy
I0430 13:55:30.698028       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:55:30.698047       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:55:30.698052       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:55:30.698076       1 controller.go:554] The operator is healthy
I0430 13:56:25.277274       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0430 13:56:25.299567       1 configmapobserver.go:84] configmaps "insights-config" not found
I0430 13:56:25.323877       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0430 13:56:25.323902       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0430 13:56:25.337481       1 configmapobserver.go:84] configmaps "insights-config" not found
I0430 13:56:25.341235       1 secretconfigobserver.go:119] support secret does not exist
I0430 13:57:30.697997       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:57:30.698019       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:57:30.698023       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:57:30.698053       1 controller.go:554] The operator is healthy
I0430 13:59:30.700873       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 13:59:30.700892       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 13:59:30.700896       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 13:59:30.700922       1 controller.go:554] The operator is healthy
I0430 14:01:25.341494       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0430 14:01:25.349325       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0430 14:01:25.349346       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0430 14:01:25.355334       1 secretconfigobserver.go:119] support secret does not exist
I0430 14:01:30.697480       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0430 14:01:30.697499       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0430 14:01:30.697505       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0430 14:01:30.697528       1 controller.go:554] The operator is healthy