I0814 02:47:35.066535 1 controller.go:80] Starting MinIO Operator I0814 02:47:35.156249 1 main-controller.go:323] Setting up event handlers I0814 02:47:35.356613 1 main-controller.go:556] Using Kubernetes CSR Version: v1 I0814 02:47:35.356658 1 main-controller.go:573] Waiting for STS API to start I0814 02:47:35.356690 1 main-controller.go:409] Starting STS API server I0814 02:47:35.356696 1 leaderelection.go:250] attempting to acquire leader lease minio-operator/minio-operator-lock... I0814 02:47:35.360937 1 tls.go:52] Waiting for the sts certificates secret to be issued I0814 02:47:35.366644 1 leaderelection.go:260] successfully acquired lease minio-operator/minio-operator-lock I0814 02:47:35.366758 1 main-controller.go:605] minio-operator-54646886cb-jhjwn: I am the leader, applying leader labels on myself I0814 02:47:35.366904 1 main-controller.go:442] Waiting for Upgrade Server to start I0814 02:47:35.366915 1 main-controller.go:446] Starting Tenant controller I0814 02:47:35.366919 1 main-controller.go:449] Waiting for informer caches to sync I0814 02:47:35.366936 1 main-controller.go:398] Starting HTTP Upgrade Tenant Image server I0814 02:47:35.756371 1 main-controller.go:460] Starting workers and Job workers I0814 02:47:35.756407 1 main-controller.go:496] Console TLS is not enabled I0814 02:47:35.756423 1 main-controller.go:505] STS is enabled, starting API certificate setup I0814 02:47:35.762320 1 monitoring.go:92] 'tekton-results/storage' no pool is initialized I0814 02:47:35.765126 1 tls.go:125] sts-tls TLS secret not found: secrets "sts-tls" not found I0814 02:47:35.876452 1 csr.go:181] Start polling for certificate of csr/sts-minio-operator-csr, every 5s, timeout after 20m0s I0814 02:47:40.241145 1 minio.go:308] Generating private key I0814 02:47:40.241228 1 minio.go:321] Generating CSR with CN=*.storage-hl.tekton-results.svc.cluster.local I0814 02:47:40.258194 1 csr.go:181] Start polling for certificate of csr/storage-tekton-results-csr, every 5s, timeout after 20m0s I0814 02:47:40.258276 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28277", FieldPath:""}): type: 'Normal' reason: 'CSRCreated' MinIO CSR Created I0814 02:47:40.884618 1 csr.go:207] Certificate successfully fetched, creating secret with Private key and Certificate I0814 02:47:40.892774 1 tls.go:128] Waiting for the sts certificates to be issued waiting for sts cert I0814 02:47:45.264849 1 csr.go:207] Certificate successfully fetched, creating secret with Private key and Certificate I0814 02:47:50.262785 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28549", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' MinIO Service Created I0814 02:47:50.272941 1 status.go:55] Hit conflict issue, getting latest version of tenant I0814 02:47:50.303220 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28559", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' Console Service Created I0814 02:47:50.315063 1 status.go:55] Hit conflict issue, getting latest version of tenant I0814 02:47:50.340604 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28569", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' Headless Service created I0814 02:47:50.394860 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28277", FieldPath:""}): type: 'Normal' reason: 'RoleCreated' Role Created I0814 02:47:50.499778 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28277", FieldPath:""}): type: 'Normal' reason: 'BindingCreated' Role Binding Created I0814 02:47:51.430864 1 status.go:89] Hit conflict issue, getting latest version of tenant I0814 02:47:51.447915 1 main-controller.go:958] Detected we are updating a legacy tenant deployment I0814 02:47:51.461932 1 main-controller.go:997] 'tekton-results/storage': Deploying pool pool-0 I0814 02:47:51.493571 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28637", FieldPath:""}): type: 'Normal' reason: 'PoolCreated' Tenant pool pool-0 created I0814 02:47:52.423822 1 pdb.go:191] PodDisruptionBudget: v1 I0814 02:47:52.615297 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:47:55.291044 1 minio-services.go:164] Headless Services don't match: service ports don't match I0814 02:47:55.305886 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"08173adc-771b-40a7-b507-c05dfd6c6f58", APIVersion:"minio.min.io/v2", ResourceVersion:"28699", FieldPath:""}): type: 'Normal' reason: 'Updated' Headless Service Updated I0814 02:47:55.579620 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:47:55.590552 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:47:55.612642 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:48:06.399807 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:48:07.228630 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:48:11.209194 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.103.136:443: connect: connection refused I0814 02:50:35.778235 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 02:50:35.778261 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 02:50:35.784547 1 tenants.go:134] there are secret(s) for the operator I0814 02:50:35.784561 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784567 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784572 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784577 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784582 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784587 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784591 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:50:35.784596 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.779847 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 02:53:35.779870 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 02:53:35.786772 1 tenants.go:134] there are secret(s) for the operator I0814 02:53:35.786787 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786793 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786798 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786803 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786807 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786812 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786817 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:53:35.786822 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.778969 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 02:56:35.778992 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 02:56:35.785469 1 tenants.go:134] there are secret(s) for the operator I0814 02:56:35.785483 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785489 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785494 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785499 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785504 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785509 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785514 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:56:35.785519 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.780426 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 02:59:35.780452 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 02:59:35.787688 1 tenants.go:134] there are secret(s) for the operator I0814 02:59:35.787703 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787709 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787714 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787719 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787724 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787729 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787734 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 02:59:35.787739 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.781270 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:02:35.781293 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:02:35.788574 1 tenants.go:134] there are secret(s) for the operator I0814 03:02:35.788588 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788595 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788600 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788605 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788610 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788614 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788619 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:02:35.788624 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.778244 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:05:35.778273 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:05:35.784935 1 tenants.go:134] there are secret(s) for the operator I0814 03:05:35.784955 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.784963 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.784970 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.784977 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.784984 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.784992 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.785000 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:05:35.785009 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.779203 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:08:35.779223 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:08:35.786408 1 tenants.go:134] there are secret(s) for the operator I0814 03:08:35.786426 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786435 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786443 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786450 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786458 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786466 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786474 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:08:35.786482 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.787218 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:11:35.787244 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:11:35.800495 1 tenants.go:134] there are secret(s) for the operator I0814 03:11:35.800510 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800517 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800521 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800526 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800531 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800536 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800540 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:11:35.800545 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.780201 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:14:35.780226 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:14:35.786672 1 tenants.go:134] there are secret(s) for the operator I0814 03:14:35.786687 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786693 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786698 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786703 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786708 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786713 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786718 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:14:35.786723 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.779793 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:17:35.779818 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:17:35.786675 1 tenants.go:134] there are secret(s) for the operator I0814 03:17:35.786690 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786697 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786702 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786707 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786712 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786717 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786722 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:17:35.786727 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.779124 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:20:35.779148 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:20:35.785876 1 tenants.go:134] there are secret(s) for the operator I0814 03:20:35.785892 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785899 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785904 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785909 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785914 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785919 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785924 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:20:35.785929 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.780140 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:23:35.780169 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:23:35.787004 1 tenants.go:134] there are secret(s) for the operator I0814 03:23:35.787020 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787026 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787032 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787037 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787041 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787048 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787057 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:23:35.787065 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.780571 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:26:35.780595 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:26:35.787629 1 tenants.go:134] there are secret(s) for the operator I0814 03:26:35.787646 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787653 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787659 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787664 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787668 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787673 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787678 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:26:35.787683 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.780768 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:29:35.780791 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:29:35.787113 1 tenants.go:134] there are secret(s) for the operator I0814 03:29:35.787127 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787133 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787138 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787145 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787150 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787156 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787161 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:29:35.787171 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.782325 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:32:35.782364 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:32:35.789834 1 tenants.go:134] there are secret(s) for the operator I0814 03:32:35.789849 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789855 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789860 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789865 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789869 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789874 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789879 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:32:35.789884 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.787751 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:35:35.787774 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:35:35.794821 1 tenants.go:134] there are secret(s) for the operator I0814 03:35:35.794836 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794842 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794847 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794852 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794858 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794863 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794868 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:35:35.794873 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.782090 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:38:35.782113 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:38:35.789057 1 tenants.go:134] there are secret(s) for the operator I0814 03:38:35.789073 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789079 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789084 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789089 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789094 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789099 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789104 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:38:35.789109 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.784243 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:41:35.784267 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:41:35.791681 1 tenants.go:134] there are secret(s) for the operator I0814 03:41:35.791700 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791708 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791715 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791723 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791730 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791739 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791750 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:41:35.791761 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.791971 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:44:35.791996 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:44:35.798729 1 tenants.go:134] there are secret(s) for the operator I0814 03:44:35.798744 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798750 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798755 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798760 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798765 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798770 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798775 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:44:35.798779 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.783256 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:47:35.783280 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:47:35.790061 1 tenants.go:134] there are secret(s) for the operator I0814 03:47:35.790076 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790084 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790093 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790100 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790105 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790110 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790115 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:47:35.790120 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.780334 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:50:35.780371 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:50:35.787114 1 tenants.go:134] there are secret(s) for the operator I0814 03:50:35.787129 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787135 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787140 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787145 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787150 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787155 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787160 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:50:35.787164 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.788980 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:53:35.789004 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:53:35.801077 1 tenants.go:134] there are secret(s) for the operator I0814 03:53:35.801093 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801099 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801104 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801109 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801114 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801121 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801126 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:53:35.801131 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.778840 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:56:35.778865 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:56:35.786330 1 tenants.go:134] there are secret(s) for the operator I0814 03:56:35.786362 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786369 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786374 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786379 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786384 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786390 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786395 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:56:35.786400 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.778653 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:59:35.778676 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:59:35.870082 1 tenants.go:134] there are secret(s) for the operator I0814 03:59:35.870100 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870106 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870111 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870116 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870121 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870129 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870138 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:59:35.870143 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.779212 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:02:35.779235 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:02:35.786434 1 tenants.go:134] there are secret(s) for the operator I0814 04:02:35.786448 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786455 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786460 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786465 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786472 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786477 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786482 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:02:35.786488 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.778192 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:05:35.778220 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:05:35.784209 1 tenants.go:134] there are secret(s) for the operator I0814 04:05:35.784224 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784230 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784235 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784240 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784245 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784249 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784254 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:05:35.784259 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.777711 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:08:35.777732 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:08:35.783806 1 tenants.go:134] there are secret(s) for the operator I0814 04:08:35.783825 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783832 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783837 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783842 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783847 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783852 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783856 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:08:35.783862 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.778127 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:11:35.778155 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:11:35.785138 1 tenants.go:134] there are secret(s) for the operator I0814 04:11:35.785156 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785164 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785171 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785179 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785186 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785195 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785203 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:11:35.785212 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.778328 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:14:35.778369 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:14:35.785065 1 tenants.go:134] there are secret(s) for the operator I0814 04:14:35.785081 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785087 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785092 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785097 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785102 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785107 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785116 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:14:35.785121 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.778412 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:17:35.778441 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:17:35.787583 1 tenants.go:134] there are secret(s) for the operator I0814 04:17:35.787602 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787611 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787618 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787625 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787633 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787641 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787650 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:17:35.787659 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.780201 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:20:35.780223 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:20:35.790597 1 tenants.go:134] there are secret(s) for the operator I0814 04:20:35.790613 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790619 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790624 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790629 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790634 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790638 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790645 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:20:35.790650 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates