I0814 03:18:51.713589 1 controller.go:80] Starting MinIO Operator I0814 03:18:51.736340 1 main-controller.go:323] Setting up event handlers I0814 03:18:52.007629 1 main-controller.go:556] Using Kubernetes CSR Version: v1 I0814 03:18:52.007684 1 main-controller.go:573] Waiting for STS API to start I0814 03:18:52.007716 1 leaderelection.go:250] attempting to acquire leader lease minio-operator/minio-operator-lock... I0814 03:18:52.007736 1 main-controller.go:409] Starting STS API server I0814 03:18:52.106052 1 tls.go:52] Waiting for the sts certificates secret to be issued I0814 03:18:52.121513 1 leaderelection.go:260] successfully acquired lease minio-operator/minio-operator-lock I0814 03:18:52.121575 1 main-controller.go:605] minio-operator-54646886cb-t8sj9: I am the leader, applying leader labels on myself I0814 03:18:52.121654 1 main-controller.go:442] Waiting for Upgrade Server to start I0814 03:18:52.121669 1 main-controller.go:446] Starting Tenant controller I0814 03:18:52.121671 1 main-controller.go:449] Waiting for informer caches to sync I0814 03:18:52.121693 1 main-controller.go:398] Starting HTTP Upgrade Tenant Image server I0814 03:18:52.322384 1 main-controller.go:460] Starting workers and Job workers I0814 03:18:52.322413 1 main-controller.go:496] Console TLS is not enabled I0814 03:18:52.322430 1 main-controller.go:505] STS is enabled, starting API certificate setup I0814 03:18:52.341831 1 tls.go:125] sts-tls TLS secret not found: secrets "sts-tls" not found I0814 03:18:52.434617 1 csr.go:181] Start polling for certificate of csr/sts-minio-operator-csr, every 5s, timeout after 20m0s I0814 03:18:57.450477 1 csr.go:207] Certificate successfully fetched, creating secret with Private key and Certificate I0814 03:18:57.481292 1 tls.go:128] Waiting for the sts certificates to be issued waiting for sts cert I0814 03:19:02.961979 1 minio.go:308] Generating private key I0814 03:19:02.962046 1 minio.go:321] Generating CSR with CN=*.storage-hl.tekton-results.svc.cluster.local I0814 03:19:02.985979 1 csr.go:181] Start polling for certificate of csr/storage-tekton-results-csr, every 5s, timeout after 20m0s I0814 03:19:02.986063 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"25917", FieldPath:""}): type: 'Normal' reason: 'CSRCreated' MinIO CSR Created I0814 03:19:07.993059 1 csr.go:207] Certificate successfully fetched, creating secret with Private key and Certificate E0814 03:19:07.996759 1 minio.go:392] Unexpected error during the creation of the secret/storage-tls: secrets "storage-tls" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion minio.min.io/v2 Kind Tenant: no matches for kind "Tenant" in version "minio.min.io/v2" I0814 03:19:17.990210 1 minio.go:308] Generating private key I0814 03:19:17.990284 1 minio.go:321] Generating CSR with CN=*.storage-hl.tekton-results.svc.cluster.local I0814 03:19:18.011101 1 csr.go:181] Start polling for certificate of csr/storage-tekton-results-csr, every 5s, timeout after 20m0s I0814 03:19:18.011155 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"25917", FieldPath:""}): type: 'Normal' reason: 'CSRCreated' MinIO CSR Created I0814 03:19:23.021074 1 csr.go:207] Certificate successfully fetched, creating secret with Private key and Certificate I0814 03:19:28.494106 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"27394", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' MinIO Service Created I0814 03:19:28.536002 1 status.go:55] Hit conflict issue, getting latest version of tenant I0814 03:19:28.848587 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"27435", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' Console Service Created I0814 03:19:28.931940 1 status.go:55] Hit conflict issue, getting latest version of tenant I0814 03:19:29.033505 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"27468", FieldPath:""}): type: 'Normal' reason: 'SvcCreated' Headless Service created I0814 03:19:29.242938 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"25917", FieldPath:""}): type: 'Normal' reason: 'RoleCreated' Role Created I0814 03:19:29.371147 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"25917", FieldPath:""}): type: 'Normal' reason: 'BindingCreated' Role Binding Created I0814 03:19:29.425303 1 status.go:89] Hit conflict issue, getting latest version of tenant I0814 03:19:29.442306 1 main-controller.go:958] Detected we are updating a legacy tenant deployment I0814 03:19:29.458046 1 main-controller.go:997] 'tekton-results/storage': Deploying pool pool-0 I0814 03:19:29.488797 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"27520", FieldPath:""}): type: 'Normal' reason: 'PoolCreated' Tenant pool pool-0 created I0814 03:19:30.264519 1 pdb.go:191] PodDisruptionBudget: v1 I0814 03:19:30.450625 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:32.598284 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:32.621238 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:32.647796 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:33.446163 1 minio-services.go:164] Headless Services don't match: service ports don't match I0814 03:19:33.454717 1 event.go:364] Event(v1.ObjectReference{Kind:"Tenant", Namespace:"tekton-results", Name:"storage", UID:"7e59cda0-6dbc-4d57-84c4-36579ddd2fd2", APIVersion:"minio.min.io/v2", ResourceVersion:"27590", FieldPath:""}): type: 'Normal' reason: 'Updated' Headless Service Updated I0814 03:19:42.852239 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:43.651608 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": dial tcp 172.30.80.106:443: connect: connection refused I0814 03:19:46.659125 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:19:46.659148 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:19:46.667685 1 tenants.go:134] there are secret(s) for the operator I0814 03:19:46.667698 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667705 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667710 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667715 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667719 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667724 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667729 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:19:46.667734 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.354071 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:21:52.354096 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:21:52.365138 1 tenants.go:134] there are secret(s) for the operator I0814 03:21:52.365162 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365172 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365180 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365188 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365196 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365204 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365212 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:21:52.365220 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.357770 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:24:52.357794 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:24:52.374493 1 tenants.go:134] there are secret(s) for the operator I0814 03:24:52.374509 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374515 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374520 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374526 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374531 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374536 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374540 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:24:52.374556 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.354993 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:27:52.355018 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:27:52.363889 1 tenants.go:134] there are secret(s) for the operator I0814 03:27:52.363904 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363910 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363916 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363920 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363925 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363930 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363935 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:27:52.363939 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.353293 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:30:52.353317 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:30:52.365494 1 tenants.go:134] there are secret(s) for the operator I0814 03:30:52.365521 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365531 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365539 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365565 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365579 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365588 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365599 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:30:52.365608 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.353539 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:33:52.353582 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:33:52.364727 1 tenants.go:134] there are secret(s) for the operator I0814 03:33:52.364745 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364752 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364757 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364762 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364767 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364772 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364776 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:33:52.364781 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.353619 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:36:52.353650 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:36:52.364401 1 tenants.go:134] there are secret(s) for the operator I0814 03:36:52.364417 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364423 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364428 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364434 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364439 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364444 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364448 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:36:52.364453 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.352677 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:39:52.352700 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:39:52.364267 1 tenants.go:134] there are secret(s) for the operator I0814 03:39:52.364284 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364291 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364297 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364302 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364306 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364311 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364316 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:39:52.364321 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.352395 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:42:52.352417 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:42:52.363106 1 tenants.go:134] there are secret(s) for the operator I0814 03:42:52.363121 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363127 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363132 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363137 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363142 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363147 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363152 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:42:52.363158 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.357514 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:45:52.357539 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:45:52.398274 1 tenants.go:134] there are secret(s) for the operator I0814 03:45:52.398295 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398303 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398311 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398318 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398325 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398333 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398342 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:45:52.398349 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.354653 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:48:52.354693 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:48:52.366753 1 tenants.go:134] there are secret(s) for the operator I0814 03:48:52.366771 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366777 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366782 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366787 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366792 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366797 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366802 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:48:52.366806 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.352424 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:51:52.352454 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:51:52.373093 1 tenants.go:134] there are secret(s) for the operator I0814 03:51:52.373112 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373118 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373123 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373128 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373133 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373137 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373142 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:51:52.373147 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.351770 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:54:52.351799 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:54:52.454122 1 tenants.go:134] there are secret(s) for the operator I0814 03:54:52.454138 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454145 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454150 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454155 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454160 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454165 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454170 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:54:52.454175 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.352594 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 03:57:52.352617 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 03:57:52.363885 1 tenants.go:134] there are secret(s) for the operator I0814 03:57:52.363901 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363908 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363913 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363918 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363923 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363927 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363932 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 03:57:52.363939 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.359191 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:00:52.359213 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:00:52.375828 1 tenants.go:134] there are secret(s) for the operator I0814 04:00:52.375847 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375854 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375859 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375864 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375868 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375873 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375878 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:00:52.375883 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.358086 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:03:52.358109 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:03:52.366296 1 tenants.go:134] there are secret(s) for the operator I0814 04:03:52.366313 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366319 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366324 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366329 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366334 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366339 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366344 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:03:52.366348 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.354112 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:06:52.354138 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:06:52.364102 1 tenants.go:134] there are secret(s) for the operator I0814 04:06:52.364118 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364125 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364130 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364134 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364139 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364144 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364149 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:06:52.364153 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.354456 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:09:52.354481 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:09:52.363301 1 tenants.go:134] there are secret(s) for the operator I0814 04:09:52.363321 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363327 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363332 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363338 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363343 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363348 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363352 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:09:52.363357 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.353164 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:12:52.353192 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:12:52.361458 1 tenants.go:134] there are secret(s) for the operator I0814 04:12:52.361476 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361483 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361488 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361493 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361498 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361503 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361518 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:12:52.361522 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.353631 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:15:52.353657 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:15:52.364338 1 tenants.go:134] there are secret(s) for the operator I0814 04:15:52.364353 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364359 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364364 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364369 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364374 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364379 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364384 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:15:52.364390 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.353542 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:18:52.353584 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:18:52.366211 1 tenants.go:134] there are secret(s) for the operator I0814 04:18:52.366229 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366236 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366241 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366246 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366251 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366255 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366260 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:18:52.366265 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.354042 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:21:52.354067 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:21:52.364403 1 tenants.go:134] there are secret(s) for the operator I0814 04:21:52.364419 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364426 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364431 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364436 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364441 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364446 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364450 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:21:52.364455 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.353358 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:24:52.353383 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:24:52.364149 1 tenants.go:134] there are secret(s) for the operator I0814 04:24:52.364167 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364174 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364179 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364184 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364190 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364194 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364199 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:24:52.364204 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.353325 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:27:52.353348 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:27:52.362491 1 tenants.go:134] there are secret(s) for the operator I0814 04:27:52.362511 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362518 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362523 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362528 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362533 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362540 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362560 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:27:52.362568 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.366757 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:30:52.366790 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:30:52.384452 1 tenants.go:134] there are secret(s) for the operator I0814 04:30:52.384469 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384475 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384480 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384485 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384490 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384495 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384500 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:30:52.384505 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.354096 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:33:52.354119 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:33:52.363709 1 tenants.go:134] there are secret(s) for the operator I0814 04:33:52.363728 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363736 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363743 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363750 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363757 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363764 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363773 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:33:52.363783 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.353682 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:36:52.353707 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:36:52.361893 1 tenants.go:134] there are secret(s) for the operator I0814 04:36:52.361908 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361914 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361919 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361924 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361929 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361934 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361939 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:36:52.361944 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.354139 1 monitoring.go:122] 'tekton-results/storage' Failed to get cluster health: Get "https://minio.tekton-results.svc.cluster.local/minio/health/cluster": tls: failed to verify certificate: x509: certificate signed by unknown authority I0814 04:39:52.354165 1 tenants.go:126] Let's check if there is an external cert for the tenant... I0814 04:39:52.364459 1 tenants.go:134] there are secret(s) for the operator I0814 04:39:52.364475 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364481 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364486 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364491 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364496 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364501 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364506 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates I0814 04:39:52.364510 1 tenants.go:58] No secret found for multi-tenancy architecture of external certificates