__ __ / \ / \ ______ _ _ __ __ __ / /\ / /\ \ / __ \ | | | | / \ \ \ / / / / / / \ \ | | | | | | | | / /\ \ \ / \ \ \ \ / / | |__| | | |__| | / ____ \ | | \ \/ \ \/ / \_ ___/ \____/ /_/ \_\ |_| \__/ \__/ \ \__ \___\ by Red Hat Build, Store, and Distribute your Containers Startup timestamp: Mon Jul 13 10:05:46 PM UTC 2026 Running all default registry services Running init script '/quay-registry/conf/init/certs_install.sh' Running init script '/quay-registry/conf/init/client_certs.sh' Running init script '/quay-registry/conf/init/copy_config_files.sh' Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh' Validating Configuration plpgsql pg_trgm +------------------------+-------+--------+ | Field Group | Error | Status | +------------------------+-------+--------+ | AccessSettings | - | 🟒 | +------------------------+-------+--------+ | ActionLogArchiving | - | 🟒 | +------------------------+-------+--------+ | AppTokenAuthentication | - | 🟒 | +------------------------+-------+--------+ | AutoPrune | - | 🟒 | +------------------------+-------+--------+ | BitbucketBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | BuildManager | - | 🟒 | +------------------------+-------+--------+ | Database | - | 🟒 | +------------------------+-------+--------+ | DistributedStorage | - | 🟒 | +------------------------+-------+--------+ | ElasticSearch | - | 🟒 | +------------------------+-------+--------+ | Email | - | 🟒 | +------------------------+-------+--------+ | GitHubBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | GitHubLogin | - | 🟒 | +------------------------+-------+--------+ | GitLabBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | GoogleLogin | - | 🟒 | +------------------------+-------+--------+ | HostSettings | - | 🟒 | +------------------------+-------+--------+ | JWTAuthentication | - | 🟒 | +------------------------+-------+--------+ | LDAP | - | 🟒 | +------------------------+-------+--------+ | OIDC | - | 🟒 | +------------------------+-------+--------+ | QuayDocumentation | - | 🟒 | +------------------------+-------+--------+ | Redis | - | 🟒 | +------------------------+-------+--------+ | RepoMirror | - | 🟒 | +------------------------+-------+--------+ | SecurityScanner | - | 🟒 | +------------------------+-------+--------+ | TeamSyncing | - | 🟒 | +------------------------+-------+--------+ | TimeMachine | - | 🟒 | +------------------------+-------+--------+ | UserVisibleSettings | - | 🟒 | +------------------------+-------+--------+ Running init script '/quay-registry/conf/init/nginx_conf_create.sh' Running init script '/quay-registry/conf/init/runmigration.sh' fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. 22:05:52 INFO [alembic.runtime.migration] Context impl PostgresqlImpl. 22:05:52 INFO [alembic.runtime.migration] Will assume non-transactional DDL. 22:05:52 INFO [alembic.runtime.migration] Running upgrade -> c156deb8845d, Reset our migrations with a required update. 22:05:53 INFO [alembic.runtime.migration] Running upgrade c156deb8845d -> 6c7014e84a5e, Add user prompt support. 22:05:53 INFO [alembic.runtime.migration] Running upgrade 6c7014e84a5e -> faf752bd2e0a, Add user metadata fields. 22:05:53 INFO [alembic.runtime.migration] Running upgrade faf752bd2e0a -> 94836b099894, Create new notification type. 22:05:53 INFO [alembic.runtime.migration] Running upgrade 94836b099894 -> 45fd8b9869d4, add_notification_type. 22:05:53 INFO [alembic.runtime.migration] Running upgrade 45fd8b9869d4 -> f5167870dd66, update queue item table indices. 22:05:53 INFO [alembic.runtime.migration] Running upgrade f5167870dd66 -> fc47c1ec019f, Add state_id field to QueueItem. 22:05:53 INFO [alembic.runtime.migration] Running upgrade fc47c1ec019f -> 3e8cc74a1e7b, Add severity and media_type to global messages. 22:05:53 INFO [alembic.runtime.migration] Running upgrade 3e8cc74a1e7b -> d42c175b439a, Backfill state_id and make it unique. 22:05:53 INFO [alembic.runtime.migration] Running upgrade d42c175b439a -> e2894a3a3c19, Add full text search indexing for repo name and description. 22:05:53 INFO [alembic.runtime.migration] Running upgrade e2894a3a3c19 -> 7a525c68eb13, Add OCI/App models. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 7a525c68eb13 -> b8ae68ad3e52, Change BlobUpload fields to BigIntegers to allow layers > 8GB. 22:05:54 INFO [alembic.runtime.migration] Running upgrade b8ae68ad3e52 -> b4df55dea4b3, add repository kind. 22:05:54 INFO [alembic.runtime.migration] Running upgrade b4df55dea4b3 -> a6c463dfb9fe, back fill build expand_config. 22:05:54 INFO [alembic.runtime.migration] Running upgrade a6c463dfb9fe -> be8d1c402ce0, Add TeamSync table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade be8d1c402ce0 -> f30984525c86, Add RepositorySearchScore table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade f30984525c86 -> c3d4b7ebcdf7, Backfill RepositorySearchScore table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade c3d4b7ebcdf7 -> ed01e313d3cb, Add trust_enabled to repository. 22:05:54 INFO [alembic.runtime.migration] Running upgrade ed01e313d3cb -> 53e2ac668296, Remove reference to subdir. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 53e2ac668296 -> dc4af11a5f90, add notification number of failures column. 22:05:54 INFO [alembic.runtime.migration] Running upgrade dc4af11a5f90 -> d8989249f8f6, Add change_tag_expiration log type. 22:05:54 INFO [alembic.runtime.migration] Running upgrade d8989249f8f6 -> 7367229b38d9, Add support for app specific tokens. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 7367229b38d9 -> cbc8177760d9, Add user location field. 22:05:54 INFO [alembic.runtime.migration] Running upgrade cbc8177760d9 -> 152bb29a1bb3, Add maximum build queue count setting to user table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 152bb29a1bb3 -> c91c564aad34, Drop checksum on ImageStorage. 22:05:54 INFO [alembic.runtime.migration] Running upgrade c91c564aad34 -> 152edccba18c, Make BlodUpload byte_count not nullable. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 152edccba18c -> b4c2d45bc132, Add deleted namespace table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade b4c2d45bc132 -> 61cadbacb9fc, Add ability for build triggers to be disabled. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 61cadbacb9fc -> 17aff2e1354e, Add automatic disable of build triggers. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 17aff2e1354e -> 87fbbc224f10, Add disabled datetime to trigger. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 87fbbc224f10 -> 0cf50323c78b, Add creation date to User table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 0cf50323c78b -> b547bc139ad8, Add RobotAccountMetadata table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade b547bc139ad8 -> 224ce4c72c2f, Add last_accessed field to User table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 224ce4c72c2f -> 5b7503aada1b, Cleanup old robots. 22:05:54 INFO [util.migrate.cleanup_old_robots] Found 0 robots to delete 22:05:54 INFO [alembic.runtime.migration] Running upgrade 5b7503aada1b -> 1783530bee68, Add LogEntry2 table - QUAY.IO ONLY 22:05:54 INFO [alembic.runtime.migration] Running upgrade 1783530bee68 -> 5cbbfc95bac7, Remove 'oci' tables not used by CNR. The rest will be migrated and renamed. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 5cbbfc95bac7 -> 610320e9dacf, Add new Appr-specific tables. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 610320e9dacf -> 5d463ea1e8a8, Backfill new appr tables. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 5d463ea1e8a8 -> d17c695859ea, Delete old Appr tables. 22:05:54 INFO [alembic.runtime.migration] Running upgrade d17c695859ea -> 6c21e2cfb8b6, Change LogEntry to use a BigInteger as its primary key. /opt/app-root/lib64/python3.12/site-packages/alembic/ddl/postgresql.py:187: UserWarning: autoincrement and existing_autoincrement only make sense for MySQL super().alter_column( 22:05:54 INFO [alembic.runtime.migration] Running upgrade 6c21e2cfb8b6 -> 9093adccc784, Add V2_2 data models for Manifest, ManifestBlob and ManifestLegacyImage. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 9093adccc784 -> eafdeadcebc7, Remove blob_index from ManifestBlob table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade eafdeadcebc7 -> 654e6df88b71, Change manifest_bytes to a UTF8 text field. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 654e6df88b71 -> 13411de1c0ff, Remove unique from TagManifestToManifest. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 13411de1c0ff -> 10f45ee2310b, Add Tag, TagKind and ManifestChild tables. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 10f45ee2310b -> 67f0abd172ae, Add TagToRepositoryTag table. 22:05:54 INFO [alembic.runtime.migration] Running upgrade 67f0abd172ae -> c00a1f15968b 22:05:54 INFO [alembic.runtime.migration] Running upgrade c00a1f15968b -> 54492a68a3cf, Add NamespaceGeoRestriction table. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 54492a68a3cf -> 6ec8726c0ace, Add LogEntry3 table. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 6ec8726c0ace -> e184af42242d, Add missing index on UUID fields. 22:05:55 INFO [alembic.runtime.migration] Running upgrade e184af42242d -> b9045731c4de, Add lifetime end indexes to tag tables. 22:05:55 INFO [alembic.runtime.migration] Running upgrade b9045731c4de -> 481623ba00ba, Add index on logs_archived on repositorybuild. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 481623ba00ba -> b918abdbee43, Run full tag backfill. 22:05:55 INFO [alembic.runtime.migration] Running upgrade b918abdbee43 -> 5248ddf35167, Repository Mirror. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 5248ddf35167 -> c13c8052f7a6, Add new fields and tables for encrypted tokens. 22:05:55 INFO [alembic.runtime.migration] Running upgrade c13c8052f7a6 -> 703298a825c2, Backfill new encrypted fields. 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for access tokens 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for robots 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for repo build triggers 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for app specific auth tokens 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling credentials for OAuth access tokens 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling credentials for OAuth auth code 22:05:55 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling secret for OAuth applications 22:05:55 INFO [alembic.runtime.migration] Running upgrade 703298a825c2 -> 49e1138ed12d, Change token column types for encrypted columns. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 49e1138ed12d -> c059b952ed76, Remove unencrypted fields and data. 22:05:55 INFO [alembic.runtime.migration] Running upgrade c059b952ed76 -> cc6778199cdb, repository mirror notification. 22:05:55 INFO [alembic.runtime.migration] Running upgrade cc6778199cdb -> 34c8ef052ec9, repo mirror columns. 22:05:55 INFO [34c8ef052ec9_repo_mirror_columns_py] Migrating to external_reference from existing columns 22:05:55 INFO [34c8ef052ec9_repo_mirror_columns_py] Reencrypting existing columns 22:05:55 INFO [alembic.runtime.migration] Running upgrade 34c8ef052ec9 -> 4fd6b8463eb2, Add new DeletedRepository tracking table. 22:05:55 INFO [alembic.runtime.migration] Running upgrade 4fd6b8463eb2 -> 8e6a363784bb, add manifestsecuritystatus table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8e6a363784bb -> 04b9d2191450 22:05:55 INFO [alembic.runtime.migration] Running upgrade 04b9d2191450 -> 3383aad1e992, Add UploadedBlob table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 3383aad1e992 -> 88e64904d000, Add new metadata columns to Manifest table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 88e64904d000 -> 909d725887d3, Add composite index on manifestblob 22:05:55 INFO [alembic.runtime.migration] Running upgrade 909d725887d3 -> e9f3e4dbb979, quota_management_reporting 22:05:55 INFO [alembic.runtime.migration] Running upgrade e9f3e4dbb979 -> 10d34e6536f8, create proxy_cache_config table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 10d34e6536f8 -> b43b44996c26, increase proxy cache config creds max len 22:05:55 INFO [alembic.runtime.migration] Running upgrade b43b44996c26 -> d94d328733e4, Increase repomirrorconfig char size 22:05:55 INFO [alembic.runtime.migration] Running upgrade d94d328733e4 -> 2d66ad598b56, Change metadata_json size in logentry3 table for MySQL 22:05:55 INFO [alembic.runtime.migration] Running upgrade 2d66ad598b56 -> 7bca88923f2c, add proxy cache logentrykind 22:05:55 INFO [alembic.runtime.migration] Running upgrade 7bca88923f2c -> b2d1e4b95fc2, add build triggers' logentrykind 22:05:55 INFO [alembic.runtime.migration] Running upgrade b2d1e4b95fc2 -> f0875fbc7c7a, β€œquota-v2” 22:05:55 INFO [alembic.runtime.migration] Running upgrade f0875fbc7c7a -> a648ab200ab7, add org auditing 22:05:55 INFO [alembic.runtime.migration] Running upgrade a648ab200ab7 -> 43fea47d641f, create RH subscriptions table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 43fea47d641f -> 0246c2d0e750, add login logout logentrykind 22:05:55 INFO [alembic.runtime.migration] Running upgrade 0246c2d0e750 -> ab5a24478052, β€œadd_registry_size_table” 22:05:55 INFO [alembic.runtime.migration] Running upgrade ab5a24478052 -> 8cf90670bf38, add permanently delete tag log entry kind 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8cf90670bf38 -> 46980ea2dde5, change removed_tag_expiration_s to BIGINT 22:05:55 INFO [alembic.runtime.migration] Running upgrade 46980ea2dde5 -> a0fc06d604a4, Unlink deprecated tables 22:05:55 INFO [alembic.runtime.migration] Running upgrade a0fc06d604a4 -> 8a70b8777089, drop deprecated tables 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8a70b8777089 -> b82361fba1cd, Create table for org to sku relations 22:05:55 INFO [alembic.runtime.migration] Running upgrade b82361fba1cd -> 4366f54be43c, add indexes to quotanamespacesize and quotarepositorysize tables 22:05:55 INFO [alembic.runtime.migration] Running upgrade 4366f54be43c -> 222debc16e18, β€œautopruning” 22:05:55 INFO [alembic.runtime.migration] Running upgrade 222debc16e18 -> 2062bbd5ef0e, insert logentrykind 22:05:55 INFO [alembic.runtime.migration] Running upgrade 2062bbd5ef0e -> 8d47693829a0, auto prune policy audit logs 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8d47693829a0 -> 3f8e3657bb67, add login and pull failure logentrykind 22:05:55 INFO [alembic.runtime.migration] Running upgrade 3f8e3657bb67 -> 41d15c93c299, add quantity field to orgRhSkus 22:05:55 INFO [alembic.runtime.migration] Running upgrade 41d15c93c299 -> b4da5b09c8df, repository autoprune policy 22:05:55 INFO [alembic.runtime.migration] Running upgrade b4da5b09c8df -> 135fd3e94615, insert oidc in loginservice 22:05:55 INFO [alembic.runtime.migration] Running upgrade 135fd3e94615 -> cead4183265c, recreate index for repository autoprune policy 22:05:55 INFO [alembic.runtime.migration] Running upgrade cead4183265c -> 36cd2b747a08, team sync logs 22:05:55 INFO [alembic.runtime.migration] Running upgrade 36cd2b747a08 -> 946f0e90f9c9, Create manifestsubject table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 946f0e90f9c9 -> 0cdd1f27a450, add subject backfilled index 22:05:55 INFO [alembic.runtime.migration] Running upgrade 0cdd1f27a450 -> 0988213e0885, add oauth assigned token table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 0988213e0885 -> 66147b81aad2, create repo_image_expiry notification type 22:05:55 INFO [alembic.runtime.migration] Running upgrade 66147b81aad2 -> f67fe4871771, create tag_notification_sent table 22:05:55 INFO [alembic.runtime.migration] Running upgrade f67fe4871771 -> 2664723e1b4b, add last_ran_ms to repository_notification_table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 2664723e1b4b -> 8a7ba94c2e84, add assign token logentry 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8a7ba94c2e84 -> 3f8d7acdf7f9, Add artifact_type column 22:05:55 INFO [alembic.runtime.migration] Running upgrade 3f8d7acdf7f9 -> a32e17bfad20, increase upstreamregistry's password length (PROJQUAY-7430) 22:05:55 INFO [alembic.runtime.migration] Running upgrade a32e17bfad20 -> 5b8dc452f5c3, add tag immutability column 22:05:55 INFO [alembic.runtime.migration] Running upgrade 5b8dc452f5c3 -> ba263f9be4a6, remove unique constraint for autoprunepolicy 22:05:55 INFO [alembic.runtime.migration] Running upgrade ba263f9be4a6 -> 9085e82074f2, Add log event kind for federated robot 22:05:55 INFO [alembic.runtime.migration] Running upgrade 9085e82074f2 -> 8e97c2cfee57, Add export logs auditing 22:05:55 INFO [alembic.runtime.migration] Running upgrade 8e97c2cfee57 -> 3634f2df3c5b, drop unique constraint on org sku table 22:05:55 INFO [alembic.runtime.migration] Running upgrade 3634f2df3c5b -> e8ed3fb547da, alter manifestblob id 22:05:56 INFO [alembic.runtime.migration] Running upgrade e8ed3fb547da -> 1623f40582ed, Add skopeo timeout to mirroring config 22:05:56 INFO [alembic.runtime.migration] Running upgrade 1623f40582ed -> 7078c84d14e8, add_pull_statistics_tables Running init script '/quay-registry/conf/init/supervisord_conf_create.sh' Running init script '/quay-registry/conf/init/zz_boot.sh' fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. /quay-registry/boot.py:76: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC). expiration = datetime.utcnow() + timedelta(minutes=minutes_until_expiration) 2026-07-13 22:05:58,818 INFO RPC interface 'supervisor' initialized 2026-07-13 22:05:58,818 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2026-07-13 22:05:58,818 INFO supervisord started with pid 14 2026-07-13 22:05:59,821 INFO spawned: 'stdout' with pid 79 2026-07-13 22:05:59,822 INFO spawned: 'autopruneworker' with pid 80 2026-07-13 22:05:59,824 INFO spawned: 'blobuploadcleanupworker' with pid 81 2026-07-13 22:05:59,826 INFO spawned: 'builder' with pid 82 2026-07-13 22:05:59,828 INFO spawned: 'buildlogsarchiver' with pid 83 2026-07-13 22:05:59,830 INFO spawned: 'chunkcleanupworker' with pid 84 2026-07-13 22:05:59,832 INFO spawned: 'dnsmasq' with pid 85 2026-07-13 22:05:59,833 INFO spawned: 'expiredappspecifictokenworker' with pid 86 2026-07-13 22:05:59,836 INFO spawned: 'exportactionlogsworker' with pid 87 2026-07-13 22:05:59,838 INFO spawned: 'gcworker' with pid 88 2026-07-13 22:05:59,841 INFO spawned: 'globalpromstats' with pid 89 2026-07-13 22:05:59,844 INFO spawned: 'gunicorn-registry' with pid 90 2026-07-13 22:05:59,847 INFO spawned: 'gunicorn-secscan' with pid 91 2026-07-13 22:05:59,849 INFO spawned: 'gunicorn-web' with pid 92 2026-07-13 22:05:59,851 INFO spawned: 'logrotateworker' with pid 93 2026-07-13 22:05:59,854 INFO spawned: 'manifestbackfillworker' with pid 94 2026-07-13 22:05:59,856 INFO spawned: 'manifestsubjectbackfillworker' with pid 95 2026-07-13 22:05:59,859 INFO spawned: 'memcache' with pid 96 2026-07-13 22:05:59,862 INFO spawned: 'namespacegcworker' with pid 97 2026-07-13 22:05:59,885 INFO spawned: 'nginx' with pid 98 2026-07-13 22:05:59,929 INFO spawned: 'notificationworker' with pid 99 2026-07-13 22:05:59,931 INFO spawned: 'proxycacheblobworker' with pid 105 2026-07-13 22:05:59,934 INFO spawned: 'pullstatsredisflushworker' with pid 110 2026-07-13 22:05:59,937 INFO spawned: 'pushgateway' with pid 111 2026-07-13 22:05:59,939 INFO spawned: 'queuecleanupworker' with pid 112 2026-07-13 22:05:59,942 INFO spawned: 'quotaregistrysizeworker' with pid 113 2026-07-13 22:05:59,945 INFO spawned: 'quotatotalworker' with pid 114 2026-07-13 22:05:59,947 INFO spawned: 'reconciliationworker' with pid 118 2026-07-13 22:05:59,950 INFO spawned: 'repositoryactioncounter' with pid 120 2026-07-13 22:05:59,953 INFO spawned: 'repositorygcworker' with pid 121 2026-07-13 22:06:00,030 INFO spawned: 'securityscanningnotificationworker' with pid 122 2026-07-13 22:06:00,033 INFO spawned: 'securityworker' with pid 123 2026-07-13 22:06:00,036 INFO spawned: 'servicekey' with pid 124 2026-07-13 22:06:00,038 INFO spawned: 'storagereplication' with pid 125 2026-07-13 22:06:00,041 INFO spawned: 'teamsyncworker' with pid 129 2026-07-13 22:06:01,139 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: autopruneworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,140 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: manifestsubjectbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,141 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,142 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,143 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: proxycacheblobworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: pullstatsredisflushworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: quotaregistrysizeworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,144 INFO success: quotatotalworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: reconciliationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 22:06:01,145 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) dnsmasq stderr | dnsmasq: started, version 2.85 cachesize 150 dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth cryptohash DNSSEC loop-detect inotify dumpfile dnsmasq stderr | dnsmasq: reading /etc/resolv.conf dnsmasq stderr | dnsmasq: using nameserver 10.96.0.10#53 dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses nginx stdout | 2026/07/13 22:05:59 [warn] 98#98: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:40 nginx stdout | 2026/07/13 22:05:59 [warn] 98#98: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:67 nginx stdout | 2026/07/13 22:05:59 [warn] 98#98: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:91 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:40 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:67 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:91 pushgateway stderr | ts=2026-07-13T22:06:00.037Z level=info caller=main.go:82 msg="starting pushgateway" version="(version=1.11.1, branch=HEAD, revision=aff0d834b730375fc965135e3e2d17d15f82a76f)" pushgateway stderr | ts=2026-07-13T22:06:00.037Z level=info caller=main.go:83 msg="Build context" build_context="(go=go1.24.1, platform=linux/amd64, user=root@672a818fb093, date=20250409-13:24:09, tags=unknown)" pushgateway stderr | ts=2026-07-13T22:06:00.040Z level=info caller=tls_config.go:347 msg="Listening on" address=[::]:9091 pushgateway stderr | ts=2026-07-13T22:06:00.040Z level=info caller=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9091 nginx stdout | 2026/07/13 22:05:59 [alert] 132#132: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 135#135: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 142#142: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 133#133: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 145#145: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 143#143: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 136#136: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 140#140: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 146#146: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 134#134: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 144#144: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 141#141: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 137#137: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 138#138: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 139#139: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 22:05:59 [alert] 147#147: setpriority(-10) failed (13: Permission denied) chunkcleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git buildlogsarchiver stderr | fatal: not a git repository (or any of the parent directories): .git notificationworker stderr | fatal: not a git repository (or any of the parent directories): .git logrotateworker stderr | fatal: not a git repository (or any of the parent directories): .git expiredappspecifictokenworker stderr | fatal: not a git repository (or any of the parent directories): .git builder stderr | fatal: not a git repository (or any of the parent directories): .git repositorygcworker stderr | fatal: not a git repository (or any of the parent directories): .git reconciliationworker stderr | fatal: not a git repository (or any of the parent directories): .git teamsyncworker stderr | fatal: not a git repository (or any of the parent directories): .git exportactionlogsworker stderr | fatal: not a git repository (or any of the parent directories): .git gcworker stderr | fatal: not a git repository (or any of the parent directories): .git queuecleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git namespacegcworker stderr | fatal: not a git repository (or any of the parent directories): .git blobuploadcleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git gunicorn-web stderr | fatal: not a git repository (or any of the parent directories): .git securityworker stderr | fatal: not a git repository (or any of the parent directories): .git manifestsubjectbackfillworker stderr | fatal: not a git repository (or any of the parent directories): .git globalpromstats stderr | fatal: not a git repository (or any of the parent directories): .git manifestbackfillworker stderr | fatal: not a git repository (or any of the parent directories): .git nginx stdout | 2026/07/13 22:06:05 [crit] 142#142: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.244.0.44:8443" nginx stdout | 2026/07/13 22:06:05 [error] 142#142: *1 open() "/quay-registry/static/patternfly/quay-registry/static/502.html" failed (2: No such file or directory), client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock/health/instance", host: "10.244.0.44:8443" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:05 +0000] "GET /health/instance HTTP/2.0" 404 146 "-" "kube-probe/1.32" (0.000 47 0.000) repositoryactioncounter stderr | fatal: not a git repository (or any of the parent directories): .git storagereplication stderr | fatal: not a git repository (or any of the parent directories): .git quotatotalworker stderr | fatal: not a git repository (or any of the parent directories): .git gunicorn-registry stderr | fatal: not a git repository (or any of the parent directories): .git gunicorn-secscan stderr | fatal: not a git repository (or any of the parent directories): .git proxycacheblobworker stderr | fatal: not a git repository (or any of the parent directories): .git builder stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. builder stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. chunkcleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. chunkcleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. buildlogsarchiver stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. servicekey stderr | fatal: not a git repository (or any of the parent directories): .git buildlogsarchiver stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. autopruneworker stderr | fatal: not a git repository (or any of the parent directories): .git quotaregistrysizeworker stderr | fatal: not a git repository (or any of the parent directories): .git teamsyncworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. teamsyncworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. logrotateworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. logrotateworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. securityscanningnotificationworker stderr | fatal: not a git repository (or any of the parent directories): .git expiredappspecifictokenworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. expiredappspecifictokenworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. repositorygcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. repositorygcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. pullstatsredisflushworker stderr | fatal: not a git repository (or any of the parent directories): .git buildlogsarchiver stdout | 2026-07-13 22:06:14,084 [83] [INFO] [apscheduler.scheduler] Scheduler started buildlogsarchiver stdout | 2026-07-13 22:06:14,131 [83] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default" storagereplication stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. storagereplication stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. manifestbackfillworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. manifestbackfillworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. notificationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. notificationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. securityworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. securityworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. manifestsubjectbackfillworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. manifestsubjectbackfillworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. nginx stdout | 2026/07/13 22:06:15 [crit] 143#143: *3 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.244.0.44:8443" nginx stdout | 2026/07/13 22:06:15 [error] 143#143: *3 open() "/quay-registry/static/patternfly/quay-registry/static/502.html" failed (2: No such file or directory), client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock/health/instance", host: "10.244.0.44:8443" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:15 +0000] "GET /health/instance HTTP/2.0" 404 146 "-" "kube-probe/1.32" (0.000 47 0.000) repositorygcworker stdout | 2026-07-13 22:06:16,134 [121] [INFO] [apscheduler.scheduler] Scheduler started repositorygcworker stdout | 2026-07-13 22:06:16,138 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" repositorygcworker stdout | 2026-07-13 22:06:16,138 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" repositorygcworker stdout | 2026-07-13 22:06:16,139 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" expiredappspecifictokenworker stdout | 2026-07-13 22:06:16,149 [86] [INFO] [apscheduler.scheduler] Scheduler started expiredappspecifictokenworker stdout | 2026-07-13 22:06:16,230 [86] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default" 2026-07-13 22:06:16,832 INFO exited: builder (exit status 0; expected) repositoryactioncounter stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. repositoryactioncounter stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. manifestbackfillworker stdout | 2026-07-13 22:06:17,252 [94] [INFO] [apscheduler.scheduler] Scheduler started manifestbackfillworker stdout | 2026-07-13 22:06:17,329 [94] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default" gcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. blobuploadcleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. blobuploadcleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-web stdout | 2026-07-13 22:06:17,651 [92] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-web stdout | 2026-07-13 22:06:17,651 [92] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-web stdout | 2026-07-13 22:06:17,653 [92] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-secscan stdout | 2026-07-13 22:06:17,739 [91] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-secscan stdout | 2026-07-13 22:06:17,740 [91] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-secscan stdout | 2026-07-13 22:06:17,742 [91] [INFO] [util.ipresolver] Loading AWS IP ranges from disk manifestsubjectbackfillworker stdout | 2026-07-13 22:06:18,037 [95] [INFO] [apscheduler.scheduler] Scheduler started manifestsubjectbackfillworker stdout | 2026-07-13 22:06:18,039 [95] [INFO] [apscheduler.scheduler] Added job "ManifestSubjectBackfillWorker._backfill_manifest_subject" to job store "default" manifestsubjectbackfillworker stdout | 2026-07-13 22:06:18,039 [95] [INFO] [apscheduler.scheduler] Added job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type" to job store "default" queuecleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. queuecleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. globalpromstats stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. globalpromstats stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. notificationworker stdout | 2026-07-13 22:06:18,434 [99] [INFO] [apscheduler.scheduler] Scheduler started notificationworker stdout | 2026-07-13 22:06:18,446 [99] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" notificationworker stdout | 2026-07-13 22:06:18,447 [99] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" notificationworker stdout | 2026-07-13 22:06:18,447 [99] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" reconciliationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. reconciliationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. quotatotalworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. quotatotalworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. exportactionlogsworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. exportactionlogsworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. namespacegcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. namespacegcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-web stdout | 2026-07-13 22:06:18,841 [92] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:18,841 [92] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:18,842 [92] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2026-07-13 22:06:18,842 [92] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-web stdout | 2026-07-13 22:06:18,843 [92] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2026-07-13 22:06:18,844 [92] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2026-07-13 22:06:18,844 [92] [INFO] [data.logs_model] Using logs model `` gunicorn-web stdout | 2026-07-13 22:06:18,844 [92] [INFO] [data.logs_model] =============================== repositoryactioncounter stdout | 2026-07-13 22:06:18,846 [120] [INFO] [apscheduler.scheduler] Scheduler started repositoryactioncounter stdout | 2026-07-13 22:06:18,848 [120] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default" gunicorn-secscan stdout | 2026-07-13 22:06:19,029 [91] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-secscan gunicorn-secscan stdout | 2026-07-13 22:06:19,029 [91] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-secscan stdout | 2026-07-13 22:06:19,030 [91] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2026-07-13 22:06:19,030 [91] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-secscan stdout | 2026-07-13 22:06:19,030 [91] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2026-07-13 22:06:19,030 [91] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2026-07-13 22:06:19,030 [91] [INFO] [data.logs_model] Using logs model `` gunicorn-secscan stdout | 2026-07-13 22:06:19,031 [91] [INFO] [data.logs_model] =============================== gcworker stdout | 2026-07-13 22:06:19,146 [88] [INFO] [apscheduler.scheduler] Scheduler started gcworker stdout | 2026-07-13 22:06:19,148 [88] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default" blobuploadcleanupworker stdout | 2026-07-13 22:06:19,445 [81] [INFO] [apscheduler.scheduler] Scheduler started blobuploadcleanupworker stdout | 2026-07-13 22:06:19,446 [81] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default" servicekey stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. servicekey stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-secscan stderr | Traceback (most recent call last): gunicorn-secscan stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-secscan stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-secscan stderr | AssertionError: (None, ) gunicorn-secscan stderr | 2026-07-13T22:06:19Z failed with AssertionError queuecleanupworker stdout | 2026-07-13 22:06:20,049 [112] [INFO] [apscheduler.scheduler] Scheduler started queuecleanupworker stdout | 2026-07-13 22:06:20,129 [112] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default" globalpromstats stdout | 2026-07-13 22:06:20,151 [89] [INFO] [apscheduler.scheduler] Scheduler started globalpromstats stdout | 2026-07-13 22:06:20,152 [89] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default" namespacegcworker stdout | 2026-07-13 22:06:20,456 [97] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stdout | 2026-07-13 22:06:20,457 [97] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" namespacegcworker stdout | 2026-07-13 22:06:20,457 [97] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" namespacegcworker stdout | 2026-07-13 22:06:20,457 [97] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" quotaregistrysizeworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. quotaregistrysizeworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. proxycacheblobworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. proxycacheblobworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. pullstatsredisflushworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. pullstatsredisflushworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. securityscanningnotificationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. securityscanningnotificationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. autopruneworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. autopruneworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-registry stdout | 2026-07-13 22:06:21,133 [90] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-registry stdout | 2026-07-13 22:06:21,133 [90] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-registry stdout | 2026-07-13 22:06:21,134 [90] [INFO] [util.ipresolver] Loading AWS IP ranges from disk servicekey stdout | 2026-07-13 22:06:21,150 [124] [INFO] [apscheduler.scheduler] Scheduler started servicekey stdout | 2026-07-13 22:06:21,151 [124] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default" gunicorn-registry stdout | 2026-07-13 22:06:21,575 [90] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-registry gunicorn-registry stdout | 2026-07-13 22:06:21,575 [90] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.logs_model] Using logs model `` gunicorn-registry stdout | 2026-07-13 22:06:21,576 [90] [INFO] [data.logs_model] =============================== gunicorn-web stderr | Traceback (most recent call last): gunicorn-web stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-web stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-web stderr | AssertionError: (None, ) gunicorn-web stderr | 2026-07-13T22:06:21Z failed with AssertionError exportactionlogsworker stdout | 2026-07-13 22:06:21,666 [87] [INFO] [apscheduler.scheduler] Scheduler started exportactionlogsworker stdout | 2026-07-13 22:06:21,667 [87] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" exportactionlogsworker stdout | 2026-07-13 22:06:21,667 [87] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" exportactionlogsworker stdout | 2026-07-13 22:06:21,667 [87] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" gunicorn-registry stderr | Traceback (most recent call last): gunicorn-registry stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-registry stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-registry stderr | AssertionError: (None, ) gunicorn-registry stderr | 2026-07-13T22:06:22Z failed with AssertionError gunicorn-web stdout | 2026-07-13 22:06:25,505 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.005 162 0.005) gunicorn-registry stdout | 2026-07-13 22:06:25,510 [371] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:25,526 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.002) gunicorn-web stdout | 2026-07-13 22:06:25,528 [336] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:25,542 [336] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:25,542 [336] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:25,550 [336] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.078 47 0.078) gunicorn-web stdout | 2026-07-13 22:06:25,585 [339] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.005 162 0.005) gunicorn-registry stdout | 2026-07-13 22:06:25,591 [375] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:25,605 [339] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.002) gunicorn-web stdout | 2026-07-13 22:06:25,608 [339] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:25,620 [339] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:25,620 [339] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:25,628 [339] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:06:25 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:25 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.075 47 0.074) gcworker stdout | 2026-07-13 22:06:26,149 [88] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 22:06:26 GMT)" (scheduled at 2026-07-13 22:06:26.148900+00:00) gcworker stdout | 2026-07-13 22:06:26,157 [88] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 22:06:56 GMT)" executed successfully notificationworker stdout | 2026-07-13 22:06:26,447 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:26 GMT)" (scheduled at 2026-07-13 22:06:26.447203+00:00) notificationworker stdout | 2026-07-13 22:06:26,456 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:36 GMT)" executed successfully buildlogsarchiver stdout | 2026-07-13 22:06:31,132 [83] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 22:06:31 GMT)" (scheduled at 2026-07-13 22:06:31.131780+00:00) buildlogsarchiver stdout | 2026-07-13 22:06:31,141 [83] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 22:07:01 GMT)" executed successfully manifestsubjectbackfillworker stdout | 2026-07-13 22:06:35,040 [95] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 22:06:35 GMT)" (scheduled at 2026-07-13 22:06:35.039931+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 22:06:35,048 [95] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:35 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 22:06:35,567 [339] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:35 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.005 162 0.005) gunicorn-registry stdout | 2026-07-13 22:06:35,572 [376] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:35 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:35,585 [339] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:35 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 22:06:35,587 [339] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:35 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:35,588 [339] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:35,588 [339] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:35,600 [339] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:06:35 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:35 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.047 47 0.047) notificationworker stdout | 2026-07-13 22:06:36,447 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:46 GMT)" (scheduled at 2026-07-13 22:06:36.447203+00:00) notificationworker stdout | 2026-07-13 22:06:36,449 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:46 GMT)" executed successfully notificationworker stdout | 2026-07-13 22:06:41,448 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 22:11:41 GMT)" (scheduled at 2026-07-13 22:06:41.448308+00:00) notificationworker stdout | 2026-07-13 22:06:41,452 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 22:11:41 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 22:06:45,568 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.004 162 0.005) gunicorn-registry stdout | 2026-07-13 22:06:45,574 [379] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:45 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:45,586 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:45 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 22:06:45,588 [336] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:45 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:45,588 [336] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:45,589 [336] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:45,601 [336] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:06:45 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:45 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.047 47 0.047) notificationworker stdout | 2026-07-13 22:06:46,447 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:56 GMT)" (scheduled at 2026-07-13 22:06:46.447203+00:00) notificationworker stdout | 2026-07-13 22:06:46,449 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:06:56 GMT)" executed successfully notificationworker stdout | 2026-07-13 22:06:47,448 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:47 GMT)" (scheduled at 2026-07-13 22:06:47.448563+00:00) notificationworker stdout | 2026-07-13 22:06:47,449 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:47 GMT)" executed successfully namespacegcworker stdout | 2026-07-13 22:06:55,459 [97] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:06:55 GMT)" (scheduled at 2026-07-13 22:06:55.458535+00:00) namespacegcworker stdout | 2026-07-13 22:06:55,460 [97] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:55 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 22:06:55,568 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:55 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.004 162 0.004) gunicorn-registry stdout | 2026-07-13 22:06:55,573 [380] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:55 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:55,585 [336] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:06:55 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 22:06:55,587 [339] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:06:55 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:06:55,588 [336] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:06:55,588 [336] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 22:06:55,600 [336] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:06:55 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:06:55 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.046 47 0.047) gcworker stdout | 2026-07-13 22:06:56,149 [88] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 22:07:26 GMT)" (scheduled at 2026-07-13 22:06:56.148900+00:00) gcworker stdout | 2026-07-13 22:06:56,149 [88] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 22:07:26 GMT)" executed successfully notificationworker stdout | 2026-07-13 22:06:56,447 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:07:06 GMT)" (scheduled at 2026-07-13 22:06:56.447203+00:00) notificationworker stdout | 2026-07-13 22:06:56,449 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:07:06 GMT)" executed successfully manifestsubjectbackfillworker stdout | 2026-07-13 22:06:57,041 [95] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:57 GMT)" (scheduled at 2026-07-13 22:06:57.040667+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 22:06:57,043 [95] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:57 GMT)" executed successfully namespacegcworker stdout | 2026-07-13 22:07:00,457 [97] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 22:08:00 GMT)" (scheduled at 2026-07-13 22:07:00.457603+00:00) namespacegcworker stdout | 2026-07-13 22:07:00,467 [97] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 22:08:00 GMT)" executed successfully buildlogsarchiver stdout | 2026-07-13 22:07:01,132 [83] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 22:07:31 GMT)" (scheduled at 2026-07-13 22:07:01.131780+00:00) buildlogsarchiver stdout | 2026-07-13 22:07:01,133 [83] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 22:07:31 GMT)" executed successfully repositorygcworker stdout | 2026-07-13 22:07:04,140 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:04 GMT)" (scheduled at 2026-07-13 22:07:04.138804+00:00) repositorygcworker stdout | 2026-07-13 22:07:04,151 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 22:08:04 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 22:07:05,574 [331] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:07:05 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 22:07:05,576 [379] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:07:05 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:07:05,590 [331] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:22:07:05 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 22:07:05,591 [336] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:22:07:05 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 22:07:05,603 [331] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 22:07:05,603 [331] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:22:07:05 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.059 47 0.059) gunicorn-web stdout | 2026-07-13 22:07:05,612 [331] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:22:07:05 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" exportactionlogsworker stdout | 2026-07-13 22:07:05,669 [87] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:05 GMT)" (scheduled at 2026-07-13 22:07:05.668633+00:00) exportactionlogsworker stdout | 2026-07-13 22:07:05,669 [87] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 22:07:05 GMT)" executed successfully notificationworker stdout | 2026-07-13 22:07:06,447 [99] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:07:16 GMT)" (scheduled at 2026-07-13 22:07:06.447203+00:00) notificationworker stdout | 2026-07-13 22:07:06,449 [99] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 22:07:16 GMT)" executed successfully