__ __ / \ / \ ______ _ _ __ __ __ / /\ / /\ \ / __ \ | | | | / \ \ \ / / / / / / \ \ | | | | | | | | / /\ \ \ / \ \ \ \ / / | |__| | | |__| | / ____ \ | | \ \/ \ \/ / \_ ___/ \____/ /_/ \_\ |_| \__/ \__/ \ \__ \___\ by Red Hat Build, Store, and Distribute your Containers Startup timestamp: Mon Jul 13 04:12:43 PM UTC 2026 Running all default registry services Running init script '/quay-registry/conf/init/certs_install.sh' Running init script '/quay-registry/conf/init/client_certs.sh' Running init script '/quay-registry/conf/init/copy_config_files.sh' Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh' Validating Configuration plpgsql pg_trgm +------------------------+-------+--------+ | Field Group | Error | Status | +------------------------+-------+--------+ | AccessSettings | - | 🟒 | +------------------------+-------+--------+ | ActionLogArchiving | - | 🟒 | +------------------------+-------+--------+ | AppTokenAuthentication | - | 🟒 | +------------------------+-------+--------+ | AutoPrune | - | 🟒 | +------------------------+-------+--------+ | BitbucketBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | BuildManager | - | 🟒 | +------------------------+-------+--------+ | Database | - | 🟒 | +------------------------+-------+--------+ | DistributedStorage | - | 🟒 | +------------------------+-------+--------+ | ElasticSearch | - | 🟒 | +------------------------+-------+--------+ | Email | - | 🟒 | +------------------------+-------+--------+ | GitHubBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | GitHubLogin | - | 🟒 | +------------------------+-------+--------+ | GitLabBuildTrigger | - | 🟒 | +------------------------+-------+--------+ | GoogleLogin | - | 🟒 | +------------------------+-------+--------+ | HostSettings | - | 🟒 | +------------------------+-------+--------+ | JWTAuthentication | - | 🟒 | +------------------------+-------+--------+ | LDAP | - | 🟒 | +------------------------+-------+--------+ | OIDC | - | 🟒 | +------------------------+-------+--------+ | QuayDocumentation | - | 🟒 | +------------------------+-------+--------+ | Redis | - | 🟒 | +------------------------+-------+--------+ | RepoMirror | - | 🟒 | +------------------------+-------+--------+ | SecurityScanner | - | 🟒 | +------------------------+-------+--------+ | TeamSyncing | - | 🟒 | +------------------------+-------+--------+ | TimeMachine | - | 🟒 | +------------------------+-------+--------+ | UserVisibleSettings | - | 🟒 | +------------------------+-------+--------+ Running init script '/quay-registry/conf/init/nginx_conf_create.sh' Running init script '/quay-registry/conf/init/runmigration.sh' fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. 16:12:48 INFO [alembic.runtime.migration] Context impl PostgresqlImpl. 16:12:48 INFO [alembic.runtime.migration] Will assume non-transactional DDL. 16:12:49 INFO [alembic.runtime.migration] Running upgrade -> c156deb8845d, Reset our migrations with a required update. 16:12:50 INFO [alembic.runtime.migration] Running upgrade c156deb8845d -> 6c7014e84a5e, Add user prompt support. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 6c7014e84a5e -> faf752bd2e0a, Add user metadata fields. 16:12:50 INFO [alembic.runtime.migration] Running upgrade faf752bd2e0a -> 94836b099894, Create new notification type. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 94836b099894 -> 45fd8b9869d4, add_notification_type. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 45fd8b9869d4 -> f5167870dd66, update queue item table indices. 16:12:50 INFO [alembic.runtime.migration] Running upgrade f5167870dd66 -> fc47c1ec019f, Add state_id field to QueueItem. 16:12:50 INFO [alembic.runtime.migration] Running upgrade fc47c1ec019f -> 3e8cc74a1e7b, Add severity and media_type to global messages. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 3e8cc74a1e7b -> d42c175b439a, Backfill state_id and make it unique. 16:12:50 INFO [alembic.runtime.migration] Running upgrade d42c175b439a -> e2894a3a3c19, Add full text search indexing for repo name and description. 16:12:50 INFO [alembic.runtime.migration] Running upgrade e2894a3a3c19 -> 7a525c68eb13, Add OCI/App models. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 7a525c68eb13 -> b8ae68ad3e52, Change BlobUpload fields to BigIntegers to allow layers > 8GB. 16:12:50 INFO [alembic.runtime.migration] Running upgrade b8ae68ad3e52 -> b4df55dea4b3, add repository kind. 16:12:50 INFO [alembic.runtime.migration] Running upgrade b4df55dea4b3 -> a6c463dfb9fe, back fill build expand_config. 16:12:50 INFO [alembic.runtime.migration] Running upgrade a6c463dfb9fe -> be8d1c402ce0, Add TeamSync table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade be8d1c402ce0 -> f30984525c86, Add RepositorySearchScore table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade f30984525c86 -> c3d4b7ebcdf7, Backfill RepositorySearchScore table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade c3d4b7ebcdf7 -> ed01e313d3cb, Add trust_enabled to repository. 16:12:50 INFO [alembic.runtime.migration] Running upgrade ed01e313d3cb -> 53e2ac668296, Remove reference to subdir. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 53e2ac668296 -> dc4af11a5f90, add notification number of failures column. 16:12:50 INFO [alembic.runtime.migration] Running upgrade dc4af11a5f90 -> d8989249f8f6, Add change_tag_expiration log type. 16:12:50 INFO [alembic.runtime.migration] Running upgrade d8989249f8f6 -> 7367229b38d9, Add support for app specific tokens. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 7367229b38d9 -> cbc8177760d9, Add user location field. 16:12:50 INFO [alembic.runtime.migration] Running upgrade cbc8177760d9 -> 152bb29a1bb3, Add maximum build queue count setting to user table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 152bb29a1bb3 -> c91c564aad34, Drop checksum on ImageStorage. 16:12:50 INFO [alembic.runtime.migration] Running upgrade c91c564aad34 -> 152edccba18c, Make BlodUpload byte_count not nullable. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 152edccba18c -> b4c2d45bc132, Add deleted namespace table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade b4c2d45bc132 -> 61cadbacb9fc, Add ability for build triggers to be disabled. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 61cadbacb9fc -> 17aff2e1354e, Add automatic disable of build triggers. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 17aff2e1354e -> 87fbbc224f10, Add disabled datetime to trigger. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 87fbbc224f10 -> 0cf50323c78b, Add creation date to User table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 0cf50323c78b -> b547bc139ad8, Add RobotAccountMetadata table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade b547bc139ad8 -> 224ce4c72c2f, Add last_accessed field to User table. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 224ce4c72c2f -> 5b7503aada1b, Cleanup old robots. 16:12:50 INFO [util.migrate.cleanup_old_robots] Found 0 robots to delete 16:12:50 INFO [alembic.runtime.migration] Running upgrade 5b7503aada1b -> 1783530bee68, Add LogEntry2 table - QUAY.IO ONLY 16:12:50 INFO [alembic.runtime.migration] Running upgrade 1783530bee68 -> 5cbbfc95bac7, Remove 'oci' tables not used by CNR. The rest will be migrated and renamed. 16:12:50 INFO [alembic.runtime.migration] Running upgrade 5cbbfc95bac7 -> 610320e9dacf, Add new Appr-specific tables. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 610320e9dacf -> 5d463ea1e8a8, Backfill new appr tables. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 5d463ea1e8a8 -> d17c695859ea, Delete old Appr tables. 16:12:51 INFO [alembic.runtime.migration] Running upgrade d17c695859ea -> 6c21e2cfb8b6, Change LogEntry to use a BigInteger as its primary key. /opt/app-root/lib64/python3.12/site-packages/alembic/ddl/postgresql.py:187: UserWarning: autoincrement and existing_autoincrement only make sense for MySQL super().alter_column( 16:12:51 INFO [alembic.runtime.migration] Running upgrade 6c21e2cfb8b6 -> 9093adccc784, Add V2_2 data models for Manifest, ManifestBlob and ManifestLegacyImage. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 9093adccc784 -> eafdeadcebc7, Remove blob_index from ManifestBlob table. 16:12:51 INFO [alembic.runtime.migration] Running upgrade eafdeadcebc7 -> 654e6df88b71, Change manifest_bytes to a UTF8 text field. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 654e6df88b71 -> 13411de1c0ff, Remove unique from TagManifestToManifest. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 13411de1c0ff -> 10f45ee2310b, Add Tag, TagKind and ManifestChild tables. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 10f45ee2310b -> 67f0abd172ae, Add TagToRepositoryTag table. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 67f0abd172ae -> c00a1f15968b 16:12:51 INFO [alembic.runtime.migration] Running upgrade c00a1f15968b -> 54492a68a3cf, Add NamespaceGeoRestriction table. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 54492a68a3cf -> 6ec8726c0ace, Add LogEntry3 table. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 6ec8726c0ace -> e184af42242d, Add missing index on UUID fields. 16:12:51 INFO [alembic.runtime.migration] Running upgrade e184af42242d -> b9045731c4de, Add lifetime end indexes to tag tables. 16:12:51 INFO [alembic.runtime.migration] Running upgrade b9045731c4de -> 481623ba00ba, Add index on logs_archived on repositorybuild. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 481623ba00ba -> b918abdbee43, Run full tag backfill. 16:12:51 INFO [alembic.runtime.migration] Running upgrade b918abdbee43 -> 5248ddf35167, Repository Mirror. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 5248ddf35167 -> c13c8052f7a6, Add new fields and tables for encrypted tokens. 16:12:51 INFO [alembic.runtime.migration] Running upgrade c13c8052f7a6 -> 703298a825c2, Backfill new encrypted fields. 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for access tokens 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for robots 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for repo build triggers 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling encrypted credentials for app specific auth tokens 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling credentials for OAuth access tokens 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling credentials for OAuth auth code 16:12:51 INFO [703298a825c2_backfill_new_encrypted_fields_py] Backfilling secret for OAuth applications 16:12:51 INFO [alembic.runtime.migration] Running upgrade 703298a825c2 -> 49e1138ed12d, Change token column types for encrypted columns. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 49e1138ed12d -> c059b952ed76, Remove unencrypted fields and data. 16:12:51 INFO [alembic.runtime.migration] Running upgrade c059b952ed76 -> cc6778199cdb, repository mirror notification. 16:12:51 INFO [alembic.runtime.migration] Running upgrade cc6778199cdb -> 34c8ef052ec9, repo mirror columns. 16:12:51 INFO [34c8ef052ec9_repo_mirror_columns_py] Migrating to external_reference from existing columns 16:12:51 INFO [34c8ef052ec9_repo_mirror_columns_py] Reencrypting existing columns 16:12:51 INFO [alembic.runtime.migration] Running upgrade 34c8ef052ec9 -> 4fd6b8463eb2, Add new DeletedRepository tracking table. 16:12:51 INFO [alembic.runtime.migration] Running upgrade 4fd6b8463eb2 -> 8e6a363784bb, add manifestsecuritystatus table 16:12:51 INFO [alembic.runtime.migration] Running upgrade 8e6a363784bb -> 04b9d2191450 16:12:51 INFO [alembic.runtime.migration] Running upgrade 04b9d2191450 -> 3383aad1e992, Add UploadedBlob table 16:12:51 INFO [alembic.runtime.migration] Running upgrade 3383aad1e992 -> 88e64904d000, Add new metadata columns to Manifest table 16:12:51 INFO [alembic.runtime.migration] Running upgrade 88e64904d000 -> 909d725887d3, Add composite index on manifestblob 16:12:51 INFO [alembic.runtime.migration] Running upgrade 909d725887d3 -> e9f3e4dbb979, quota_management_reporting 16:12:51 INFO [alembic.runtime.migration] Running upgrade e9f3e4dbb979 -> 10d34e6536f8, create proxy_cache_config table 16:12:51 INFO [alembic.runtime.migration] Running upgrade 10d34e6536f8 -> b43b44996c26, increase proxy cache config creds max len 16:12:51 INFO [alembic.runtime.migration] Running upgrade b43b44996c26 -> d94d328733e4, Increase repomirrorconfig char size 16:12:51 INFO [alembic.runtime.migration] Running upgrade d94d328733e4 -> 2d66ad598b56, Change metadata_json size in logentry3 table for MySQL 16:12:51 INFO [alembic.runtime.migration] Running upgrade 2d66ad598b56 -> 7bca88923f2c, add proxy cache logentrykind 16:12:51 INFO [alembic.runtime.migration] Running upgrade 7bca88923f2c -> b2d1e4b95fc2, add build triggers' logentrykind 16:12:51 INFO [alembic.runtime.migration] Running upgrade b2d1e4b95fc2 -> f0875fbc7c7a, β€œquota-v2” 16:12:51 INFO [alembic.runtime.migration] Running upgrade f0875fbc7c7a -> a648ab200ab7, add org auditing 16:12:52 INFO [alembic.runtime.migration] Running upgrade a648ab200ab7 -> 43fea47d641f, create RH subscriptions table 16:12:52 INFO [alembic.runtime.migration] Running upgrade 43fea47d641f -> 0246c2d0e750, add login logout logentrykind 16:12:52 INFO [alembic.runtime.migration] Running upgrade 0246c2d0e750 -> ab5a24478052, β€œadd_registry_size_table” 16:12:52 INFO [alembic.runtime.migration] Running upgrade ab5a24478052 -> 8cf90670bf38, add permanently delete tag log entry kind 16:12:52 INFO [alembic.runtime.migration] Running upgrade 8cf90670bf38 -> 46980ea2dde5, change removed_tag_expiration_s to BIGINT 16:12:52 INFO [alembic.runtime.migration] Running upgrade 46980ea2dde5 -> a0fc06d604a4, Unlink deprecated tables 16:12:52 INFO [alembic.runtime.migration] Running upgrade a0fc06d604a4 -> 8a70b8777089, drop deprecated tables 16:12:52 INFO [alembic.runtime.migration] Running upgrade 8a70b8777089 -> b82361fba1cd, Create table for org to sku relations 16:12:52 INFO [alembic.runtime.migration] Running upgrade b82361fba1cd -> 4366f54be43c, add indexes to quotanamespacesize and quotarepositorysize tables 16:12:52 INFO [alembic.runtime.migration] Running upgrade 4366f54be43c -> 222debc16e18, β€œautopruning” 16:12:52 INFO [alembic.runtime.migration] Running upgrade 222debc16e18 -> 2062bbd5ef0e, insert logentrykind 16:12:52 INFO [alembic.runtime.migration] Running upgrade 2062bbd5ef0e -> 8d47693829a0, auto prune policy audit logs 16:12:52 INFO [alembic.runtime.migration] Running upgrade 8d47693829a0 -> 3f8e3657bb67, add login and pull failure logentrykind 16:12:52 INFO [alembic.runtime.migration] Running upgrade 3f8e3657bb67 -> 41d15c93c299, add quantity field to orgRhSkus 16:12:52 INFO [alembic.runtime.migration] Running upgrade 41d15c93c299 -> b4da5b09c8df, repository autoprune policy 16:12:52 INFO [alembic.runtime.migration] Running upgrade b4da5b09c8df -> 135fd3e94615, insert oidc in loginservice 16:12:52 INFO [alembic.runtime.migration] Running upgrade 135fd3e94615 -> cead4183265c, recreate index for repository autoprune policy 16:12:52 INFO [alembic.runtime.migration] Running upgrade cead4183265c -> 36cd2b747a08, team sync logs 16:12:52 INFO [alembic.runtime.migration] Running upgrade 36cd2b747a08 -> 946f0e90f9c9, Create manifestsubject table 16:12:52 INFO [alembic.runtime.migration] Running upgrade 946f0e90f9c9 -> 0cdd1f27a450, add subject backfilled index 16:12:52 INFO [alembic.runtime.migration] Running upgrade 0cdd1f27a450 -> 0988213e0885, add oauth assigned token table 16:12:52 INFO [alembic.runtime.migration] Running upgrade 0988213e0885 -> 66147b81aad2, create repo_image_expiry notification type 16:12:52 INFO [alembic.runtime.migration] Running upgrade 66147b81aad2 -> f67fe4871771, create tag_notification_sent table 16:12:52 INFO [alembic.runtime.migration] Running upgrade f67fe4871771 -> 2664723e1b4b, add last_ran_ms to repository_notification_table 16:12:52 INFO [alembic.runtime.migration] Running upgrade 2664723e1b4b -> 8a7ba94c2e84, add assign token logentry 16:12:52 INFO [alembic.runtime.migration] Running upgrade 8a7ba94c2e84 -> 3f8d7acdf7f9, Add artifact_type column 16:12:52 INFO [alembic.runtime.migration] Running upgrade 3f8d7acdf7f9 -> a32e17bfad20, increase upstreamregistry's password length (PROJQUAY-7430) 16:12:52 INFO [alembic.runtime.migration] Running upgrade a32e17bfad20 -> 5b8dc452f5c3, add tag immutability column 16:12:52 INFO [alembic.runtime.migration] Running upgrade 5b8dc452f5c3 -> ba263f9be4a6, remove unique constraint for autoprunepolicy 16:12:52 INFO [alembic.runtime.migration] Running upgrade ba263f9be4a6 -> 9085e82074f2, Add log event kind for federated robot 16:12:52 INFO [alembic.runtime.migration] Running upgrade 9085e82074f2 -> 8e97c2cfee57, Add export logs auditing 16:12:52 INFO [alembic.runtime.migration] Running upgrade 8e97c2cfee57 -> 3634f2df3c5b, drop unique constraint on org sku table 16:12:52 INFO [alembic.runtime.migration] Running upgrade 3634f2df3c5b -> e8ed3fb547da, alter manifestblob id 16:12:52 INFO [alembic.runtime.migration] Running upgrade e8ed3fb547da -> 1623f40582ed, Add skopeo timeout to mirroring config 16:12:52 INFO [alembic.runtime.migration] Running upgrade 1623f40582ed -> 7078c84d14e8, add_pull_statistics_tables Running init script '/quay-registry/conf/init/supervisord_conf_create.sh' Running init script '/quay-registry/conf/init/zz_boot.sh' fatal: not a git repository (or any of the parent directories): .git 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. /quay-registry/boot.py:76: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC). expiration = datetime.utcnow() + timedelta(minutes=minutes_until_expiration) 2026-07-13 16:12:55,372 INFO RPC interface 'supervisor' initialized 2026-07-13 16:12:55,373 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2026-07-13 16:12:55,373 INFO supervisord started with pid 14 2026-07-13 16:12:56,375 INFO spawned: 'stdout' with pid 78 2026-07-13 16:12:56,377 INFO spawned: 'autopruneworker' with pid 79 2026-07-13 16:12:56,379 INFO spawned: 'blobuploadcleanupworker' with pid 80 2026-07-13 16:12:56,381 INFO spawned: 'builder' with pid 81 2026-07-13 16:12:56,383 INFO spawned: 'buildlogsarchiver' with pid 82 2026-07-13 16:12:56,384 INFO spawned: 'chunkcleanupworker' with pid 83 2026-07-13 16:12:56,386 INFO spawned: 'dnsmasq' with pid 84 2026-07-13 16:12:56,388 INFO spawned: 'expiredappspecifictokenworker' with pid 85 2026-07-13 16:12:56,391 INFO spawned: 'exportactionlogsworker' with pid 86 2026-07-13 16:12:56,393 INFO spawned: 'gcworker' with pid 87 2026-07-13 16:12:56,395 INFO spawned: 'globalpromstats' with pid 88 2026-07-13 16:12:56,398 INFO spawned: 'gunicorn-registry' with pid 89 2026-07-13 16:12:56,401 INFO spawned: 'gunicorn-secscan' with pid 90 2026-07-13 16:12:56,403 INFO spawned: 'gunicorn-web' with pid 91 2026-07-13 16:12:56,405 INFO spawned: 'logrotateworker' with pid 92 2026-07-13 16:12:56,408 INFO spawned: 'manifestbackfillworker' with pid 93 2026-07-13 16:12:56,411 INFO spawned: 'manifestsubjectbackfillworker' with pid 94 2026-07-13 16:12:56,413 INFO spawned: 'memcache' with pid 95 2026-07-13 16:12:56,416 INFO spawned: 'namespacegcworker' with pid 96 2026-07-13 16:12:56,419 INFO spawned: 'nginx' with pid 97 2026-07-13 16:12:56,441 INFO spawned: 'notificationworker' with pid 98 2026-07-13 16:12:56,444 INFO spawned: 'proxycacheblobworker' with pid 99 2026-07-13 16:12:56,446 INFO spawned: 'pullstatsredisflushworker' with pid 100 2026-07-13 16:12:56,449 INFO spawned: 'pushgateway' with pid 110 2026-07-13 16:12:56,451 INFO spawned: 'queuecleanupworker' with pid 111 2026-07-13 16:12:56,454 INFO spawned: 'quotaregistrysizeworker' with pid 112 2026-07-13 16:12:56,458 INFO spawned: 'quotatotalworker' with pid 116 2026-07-13 16:12:56,460 INFO spawned: 'reconciliationworker' with pid 118 2026-07-13 16:12:56,463 INFO spawned: 'repositoryactioncounter' with pid 119 2026-07-13 16:12:56,465 INFO spawned: 'repositorygcworker' with pid 121 2026-07-13 16:12:56,513 INFO spawned: 'securityscanningnotificationworker' with pid 122 2026-07-13 16:12:56,546 INFO spawned: 'securityworker' with pid 124 2026-07-13 16:12:56,548 INFO spawned: 'servicekey' with pid 125 2026-07-13 16:12:56,551 INFO spawned: 'storagereplication' with pid 127 2026-07-13 16:12:56,554 INFO spawned: 'teamsyncworker' with pid 128 2026-07-13 16:12:57,641 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,643 INFO success: autopruneworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,643 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,644 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: manifestsubjectbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,645 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: proxycacheblobworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: pullstatsredisflushworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,646 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,647 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,647 INFO success: quotaregistrysizeworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,647 INFO success: quotatotalworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,647 INFO success: reconciliationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,647 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,648 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,648 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,648 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,648 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,648 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2026-07-13 16:12:57,649 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) dnsmasq stderr | dnsmasq: started, version 2.85 cachesize 150 dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth cryptohash DNSSEC loop-detect inotify dumpfile dnsmasq stderr | dnsmasq: reading /etc/resolv.conf dnsmasq stderr | dnsmasq: using nameserver 10.96.0.10#53 dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses nginx stdout | 2026/07/13 16:12:56 [warn] 97#97: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:40 nginx stdout | 2026/07/13 16:12:56 [warn] 97#97: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:67 nginx stdout | 2026/07/13 16:12:56 [warn] 97#97: the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:91 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:40 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:67 nginx stderr | nginx: [warn] the "ssl" directive is deprecated, use the "listen ... ssl" directive instead in /quay-registry/conf/nginx/nginx.conf:91 pushgateway stderr | ts=2026-07-13T16:12:56.544Z level=info caller=main.go:82 msg="starting pushgateway" version="(version=1.11.1, branch=HEAD, revision=aff0d834b730375fc965135e3e2d17d15f82a76f)" pushgateway stderr | ts=2026-07-13T16:12:56.544Z level=info caller=main.go:83 msg="Build context" build_context="(go=go1.24.1, platform=linux/amd64, user=root@672a818fb093, date=20250409-13:24:09, tags=unknown)" pushgateway stderr | ts=2026-07-13T16:12:56.549Z level=info caller=tls_config.go:347 msg="Listening on" address=[::]:9091 pushgateway stderr | ts=2026-07-13T16:12:56.549Z level=info caller=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9091 nginx stdout | 2026/07/13 16:12:56 [alert] 129#129: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 130#130: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 131#131: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 134#134: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 137#137: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 141#141: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 142#142: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 144#144: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 132#132: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 136#136: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 133#133: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 135#135: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 138#138: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 143#143: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 139#139: setpriority(-10) failed (13: Permission denied) nginx stdout | 2026/07/13 16:12:56 [alert] 140#140: setpriority(-10) failed (13: Permission denied) blobuploadcleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git buildlogsarchiver stderr | fatal: not a git repository (or any of the parent directories): .git chunkcleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git expiredappspecifictokenworker stderr | fatal: not a git repository (or any of the parent directories): .git gcworker stderr | fatal: not a git repository (or any of the parent directories): .git exportactionlogsworker stderr | fatal: not a git repository (or any of the parent directories): .git namespacegcworker stderr | fatal: not a git repository (or any of the parent directories): .git logrotateworker stderr | fatal: not a git repository (or any of the parent directories): .git autopruneworker stderr | fatal: not a git repository (or any of the parent directories): .git notificationworker stderr | fatal: not a git repository (or any of the parent directories): .git servicekey stderr | fatal: not a git repository (or any of the parent directories): .git storagereplication stderr | fatal: not a git repository (or any of the parent directories): .git securityworker stderr | fatal: not a git repository (or any of the parent directories): .git quotaregistrysizeworker stderr | fatal: not a git repository (or any of the parent directories): .git repositorygcworker stderr | fatal: not a git repository (or any of the parent directories): .git builder stderr | fatal: not a git repository (or any of the parent directories): .git gunicorn-registry stderr | fatal: not a git repository (or any of the parent directories): .git securityscanningnotificationworker stderr | fatal: not a git repository (or any of the parent directories): .git globalpromstats stderr | fatal: not a git repository (or any of the parent directories): .git nginx stdout | 2026/07/13 16:13:02 [crit] 141#141: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.244.0.44:8443" nginx stdout | 2026/07/13 16:13:02 [error] 141#141: *1 open() "/quay-registry/static/patternfly/quay-registry/static/502.html" failed (2: No such file or directory), client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock/health/instance", host: "10.244.0.44:8443" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:02 +0000] "GET /health/instance HTTP/2.0" 404 146 "-" "kube-probe/1.32" (0.000 47 0.000) gunicorn-web stderr | fatal: not a git repository (or any of the parent directories): .git gunicorn-secscan stderr | fatal: not a git repository (or any of the parent directories): .git proxycacheblobworker stderr | fatal: not a git repository (or any of the parent directories): .git reconciliationworker stderr | fatal: not a git repository (or any of the parent directories): .git manifestsubjectbackfillworker stderr | fatal: not a git repository (or any of the parent directories): .git repositoryactioncounter stderr | fatal: not a git repository (or any of the parent directories): .git queuecleanupworker stderr | fatal: not a git repository (or any of the parent directories): .git pullstatsredisflushworker stderr | fatal: not a git repository (or any of the parent directories): .git manifestbackfillworker stderr | fatal: not a git repository (or any of the parent directories): .git autopruneworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. autopruneworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. quotatotalworker stderr | fatal: not a git repository (or any of the parent directories): .git teamsyncworker stderr | fatal: not a git repository (or any of the parent directories): .git blobuploadcleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. blobuploadcleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. logrotateworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. logrotateworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. chunkcleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. chunkcleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. namespacegcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. namespacegcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. storagereplication stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. storagereplication stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. buildlogsarchiver stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. buildlogsarchiver stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. blobuploadcleanupworker stdout | 2026-07-13 16:13:10,654 [80] [INFO] [apscheduler.scheduler] Scheduler started blobuploadcleanupworker stdout | 2026-07-13 16:13:10,656 [80] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default" repositorygcworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. repositorygcworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. namespacegcworker stdout | 2026-07-13 16:13:11,342 [96] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stdout | 2026-07-13 16:13:11,347 [96] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" namespacegcworker stdout | 2026-07-13 16:13:11,347 [96] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" namespacegcworker stdout | 2026-07-13 16:13:11,348 [96] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" gcworker stdout | 2026-07-13 16:13:11,451 [87] [INFO] [apscheduler.scheduler] Scheduler started gcworker stdout | 2026-07-13 16:13:11,452 [87] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default" buildlogsarchiver stdout | 2026-07-13 16:13:11,762 [82] [INFO] [apscheduler.scheduler] Scheduler started buildlogsarchiver stdout | 2026-07-13 16:13:11,841 [82] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default" exportactionlogsworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. exportactionlogsworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. notificationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. notificationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. globalpromstats stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. globalpromstats stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. nginx stdout | 2026/07/13 16:13:12 [crit] 129#129: *3 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.244.0.44:8443" nginx stdout | 2026/07/13 16:13:12 [error] 129#129: *3 open() "/quay-registry/static/patternfly/quay-registry/static/502.html" failed (2: No such file or directory), client: 10.244.0.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock/health/instance", host: "10.244.0.44:8443" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:12 +0000] "GET /health/instance HTTP/2.0" 404 146 "-" "kube-probe/1.32" (0.000 47 0.000) builder stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. builder stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. repositorygcworker stdout | 2026-07-13 16:13:13,163 [121] [INFO] [apscheduler.scheduler] Scheduler started repositorygcworker stdout | 2026-07-13 16:13:13,241 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" repositorygcworker stdout | 2026-07-13 16:13:13,242 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" repositorygcworker stdout | 2026-07-13 16:13:13,243 [121] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" reconciliationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. reconciliationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. namespacegcworker stdout | 2026-07-13 16:13:13,350 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:13 GMT)" (scheduled at 2026-07-13 16:13:13.348880+00:00) namespacegcworker stdout | 2026-07-13 16:13:13,350 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:13 GMT)" executed successfully expiredappspecifictokenworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. expiredappspecifictokenworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. proxycacheblobworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. proxycacheblobworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. securityscanningnotificationworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. securityscanningnotificationworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. globalpromstats stdout | 2026-07-13 16:13:14,447 [88] [INFO] [apscheduler.scheduler] Scheduler started globalpromstats stdout | 2026-07-13 16:13:14,449 [88] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default" notificationworker stdout | 2026-07-13 16:13:14,653 [98] [INFO] [apscheduler.scheduler] Scheduler started notificationworker stdout | 2026-07-13 16:13:14,655 [98] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" notificationworker stdout | 2026-07-13 16:13:14,655 [98] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" notificationworker stdout | 2026-07-13 16:13:14,655 [98] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" quotaregistrysizeworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. quotaregistrysizeworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. servicekey stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. servicekey stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. quotatotalworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. quotatotalworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-web stdout | 2026-07-13 16:13:15,658 [91] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-web stdout | 2026-07-13 16:13:15,659 [91] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-web stdout | 2026-07-13 16:13:15,661 [91] [INFO] [util.ipresolver] Loading AWS IP ranges from disk expiredappspecifictokenworker stdout | 2026-07-13 16:13:15,943 [85] [INFO] [apscheduler.scheduler] Scheduler started expiredappspecifictokenworker stdout | 2026-07-13 16:13:15,944 [85] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default" manifestbackfillworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. manifestbackfillworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. manifestsubjectbackfillworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. manifestsubjectbackfillworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. 2026-07-13 16:13:16,351 INFO exited: builder (exit status 0; expected) pullstatsredisflushworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. pullstatsredisflushworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-registry stdout | 2026-07-13 16:13:16,559 [89] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-registry stdout | 2026-07-13 16:13:16,560 [89] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-registry stdout | 2026-07-13 16:13:16,562 [89] [INFO] [util.ipresolver] Loading AWS IP ranges from disk securityworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. securityworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. exportactionlogsworker stdout | 2026-07-13 16:13:16,913 [86] [INFO] [apscheduler.scheduler] Scheduler started exportactionlogsworker stdout | 2026-07-13 16:13:16,942 [86] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" exportactionlogsworker stdout | 2026-07-13 16:13:16,943 [86] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" exportactionlogsworker stdout | 2026-07-13 16:13:16,943 [86] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" gunicorn-web stdout | 2026-07-13 16:13:16,954 [91] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:16,954 [91] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:13:16,956 [91] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2026-07-13 16:13:16,956 [91] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-web stdout | 2026-07-13 16:13:16,956 [91] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2026-07-13 16:13:16,956 [91] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2026-07-13 16:13:16,956 [91] [INFO] [data.logs_model] Using logs model `` gunicorn-web stdout | 2026-07-13 16:13:16,957 [91] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2026-07-13 16:13:17,052 [90] [WARNING] [app] 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. gunicorn-secscan stdout | 2026-07-13 16:13:17,053 [90] [WARNING] [app] 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-secscan stdout | 2026-07-13 16:13:17,054 [90] [INFO] [util.ipresolver] Loading AWS IP ranges from disk queuecleanupworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. queuecleanupworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. servicekey stdout | 2026-07-13 16:13:17,112 [125] [INFO] [apscheduler.scheduler] Scheduler started servicekey stdout | 2026-07-13 16:13:17,142 [125] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default" gunicorn-registry stdout | 2026-07-13 16:13:17,551 [89] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-registry gunicorn-registry stdout | 2026-07-13 16:13:17,551 [89] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None gunicorn-registry stdout | 2026-07-13 16:13:17,551 [89] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2026-07-13 16:13:17,551 [89] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-registry stdout | 2026-07-13 16:13:17,552 [89] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2026-07-13 16:13:17,552 [89] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2026-07-13 16:13:17,552 [89] [INFO] [data.logs_model] Using logs model `` gunicorn-registry stdout | 2026-07-13 16:13:17,552 [89] [INFO] [data.logs_model] =============================== teamsyncworker stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. teamsyncworker stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. gunicorn-secscan stdout | 2026-07-13 16:13:17,749 [90] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-secscan gunicorn-secscan stdout | 2026-07-13 16:13:17,749 [90] [INFO] [data.database] Connection pooling disabled for postgresql manifestbackfillworker stdout | 2026-07-13 16:13:17,749 [93] [INFO] [apscheduler.scheduler] Scheduler started gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.secscan_model] Using split secscan model: `[]` gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.logs_model] Using logs model `` gunicorn-secscan stdout | 2026-07-13 16:13:17,750 [90] [INFO] [data.logs_model] =============================== manifestbackfillworker stdout | 2026-07-13 16:13:17,750 [93] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default" manifestsubjectbackfillworker stdout | 2026-07-13 16:13:17,813 [94] [INFO] [apscheduler.scheduler] Scheduler started manifestsubjectbackfillworker stdout | 2026-07-13 16:13:17,841 [94] [INFO] [apscheduler.scheduler] Added job "ManifestSubjectBackfillWorker._backfill_manifest_subject" to job store "default" manifestsubjectbackfillworker stdout | 2026-07-13 16:13:17,842 [94] [INFO] [apscheduler.scheduler] Added job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type" to job store "default" exportactionlogsworker stdout | 2026-07-13 16:13:17,943 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:17 GMT)" (scheduled at 2026-07-13 16:13:17.943073+00:00) exportactionlogsworker stdout | 2026-07-13 16:13:17,955 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:17 GMT)" executed successfully gunicorn-secscan stderr | Traceback (most recent call last): gunicorn-secscan stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-secscan stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-secscan stderr | AssertionError: (None, ) gunicorn-secscan stderr | 2026-07-13T16:13:18Z failed with AssertionError repositoryactioncounter stderr | 🟑🟑🟑 Detected TESTING: true on startup. TESTING property is either missing from config.yaml or set to 'true'. repositoryactioncounter stderr | 🟑🟑🟑 Quay starting in TESTING mode, some functionality such as e-mail sending will not be available. queuecleanupworker stdout | 2026-07-13 16:13:18,153 [111] [INFO] [apscheduler.scheduler] Scheduler started queuecleanupworker stdout | 2026-07-13 16:13:18,154 [111] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default" repositoryactioncounter stdout | 2026-07-13 16:13:18,471 [119] [INFO] [apscheduler.scheduler] Scheduler started repositoryactioncounter stdout | 2026-07-13 16:13:18,472 [119] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default" gunicorn-registry stderr | Traceback (most recent call last): gunicorn-registry stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-registry stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-registry stderr | AssertionError: (None, ) gunicorn-registry stderr | 2026-07-13T16:13:18Z failed with AssertionError gunicorn-web stderr | Traceback (most recent call last): gunicorn-web stderr | File "src/gevent/_abstract_linkable.py", line 287, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-web stderr | File "src/gevent/_abstract_linkable.py", line 333, in gevent._gevent_c_abstract_linkable.AbstractLinkable._notify_links gunicorn-web stderr | AssertionError: (None, ) gunicorn-web stderr | 2026-07-13T16:13:18Z failed with AssertionError notificationworker stdout | 2026-07-13 16:13:21,656 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:21 GMT)" (scheduled at 2026-07-13 16:13:21.655584+00:00) notificationworker stdout | 2026-07-13 16:13:21,665 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:31 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:13:22,494 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.005 162 0.005) gunicorn-registry stdout | 2026-07-13 16:13:22,500 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:22,515 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.003) gunicorn-web stdout | 2026-07-13 16:13:22,517 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:22,529 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:22,529 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:13:22,538 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.075 47 0.074) gunicorn-web stdout | 2026-07-13 16:13:22,543 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:13:22,545 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:22,558 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:13:22,560 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:22,560 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:22,560 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:13:22,573 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:13:22 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:22 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.031 47 0.032) buildlogsarchiver stdout | 2026-07-13 16:13:25,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:13:25 GMT)" (scheduled at 2026-07-13 16:13:25.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:13:25,851 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:13:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:13:28,453 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:13:28 GMT)" (scheduled at 2026-07-13 16:13:28.452639+00:00) gcworker stdout | 2026-07-13 16:13:28,460 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:13:58 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:13:31,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:41 GMT)" (scheduled at 2026-07-13 16:13:31.655584+00:00) notificationworker stdout | 2026-07-13 16:13:31,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:41 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:13:32,555 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 162 0.002) gunicorn-registry stdout | 2026-07-13 16:13:32,557 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:32,570 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:32 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.001) gunicorn-web stdout | 2026-07-13 16:13:32,572 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:32 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:32,573 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:32,573 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:13:32,586 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:13:32 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:32 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.045 47 0.044) namespacegcworker stdout | 2026-07-13 16:13:35,348 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:35 GMT)" (scheduled at 2026-07-13 16:13:35.347846+00:00) namespacegcworker stdout | 2026-07-13 16:13:35,356 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:35 GMT)" executed successfully manifestsubjectbackfillworker stdout | 2026-07-13 16:13:39,842 [94] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:39 GMT)" (scheduled at 2026-07-13 16:13:39.842354+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 16:13:39,850 [94] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:39 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:13:41,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:51 GMT)" (scheduled at 2026-07-13 16:13:41.655584+00:00) notificationworker stdout | 2026-07-13 16:13:41,658 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:13:51 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:13:42,575 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.002) gunicorn-registry stdout | 2026-07-13 16:13:42,577 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:42,593 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:42 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.003 159 0.002) gunicorn-web stdout | 2026-07-13 16:13:42,596 [341] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:42 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:42,609 [341] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:42,609 [341] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:42 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.077 47 0.076) gunicorn-web stdout | 2026-07-13 16:13:42,618 [341] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:13:42 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" repositorygcworker stdout | 2026-07-13 16:13:47,244 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:47 GMT)" (scheduled at 2026-07-13 16:13:47.243386+00:00) repositorygcworker stdout | 2026-07-13 16:13:47,244 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:13:47 GMT)" executed successfully repositorygcworker stdout | 2026-07-13 16:13:48,242 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:48 GMT)" (scheduled at 2026-07-13 16:13:48.242270+00:00) repositorygcworker stdout | 2026-07-13 16:13:48,251 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:48 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:13:48,656 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 16:18:48 GMT)" (scheduled at 2026-07-13 16:13:48.656228+00:00) notificationworker stdout | 2026-07-13 16:13:48,660 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 16:18:48 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:13:51,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:01 GMT)" (scheduled at 2026-07-13 16:13:51.655584+00:00) notificationworker stdout | 2026-07-13 16:13:51,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:01 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:13:52,556 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 162 0.002) gunicorn-registry stdout | 2026-07-13 16:13:52,557 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:52,570 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:13:52 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:13:52,572 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:13:52 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:13:52,572 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:13:52,573 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:13:52,585 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:13:52 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:13:52 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.043 47 0.043) buildlogsarchiver stdout | 2026-07-13 16:13:55,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:25 GMT)" (scheduled at 2026-07-13 16:13:55.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:13:55,844 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:25 GMT)" executed successfully exportactionlogsworker stdout | 2026-07-13 16:13:55,944 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:55 GMT)" (scheduled at 2026-07-13 16:13:55.944092+00:00) exportactionlogsworker stdout | 2026-07-13 16:13:55,944 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:14:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:13:58,452 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:28 GMT)" (scheduled at 2026-07-13 16:13:58.452639+00:00) gcworker stdout | 2026-07-13 16:13:58,453 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:28 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:01,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:11 GMT)" (scheduled at 2026-07-13 16:14:01.655584+00:00) notificationworker stdout | 2026-07-13 16:14:01,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:11 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:02,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:02 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:14:02,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:02 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:02,567 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:02 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.004 159 0.005) gunicorn-web stdout | 2026-07-13 16:14:02,572 [344] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:02 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:02,573 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:02,573 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:14:02,585 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:02 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:02 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.044 47 0.044) manifestsubjectbackfillworker stdout | 2026-07-13 16:14:04,843 [94] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:04 GMT)" (scheduled at 2026-07-13 16:14:04.843019+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 16:14:04,845 [94] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:04 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:06,656 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:06 GMT)" (scheduled at 2026-07-13 16:14:06.656445+00:00) notificationworker stdout | 2026-07-13 16:14:06,656 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:06 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:11,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:21 GMT)" (scheduled at 2026-07-13 16:14:11.655584+00:00) notificationworker stdout | 2026-07-13 16:14:11,658 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:21 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:12,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:12 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.005 162 0.004) gunicorn-registry stdout | 2026-07-13 16:14:12,559 [377] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:12 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:12,571 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:12 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:14:12,572 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:12 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:12,573 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:12,573 [346] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:12 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.047 47 0.047) gunicorn-web stdout | 2026-07-13 16:14:12,588 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:12 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" namespacegcworker stdout | 2026-07-13 16:14:13,349 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:13 GMT)" (scheduled at 2026-07-13 16:14:13.348880+00:00) namespacegcworker stdout | 2026-07-13 16:14:13,349 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:13 GMT)" executed successfully exportactionlogsworker stdout | 2026-07-13 16:14:17,943 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:17 GMT)" (scheduled at 2026-07-13 16:14:17.943073+00:00) exportactionlogsworker stdout | 2026-07-13 16:14:17,945 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:17 GMT)" executed successfully repositorygcworker stdout | 2026-07-13 16:14:21,243 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 16:19:21 GMT)" (scheduled at 2026-07-13 16:14:21.243083+00:00) repositorygcworker stdout | 2026-07-13 16:14:21,247 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2026-07-13 16:19:21 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:21,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:31 GMT)" (scheduled at 2026-07-13 16:14:21.655584+00:00) notificationworker stdout | 2026-07-13 16:14:21,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:31 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:22,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:14:22,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:22,567 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:22 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:14:22,569 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:22 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:22,569 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:22,569 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:14:22,582 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:22 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:22 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.041 47 0.040) buildlogsarchiver stdout | 2026-07-13 16:14:25,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:55 GMT)" (scheduled at 2026-07-13 16:14:25.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:14:25,844 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:14:28,453 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:58 GMT)" (scheduled at 2026-07-13 16:14:28.452639+00:00) gcworker stdout | 2026-07-13 16:14:28,453 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:14:58 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:31,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:41 GMT)" (scheduled at 2026-07-13 16:14:31.655584+00:00) notificationworker stdout | 2026-07-13 16:14:31,658 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:41 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:32,560 [344] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:14:32,562 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:32,574 [344] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:32 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.001) gunicorn-web stdout | 2026-07-13 16:14:32,576 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:32 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:32,587 [344] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:32,587 [344] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:32 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.053 47 0.054) gunicorn-web stdout | 2026-07-13 16:14:32,594 [344] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:32 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" namespacegcworker stdout | 2026-07-13 16:14:35,348 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:35 GMT)" (scheduled at 2026-07-13 16:14:35.347846+00:00) namespacegcworker stdout | 2026-07-13 16:14:35,350 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:35 GMT)" executed successfully manifestsubjectbackfillworker stdout | 2026-07-13 16:14:39,842 [94] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:39 GMT)" (scheduled at 2026-07-13 16:14:39.842354+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 16:14:39,844 [94] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:39 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:41,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:51 GMT)" (scheduled at 2026-07-13 16:14:41.655584+00:00) notificationworker stdout | 2026-07-13 16:14:41,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:14:51 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:42,554 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:14:42,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:42,567 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:42 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.001) gunicorn-web stdout | 2026-07-13 16:14:42,569 [341] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:42 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:42,569 [341] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:42,569 [341] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:14:42,582 [341] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:42 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:42 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.041 47 0.041) repositorygcworker stdout | 2026-07-13 16:14:47,243 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:47 GMT)" (scheduled at 2026-07-13 16:14:47.243386+00:00) repositorygcworker stdout | 2026-07-13 16:14:47,243 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:47 GMT)" executed successfully repositorygcworker stdout | 2026-07-13 16:14:48,242 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:48 GMT)" (scheduled at 2026-07-13 16:14:48.242270+00:00) repositorygcworker stdout | 2026-07-13 16:14:48,244 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:48 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:14:51,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:01 GMT)" (scheduled at 2026-07-13 16:14:51.655584+00:00) notificationworker stdout | 2026-07-13 16:14:51,658 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:01 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:14:52,553 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:14:52,555 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:52,567 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:14:52 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:14:52,568 [344] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:14:52 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:14:52,568 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:14:52,569 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:14:52,581 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:14:52 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:14:52 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.041 47 0.040) buildlogsarchiver stdout | 2026-07-13 16:14:55,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:25 GMT)" (scheduled at 2026-07-13 16:14:55.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:14:55,844 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:25 GMT)" executed successfully exportactionlogsworker stdout | 2026-07-13 16:14:55,944 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:55 GMT)" (scheduled at 2026-07-13 16:14:55.944092+00:00) exportactionlogsworker stdout | 2026-07-13 16:14:55,944 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:15:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:14:58,452 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:28 GMT)" (scheduled at 2026-07-13 16:14:58.452639+00:00) gcworker stdout | 2026-07-13 16:14:58,453 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:28 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:01,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:11 GMT)" (scheduled at 2026-07-13 16:15:01.655584+00:00) notificationworker stdout | 2026-07-13 16:15:01,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:11 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:02,554 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:02 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:15:02,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:02 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:02,567 [341] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:02 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:15:02,569 [344] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:02 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:02,569 [341] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:02,570 [341] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:15:02,582 [341] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:02 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:02 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.041 47 0.041) manifestsubjectbackfillworker stdout | 2026-07-13 16:15:04,843 [94] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:04 GMT)" (scheduled at 2026-07-13 16:15:04.843019+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 16:15:04,844 [94] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_artifact_type (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:04 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:06,656 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:06 GMT)" (scheduled at 2026-07-13 16:15:06.656445+00:00) notificationworker stdout | 2026-07-13 16:15:06,656 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:06 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:11,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:21 GMT)" (scheduled at 2026-07-13 16:15:11.655584+00:00) notificationworker stdout | 2026-07-13 16:15:11,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:21 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:12,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:12 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 162 0.001) gunicorn-registry stdout | 2026-07-13 16:15:12,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:12 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:12,568 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:12 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:15:12,569 [344] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:12 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:12,569 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:12,570 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:15:12,582 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:12 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:12 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.041 47 0.041) namespacegcworker stdout | 2026-07-13 16:15:13,349 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:13 GMT)" (scheduled at 2026-07-13 16:15:13.348880+00:00) namespacegcworker stdout | 2026-07-13 16:15:13,349 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:13 GMT)" executed successfully exportactionlogsworker stdout | 2026-07-13 16:15:17,943 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:17 GMT)" (scheduled at 2026-07-13 16:15:17.943073+00:00) exportactionlogsworker stdout | 2026-07-13 16:15:17,945 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:17 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:21,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:31 GMT)" (scheduled at 2026-07-13 16:15:21.655584+00:00) notificationworker stdout | 2026-07-13 16:15:21,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:31 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:22,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 162 0.001) gunicorn-registry stdout | 2026-07-13 16:15:22,556 [377] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:22 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:22,570 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:22 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.002) gunicorn-web stdout | 2026-07-13 16:15:22,571 [344] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:22 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:22,572 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:22,572 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:15:22,584 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:22 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:22 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.043 47 0.044) buildlogsarchiver stdout | 2026-07-13 16:15:25,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:55 GMT)" (scheduled at 2026-07-13 16:15:25.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:15:25,846 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:15:28,452 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:58 GMT)" (scheduled at 2026-07-13 16:15:28.452639+00:00) gcworker stdout | 2026-07-13 16:15:28,453 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:15:58 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:31,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:41 GMT)" (scheduled at 2026-07-13 16:15:31.655584+00:00) notificationworker stdout | 2026-07-13 16:15:31,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:41 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:32,553 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 162 0.002) gunicorn-registry stdout | 2026-07-13 16:15:32,555 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:32 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:32,568 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:32 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.002 159 0.001) gunicorn-web stdout | 2026-07-13 16:15:32,570 [341] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:32 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:32,570 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:32,570 [346] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2026-07-13 16:15:32,583 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:32 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:32 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.042 47 0.042) namespacegcworker stdout | 2026-07-13 16:15:35,348 [96] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:35 GMT)" (scheduled at 2026-07-13 16:15:35.347846+00:00) namespacegcworker stdout | 2026-07-13 16:15:35,350 [96] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:35 GMT)" executed successfully manifestsubjectbackfillworker stdout | 2026-07-13 16:15:39,842 [94] [INFO] [apscheduler.executors.default] Running job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:39 GMT)" (scheduled at 2026-07-13 16:15:39.842354+00:00) manifestsubjectbackfillworker stdout | 2026-07-13 16:15:39,844 [94] [INFO] [apscheduler.executors.default] Job "ManifestSubjectBackfillWorker._backfill_manifest_subject (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:39 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:41,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:51 GMT)" (scheduled at 2026-07-13 16:15:41.655584+00:00) notificationworker stdout | 2026-07-13 16:15:41,658 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:15:51 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:42,555 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.004 162 0.005) gunicorn-registry stdout | 2026-07-13 16:15:42,560 [375] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:42 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:42,572 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:42 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.002) gunicorn-web stdout | 2026-07-13 16:15:42,573 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:42 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:42,574 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:42,574 [346] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:42 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.046 47 0.046) gunicorn-web stdout | 2026-07-13 16:15:42,586 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:42 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" repositorygcworker stdout | 2026-07-13 16:15:47,243 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:47 GMT)" (scheduled at 2026-07-13 16:15:47.243386+00:00) repositorygcworker stdout | 2026-07-13 16:15:47,244 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:47 GMT)" executed successfully repositorygcworker stdout | 2026-07-13 16:15:48,242 [121] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:48 GMT)" (scheduled at 2026-07-13 16:15:48.242270+00:00) repositorygcworker stdout | 2026-07-13 16:15:48,244 [121] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:48 GMT)" executed successfully notificationworker stdout | 2026-07-13 16:15:51,655 [98] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:16:01 GMT)" (scheduled at 2026-07-13 16:15:51.655584+00:00) notificationworker stdout | 2026-07-13 16:15:51,657 [98] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2026-07-13 16:16:01 GMT)" executed successfully gunicorn-web stdout | 2026-07-13 16:15:52,554 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 162 0.001) gunicorn-registry stdout | 2026-07-13 16:15:52,556 [378] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:52 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:52,567 [346] [WARNING] [py.warnings] /opt/app-root/lib64/python3.12/site-packages/urllib3/connectionpool.py:1097: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings gunicorn-web stdout | warnings.warn( nginx stdout | 127.0.0.1 (-) - - [13/Jul/2026:16:15:52 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.32.3" (0.001 159 0.001) gunicorn-web stdout | 2026-07-13 16:15:52,568 [346] [INFO] [gunicorn.access] 127.0.0.1 - - [13/Jul/2026:16:15:52 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.32.3" gunicorn-web stdout | 2026-07-13 16:15:52,569 [346] [INFO] [data.database] Setting database host to quay-postgres.quay for worker gunicorn-web gunicorn-web stdout | 2026-07-13 16:15:52,569 [346] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 10.244.0.1 (-) - - [13/Jul/2026:16:15:52 +0000] "GET /health/instance HTTP/2.0" 200 152 "-" "kube-probe/1.32" (0.040 47 0.041) gunicorn-web stdout | 2026-07-13 16:15:52,581 [346] [INFO] [gunicorn.access] 10.244.0.1 - - [13/Jul/2026:16:15:52 +0000] "GET /health/instance HTTP/1.0" 200 152 "-" "kube-probe/1.32" buildlogsarchiver stdout | 2026-07-13 16:15:55,842 [82] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:16:25 GMT)" (scheduled at 2026-07-13 16:15:55.842171+00:00) buildlogsarchiver stdout | 2026-07-13 16:15:55,844 [82] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2026-07-13 16:16:25 GMT)" executed successfully exportactionlogsworker stdout | 2026-07-13 16:15:55,944 [86] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:55 GMT)" (scheduled at 2026-07-13 16:15:55.944092+00:00) exportactionlogsworker stdout | 2026-07-13 16:15:55,944 [86] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2026-07-13 16:16:55 GMT)" executed successfully gcworker stdout | 2026-07-13 16:15:58,452 [87] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:16:28 GMT)" (scheduled at 2026-07-13 16:15:58.452639+00:00) gcworker stdout | 2026-07-13 16:15:58,453 [87] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2026-07-13 16:16:28 GMT)" executed successfully