Skip to content

limit concurrent downloads per user and queue the rest - #341

Closed
grojeda wants to merge 1 commit into
mainfrom
feature/9085-per-user-download-limit
Closed

limit concurrent downloads per user and queue the rest#341
grojeda wants to merge 1 commit into
mainfrom
feature/9085-per-user-download-limit

Conversation

@grojeda

@grojeda grojeda commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

A user (identified by their recipient email) can now have at most 10 downloads in flight at once; anything beyond that is queued inside ogcapi and submitted to AWS Batch automatically as their slots free, rather than rejected — a queued download still gets a job ID and answers on the status endpoint. A slot stays occupied for the whole workflow (the master job plus the prepare/collect children DAS spawns), counted from one cached sweep of the Batch queues shared by all users. The execute and status responses gain queued and queuePosition so the portal can show the queued state without parsing message text; both additions are backwards compatible. Configurable under aws.batch.job.user-limitmax-concurrent defaults to 10, enabled: false turns it off. Note the recipient email is not authenticated, so this is a fairness mechanism rather than a security control.

@grojeda
grojeda requested a review from NekoLyn August 31, 2026 02:44
@grojeda
grojeda marked this pull request as ready for review August 31, 2026 02:45
@grojeda grojeda closed this Aug 31, 2026
@grojeda
grojeda deleted the feature/9085-per-user-download-limit branch August 31, 2026 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant