Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add limit to concurrent executions to prevent overrun #12

Open
russbiggs opened this issue Jun 10, 2024 · 1 comment
Open

add limit to concurrent executions to prevent overrun #12

russbiggs opened this issue Jun 10, 2024 · 1 comment

Comments

@russbiggs
Copy link
Member

Currently if the ingestor function take a long time to run (due to an error in the pipeline) there is no limit on the number of concurrent executions, mean the function can scale up and cost a lot.

Configuring a reserved concurrency limit in the CDK configuration should solve this. Currently the function hovers around 30-40 concurrent executions so limiting to 100 would provide a safe ceiling.

@russbiggs
Copy link
Member Author

The reserved_concurrent_executions seems to be the parameter to set in the Function construct.

https://docs.aws.amazon.com/cdk/api/v2/python/aws_cdk.aws_lambda/Function.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant