Benchmarking the cloud using AWS CDK and Serverless Stack.
The goal of this projest is to provide an extensible framework for benchmarking cloud resources and enable developers to make informed decisions about languages, frameworks, etc. The benchmarks will run automatically in the cloud and publish to a website.
The PoC tests different aws-sdk configurations in TypeScript applications. See Csv2Dddb.
Would be good to add other runtimes as well as .js and .mjs for comparison.
The PoC uses nested state machines to spin up function executions in parallel, then fetches xray traces for analysis. Given the wide variety of Step Functions integrations, we should be able to support many different kinds of applications including both synchronous and asynchronous execution.
State Machines are nested because executing all the functions in a single state machine produces a very large xray trace that gets truncated. Is there a better way to do this?
- Implement and test PoC using nested State Machines.
- Write unit tests.
- Store results in a table.
- Aggregate results
- Write results back to a website (using mkdocs?).
- Trigger with EventBridge cron.
- Implement some http patterns.
- Package up as a CDK Construct