Loadtesting E2Es

[enisdenjo]

• Loadtests are regular tests
  • Loadtest filenames match pattern *.loadtest.ts
• Loadtests is buildless
• Loadtests are isolated, but should NOT run concurrently making sure they don't interfere
• No extra tools, just JavaScript
• Type-safe
• Easy to set up
• Automatic cleanup
• Any E2E and any GraphQL request can be benchmarked
• Expected thresholds are coded in tests
• All loadtest requests must be successful (respond with a 200 OK and not contain any GQL errors)

graphql-mesh/e2e/sqlite-chinook/sqlite-chinook.loadtest.ts

Lines 1 to 44 in c60a4e6

	import os from 'os';
	import { createTbench, Tbench, TbenchResult } from '@e2e/tbench';
	import { createTenv } from '@e2e/tenv';
	const { serve, compose } = createTenv(__dirname);
	let tbench: Tbench;
	beforeAll(async () => {
	tbench = await createTbench(
	// to give space for jest and the serve process.
	os.availableParallelism() - 2,
	);
	});
	const threshold: TbenchResult = {
	maxCpu: Infinity, // we dont care
	maxMem: 300, // MB
	slowestRequest: 0.5, // seconds
	};
	it(`should perform within threshold ${JSON.stringify(threshold)}`, async () => {
	const { output } = await compose({ output: 'graphql' });
	const { maxCpu, maxMem, slowestRequest } = await tbench.serveSustain({
	serve: await serve({ fusiongraph: output }),
	params: {
	query: /* GraphQL */ `
	query Albums {
	albums(limit: 2) {
	albumId
	title
	artist {
	name
	}
	}
	}
	`,
	},
	});
	expect(maxCpu).toBeLessThan(threshold.maxCpu);
	expect(maxMem).toBeLessThan(threshold.maxMem);
	expect(slowestRequest).toBeLessThan(threshold.slowestRequest);
	});

TODO

• Loadtest rest of E2Es

[codesandbox]

Review or Edit in CodeSandbox

Open the branch in Web Editor • VS Code • Insiders

Open Preview

[github-actions]

💻 Website Preview

The latest changes are available as preview in: https://8421a2e7.graphql-mesh.pages.dev

[github-actions]

🚀 Snapshot Release (alpha)

The latest changes of this PR are available as alpha on npm (based on the declared changesets):

Package	Version	Info
@graphql-mesh/json-schema	0.100.7-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎
@graphql-mesh/openapi	0.100.8-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎
@graphql-mesh/raml	0.100.7-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎
@omnigraph/json-schema	0.100.7-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎
@omnigraph/openapi	0.100.8-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎
@omnigraph/raml	0.100.7-alpha-20240514183156-bf92bd7a55730267c588da9d69b37227c33ae841	npm ↗︎ unpkg ↗︎