externalize audits so they can be run locally and/or within target library CI/CD

[dariuszkuc]

Story

As a GraphQL library maintainer I would like to be able to run HTTP spec audit locally to ensure my client/server remains compliant with the spec.

Acceptance criteria

• GraphQL library maintainer is able to run HTTP spec audit locally

Related

• Server compliance audit through a website #8
• Apollo Federation Spec Compliance Tools

[enisdenjo]

You already can, see the "Audit for servers usage in Jest environment" recipe.

[dariuszkuc]

Its doable but somewhat clunky -> it implies folks have to write Javascript to run tests (and many libraries are not Javascript based). Ideally they could just run some executable script that gives them the results*.

*Looks like we would also need to generate the report matrix manually as well (example auto generated report apollographql/federation-jvm#290 (comment)).

[enisdenjo]

Ah yes, a CLI. Makes sense! I'll see what I can do.