Add PPR evals and fix env loading for agent-eval 0.9.5#92063
Open
Add PPR evals and fix env loading for agent-eval 0.9.5#92063
Conversation
aurorascharff
approved these changes
Mar 29, 2026
Collaborator
Stats from current PR🔴 3 regressions
📊 All Metrics📖 Metrics GlossaryDev Server Metrics:
Build Metrics:
Change Thresholds:
⚡ Dev Server
📦 Dev Server (Webpack) (Legacy)📦 Dev Server (Webpack)
⚡ Production Builds
📦 Production Builds (Webpack) (Legacy)📦 Production Builds (Webpack)
📦 Bundle SizesBundle Sizes⚡ TurbopackClient Main Bundles
Server Middleware
Build DetailsBuild Manifests
📦 WebpackClient Main Bundles
Polyfills
Pages
Server Edge SSR
Middleware
Build DetailsBuild Manifests
Build Cache
🔄 Shared (bundler-independent)Runtimes
📝 Changed Files (4 files)Files with changes:
View diffspages-api-tu..ntime.dev.jsDiff too large to display pages-api-tu..time.prod.jsDiff too large to display pages-turbo...ntime.dev.jsDiff too large to display pages-turbo...time.prod.jsDiff too large to display 📎 Tarball URL |
Collaborator
Failing test suitesCommit: 9972d1b | About building and testing Next.js
Expand output● app-dir - server-action-period-hash › should have same manifest between continuous two builds ● app-dir - server-action-period-hash › should have different manifest between two builds with period hash
Expand output● segment cache (per-page dynamic stale time) › two dynamic pages with different stale times behave independently ● segment cache (per-page dynamic stale time) › per-page value overrides global staleTimes.dynamic regardless of direction
Expand output● app dir - navigation › navigating to dynamic params & changing the casing › should load the page correctly |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Upgrades
@vercel/agent-evalfrom 0.8.0 to 0.9.5. The new version loads.env/.env.localfrom its own cwd (evals/) rather than inheriting from the parent process, so the oldprocess.loadEnvFile()call no longer works. Instead,run-evals.jsnow symlinks the root env files intoevals/before spawning the harness.evals/.envis added to.gitignoreto keep secrets out of the tree.Two new evals exercise PPR knowledge:
agent-041-optimize-ppr-shellchecks that the agent decomposes a monolithicloading.tsxinto granularSuspenseboundaries, andagent-042-enable-pprverifies the agent knows PPR is enabled viacacheComponents: true(not the oldexperimental.pprflag).