[PATH][PORTALDB][INFRASTRUCTURE] Implement the new Portal DB #400
Description
Objective
Right now, we are living in a way where the configuration of PATH is hosted in raw files in 1password (not even secret manager) and requires a manual upload into K8s
The rest of the codebase related to the actual business (Portal, PHD, PUB, DWH) are completely disjointed from the "new" codebase.
This is a prime forcing function to deploy our new infrastructure.
Origin Document
- DB Migration: https://www.notion.so/buildwithgrove/Portal-DB-Rewrite-224a36edfff6806b9c67dc20b5e1142b
- Infra Migration: https://www.notion.so/buildwithgrove/Infra-Migration-Q3-2025-246a36edfff6807e9e91dff91881e005
Goals
- Move all business logic for PATH and Portal into a single application database
- Bundle the Portal/PATH DB as part of PATH and allow PATH to be run with or without the database
- Enable hot-reloading of PATH configuration that is handled within the database
- Enable business users to manage Portal / Path configuration in a "one-stop-shop"
Deliverables
- Define and implement the Portal/PATH DB on new infrastructure (
grove-main) - Populate the new database with relevant legacy data
- Create scripts to pull relevant onchain data into the Portal DB
- Configure PATH to use the new database (hot reloadable)
- Update/consolidate PHD/PUB into a single repository and to expose the new DB structure (CRUD for every single data element)
- Move PHD/PUB onto new infrastructure and into
buildwithgrove - Update the Portal to use the new DB Schema but maintain its existing functionality
Non-goals / Non-deliverables
- New features or improvements to the Portal UI
General deliverables
- Comments: Add/update TODOs and comments alongside the source code so it is easier to follow.
- Testing: Add new tests (unit and/or E2E) to the test suite.
- Makefile: Add new targets to the Makefile to make the new functionality easier to use.
- Documentation: Update architectural or development READMEs; use mermaid diagrams where appropriate.
Creator: @fredteumer
Co-Owners: @Olshansk