How to create live page of rows in panel

[GlenNicholls]

I am using python to run FPGA builds, using subprocess to run the FPGA build software. These builds can take multiple hours to complete. I decided to use rich's multiple progress bars to display the current build step and the overall progress. I also put a single-line, progress bar with only a TextColumn in the panel. This is cleaned up the 100k+ lines of mostly debug info from running the FPGA tool which is nice because it doesn't mask important warnings or errors in my python code. The panel is used to show the user what's coming out from the subprocess pipe, essentially a terminal view to see that things are still running properly and also provide some insight about where it's at in each step of the build process.

Reference how this looks:

However, I am not quite satisfied with the "terminal view" in the "Running Vivado" panel. One thing I would like to do is have it display more lines that would eventually scroll out of view, similar to what python -m rich.live does, but in a panel instead of a table. I have avoided using a table because as I mentioned, there are 100k+ lines of information that will be displayed and I'm not sure if the table.add_row() method would eventually run into memory issues. I thought about adding more progress instances with TextColumn, but it seems ugly to keep track of lines and propagate them "upwards" row-wise. Anyways, is there a way to accomplish this to look similar to what I have but display more output in the panel?

EDIT: Here is how my code currently looks:

        # progress bar for steps in bar_items
        step_prog = Progress(
            TimeElapsedColumn(),
            SpinnerColumn("dots"),
            TextColumn("On {task.fields[step]}: [purple]{task.description}"),
        )
        step_id = step_prog.add_task("Starting Vivado", step=0)

        # progress bar for terminal output (will be hidden when step is done)
        # disabling markup because it causes live to hang
        term_prog = Progress(TextColumn("{task.description}", markup=False))
        term_id = term_prog.add_task("")

        # progress bar for command
        all_prog = Progress(
            TimeElapsedColumn(),
            BarColumn(),
            TextColumn("{task.percentage:>3.0f}% ({task.completed}/{task.total})"),
            TextColumn("{task.description}"),
        )
        all_id = all_prog.add_task("", total=len(bar_items))

        # use live instance as context manager with progress bars, need
        # this to run multiple bars in parallel
        with Live(
            Group(
                Panel(
                    term_prog,
                    title=bar_title, subtitle=subtitle, border_style="red",
                ),
                step_prog,
                all_prog
            )
        ) as live:
            for line in stdout:
                # irrelevant stuff here for updating step_prog and all_prog
                ...
                # update status of terminal bar only if there's
                # output
                term_prog.update(term_id, description=line, advance=1)
                term_prog.reset(term_id)
                live.refresh()  # to keep up with terminal output