Add real terminal support #1390
Description
Is your feature request related to a problem? Please describe.
OpenInterpreter currently is unable to interact with common REPL and shell environment in an asynchronous way. It is always blocking.
Describe the solution you'd like
Introducing a fully capable terminal agent environment. Here are few things it can do.
You can see the position of the cursor, the range of the selected text.
You can also capture a screenshot of the terminal with cursor denoted in red.
Grayscale augmented terminal gives high contrast to the red cursor, making the agent easier to locate it.
Would be great if OpenInterpreter adopts this.
Describe alternatives you've considered
OpenDevin has a milestone over this. Devin as shown is already capable of doing this.
Additional context
You can learn more about my efforts here.