Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LLM-SPOT INTEGRATION, WIP, DO NOT REVIEW] Use habitat-llm to call spot-sim2real lls #134

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

jimmytyyang
Copy link
Contributor

To achieve the design of using habitat-llm to call spot-sim2real, we made several design decisions

  • Remove all the dependency of habitat-baselines in spot-sim2real. We are glad that we use torchscript to load skills in spot-sim2real, allowing us to have only one version of habitat-lab and habitat-baselines for habitat-llm.
  • Update the environment yml for habitat-llm. Current spot-sim2real uses python3.8 to run the experiments. However, habitat-sim required by habitat-llm needs python3.9. We bump up the version of python to 3.9 in spot-sim2real. We will test this on hardware on Monday (Feb 5)
  • We are able to run habitat-llm demo code in this new conda env that is compatible with spot-sim2real packages. We will release an installation readme.
  • We will test this pipeline on hardware on Monday (Feb 5)

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants