Open
Description
We support lws as the default workload, however, most of the cases mutli-hosts is not needed, even with Llama3.1 405B. So maybe this is a better choice, people don't need to lws controller then. However, this leads to the complexities of workload orchestrations.