LUIS for XR is a reference implementation for Natural Language Understanding in XR applications using LUIS.
For an overview of Natural Language and why it's more powerful than traditional voice commands, please see:
Natural Language for Simulations
This reference is easy to use and is distributed as a Unity Package. For a complete step-by-step guide on how to get started using it in your own applications, please see the article:
- Unity 2017.2 or later
.NET 4.6under player settings.NET backendunder player settings
Though you will see "Mixed Reality" mentioned throughout this reference, it is not exclusive to Windows Mixed Reality devices. This code will work with all Unity projects that support .NET 4.6. The only exception to this rule is the Luis Dictation Manager which needs Windows 10 APIs to access the microphone. This component is optional and will work on all devices that run Windows 10, including HoloLens.
The earliest prototype of this project was developed during an internal Microsoft hack in December 2017. That team consisted of Adina Shanholtz, Anna Fear and David Douglas. The Reference Architecture here evolved out that prototype during a Microsoft + Partner hack in February 2018. The primary contributors to this reference included Jared Bienz from Microsoft, Michael House from Object Theory and Stephen Hodgson from Valorem.