OpenVoiceOS
Replies: 6 comments 3 replies
-
|
not a huge fan of wyoming protocol, in OVOS we support satellites via the companion project hivemind the idea has floated around for making a wyoming bridge HiveMindInsiders/feature-tracker#2 and also to look into updating the firmware for speaking native hivemind HiveMindInsiders/feature-tracker#3 nothing concrete is planned, but i would love to see all that hardware working with OVOS! |
Beta Was this translation helpful? Give feedback.
-
|
I am only asking about supporting the hardware (i.e. the "FutureProofHomes Satellite1 HAT Board"), so not asking about Wyoming support. So just to clarify Wyoming protocol support is totally off-topic and has absolutely nothing directly to do with with this suggestion/question. |
Beta Was this translation helpful? Give feedback.
-
|
wyoming is relevant as mentioned in HiveMindInsiders/feature-tracker#2 the better but more time consuming approach will require updating the firmware to remove wyoming, a adapter can be made to translate wyoming to Hivemind/OVOS which should in theory allow all the wyoming satellites out there to just work without changing firmware, not as secure and introduces latency etc, but accounts for the users that want to use the stock firmware |
Beta Was this translation helpful? Give feedback.
-
|
Very interesting device! Will for sure check it out. If it basically rpi zero, I do hae good hope it can be setup as OVOS / Hivemind satelite which opens up another market for the device. |
Beta Was this translation helpful? Give feedback.
-
|
Note! I am only suggesting to add support for FutureProofHomes Satellite1 HAT Board hardware to the OpenVoiceOS operatingsystem. As in using the FutureProofHomes Satellite1 HAT Board as a microphone/speaker hardware with a Raspberry Pi Zero running OpenVoiceOS. Today they only offer it with their own ESP32-based "compute board" but you can replace that with any Raspberry Pi Zero compatible board: https://futureproofhomes.net/products/satellite1-pcb-dev-kit Satellite1 HAT Board:Satellite1 HAT Board features 4 high-performance microphones powered by an XMOS audio processing chip, enabling clear audio capture even in noisy environments. Additionally, the HAT boasts 4 programmable buttons, a headphone jack, and a robust 25W speaker amplifier. It even acts as a multi-sensor by measuring room temperature, humidity, luminosity, and presence when paired with a mmWave radar sensor.
|
Beta Was this translation helpful? Give feedback.
-
|
FYI; since it is based on XMOS XU316 advanced DSP microcontroller for audio input and output you can for a DIY setup alternativly also test the similar stand-alone USB-microphone solution with the “ReSpeaker Lite 2-Mic Array” (from Seeed Studio) that can connect direct to a computer: More in their wiki : and GitHub repo Seeed Studio currently sells three different "ReSpeaker Lite" variants and kits containing different components in combination with a board, and note that you can also add speaker and a basic enclosure to each kit to get a stand-alone setup, (as well as a computer like a Raspberry Pi Zero):
All the "ReSpeaker Lite" kits use a solution that is designed to combine an XMOS XU-316 AI (xCORE XU316) which is a dedicated DSP (Digital Signal Processor) Audio Processor Microcontroller IC chipset which can act as a audio co-processor (i.e. onboard sound-card) for all type of advanced on-device sound and voice processing with an ESP32-S3 that can be used to run ESPHome firmware to allow for Voice and Assist integration with Home Assistant integration, and they have a wiki with instructions on how to set it up (though unclear if and how that setup is utilized the XMOS chip for advanced audio processing): The XMOS xCORE DSP chip acts like sound-card co-processor adding in-line off-loading of audio noise removal (voice clean-up) from the microphone(s), like Interference Cancellation (IC), Acoustic Echo Cancellation (AEC), Noise Suppression (NS), and Automatic Gain Control, etc. and/and other audio post-processing algorithms to improve the solution’s voice recognition capabilities). (Depending on which XMOS chip they use their XCORE-VOICE framework could technically also allow also for up to 16 PDM microphones to be connected to a single xCORE device with a different PCB design). Note that these “ReSpeaker Lite” kits (all three available via the same webpage) seem to specifically be targeting ESPHome voice-assistant developers and early-adopter tinkerers, and currently looks to be available as a full development-kit that including an ESP32-S3 based board (Seeed Studio’s XIAO ESP32S3) with simple acrylic enclosure and a speaker or a smaller DIY-kit that only includes the ReSpeaker Lite board where to user will needs to add their own MCU board, SBC or other computer using I2S and/or USB connections, as well as a larger third-kit that include both those two kits. Both the boards have on-board dual-microphone array (2-Mic Array) for far-field voice control interaction, and it says that these kits support custom firmware updates via DFU-Util (though unclear if that includes firmware and/or configuration for the XMOS as well), and it also features an stereo audio output jack for connecting external (Hi-Fi) speakers. Seeed Studio published these videos showing the stand-alone ESP32 model and the USB model: https://www.youtube.com/watch?v=C2pXledr8kM https://www.youtube.com/watch?v=I9KOY2ik5nw PS: CNX Software has a nice summary blog article with details on the technical hardware specification: |
Beta Was this translation helpful? Give feedback.
-
|
Tip regarding "ReSpeaker Lite" is to check out the 3D-print enclodure from the formatBCE's Koala Satellite project based on Respeaker Lite: Not sure if it would fit a Raspberry Pi Zero out-of-the-box but might be able to modify the design to fit a Raspberry Pi Zero instead of ESP32? https://github.com/formatBCE/Koala-Satellite/tree/main/casing Parts and tools needed are: Parts used
Tools used
|
Beta Was this translation helpful? Give feedback.
-
|
The specifications look great and we do know the XMOS chips. The SJ-201 HAT used within the Mycroft Mark2 device is based on their (now rather old) VocalFusion 3510 INT chip for which I wrote the linux driver for the newer linux kernel a while back. Looks like I have some research, reading and digging to do the upcoming days. |
Beta Was this translation helpful? Give feedback.
-
|
From my own research I believe that they are all using the XU316-1024-QF60B family of chips, as that chip is native 3.3v IO (which is same as an ESP32), specifically the ”XU316-1024-QF60B-C32" SKU of the XMOS xCORE AI chips because the "C32" models offer 3200 MIPS in performance compared to 2400 MIPS of "C24" models. https://www.xmos.com/file/xu316-1024-qf60a-xcore_ai-datasheet?version=latest https://www.xmos.com/download/XU316-1024-QF60A-xcore_ai-Datasheet(26).pdf A good start could also be to take a look at the XMOS's "XK-VOICE-L71 Voice Reference Design Evaluation Kit" as almost all of these projects are using as a reference design because it is very well documented and tested: https://www.xmos.com/xk-voice-l71 https://www.xmos.com/file/xu316-1024-qf60a-datasheet/?version=latest https://www.xmos.com/file/xk-voice-l71-hardware-manual/?version=latest https://www.xmos.com/file/xk-voice-l71-pcb-design-files/?version=latest https://www.xmos.com/download/XVF3610-User-Guide(v5_7_3).pdf |
Beta Was this translation helpful? Give feedback.
-
Any plans to make an image supporting OpenVoiceOS (on Raspberry Pi Zero) with the FutureProofHomes Satellite1 HAT Board hardware?
https://github.com/orgs/FutureProofHomes/discussions/24
https://futureproofhomes.net/products/satellite1-pcb-dev-kit
https://github.com/FutureProofHomes/Satellite1-Hardware
mp4_hero_480_frames.mp4
FutureProofHomes are also working on enclosures and 3D-print enclodure designs;:
https://futureproofhomes.net/pages/satellite1-enclosure
https://docs.futureproofhomes.net/satellite1-dev-kit-enclosure/
I understand the FutureProofHomes Satellite1 HAT Board hardware will technically be able use a Raspberry Pi Zero as a compute board but not heard of any plans to develop their own operating-system image themself as they instead pointed to rhasspy's wyoming-satellite repo for those wanting to use Raspberry Pi:
...as well as working on their own ESPHome firmware image for their ESP32 board based on the Home Assistant Voice PE reference hardware:
PS: Noticed that FutureProofHomes had a preview video on YouTube mentioning an early prototype of their project as "HomeX" when they at that time has based their prototype on the wyoming-satellite platform running on a Raspberry Pi instead of the released dev kit which instead by default comes with an ESP32 compute board flashed with Nabu Casa's upcoming ESPHome-based voice-kit hardware platform but still using an XMOS xCORE chip for audio processing:
https://www.youtube.com/watch?v=dRTLjQHfjSM
Beta Was this translation helpful? Give feedback.
All reactions