willow: Multinet slower than Alexa
While Wakenet is only trivially slower than Alexa, Multinet is perceptible slower.
I timed a very unscientific video of all three turning on my living room lights and here is what I have found:
I have confirmed that the command TURN ON LIVING ROOM LIGHTS is in speech_commands/commands_en.txt.
What else do I need to do in order to improve my multinet speeds?
EDIT: removed movies from automatically showing due to bringing browser to a crawl, hoping links above will still work.
About this issue
- Original URL
- State: closed
- Created a year ago
- Comments: 18 (18 by maintainers)
One clarification - you’re always using Wakenet. Wakenet is for wake word, multinet is for local speech commands, and server/WIS mode is using a Willow Inference Server.
Speaking of which, we will be releasing WIS tomorrow. Our goal is for this to be all local and as right now, if you are using the demo Tovera hosted WIS, you’re just sending your speech to us instead of Amazon. That’s not the goal for this project.
For performance with accuracy WIS strongly prefers CUDA. If you have CUDA hardware on your WIS instance a locally hosted WIS is the most private, fastest, and most reliable of all options. WIS has been highly optimized by us for acceleration on Nvidia hardware going back to Pascal. I’ll be testing, demoing, and documenting CUDA hardware configurations using $100 used GTX hardware later this week. WIS runs on CPU but the performance isn’t any better than other CPU Whisper implementations which is to say it won’t be competing with Alexa for speed and accuracy anytime soon.
WIS released - discuss on HN
It is containerized but setup is a little more involved than
docker run- much like Willow today it is early.Perfect! I’m actually going to be doing benchmarks with my recently ordered GTX 1070 later this week. For new users it’s probably the best bang for the buck right now.
You might have given me reason to dust of my hardly used/old gaming computer…would just want to see how low I could make the energy consumption.