wyoming-satellite: satellite gets stuck after only 1 wake word detection
Hello,
I built wyoming-satellite and I run it this way:
/opt/wyoming-satellite# script/run --name "my satellite" --uri tcp://0.0.0.0:10700 --mic-command "arecord -D plughw:CARD=seeed8micvoicec,DEV=0 -r 16000 -c 1 -f S16_LE -t raw" --snd-command "aplay -D plughw:CARD=seeed8micvoicec,DEV=1 -r 22050 -c 1 -f S16_LE -t raw" --awake-wav sounds/awake.wav --detection-command examples/commands/detection.sh --wake-refractory-seconds 0 --debug
I’m using a custom wakeword (Google colab) and it works fine; but it only works “once” I mean:
- I start the satellite process with the above command line
- I wait for it to start
- Then I say the wakeword “hé chou pee”
- The satellite activates, plays the sound (-awake-wav) and wait for my command
- The command is recognized (STT --> ASR --> Intent) and gets executed
- The audio feedback (TTS) is sent back to the satellite and I can hear it
And that’s it. I am unable to get the wakeword activating again without killing and restarting the satellite process. After restarting; it works (for 1 time) etc…
NB: I had the same result when using standard wakewords (hey_rhasspy, hey_jarvis, etc…)
Here are DEBUG logs of my satellite:
DEBUG:root:Namespace(mic_uri=None, mic_command='arecord -D plughw:CARD=seeed8micvoicec,DEV=0 -r 16000 -c 1 -f S16_LE -t raw', mic_command_rate=16000, mic_command_width=2, mic_command_channels=1, mic_command_samples_per_chunk=1024, mic_volume_multiplier=1.0, mic_noise_suppression=0, mic_auto_gain=0, mic_seconds_to_mute_after_awake_wav=0.5, mic_no_mute_during_awake_wav=False, mic_channel_index=None, snd_uri=None, snd_command='aplay -D plughw:CARD=seeed8micvoicec,DEV=1 -r 22050 -c 1 -f S16_LE -t raw', snd_command_rate=22050, snd_command_width=2, snd_command_channels=1, snd_volume_multiplier=1.0, wake_uri=None, wake_word_name=[], wake_command=None, wake_command_rate=16000, wake_command_width=2, wake_command_channels=1, wake_refractory_seconds=0.0, vad=False, vad_threshold=0.5, vad_trigger_level=1, vad_buffer_seconds=2, vad_wake_word_timeout=5.0, event_uri=None, startup_command=None, detect_command=None, detection_command='examples/commands/detection.sh', transcript_command=None, stt_start_command=None, stt_stop_command=None, synthesize_command=None, tts_start_command=None, tts_stop_command=None, tts_played_command=None, streaming_start_command=None, streaming_stop_command=None, error_command=None, connected_command=None, disconnected_command=None, awake_wav='sounds/awake.wav', done_wav=None, uri='tcp://0.0.0.0:10700', name='my satellite', area=None, no_zeroconf=False, zeroconf_name=None, zeroconf_host=None, debug_recording_dir=None, debug=True, log_format='%(levelname)s:%(name)s:%(message)s')
INFO:root:Ready
DEBUG:root:Detected IP: 192.168.1.244
DEBUG:root:Zeroconf discovery enabled (name=6c21a2437eae, host=None)
DEBUG:root:Connecting to mic service: ['arecord', '-D', 'plughw:CARD=seeed8micvoicec,DEV=0', '-r', '16000', '-c', '1', '-f', 'S16_LE', '-t', 'raw']
DEBUG:root:Connecting to snd service: ['aplay', '-D', 'plughw:CARD=seeed8micvoicec,DEV=1', '-r', '22050', '-c', '1', '-f', 'S16_LE', '-t', 'raw']
INFO:root:Connected to services
DEBUG:root:Connected to mic service
Recording raw data 'stdin' : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
DEBUG:root:Server set: 34436877217185
INFO:root:Connected to server
INFO:root:Streaming audio
DEBUG:root:Event(type='run-pipeline', data={'start_stage': 'wake', 'end_stage': 'tts', 'restart_on_end': True, 'snd_format': {'rate': 22050, 'width': 2, 'channels': 1}}, payload=None)
DEBUG:root:Ping enabled
DEBUG:root:Wake word detected
DEBUG:root:Running ['examples/commands/detection.sh']
Wake word detected: éh_chou_pee
DEBUG:root:Muting microphone for 0.8995918367346939 second(s)
DEBUG:root:Connected to snd service
Playing raw data 'stdin' : Signed 16 bit Little Endian, Rate 22050 Hz, Mono
DEBUG:root:Unmuted microphone
DEBUG:root:Event(type='transcript', data={'text': ' Allume la cuisine !'}, payload=None)
INFO:root:Streaming audio
DEBUG:root:Event(type='synthesize', data={'text': 'Allumé', 'voice': {'name': 'fr_FR-siwis-low'}}, payload=None)
DEBUG:root:Connected to snd service
Playing raw data 'stdin' : Signed 16 bit Little Endian, Rate 22050 Hz, Mono
What did I do wrong please ?
Hardware:
- Model: Seeed studio Respeaker core 2
- Linux speaker-salon.maison.lan 4.4.138-respeaker-r0 #2 SMP Wed Jul 25 11:29:18 CST 2018 armv7l GNU/Linux
- 4x ARMv7 Processor rev 5 (v7l)
- 1024 system memory
- 16GB (sdcard)
Thank you for your help 😃
Best regards
About this issue
- Original URL
- State: open
- Created 3 years ago
- Reactions: 2
- Comments: 21
Hi @synesthesiam, It seems there are several people facing the “keyword spotting only work once” issue
Can we kindly ask you for some support on this please? 🙏 Best regards
Additional context:
I’m following https://www.youtube.com/watch?v=eTKgc0YDCwE&list=WL&index=54 with the same hardware:
Additional logs:
I added
>>>to theexamples/commandsto make then easier to be viewed:Only the called commands logs:
And this is my service definition:
Hopefully @synesthesiam can take a look at this 🙏
Similar issue here, in debug mode it only responds to wake word one time and gets stuck. The satellite is configured in Home Assistant. I’m using most of the defaults from the tutorial since I have the same hardware wyoming-satellite v1.2.0 wyoming-openwakeword v1.10.0 Home Assistant v2024.5.4 (docker)
Hello, I had a similliar issue, but just getting detected once, without ever executing any commands. I managed to locate the problem with Speech To Text in homeassistant logs.
Steps I took to fix it:
Not sure if all of the above is needed, but the core of the issue for me was not having a Speech to text agent configured, which made the service stuck in listening mode.
#87 I suppose this could be the same issue as I had.
Hi all, I did some more tests with ESP32-S3-BOX-3 (tutorial link)
So the device is using the same Home Assistant setup than the one I used with wyoming-satellite: wyoming openwakeword (still with my custom wakeword)
Only difference is that I replaced wyoming-satellite by an SP32-S3-BOX-3
And with this setup; I’m able to trigger the wakeword several times without having to restart anything. So I think Home Assistant setup + wyoming-openwakeword are working correctly and I think there is a problem with the configuration of my wyoming-satellite. But what can be the problem ? Really need some feedback on this please 😃
NB: In case it can help: I’m using docker version of Home Assistant and wyoming-openwakeword
Thank you for your help Best regards