ha-llmvision: Failed to fetch camera image, No image input provided

First of all, thank you for creating this system! I’m trying it for the first time and got stuck:

Bug Description

I ran action LLM Vision: Stream Analyzer with my Generic Camera which has a stream, and it says no image input provided. I’m clueless. All my cameras are ONVIF with RTSP streams.

Camera entity I tried to use: image

Version: v1.3.1

Service Call

action: llmvision.stream_analyzer
data:
  duration: 5
  max_frames: 3
  include_filename: false
  target_width: 1280
  detail: low
  max_tokens: 100
  temperature: 0.2
  provider: 01JE8YYXHR04KV5JT4W3DSED7K
  message: Describe the image in one short sentence
  image_entity:
    - camera.192_168_68_111

Additional Information

From my understanding, the camera’s image(s) aren’t being fetched successfully.

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Reactions: 1
  • Comments: 29 (10 by maintainers)

Most upvoted comments

Finally get it works… In network settings of home assistant put automatic for local rather than write local ip address and add 127.0.0.1 as trusted proxy in configuration.ylm of home assistant

Thanks for you work !!

I am pretty sure it has something to do with your network setup. I cannot replicate this issue. Feel free to reopen this issue, if you need help!

So very interesting you bring that up because in past i was able to resolve hass from command line in Terminal but now i cannot. I have my dns settings on network interface but when i go to command line and cat /etc/resolv.conf I have following:

nameserver 127.0.0.11 search local.hass.io options timeout:10 ndots:0

so it looks like my nic configurations do not trickle into the OS on hass and when I ping hass, hass.local, hass.newtech.local they all fail.

If i do nslookup with default server it fails. If i change the server to be my internal dns server then resolution works. Trying to figure out how to resolve dns resolution issue.

@vulcanjedi were you able to resolve the original issue? I dont have onvif cameras but I have frigate and reolink doorbell and a another basic webcam in the garage was able to use the LLM stream integration once I was able to affirm my mdns entry LLM showed in the hass logs was failing to fetch. I believe all the analyzer service calls work now…more so than before. I was able to someone pipe the data analyser to another value and then have the default Frigate blueprint notification pull that for the message since all the richer actionable notification automation stuff is in that blueprint and works better.

Incredible work btw and thanks so much. Can’t believe I sat on this so long had no idea needed custom repo url to find first @valentinfrlch