vector: Vector cannot handle the throttle exception from Kinesis data stream

A note for the community

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

I use vector to sink the data to Kinesis data stream, some requests are throttled, but vector cannot catch these exception and still return successful response to front-end.

Is it vector issue or any config I can set to handle these exception?

Thanks, Mingtong

Configuration

[sinks.kinesis_sink]
type = "aws_kinesis_streams"
inputs =  ["json_parser"]   
partition_key_field = "timestamp"
compression = "none"
region = "%%AWS_REGION%%"
stream_name = "%%AWS_KINESIS_STREAM_NAME%%"

acknowledgements.enabled = true
  [sinks.kinesis_sink.encoding]
  codec = "json"

Version

0.25.1-debian

Debug Output

No response

Example Data

No response

Additional Context

No response

References

No response

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Comments: 27 (27 by maintainers)

Commits related to this issue

Most upvoted comments

Yes, it is #17535 PR.