vector: Vector cannot handle the throttle exception from Kinesis data stream
A note for the community
- Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
 - If you are interested in working on this issue or have submitted a pull request, please leave a comment
 
Problem
I use vector to sink the data to Kinesis data stream, some requests are throttled, but vector cannot catch these exception and still return successful response to front-end.
Is it vector issue or any config I can set to handle these exception?
Thanks, Mingtong
Configuration
[sinks.kinesis_sink]
type = "aws_kinesis_streams"
inputs =  ["json_parser"]   
partition_key_field = "timestamp"
compression = "none"
region = "%%AWS_REGION%%"
stream_name = "%%AWS_KINESIS_STREAM_NAME%%"
acknowledgements.enabled = true
  [sinks.kinesis_sink.encoding]
  codec = "json"
Version
0.25.1-debian
Debug Output
No response
Example Data
No response
Additional Context
No response
References
No response
About this issue
- Original URL
 - State: closed
 - Created a year ago
 - Comments: 27 (27 by maintainers)
 
Yes, it is #17535 PR.