vector: Vector cannot handle the throttle exception from Kinesis data stream
A note for the community
- Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
- If you are interested in working on this issue or have submitted a pull request, please leave a comment
Problem
I use vector to sink the data to Kinesis data stream, some requests are throttled, but vector cannot catch these exception and still return successful response to front-end.
Is it vector issue or any config I can set to handle these exception?
Thanks, Mingtong
Configuration
[sinks.kinesis_sink]
type = "aws_kinesis_streams"
inputs = ["json_parser"]
partition_key_field = "timestamp"
compression = "none"
region = "%%AWS_REGION%%"
stream_name = "%%AWS_KINESIS_STREAM_NAME%%"
acknowledgements.enabled = true
[sinks.kinesis_sink.encoding]
codec = "json"
Version
0.25.1-debian
Debug Output
No response
Example Data
No response
Additional Context
No response
References
No response
About this issue
- Original URL
- State: closed
- Created a year ago
- Comments: 27 (27 by maintainers)
Yes, it is #17535 PR.