data-prepper: [BUG] Flaky tests high-level tracking

Describe the bug Running the data-prepper build and github actions frequently has failing flaky tests, and often requires retrying the tests multiple times before it succeeds. This issue is meant to allow easy tracking of these flaky tests, by adding an item to the checklist when a flaky test is seen.

Flaky tests

About this issue

  • Original URL
  • State: open
  • Created 3 years ago
  • Comments: 25 (24 by maintainers)

Most upvoted comments

RDS now has a flaky test:

> Task :data-prepper-plugins:rds-source:test

ExportSchedulerTest > test_shutDown() FAILED
    org.mockito.exceptions.verification.NoInteractionsWanted at ExportSchedulerTest.java:271

https://github.com/opensearch-project/data-prepper/actions/runs/11172396206/job/31058770072?pr=5021

@oeyh , Can you look at this one?

DataFileSchedulerTest > test_shutdown() FAILED
    org.mockito.exceptions.verification.NoInteractionsWanted: 
    No interactions wanted here:
    -> at org.opensearch.dataprepper.plugins.source.rds.export.DataFileSchedulerTest.test_shutdown(DataFileSchedulerTest.java:197)
    But found this interaction on mock 'sourceCoordinator':
    -> at org.opensearch.dataprepper.plugins.source.rds.export.DataFileScheduler.run(DataFileScheduler.java:107)
    Actually, above is the only interaction with this mock.

https://github.com/opensearch-project/data-prepper/actions/runs/12371897788/job/35401071596?pr=5268

> Task :data-prepper-plugins:rds-source:test

StreamSchedulerTest > test_shutdown() FAILED
    org.mockito.exceptions.verification.NoInteractionsWanted at StreamSchedulerTest.java:118

@oeyh , Here is another failure in RDS.