cypress: unusually slow tests & unplayable videos after upgrading to 8.7
Current behavior
after upgrading from cypress 8.3.1 to 8.7.0, tests started running extremely slow in CI. previously a run was about 15 minutes, now it takes over 30 minutes and sometimes times out.
furthermore, the videos generated by cypress are not playable. i can open or download them, but 90% of the video is just a frozen screen. attaching an example.
if i downgrade to 8.6, the issues still persist (the video issue is different, shows error instead, this issue was fixed in 8.7.0 according to the release logs). if i downgrade to 8.5, everything works fine.
as far as i can tell, there are no issues running tests locally. also as far as i can tell, there are no error messages or logs displayed.
https://user-images.githubusercontent.com/2622838/139847729-878b53c3-ac43-4c36-bdd2-a13689727785.mp4
Desired behavior
tests should run normally and videos should be playable, like on cypress 8.5.0.
Test code to reproduce
i don’t know how to provide a reproducible example. my code is proprietary and the CI environment would have to be recreated.
please let me know what other info i could provide.
i’m hoping that others are facing the same issues and we would be able to come up with a reproducible example together.
Cypress Version
8.7.0
Other
i’m running cypress in CI via cypress-io/github-action@v2. here’s my cypress.yaml:
- name: Run cypress tests
uses: cypress-io/github-action@v2
with:
start: yarn serve -s build -l 3000
wait-on: "http://localhost:3000"
working-directory: frontend
record: true
parallel: true
# tag will be either "push" or "pull_request"
# https://github.com/cypress-io/github-action/issues/124#issuecomment-653180260
tag: ${{ github.event_name }}
# we have already installed all dependencies above
install: false
# only run integration tests
spec: cypress/specs/integration/**/*.spec.js
About this issue
- Original URL
- State: open
- Created 3 years ago
- Reactions: 14
- Comments: 24 (4 by maintainers)
We have encountered the same issue, will have to rollback. Here are some numbers from our projects:
How come Cypress team still not solving this issue? It seems that from some 8.x version things started getting worse and worse (some would even say things got slower in one of the 7.x) We’re using 8.5.0 and we can’t upgrade for months now, and it seems to affect tons of other companies, also.
We’ve encountered similar issues. Downgrading to 8.3 solved it. Also using cypress.io to upload the videos.
We are facing the same issues both in terms of slower performance after upgrading to Cypress 8.7 - and only on the CI. The same problems are present in Cypress after upgrading to Cypress 9.0. Therefore we decide to stick with 8.4 where videos are working and performance is OK.
Here are links to videos not working (we are only recording videos on failing tests) https://dashboard.cypress.io/projects/ry3x7y/runs/963/specs Here is a link to our repository https://github.com/equinor/fusion-bmt/tree/master/frontend/cypress
using 9.6.1. Cypres .type() is very slow. Further, after a while website says unusual traffic detected from browser. Using electron.
Sadly I cannot reproduce such a big win with this param. We use 4 test execution machines and run ~800 tests within ~200 specs. Our differences are neglible. The best win so far was removing the cypress-terminal-report plugin…
Additionally I tested the NO_COMMAND_LOG option in a very basic setup (no TypeScript, no plugins) with a bunch of the included Cypress demo tests. I couldn’t see any improvement there and since I had the option, I also tried out older versions. Funny thing: I went back to Version 6.3 and 8.7 as well but Cypress 9.5.1. was the fastest overall (not much faster, but definitely not slower). So my guess is that probably some preprocessors/plugins combined with newer versions of bundled Electron might cause the performance issues?
Here’s the repo with some results… pretty messy code, didn’t cleanup much: https://github.com/mirobo/cypress-perf And a lot of runs on Windows with 8.3.1, 9.5.0 and 9.5.1: https://github.com/mirobo/cypress-perf/blob/master/run-stats.csv (I don’t see a notable difference between the different versions).
I can confirm both the video issue and the slow tests happening on my end as well. Also a proprietary codebase so, unfortunately, cannot share. We are considering downgrading to
8.3.0.This was also noted here: https://github.com/cypress-io/cypress/issues/18564
Hi, I am using cypress 9.6.1 with docker image cypress/base:16.13.0 and it slows down the tests drastically increased execution time from 10mins to 1hour. its really sad thing to see, could you please help me with it or am I using wrong docker with wrong versions