WSL: file operations fail randomly when many (thousands) files are copied
starting in recent builds, actions involving many (possibly concurrent) file create/copy/move IO randomly fail.
- Your Windows build number: (Type
verat a Windows Command Prompt)
17040 + 17063
- What you’re doing and what’s happening: (Copy&paste specific commands and their output, or include screen shots)
observed in the following cases:
composer installon large projects (f.e. Magento 2.2, involves 42’000 files)bin/magento setup:static-content:deploy(recompiles magento static files, deletes & generates 19’000 files)npm installyarn install(proprietary project, involves 20’000 files)
in all cases the errors are looking similar, but happen randomly (each time with different files/folders) and not always. in all cases, the files actually exist, despite what the error messages say. a 2nd run of the same command sometimes succeeds, sometimes fails at a different place. I’ve never seen failure at the same place.
some examples:
error An unexpected error occurred: "ENOENT: no such file or directory, copyfile '/usr/local/share/.cache/yarn/v1/npm-ckeditor-dev-4.8.0-ab350a8a3e2282ed769b5c9413fcf468d98b5163/plugins/devtools/lang/pt-br.js' -> '/mnt/t/someproject/src/node_modules/ckeditor-dev/plugins/devtools/lang/pt-br.js'".
error An unexpected error occurred: "ENOENT: no such file or directory, copyfile '/usr/local/share/.cache/yarn/v1/npm-lodash-4.17.4-78203a4d1c328ae1d86dca6460e369b57f4055ae/fp/before.js' -> '/mnt/t/someproject/src/nodeodules/sifter/node_modules/lodash/fp/before.js'".
error An unexpected error occurred: "ENOENT: no such file or directory, copyfile '/usr/local/share/.cache/yarn/v1/npm-ckeditor-dev-4.8.0-ab350a8a3e2282ed769b5c9413fcf468d98b5163/plugins/clipboard/lang/ka.js' -> '/mnt/t/someproject/src/node_modules/ckeditor-dev/plugins/clipboard/lang/ka.js'".
[Magento\Framework\Exception\FileSystemException]
Cannot read contents from file "/mnt/t/anotherproject/src/www/pub/static/adminhtml/Magento/backend/de_CH/Yireo_EmailTester2/less/emailtester.css" Warning!file_get_contents(/mnt/t/anotherproject/
src/www/pub/static/adminhtml/Magento/backend/de_CH/Yireo_EmailTester2/less/emailtester.css): failed to open stream: No such file or directory
[Magento\Framework\Exception\FileSystemException]
The path "/mnt/t/anotherproject/src/www/var/view_preprocessed/pub/static/" is not writable
the error also consistently happens when all actions are done on lxfs (i.e. it is not DrvFs related):
[Magento\Framework\Exception\FileSystemException]
Cannot read contents from file "/tmp/test/www/pub/static/frontend/MyTheme/default/fr_CH/My_Ext/css/source/edit.css" Warning!file_get_contents(/tmp/test/www/pub/static/frontend/MyTheme/default/fr_CH/My_Ext/c
ss/source/edit.css): failed to open stream: No such file or directory
disabling windows defender does not make a difference. /mnt/t is a veracrypt container, but this has worked flawlessly on earlier builds. I cannot remember the first build that showed these errors, but they did happen in the current and last insider fast builds.
it seems to be related to some concurrency issues - for bin/magento setup:static-content:deploy one can specify the parallel jobs to use. the more parallel jobs, the higher the chances the error happens: with 6 parallel jobs almost always, with 1 job “never” (at least never observed in 10 test-runs).
the errors are not happening on real metal ubuntu.
- What’s wrong / what should be happening instead:
files should be copied/created 😃
- Strace of the failing command, if applicable: (If
some_commandis failing, then runstrace -o some_command.strace -f some_command some_args, and link the contents ofsome_command.stracein a gist here)
I have not yet managed to catch this in a strace: when using strace, everything is slowed down significantly and all file actions succeed. any pointers on how to narrow this down or even produce a reliable repo are appreciated! using lxfs instead of DrvFs I was able to catch the following error in strace:
[Magento\Framework\Exception\FileSystemException]
Cannot read contents from file "/tmp/test/www/pub/static/frontend/Magento/blank/de_CH/mage/gallery/gallery.css" Warning!file_get_contents(/tmp/test/www/pub/static/frontend/Magento/blank/de_CH/mage/gallery/gallery.css): failed to open stream: No such file or directory
unfortunately it’s not showing anything interesting:
...
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 <... access resumed> ) = -1 ENOENT (No such file or directory)
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_Customer/web/css", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 time( <unfinished ...>
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_Downloadable/web/css", <unfinished ...>
7885 <... time resumed> NULL) = 1513968596
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 lstat("/tmp/test/www/pub/static/frontend/Magento/blank/de_CH/mage/gallery/gallery.css", <unfinished ...>
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GiftCard/web/css", <unfinished ...>
7885 <... lstat resumed> 0x7fffed975890) = -1 ENOENT (No such file or directory)
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 lstat("/tmp/test/www/pub/static/frontend/Magento/blank/de_CH/mage/gallery", <unfinished ...>
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GiftCardAccount/web/css", <unfinished ...>
7885 <... lstat resumed> {st_mode=S_IFDIR|0775, st_size=4096, ...}) = 0
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 openat(AT_FDCWD, "/tmp/test/www/pub/static/frontend/Magento/blank/de_CH/mage/gallery/gallery.css", O_RDONLY <unfinished ...>
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GiftMessage/web/css", <unfinished ...>
7885 <... openat resumed> ) = -1 ENOENT (No such file or directory)
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GiftRegistry/web/css", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GiftWrapping/web/css", <unfinished ...>
7885 write(4, "\n", 1 <unfinished ...>
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 <... write resumed> ) = 1
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_GroupedProduct/web/css", <unfinished ...>
7885 pipe( <unfinished ...>
7886 <... stat resumed> {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
7885 <... pipe resumed> [7, 8]) = 0
7886 stat("/tmp/test/www/vendor/magento/theme-frontend-blank/Magento_Invitation/web/css", <unfinished ...>
...
About this issue
- Original URL
- State: closed
- Created 9 years ago
- Reactions: 5
- Comments: 18
I am still facing the same issue, this should be reopened.
I also get this problem with large yarn installs. Unfortunately it’s also with proprietary projects but I’m happy to spend the time to track it down if someone wants to give directions.
Yep. You can confirm by doing an
strace -f -o npm.strace npm ...and then grep for theEACCES. But I don’t recommend it. The sequence of events leading to the fail can be nontrivial depending on whatnpmspawns and what else is happening in your Node ecosystem (either directly or indirectly), and going through the exercise mostly leads to a feeling of sadness inside. This is a well trodden road, and the probability of finding a new WSL actionable is (let’s call it) “low”.Facing the same issue as @tmcdonnell87 on Windows build 17134.285 It makes WSL useless to me.
^— that’s #1529