drone-volume-cache: cache very slow with much files

restoring cache (means copying files from a to b) is very slow when you have much files, in my setup its takes almost 5 minutes. what about tar.gz’ing files and copy and untar?

on my (very slow) testing server:

  • copying node_modules from a to b takes about 5 minutes
  • tar -czf takes about 4 seconds
  • copying a archive is fast

About this issue

  • Original URL
  • State: closed
  • Created 7 years ago
  • Reactions: 1
  • Comments: 16

Most upvoted comments

I’d suggest using https://github.com/drone-plugins/drone-volume-cache/ instead. It uses tar archives, so it only transfers a single file back and forth. The overhead of lots of tiny files is much smaller in that plugin.

It’s not very well documented, but it works in a very similar way to this plugin.