rclone: CRITICAL: Amazon Drive does not work anymore with rclone 429: "429 Too Many Requests" / Rate exceeded
It seems Amazon Drive blocked rclone, I tested it on 4 different servers, tried reauth the app but no success.
Any rclone command will deliver the following errors:
2017/05/18 11:19:14 DEBUG : pacer: Rate limited, sleeping for 666.145821ms (1 consecutive low level retries)
2017/05/18 11:19:14 DEBUG : pacer: low level retry 1/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
About this issue
- Original URL
- State: closed
- Created 7 years ago
- Comments: 93 (8 by maintainers)
F()CK OFF AMAZON, I KNOW YOU READ, F()CK OFF !
I have some emails out to contacts at Amazon asking what has happened. They are on the west coast of the US I think, so they won’t be in to work for a few hours…
@mdubash interesting info - thanks
An employee of Amazon Germany just told me on the phone that they are making changes to their services and infrastructure and that rclone probably needs to be updated accordingly.
EDIT: Scratch that, just got on their support chat to clarify after reading some more comments and the bastards actually terminated support for rclone! Apparently some office-sitter at Amazon is under the impression that informing your own support staff (let alone PAYING CUSTOMERS) about such minor changes as dropping support for an entire goddamn platform is somehow optional.
@ncw Any chance you could lock this issue down for comments from anyone except contributors? It’s gotten out of hand from a discussion standpoint (GitHub should be about the fix). That way users can monitor for new comments to get updates (from only you). Thanks for all the hard work!
If rclone is indeed banned like acd_cli, they can kiss my subscription goodbye (not that they care). This is ridiculous. Perhaps they dont like that rclone security profile keys can be accessed by anyone, as evidenced by those guys trying to impersonate rclone with acd_cli. We must wait to hear what @ncw says as anything else is hearsay.
It would be funny if rclone is banned and acd_cli gets unbanned
The funny thing about their “use our sync client” response is that I tried, I really did, and it is utter garbage. It made my CPU Max out constantly and constantly forgot what it was doing, forcing me to reauth. POS client for an increasingly POS service
I put a post in the forum which I’ll update as and when I hear more info.
~~@ginsu0 Have a look at this https://www.reddit.com/r/AlienBlue/comments/1i13io/subreddit_links_r_and_username_links_u_are/~~
@ginsu0 @SR-G @mmozeiko @thenoahcomputer @thammi @calisro Sorry, I feel dumb now. Correct link: https://www.reddit.com/r/DataHoarder/comments/6bwbst/how_would_you_transfer_8tb_of_linux_isos_from_acd/dhpzcnn/
https://forum.rclone.org/t/rclone-has-been-banned-from-amazon-drive/2314
@ncw i think it might be a good idea to create an “ACD status issue” (or forum post) which is locked and only you can post to, so people can subscribe to that and receive notifications/email updates from you, without all the non-info-comments other random users create.
@geekcroft yes I have. I’d like confirmation though.
@ncw Have you considered authenticating through/using go-acd? That project hosts an open auth server at go-acd.appspot.com.
Amazon has indeed not just changed their API requiring changes in rclone but blocked rclone access. I sent an inquery asking and if this was the case demanded a full refund since my entire use case was mounting with rclone to upload backups taken of my machines to be stored in the cloud.
This was their response:
So if everyone who was using Amazon cloud drive along with rclone demands their money back they might start to listen.
Yes they revoke/banned rclone token
anyone know where the appropriate place is to contact ACD support to beg for a positive outcome is?
@thenoahcomputer I am currently using these services to move data from ACD to Google https://www.cloudhq.net https://www.multcloud.com
@poom - few months now. All the business plans have this and you just have to move a domain over. It took me a few minutes to get it setup.
@Technifocal the fact that very few people know how to do it. Yes, what you describe is indeed entirely viable (not getting into the exact attack vectors, but yes, it does work). But the fact remains there are quite a few other apps still out there that haven’t been banned that avoid using authentication servers.
The entire “banning by app” concept is fundamentally flawed, though, because it is entirely ineffective. The sensible thing to do might be to simply alter the rclone back-end and make it fall back on web-scraping - and unless Amazon are going to kill the web interface they might as well give up at that point.
@poom google does not enforce the limit so even with 1 user you will have unlimited space.
@barnabyc Cloudhq seems to be faster than multcloud, but more expensive. I’m using both in parallel. I guess you could maybe find other cloud transfer companies to run as well if you’re willing to spend the money.
Further discussion of this probably belongs on the forum or gitter since it’s not an rclone issue?
edit: This person’s idea looks promising… https://www.reddit.com/r/DataHoarder/comments/6c7w9j/the_secret_to_moving_rclone_data_off_amazon_cloud/
#1409 #1415 have basically converged into the same issue after all. Leaving a comment for reference’s sake.
I probably got better response because I didn’t ask for support for rclone. I told them I just want my data back and can’t get at it, because they disabled the only apps that would let me do that on Ubuntu. They suggested the web interface, which I told them would just spin it’s wheel and then not download anything.
It’d be ideal if they’d offer a read-only S3 bucket without data charges to get my stuff back so I can just rclone it to Gdrive. The multcloud.com site seems to be working, but significantly slower than rclone.
Wow this is seriously bad timing for me. I was in the process of restoring a backup when acd_cli got disabled, switched to rclone and now it’s disabled too. I’ve emailed Amazon about it, but don’t expect much from them given their recent blatant disregard for their paying customers need to access their own data.
Anyone know of another way to mount or pull files out of ACD with linux or shuffle it over in bulk to gdrive?
@ncw have you seen the forum post from the guy who had a reply from Amazon DE?