juriscraper: SCOTUS Blocked
HTTPError: 403 Client Error: Forbidden for url: http://www.supremecourt.gov/oral_arguments/argument_audio.aspx
Sentry Issue: COURTLISTENER-6RW
HTTPError: 403 Client Error: Forbidden for url: http://www.supremecourt.gov/oral_arguments/argument_audio.aspx
(1 additional frame(s) were not displayed)
...
File "cl/scrapers/management/commands/cl_scrape_opinions.py", line 385, in handle
self.parse_and_scrape_site(mod, options["full_crawl"])
File "cl/scrapers/management/commands/cl_scrape_opinions.py", line 348, in parse_and_scrape_site
site = mod.Site().parse()
About this issue
- Original URL
- State: closed
- Created 4 months ago
- Comments: 17 (17 by maintainers)
Hm… not sure what was going on but I decided to run a
--fullcrawlwww-data@maintenance-wp:/opt/courtlistener$ python manage.py cl_scrape_oral_arguments --courts juriscraper.oral_args.united_states.federal_appellate.scotus --verbosity 2 --fullcrawl INFO Starting up the scraper. INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-976.mp3’ INFO Successfully added audio file 90881: b"Garland, Att’y Gen. v. Cargill" INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/23-3.mp3’ INFO Successfully added audio file 90882: b’Coinbase, Inc. v. Suski’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-7386.mp3’ INFO Successfully added audio file 90883: b’McIntosh v. United States’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-529.mp3’ INFO Successfully added audio file 90884: b’Cantero v. Bank of America, N.A.’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-555.mp3’ INFO Successfully added audio file 90885: b’NetChoice, LLC v. Paxton’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-277.mp3’ INFO Successfully added audio file 90886: b’Moody v. NetChoice, LLC’ …
and that appears to be enough for now- worth keep an eye on it -
@grossir can you investigate
Looking at oral argument on our site, it seems like it’s not yet resolved or our scraper didn’t work. Our latest:
Vs. the SCOTUS website: