juriscraper: SCOTUS Blocked

HTTPError: 403 Client Error: Forbidden for url: http://www.supremecourt.gov/oral_arguments/argument_audio.aspx

Sentry Issue: COURTLISTENER-6RW

HTTPError: 403 Client Error: Forbidden for url: http://www.supremecourt.gov/oral_arguments/argument_audio.aspx
(1 additional frame(s) were not displayed)
...
  File "cl/scrapers/management/commands/cl_scrape_opinions.py", line 385, in handle
    self.parse_and_scrape_site(mod, options["full_crawl"])
  File "cl/scrapers/management/commands/cl_scrape_opinions.py", line 348, in parse_and_scrape_site
    site = mod.Site().parse()

About this issue

  • Original URL
  • State: closed
  • Created 4 months ago
  • Comments: 17 (17 by maintainers)

Most upvoted comments

Hm… not sure what was going on but I decided to run a --fullcrawl

www-data@maintenance-wp:/opt/courtlistener$ python manage.py cl_scrape_oral_arguments --courts juriscraper.oral_args.united_states.federal_appellate.scotus --verbosity 2 --fullcrawl INFO Starting up the scraper. INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-976.mp3’ INFO Successfully added audio file 90881: b"Garland, Att’y Gen. v. Cargill" INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/23-3.mp3’ INFO Successfully added audio file 90882: b’Coinbase, Inc. v. Suski’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-7386.mp3’ INFO Successfully added audio file 90883: b’McIntosh v. United States’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-529.mp3’ INFO Successfully added audio file 90884: b’Cantero v. Bank of America, N.A.’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-555.mp3’ INFO Successfully added audio file 90885: b’NetChoice, LLC v. Paxton’ INFO Adding new document found at: b’http://www.supremecourt.gov/media/audio/mp3files/22-277.mp3’ INFO Successfully added audio file 90886: b’Moody v. NetChoice, LLC’ …

and that appears to be enough for now- worth keep an eye on it -

@grossir can you investigate

Looking at oral argument on our site, it seems like it’s not yet resolved or our scraper didn’t work. Our latest:

image

Vs. the SCOTUS website:

image