twitter-scraper: JSONDecodeError + 400 error when using get_tweets()
Code used:
import twitter_scraper
for tweet in twitter_scraper.get_tweets('twitter', pages=1):
print(tweet)
Traceback:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/foobar/code/temp/twitter-scraper/twitter_scraper/modules/tweets.py", line 166, in get_tweets
yield from gen_tweets(pages)
File "/home/foobar/code/temp/twitter-scraper/twitter_scraper/modules/tweets.py", line 37, in gen_tweets
html=r.json()["items_html"], url="bunk", default_encoding="utf-8"
File "/home/foobar/code/temp/twitter-scraper/.venv/lib/python3.6/site-packages/requests/models.py", line 898, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/lib/python3.6/json/__init__.py", line 354, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python3.6/json/decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
The response from Twitter:
url: https://twitter.com/i/profiles/show/twitter/timeline/tweets?include_available_features=1&include_entities=1&include_new_items_bar=true
status_code: 400
text: ''
Perhaps this is related to the redesign mentioned in https://github.com/bisguzar/twitter-scraper/issues/132?
About this issue
- Original URL
- State: open
- Created 4 years ago
- Comments: 24 (4 by maintainers)
Is problem back or is it just me?