crawl4ai: Error on 'charmap' codec can't encode character
Hi,
Can someone explain why Iβm experiencing this. I tried different urls and same outcome :
π Welcome to the Crawl4ai Quickstart Guide! Let's dive into some web crawling fun! π
β³οΈ First Step: Create an instance of WebCrawler and call the `warmup()` function.
If this is the first time you're running Crawl4ai, this might take a few seconds to load required model files.
[LOG] π Initializing LocalSeleniumCrawlerStrategy
DevTools listening on ws://127.0.0.1:61566/devtools/browser/ff15fd50-5eab-447a-97bb-1ca9d57126bb
[LOG] π€οΈ Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] π WebCrawler is ready to crawl
π οΈ Basic Usage: Simply provide a URL and let Crawl4ai do the magic!
[LOG] πΈοΈ Crawling https://www.morningstar.fr/fr using LocalSeleniumCrawlerStrategy...
Checking page load: 0
Checking page load: 1
Checking page load: 2
Checking page load: 3
Checking page load: 4
Checking page load: 5
[ERROR] π« Failed to crawl https://www.morningstar.fr/fr, error: Failed to crawl https://www.morningstar.fr/fr: 'charmap' codec can't encode character '\uff1a' in position 237304: character maps to <undefined>
[LOG] π¦ Basic crawl result:
Result:
url: https://www.mornings...
error_message: Failed to crawl http...
Windows 11 Python 3.11
Any insight ?
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 15 (7 by maintainers)
@unclecode thanks for your feedback. that worked for me with little update regarding subprocess call in setup.py. Actually you code :
is referring to Unix-style commands where in Windows that should looks something like this :
Thatβs being said. I would like to thank you for all the hard work youβre doing to make this a package a successful one.