WiktionaryParser: [Norwegian] Some pages are not being scrapped properly
Out of all the issues I opened here this one is the most important to me as I’ve used this project for creation of a Kindle-compatible dictionary, and incomplete/missing entries are the bane of every dictionary project ^^
https://en.wiktionary.org/wiki/seg#Norwegian_Bokmål Missing completely
[{"etymology": "", "definitions": [], "pronunciations": {"text": [], "audio": []}}]
https://en.wiktionary.org/wiki/ham#Norwegian_Bokmål Missing completely
[{"etymology": "", "definitions": [], "pronunciations": {"text": ["IPA: /h\u0251m/"], "audio": []}}]
https://en.wiktionary.org/wiki/by#Norwegian_Bokmål Missing the verb definition
[
{
"etymology": "From Old Norse býr (“place (to camp or settle), land, property, lot; and later settlement”).\n",
"definitions": [
{
"partOfSpeech": "noun",
"text": "by m (definite singular byen, indefinite plural byer, definite plural byene)\n\ntown, city (regardless of population size or land area)\n",
"relatedWords": [
{
"relationshipType": "derived terms",
"words": [
"bydel",
"byfornyelse, byfornying",
"bygdeby",
"bymessig",
"bystat",
"bystatus",
"drabantby",
"ferieby",
"gamleby",
"havneby",
"hjemby",
"landsby",
"Mexico by",
"naboby",
"spøkelsesby",
"storby"
]
}
],
"examples": []
}
],
"pronunciations": {
"text": [],
"audio": []
}
},
{
"etymology": "From byde, from Old Norse bjóða, from Proto-Germanic *beudaną (“to offer”), from Proto-Indo-European *bʰewdʰ- (“to wake, rise up”).\n",
"definitions": [],
"pronunciations": {
"text": [],
"audio": []
}
}
]
Here’s a list of errors from my project for words in Norwegian Bokmål. It is totally possible that some errors are due to a mistake in my own scripts, but all I checked were thrown due to WiktionaryParser not parsing them properly or at all.
https://haste.rys.pw/raw/vevafamiwo
Another half-broken entry -
About this issue
- Original URL
- State: open
- Created 8 years ago
- Comments: 20 (8 by maintainers)
Added some changes in 2ba2eea7d34d8e2ae57633210e648f6054d600ab to fix this. Also, the definition text is now a list so you may have to change your script
Whoops, added a fix in another release