docker: OSM import stopps without error message
I was able to run the import of a small area (portland-metro) without any problems but when I try to perform a full planet import, the osm importer stopps after ~100mio. documents without any error message. Right now I do not run the importers in parallel, only the osm importer is running. I use the default configuration of pelias / docker-compose (starting with the configuration using Elasticsearch 2.4 and also tried with the updated configuration using Elasticsearch 5.6). To speed up debugging I disabled admin lookup.
VM Specs: 16 cores 32 GB RAM 1TB Elasticsearch storage (>1,5TB for tmp storage)
Elasticsearch status: 100148808 docs 46379422702 bytes store size
OSM importer log tail:
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385600 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385601 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385602 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385603 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385604 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385605 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385606 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385613 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385614 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385615 no ways found
2019-05-28T17:26:05.323Z - verbose: [openstreetmap] [address_extractor] duplicating a venue with address
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385635 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385636 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385637 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385638 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385643 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385657 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385658 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385659 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385660 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385702 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385703 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385704 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385705 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385706 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385707 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385741 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385767 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385768 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385769 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385783 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385793 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385798 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385802 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385932 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385933 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385934 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385935 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385936 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385937 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385938 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385983 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9385984 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386021 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386456 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386573 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386574 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386575 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386576 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386577 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386578 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386579 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386580 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386581 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386582 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386583 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386584 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386585 no ways found
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9386586 no ways found
2019-05-28T17:26:05.502Z - verbose: [openstreetmap] [address_extractor] duplicating a venue with address
2019-05-28T17:26:05.508Z - verbose: [openstreetmap] [address_extractor] duplicating a venue with address
2019-05-28T17:26:05.539Z - verbose: [openstreetmap] [address_extractor] duplicating a venue with address
[pbf2json]: 2019/05/28 17:26:05 denormalize failed for relation: 9387007 no ways found
2019-05-28T17:26:05.582Z - verbose: [openstreetmap] [address_extractor] duplicating a venue with address
2019-05-28T17:26:05.720Z - info: [dbclient-openstreetmap] paused=false, transient=0, current_length=0, indexed=100148812, batch_ok=200298, batch_retries=0, failed_records=0, venue=23022762, address=77126050, persec=131.2
2019-05-28T17:26:05.720Z - info: [dbclient-openstreetmap] paused=false, transient=0, current_length=0, indexed=100148812, batch_ok=200298, batch_retries=0, failed_records=0, venue=23022762, address=77126050, persec=131.2
Elasticsearch log tail:
[2019-05-28T12:40:51,269][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [li]
[2019-05-28T12:40:51,302][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T12:42:41,001][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sn]
[2019-05-28T12:42:41,001][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sn]
[2019-05-28T12:42:41,031][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T12:46:03,957][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ik]
[2019-05-28T12:46:03,957][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ik]
[2019-05-28T12:46:03,989][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T12:59:01,399][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [av]
[2019-05-28T12:59:01,399][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [av]
[2019-05-28T12:59:01,434][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:04:39,624][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [st]
[2019-05-28T13:04:39,624][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [st]
[2019-05-28T13:04:39,657][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:07:25,990][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sd]
[2019-05-28T13:07:25,991][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sd]
[2019-05-28T13:07:26,023][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:09:11,921][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [kl]
[2019-05-28T13:09:11,921][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [kl]
[2019-05-28T13:09:11,952][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:13:45,823][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,823][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,824][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,824][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,824][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,824][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,824][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,825][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,825][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,825][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lg]
[2019-05-28T13:13:45,859][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:15:09,396][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ha]
[2019-05-28T13:15:09,396][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ha]
[2019-05-28T13:15:09,428][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:15:13,627][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [nb]
[2019-05-28T13:15:13,627][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [nb]
[2019-05-28T13:15:13,659][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:20:38,476][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [za]
[2019-05-28T13:20:38,476][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [za]
[2019-05-28T13:20:38,519][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:23:32,250][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [io]
[2019-05-28T13:23:32,251][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [io]
[2019-05-28T13:23:32,287][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:50:43,632][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ti]
[2019-05-28T13:50:43,633][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ti]
[2019-05-28T13:50:43,665][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:53:23,977][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ie]
[2019-05-28T13:53:23,978][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ie]
[2019-05-28T13:53:24,009][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T13:56:54,389][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ig]
[2019-05-28T13:56:54,389][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ig]
[2019-05-28T13:56:54,425][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:03:43,979][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [tw]
[2019-05-28T14:03:43,980][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [tw]
[2019-05-28T14:03:44,013][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:06:03,021][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [na]
[2019-05-28T14:06:03,021][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [na]
[2019-05-28T14:06:03,065][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:17:42,682][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [dz]
[2019-05-28T14:17:42,683][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [dz]
[2019-05-28T14:17:42,717][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:23:29,061][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [rn]
[2019-05-28T14:23:29,062][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [rn]
[2019-05-28T14:23:29,095][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:27:14,742][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lu]
[2019-05-28T14:27:14,743][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [lu]
[2019-05-28T14:27:14,775][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:30:19,582][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ak]
[2019-05-28T14:30:19,583][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ak]
[2019-05-28T14:30:19,618][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:34:18,349][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ny]
[2019-05-28T14:34:18,349][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ny]
[2019-05-28T14:34:18,384][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:46:54,797][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [rw]
[2019-05-28T14:46:54,797][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [rw]
[2019-05-28T14:46:54,829][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:47:54,903][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [zu]
[2019-05-28T14:47:54,903][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [zu]
[2019-05-28T14:47:54,936][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:48:30,930][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [iu]
[2019-05-28T14:48:30,930][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [iu]
[2019-05-28T14:48:30,967][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:49:05,226][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [mh]
[2019-05-28T14:49:05,227][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [mh]
[2019-05-28T14:49:05,262][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T14:50:44,910][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [yo]
[2019-05-28T14:50:44,910][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [yo]
[2019-05-28T14:50:44,945][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:04:33,876][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ks]
[2019-05-28T15:04:33,877][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ks]
[2019-05-28T15:04:33,911][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:18:46,232][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ff]
[2019-05-28T15:18:46,232][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ff]
[2019-05-28T15:18:46,268][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:19:10,851][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [cu]
[2019-05-28T15:19:10,851][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [cu]
[2019-05-28T15:19:10,886][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:31:23,311][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [bi]
[2019-05-28T15:31:23,311][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [bi]
[2019-05-28T15:31:23,311][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [bi]
[2019-05-28T15:31:23,311][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [bi]
[2019-05-28T15:31:23,347][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:39:34,034][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ss]
[2019-05-28T15:39:34,034][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ss]
[2019-05-28T15:39:34,068][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T15:47:45,038][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sg]
[2019-05-28T15:47:45,038][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [sg]
[2019-05-28T15:47:45,073][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T16:26:33,825][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [wo]
[2019-05-28T16:26:33,825][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [wo]
[2019-05-28T16:26:33,860][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T16:26:34,273][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [cr]
[2019-05-28T16:26:34,273][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [cr]
[2019-05-28T16:26:34,308][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T16:45:03,454][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ts]
[2019-05-28T16:45:03,454][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ve]
[2019-05-28T16:45:03,455][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ts]
[2019-05-28T16:45:03,455][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ve]
[2019-05-28T16:45:03,491][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-28T17:22:40,632][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ki]
[2019-05-28T17:22:40,632][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [to]
[2019-05-28T17:22:40,633][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [ki]
[2019-05-28T17:22:40,633][WARN ][o.e.d.i.m.StringFieldMapper$TypeParser] The [string] field is deprecated, please use [text] or [keyword] instead on [to]
[2019-05-28T17:22:40,664][INFO ][o.e.c.m.MetaDataMappingService] [YICKzsA] [pelias/pAKPqXxxTqOYbGsW5TN0DA] update_mapping [venue]
[2019-05-29T02:28:00,003][INFO ][o.e.x.m.MlDailyMaintenanceService] triggering scheduled [ML] maintenance tasks
[2019-05-29T02:28:00,004][INFO ][o.e.x.m.a.DeleteExpiredDataAction$TransportAction] [YICKzsA] Deleting expired data
About this issue
- Original URL
- State: closed
- Created 5 years ago
- Comments: 17 (9 by maintainers)
It looks as though the source data has changed with
whosonfirst, we’re probably using a slightly older version before the change was made.I’m going to have to close this issue because its quickly got off-topic and turned in to a general support thread. As far as I can tell there are no bugs identified in the software and I can’t afford to spend any more voluntary hours looking into this for your team.
If you need any additional help setting up a full planet build you can contact us for consultancy https://geocode.earth/consultancy
You can choose which data you want to import, but yes, if you only import OSM then you’ll have a similar amount of addresses as nominatim.
For our geocode.earth cloud service we also import all of openaddresses and then we additionally generate a planet-wide interpolation index which includes TIGER block ranges too.
Hopefully that brings us to pretty much complete coverage in the USA and most of Europe, depending on how willing the governments are in each country to provide open data 😃