jabref: Working with PostgreSQL database is unusably slow
JabRef version 4.31 on Ubuntu 16.04
- [X ] I have tested the latest development version from http://builds.jabref.org/master/ and the problem persists
Steps to reproduce the behavior:
- Connect to PostgreSQL db with ≈3,400 entries.
- See that it takes over 8 minutes the database has still not loaded completely.
This is on a very fast server. The Internet connection from here is only about 1 MB/s download. However, loading the same BibTeX file off a shared drive from the same server takes only a few seconds. Saving my 3,400 entries to the remote database also took hours and hours, and JabRef consumed something like 8 GB of memory while doing this.
Would it be worth trying a MySQL db instead?
Log File
Paste an excerpt of your log file here
About this issue
- Original URL
- State: closed
- Created 6 years ago
- Reactions: 1
- Comments: 51 (42 by maintainers)
Commits related to this issue
- Squashed 'src/main/resources/csl-styles/' changes from 268df9ebc7..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to CaptainDaVinci/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from 7365ce89fe..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to calixtus/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from db8bd334bd..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to ShikunXiong/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from 268df9ebc7..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to eetian/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from ddf2572f36..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to joe9111/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from 268df9ebc7..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to abepolk/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from 268df9ebc7..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to NikodemKch/jabref-1 by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from 0cb6762e0b..a51eb4f920 a51eb4f920 Create societe-francaise-detude-de-la-ceramique-antique-en-gaule.csl (#4653) 9032e5be40 Create geografia-fisic... — committed to systemoperator/jabref by deleted user 4 years ago
- Squashed 'src/main/resources/csl-styles/' changes from fa6bb226d2..06785fac8f 06785fac8f Update le-tapuscrit-author-date.csl (#4708) ada5282563 Update norois.csl (#4707) c1793d2fe0 Create isnad-metin... — committed to leitianjian/jabref by deleted user 4 years ago
@tobiasdiez I started writing the code to batch remove entries. I ended up changing
EntryRemovedEvent
toEntriesRemovedEvent
and changing the code wherever it was subscribed to that event. It doesn’t compile because I haven’t finished. This is actually more of a refactoring of the entry events overall than specifically something that relates to database syncs. Also, I still have to look into if the tests need to be changed. I pushed it to a branch on my fork, linked below. Would you be interested in me making a PR for this?https://github.com/NorwayMaple/jabref/commit/80e83772e77b2efc93f1b2715ae9106d463fd505
I think I figured out what the problem with trying to connect JabRef to Heroku Postgres is. It works out that Heroku does not negotiate with CA-verifiable certificates, but the Postgres JDBC wants to connect with
sslmode
set toverify-full
. I am going to try another database.Connecting to a remote PostGreSQL DB with ≈3,900 entries took 30 seconds for JabRef to show the entries in the window.
Exporting the same database as a *.bib file and opening this file from the same server (via mounted network share) using the same network connection took exactly the same time: 30 seconds.
So in response to my original problem, this is definitely a huge improvement! Thank you so much! It is well usable now! I apologize for my late response, as I have been totally overloaded at work.
For me, tests on the latest Windows built with a remote PostgreSQL server show the problem described in the issue is solved, but there are still many actions that remain slow: