drive: boltdb panics with `above high water mark` on drive pull

I was doing my initial drive pull for my drive and in the middle of pulling it panics. I tried to rerun drive pull and it constantly panics with the same error.

log

 3194928566 / 5372734489 [======================================================>------------------------------------]  59.47% 2h6m14s

panic: pgid (68719476737) above high water mark (114)

goroutine 1857 [running]:
panic(0x931900, 0xc8203aa9b0)
	/usr/lib/go-1.6/src/runtime/panic.go:481 +0x3e6
github.com/boltdb/bolt.(*node).spill(0xc820d5ae00, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/node.go:375 +0x54e
github.com/boltdb/bolt.(*node).spill(0xc820d5ad20, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/node.go:350 +0x12c
github.com/boltdb/bolt.(*node).spill(0xc820d5ac40, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/node.go:350 +0x12c
github.com/boltdb/bolt.(*Bucket).spill(0xc820418638, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/bucket.go:570 +0x1cf
github.com/boltdb/bolt.(*Tx).Commit(0xc820418620, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/tx.go:163 +0x1d4
github.com/boltdb/bolt.(*DB).Update(0xc8201ea780, 0xc8204f9b70, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/boltdb/bolt/db.go:605 +0x11d
github.com/odeke-em/drive/config.(*Context).SerializeIndex(0xc8201ce0c0, 0xc820923920, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/config/config.go:279 +0x1a3
github.com/odeke-em/drive/src.(*Commands).createIndex(0xc8201ce2c0, 0xc8200f4840, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/fetch.go:314 +0x1df
github.com/odeke-em/drive/src.(*Commands).localAdd.func1(0xc8204f9d50, 0xc82064da80, 0xc8201ce2c0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/pull.go:574 +0x65
github.com/odeke-em/drive/src.(*Commands).localAdd(0xc8201ce2c0, 0xc82064da80, 0x0, 0x0, 0x0, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/pull.go:605 +0x2b1
github.com/odeke-em/drive/src.(*Commands).(github.com/odeke-em/drive/src.localAdd)-fm(0xc82064da80, 0x0, 0x0, 0x0, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/misc.go:1066 +0x56
github.com/odeke-em/drive/src.(*Commands).playPullChanges.func2.1(0xc82064da80, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/pull.go:477 +0x57
github.com/odeke-em/drive/src.(*changeJobSt).changeJober.func1(0x0, 0x0, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/misc.go:120 +0x23e
github.com/odeke-em/drive/src.jobSt.Do(0x4ac, 0xc8202555a0, 0x0, 0x0, 0x0, 0x0)
	/home/skrzepto/go/src/github.com/odeke-em/drive/src/misc.go:100 +0x35
github.com/odeke-em/drive/src.(*jobSt).Do(0xc820ac9390, 0x0, 0x0, 0x0, 0x0)
	<autogenerated>:6 +0xb0
github.com/odeke-em/semalim.Run.func4.1(0xc8202664f0, 0xc82064f140, 0xc820266560, 0xc8202665d0, 0x7fdf10af0668, 0xc820ac9390)
	/home/skrzepto/go/src/github.com/odeke-em/semalim/semalim.go:71 +0x46
created by github.com/odeke-em/semalim.Run.func4
	/home/skrzepto/go/src/github.com/odeke-em/semalim/semalim.go:76 +0x12c

About this issue

Original URL
State: open
Created 7 years ago
Reactions: 2
Comments: 16 (5 by maintainers)

Most upvoted comments

@odeke-em

I have finished the wiki on how to work around this problem. https://github.com/odeke-em/drive/wiki/Boltdb-breaks-drive-with-(panic:-invalid-page-type:)-or-(panic:--above-high-water-mark)

nelaaro on Jan 16, 2017

Hey folks, I just commented at https://github.com/odeke-em/drive/issues/839#issuecomment-271697335. Please use that boltdb commit so that we’ll be at par. You can do so like this:

$ cd $GOPATH/src/github.com/boltdb/bolt && git reset --hard 852d3024fa8d89dcc9a715bab6f4dcd7d59577dd
$ drive-gen

odeke-em on Jan 10, 2017