rosetta-bitcoin: Rosetta keeps crashing frequently with bitcoin EOF error

Rosetta keeps crashing around 388k index and 560k tip with different errors like EOF.

Any idea why this is giving EOF?


WARN    bitcoind stderr bitcoin/node.go:42      closing logger  {"error": "EOF"}
github.com/coinbase/rosetta-bitcoin/bitcoin.logPipe
        /app/src/bitcoin/node.go:42
github.com/coinbase/rosetta-bitcoin/bitcoin.StartBitcoind.func2
        /app/src/bitcoin/node.go:88
golang.org/x/sync/errgroup.(*Group).Go.func1
        /go/pkg/mod/golang.org/x/sync@v0.0.0-20200625203802-6e8e738ad208/errgroup/errgroup.go:57
2020-11-27T00:06:04.857Z        WARN    pruner  indexer/indexer.go:284  exiting pruner
github.com/coinbase/rosetta-bitcoin/indexer.(*Indexer).Prune
        /app/src/indexer/indexer.go:284
main.startOnlineDependencies.func3
        /app/src/main.go:108
golang.org/x/sync/errgroup.(*Group).Go.func1
        /go/pkg/mod/golang.org/x/sync@v0.0.0-20200625203802-6e8e738ad208/errgroup/errgroup.go:57
2020-11-27T00:06:04.857Z        WARN    bitcoind        bitcoin/node.go:98      sending interrupt to bitcoind
github.com/coinbase/rosetta-bitcoin/bitcoin.StartBitcoind.func3
        /app/src/bitcoin/node.go:98
golang.org/x/sync/errgroup.(*Group).Go.func1
        /go/pkg/mod/golang.org/x/sync@v0.0.0-20200625203802-6e8e738ad208/errgroup/errgroup.go:57
2020-11-27T00:06:03.487Z        WARN    bitcoind        bitcoin/node.go:42      closing logger  {"error": "EOF"}
github.com/coinbase/rosetta-bitcoin/bitcoin.logPipe
        /app/src/bitcoin/node.go:42
github.com/coinbase/rosetta-bitcoin/bitcoin.StartBitcoind.func1
        /app/src/bitcoin/node.go:84
golang.org/x/sync/errgroup.(*Group).Go.func1
        /go/pkg/mod/golang.org/x/sync@v0.0.0-20200625203802-6e8e738ad208/errgroup/errgroup.go:57

More info: we were also calling /network/status while this was running which might have caused this error because the EOF seems like a common error in APIs. However if thats the case then the API crashing the bitcoin node seems very odd

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 22 (22 by maintainers)

Most upvoted comments

@HelloKashif @sidhujag : https://github.com/coinbase/rosetta-bitcoin/tree/patrick/encounter-optimization

This thing is irresponsibly fast…past here I’m not sure how to make it any faster haha

patrick-ogrady on Dec 7, 2020

I’m closing this after #53. Let me know if you still run into this, @HelloKashif!

patrick-ogrady on Dec 10, 2020

Do you know what the resident set is when it is synced, @sidhujag? The memory mapping will use a much larger virtual memory allocation than what it actually occupies (the golang GC is super lazy as well).

Its a bit over 8GB once synced, stopped started.

Also noticed these error messages that happens once in a while maybe related to pruning, wonder if @HelloKashif you see them on Bitcoin or not

sidhujag on Dec 2, 2020

I’m releasing one more small improvement to the storage model and will update after: https://github.com/coinbase/rosetta-sdk-go/pull/261

This doesn’t really have an effect on what rosetta-bitcoin does when syncing/serving requests but would require another data migration when released. Will still be done today!

patrick-ogrady on Dec 2, 2020

This will slip until tomorrow morning…will close this issue when I merge the update.

patrick-ogrady on Dec 2, 2020