orchestrator: raft: Failed to restore snapshot

getting the below error on 2 of my 3 orhchestrator nodes after upgrading to 3.0.3:

2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392340666: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392339212: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392338394: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392337800: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392337461: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392337146: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392336943: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392336671: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392336407: EOF
2017/12/04 13:05:17 [ERR] raft: Failed to restore snapshot 226641-2735898-1512392336146: EOF

About this issue

Original URL
State: open
Created 7 years ago
Comments: 16

Most upvoted comments

any advantage of using sqlite vs mysql ?

Simpler, less installation components. SQLite is bundled with orchestrator. You don’t need to install & configure, or GRANT privileges. Plays well with containers/kubernetes.

Performacne-wise I assume MySQL to be much faster, but with the orchestrator traffic I don’t think there would be anything noticeable. Needs testing.

shlomi-noach on Dec 4, 2017

while I’m fixing documentation and looking into code, can you configure:

"RaftDataDir": "/var/lib/orchestrator",

and make sure it exists and is writable?

shlomi-noach on Dec 4, 2017