horcrux: combined signature is not valid for cosmos-sdk v0.50

On seda testnet 2/3 horcrux signers sometimes has this error for hundreds of blocks in a row: combined signature is not valid

Single signer horcrux does not seem to have an issue

2/3 signer horcrux has an issue sometimes. Restarting 2/3 of the cosigners appears to resolve the issue.

Sometimes the issue occurs after restarting the chain binary and reconnecting to a working horcrux 2/3 cluster.

Is there a known resolution that is waiting to be implemented? We can attempt to assist.

commit 54beead80f63c7c8407674d112363cb752a13c61 (HEAD)

cosigner1 - message set repeats

Nonce cache is empty, triggering reload
Loading additional nonces to meet demand     target=2 remaining=0 additional=2 nonces_per_min=90.27712309797253 avg_nonces_per_min=27.380684601388218
Loaded nonces                                desired=2 added=2
Cosigner nonce cache ahead of demand         target=2 remaining=2 nonces_per_min=0 avg_nonces_per_min=27.379249357780424
Cosigner nonce cache ahead of demand         target=1 remaining=2 nonces_per_min=0 avg_nonces_per_min=12.85992754860993
I am the leader. Managing the sign process for this block chain_id=seda-1-testnet height=129343 round=0 type=prevote
I am the leader. Managing the sign process for this block chain_id=seda-1-testnet height=129343 round=0 type=precommit

cosigner2 - message set repeats

Failed to sign                               type=prevote chain_id=seda-1-testnet height=129338 round=0 error="rpc error: code = Unknown desc = combined signature is not valid"
I am not the leader. Proxying request to the leader chain_id=seda-1-testnet height=129338 round=0 step=3

cosigner 3 - similar messages repeat

Signed with shard                            chain_id=seda-1-testnet height=129329 round=0 step=2
Signed with shard                            chain_id=seda-1-testnet height=129329 round=0 step=3
Signed with shard                            chain_id=seda-1-testnet height=129330 round=0 step=2
Signed with shard                            chain_id=seda-1-testnet height=129330 round=0 step=3
Signed with shard                            chain_id=seda-1-testnet height=129331 round=0 step=2
Signed with shard                            chain_id=seda-1-testnet height=129331 round=0 step=3
Signed with shard                            chain_id=seda-1-testnet height=129332 round=0 step=2

messages are similar when signing works and when signing fails (no major difference)

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Reactions: 3
  • Comments: 16 (15 by maintainers)

Most upvoted comments

Scenario resolved. PR will be provided.