go-spacemesh: Report of Critical Bug in Spacemesh v1.2.8 - Inability for Nodes Syncing via Local Network to Receive Rewards

Dear Spacemesh Team,

I am writing to report a critical bug I encountered while using version v1.2.8 of Spacemesh. It pertains to nodes syncing via a local network, specifically the failure to correctly receive rewards, despite the rewards being logged in the system. However, these rewards are not reflected on the chain or within the account balance.

Bug Description: While running a node that syncs via a local network, the system’s logs indicate that rewards have been obtained. Regrettably, these rewards do not display accurately on the chain, nor do they reflect in the account balance. Although the rewards acquisition is logged, there is no corresponding record or reward visible on-chain or in the account balance.

Bug Manifestation:

The local network syncing node correctly logs reward acquisition. However, no corresponding reward information is displayed on the chain. My account balance fails to reflect any rewards received. Steps to Reproduce the Bug:

Run Spacemesh v1.2.8. Opt for node synchronization via a local network. After a period of operation, the logs display rewards acquired. Despite the log entry, there is no visible record of the rewards on the chain or in the account balance. Additional Information:

I attempted multiple syncs and node restarts, but the issue persists. I have ensured that my node settings are accurate and no irregular actions were taken. Expected Resolution: I kindly request your team to investigate and resolve this bug. Accurate recording of rewards is crucial for users syncing via a local network. I am willing to provide further information or assist in any tests necessary to resolve this issue.

Please let me know if there is any additional information required or if further testing is necessary to pinpoint and resolve this bug. Your team’s assistance and support are greatly appreciated.

Thank you for taking the time to review this email, and I look forward to your response.

Sincerely,

node logs： 2023-12-15T08:12:18.793Z INFO c6d00.proposalBuilder proposal eligibilities for an epoch {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "proposalBuilder", "epoch": 11, "beacon": "0xa12acad4", "atx": "4ce5ad8713", "weight": 298464, "prev": 0, "slots": 2, "eligible": 2, "eligible by layer": [{"layer": 44633, "slots": 1}, {"layer": 46845, "slots": 1}], "name": "proposalBuilder"} 2023-12-16T07:25:04.139Z INFO c6d00.conState received mempool txs {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "conState", "layer_id": 44633, "num_accounts": 0, "name": "conState"} 2023-12-16T07:25:05.781Z INFO c6d00.proposalBuilder proposal created {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "proposalBuilder", "proposal_id": "9030c9dbb2", "transactions": 0, "mesh_hash": "1b1fe7723e", "ballot_id": "2d9bc5eeed", "layer_id": 44633, "epoch_id": 11, "smesher": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "opinion hash": "1b1fe7723e", "base_ballot": "ab28a7b2b6", "support": 1, "against": 0, "abstain": 0, "atx_id": "4ce5ad8713", "ref_ballot": "0000000000", "active set hash": "0848703629", "beacon": "a12acad4", "votes": {"base": "ab28a7b2b6", "support": [{"id": "e4092bb19c", "layer": 44632, "height": 84399}], "against": [], "abstain": []}, "latency": {"data": "3.245017909s", "tortoise": "41.694309ms", "txs": "5.18565ms", "hash": "30.361797ms", "publish": "1.611940677s", "total": "4.934200342s"}, "name": "proposalBuilder"} 2023-12-16T07:26:50.717Z INFO c6d00.executor optimistically executed block {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "executor", "lid": 44633, "block": "2e49b371c7", "state_hash": "0xa7419a1f23c5dd0f75543499aec63f5a19ffa05cfefc2222406490fccdb6eb87", "duration": "1.008054682s", "count": 2, "skipped": 0, "rewards": 44, "name": "executor"} 2023-12-16T07:26:50.847Z INFO c6d00.blockGenerator generated block (optimistic) {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "blockGenerator", "layer_id": 44633, "block_id": "2e49b371c7", "name": "blockGenerator"} 2023-12-16T07:26:57.004Z INFO c6d00.blockCert generating certificate {"node_id": "c6d0075ddb273968baa24f686668ef5d47136ae1a653bdedad2b37b5db9049c4", "module": "blockCert", "requestId": "7cdf3c74-e1e8-44fa-a767-5c047d6f7e1d", "layer_id": 44633, "block_id": "2e49b371c7", "eligibility_count": 101, "num_msg": 101, "name": "blockCert"}

spacemesh log： { “timestamp”: “2023-12-16T07:25:05.782055424Z”, “help”: “Node published proposal. Rewards will be received once proposal is included in the block.”, “proposal”: { “layer”: 44633, “proposal”: “kDDJ27KMkvFJ+QxNtZpr781SdbE=” } }