lnd: LND v0.10.2-beta.rc2 restarts on 32bit ARM Debian based OS without any obvious error in the log

Background

Updating to LND v0.10.2-beta.rc2 causes random restarts. Downgrading to LND v0.10.1-beta solves the issue and runs stable.

Your environment

lnd v0.10.2-beta.rc2
operating system Latest Raspbian / Armbian 32bit Linux raspberrypi 4.19.118-v7l+ armv7l GNU/Linux Linux HC1 5.4.28-odroidxu4 armv7l GNU/Linux
version of btcd, bitcoind, or other backend Same with Bitcoin Core 0.20.0 and 0.19.1
any other relevant environment details RaspiBlitz builds on two different SBC-s RPI4 4GB and Odroid HC1 2GB Related issue: https://github.com/rootzoll/raspiblitz/issues/1240

Steps to reproduce

update lnd to the latest release installed the binary

Expected behaviour

Expected to function without restarts

Actual behaviour

LND restarts after a few minutes without any obvious reason no fails or errors I could find in the logs. Last 2000 lines from lnd.log from two separate occasions are here: https://termbin.com/6t6t https://termbin.com/hrmpp

Please tell how I can help debug further.

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 23 (17 by maintainers)

Most upvoted comments

LND v0.11.0-beta.rc1 with go1.14.6 is stable since 24h+ with numerous payments and routing events so closing this for good. Thank you for the support!

$ lncli version
{
    "lncli": {
        "commit": "v0.11.0-beta.rc1",
        "commit_hash": "247b7530caf08a555ffd56f81019031bc1af6565",
        "version": "0.11.0-beta.rc1",
        "app_major": 0,
        "app_minor": 11,
        "app_patch": 0,
        "app_pre_release": "beta.rc1",
        "build_tags": [
            "autopilotrpc",
            "signrpc",
            "walletrpc",
            "chainrpc",
            "invoicesrpc",
            "watchtowerrpc"
        ],
        "go_version": "go1.14.6"
    },
    "lnd": {
        "commit": "v0.11.0-beta.rc1",
        "commit_hash": "247b7530caf08a555ffd56f81019031bc1af6565",
        "version": "0.11.0-beta.rc1",
        "app_major": 0,
        "app_minor": 11,
        "app_patch": 0,
        "app_pre_release": "beta.rc1",
        "build_tags": [
            "autopilotrpc",
            "signrpc",
            "walletrpc",
            "chainrpc",
            "invoicesrpc",
            "watchtowerrpc"
        ],
        "go_version": "go1.14.6"
    }
}

openoms on Aug 3, 2020

ok testing with go 1.14.4 now

$ lncli version
{
    "lncli": {
        "commit": "v0.10.2-beta.rc2-1-g73dcdf9e58a743b0f82b2fafd7f2bda90fc91665",
        "commit_hash": "73dcdf9e58a743b0f82b2fafd7f2bda90fc91665",
        "version": "0.10.2-beta.rc2",
        "app_major": 0,
        "app_minor": 10,
        "app_patch": 2,
        "app_pre_release": "beta.rc2",
        "build_tags": [
        ],
        "go_version": "go1.14.4"
    },
    "lnd": {
        "commit": "v0.10.2-beta.rc2-1-g73dcdf9e58a743b0f82b2fafd7f2bda90fc91665",
        "commit_hash": "73dcdf9e58a743b0f82b2fafd7f2bda90fc91665",
        "version": "0.10.2-beta.rc2",
        "app_major": 0,
        "app_minor": 10,
        "app_patch": 2,
        "app_pre_release": "beta.rc2",
        "build_tags": [
        ],
        "go_version": "go1.14.4"
    }
}

openoms on Jun 26, 2020

Hmm, ok I think we may re-upload the binaries, but a version compiled using Go 1.13. This’ll give us time to properly look into this so we can have things working properly for the major 0.11 release.

Roasbeef on Jul 7, 2020

Yes, I assume that’s the problem. We need to build the v0.10.2 release with go1.13, only v0.11.0 will be go1.14 compatible.

guggero on Jun 23, 2020

I see the same issue when updating to 0.10.3 on my Raspberrypi 4. I am using the release binary. Frequent crashes without an error log.

v0.10.3-beta is stable when built from source with Go 1.13.3. To use a binary need to downgrade to v0.10.1-beta.

openoms on Jul 8, 2020

Running the branch: https://github.com/lightningnetwork/lnd/commits/v0.10.3-beta-rc1-branch with go1.14.4 All good so far.

 $ lncli version
{
    "lncli": {
        "commit": "v0.10.2-beta.rc4-26-gcda3088a0159516a403062db480425b6cbbae6c9",
        "commit_hash": "cda3088a0159516a403062db480425b6cbbae6c9",
        "version": "0.10.2-beta.rc4",
        "app_major": 0,
        "app_minor": 10,
        "app_patch": 2,
        "app_pre_release": "beta.rc4",
        "build_tags": [
        ],
        "go_version": "go1.14.4"
    },
    "lnd": {
        "commit": "v0.10.2-beta.rc4-26-gcda3088a0159516a403062db480425b6cbbae6c9",
        "commit_hash": "cda3088a0159516a403062db480425b6cbbae6c9",
        "version": "0.10.2-beta.rc4",
        "app_major": 0,
        "app_minor": 10,
        "app_patch": 2,
        "app_pre_release": "beta.rc4",
        "build_tags": [
        ],
        "go_version": "go1.14.4"
    }
}

openoms on Jun 30, 2020