OpenSearch: [BUG] 3.0.0 fails to start on Debian due to boostrap checks

Describe the bug

Hi,

I have found (both on my install, and on a clean install) that OpenSearch fails to start on Debian 12 when using version 3.0.0 and utilizing the network.host: 0.0.0.0 option

The network.host: 0.0.0.0 option appears to cause a “bootstrap check” to run during start (not a whole lot of OpenSearch documentation about what this is, or how to work with it).

With network.host: 0.0.0.0 the only way I can find to actually start the service is by editing /lib/systemd/system/opensearch.service and adding seccomp to the line: SystemCallFilter=madvise mincore mlock mlock2 munlock get_mempolicy sched_getaffinity sched_setaffinity fcntl

Thank you for your help.

Related component

Other

To Reproduce

  1. Install OpenSearch on fully updated Debian 12.
  2. Edit opensearch.yml to include the option: network.host: 0.0.0.0 this will cause the boostrap check to run.
  3. Attempt to restart OpenSearch service.

Expected behavior

OpenSearch start successfully, or at least gives some indication of how to fix the issue. It’s unclear what the issue even is to me. Am I not supposed to use 0.0.0.0? Am I expected to add seccomp to the SystemD option? Or is this just a bug?

Additional Details

Plugins Please list all plugins currently enabled.

Screenshots If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: Debian 12
  • Version: 3.0.0

Additional context Log:

[2025-05-12T15:01:20,036][INFO ][o.o.s.a.i.AuditLogImpl   ] [osc01-test] Closing AuditLogImpl
[2025-05-12T15:01:20,039][INFO ][o.o.n.Node               ] [osc01-test] closed
[2025-05-12T15:01:23,653][WARN ][o.o.b.JNANatives         ] [osc01-test] unable to install syscall filter:
java.lang.UnsupportedOperationException: seccomp(BOGUS_OPERATION): Operation not permitted
        at org.opensearch.bootstrap.SystemCallFilter.linuxImpl(SystemCallFilter.java:311) ~[opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.SystemCallFilter.init(SystemCallFilter.java:666) ~[opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.JNANatives.tryInstallSystemCallFilter(JNANatives.java:281) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.Natives.tryInstallSystemCallFilter(Natives.java:128) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:130) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:192) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:405) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:168) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:159) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.common.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:110) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-3.0.0.jar:3.0.0]
        at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:125) [opensearch-3.0.0.jar:3.0.0]
        at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:91) [opensearch-3.0.0.jar:3.0.0]
[2025-05-12T15:01:23,806][WARN ][stderr                   ] [osc01-test] May 12, 2025 3:01:23 PM org.opensearch.javaagent.bootstrap.AgentPolicy setPolicy
[2025-05-12T15:01:23,807][WARN ][stderr                   ] [osc01-test] INFO: Policy attached successfully: org.opensearch.bootstrap.OpenSearchPolicy@103082dd
[2025-05-12T15:01:23,814][INFO ][o.o.n.Node               ] [osc01-test] version[3.0.0], pid[3019], build[deb/dc4efa821904cc2d7ea7ef61c0f577d3fc0d8be9/2025-05-03T06:23:34.992456558Z], OS[Linux/6.1.0-34-amd64/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/21.0.7/21.0.7+6-LTS]

...

[2025-05-12T15:01:33,749][INFO ][o.o.s.l.BuiltinLogTypeLoader] [osc01-test] Loaded [ad_ldap_logtype.json] log type
[2025-05-12T15:01:33,839][INFO ][o.o.t.TransportService   ] [osc01-test] publish_address {MYIP:9300}, bound_addresses {[::]:9300}
[2025-05-12T15:01:33,840][INFO ][o.o.t.TransportService   ] [osc01-test] Remote clusters initialized successfully.
[2025-05-12T15:01:33,999][INFO ][o.o.b.BootstrapChecks    ] [osc01-test] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2025-05-12T15:01:34,002][ERROR][o.o.b.Bootstrap          ] [osc01-test] node validation exception
[2] bootstrap checks failed
[1]: system call filters failed to install; check the logs and fix your configuration or disable system call filters at your own risk
[2]: the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_cluster_manager_nodes / cluster.initial_master_nodes] must be configured
[2025-05-12T15:01:34,003][INFO ][o.o.n.Node               ] [osc01-test] stopping ...

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Reactions: 1
  • Comments: 30 (18 by maintainers)

Most upvoted comments

yeah sure. makes sense.

@RajatGupta02 let’s publish the change to include seccomp in SystemCallFilter. Its a non destructive change in presence of CAP_SYS_ADMIN and CAP_SYS_NET

@landon-lengyel we will evaluate the implications of adding secomp in SystemCallFilter rule. That’s probably the right fix here; unless we find a better alternative. We will come back on this tomorrow.

I think the issue is this. @mrluanma @landon-lengyel Could you please try this and confirm if it runs for you?

@kumargu systemd in Debian 12 is version v252.

I’m running into this on Ubuntu 22.04 as well:

ii  systemd        249.11-0ubuntu3.15 amd64        system and service manager