docker-mailserver: bug report: Incoming traffic fails to connect to DMS managed services
๐ Preliminary Checks
- I tried searching for an existing issue and followed the debugging docs advice, but still need assistance.
๐ What Happened?
Hello company, Iโve come to see you as a last resort, having worked on this case for over a month, and I canโt seem to get out of it, even with the help of the best LLMs on the market. Hope to see the end of the tunnel soon.
Installation via docker-compose, via Traefik proxy. Installation is going well, but there seem to be interconnection problems, either with the security/SSL layer, or with the proxy. Basically, I only wanted to use the secure SSL connection (IMAPS 993, SMTPS 465), but I thought Iโd seen that the 25 had to remain activated, as a universal measure (what about the 587, if you force TLS/STARTTLS, does it indicate to communicate on the 587, or does it maintain the connection on the 25, and the 587 is therefore useless (my usage doesnโt require it)?
The configuration contains a lot of tests and temporary comments.
Iโve also tried using ports + 10000 for IMAPS/SMTPS to bypass the proxy for local, but it doesnโt seem to work.
Basically, the certificates were retrieved via letsencrypt, via traefikโs acme, and copied to letsenccrypt/live, but I thought I saw that some services require specific names/folders, so I made a duplicate via the script provided in the doc, in order to also put them in /etc/dms/tls/.
Roundcube also fails to connect (for a while I could, but now I canโt).
mailserver.env
DMS_DEBUG=1
#LOG_LEVEL=info
LOG_LEVEL=debug
ONE_DIR=1
ENABLE_UPDATE_CHECK=1
UPDATE_CHECK_INTERVAL=1d
#PERMIT_DOCKER=none
#PERMIT_DOCKER=host
#PERMIT_DOCKER=container
PERMIT_DOCKER=network
ENABLE_SRS=0
ENABLE_OPENDKIM=0
ENABLE_OPENDMARC=0
ENABLE_CLAMAV=0
ENABLE_RSPAMD=1
ENABLE_AMAVIS=1
AMAVIS_LOGLEVEL=0
ENABLE_DNSBL=0
ENABLE_FAIL2BAN=1
# NEW
#ENABLE_PROXY_PROTOCOL=1
ENABLE_SUBMISSION=1
ENABLE_SUBMISSIONS=1
TZ=Europe/Paris
FAIL2BAN_BLOCKTYPE=drop
POSTSCREEN_ACTION=enforce
SSL_TYPE=letsencrypt
SSL_DOMAIN=mail.MY.DOMAIN
LETSENCRYPT_DOMAIN=mail.MY.DOMAIN
ENABLE_QUOTAS=1
LOGROTATE_INTERVAL=weekly
POSTFIX_INET_PROTOCOLS=all
DOVECOT_INET_PROTOCOLS=all
ENABLE_SPAMASSASSIN=0
SPAMASSASSIN_SPAM_TO_INBOX=1
ENABLE_SPAMASSASSIN_KAM=0
MOVE_SPAM_TO_JUNK=1
SA_TAG=2.0
SA_TAG2=6.31
SA_KILL=10.0
#SA_SPAM_SUBJECT=***SPAM*****
SPAM_SUBJECT=***SPAM*****
ENABLE_FETCHMAIL=0
FETCHMAIL_POLL=300
DOVECOT_MAILBOX_FORMAT=maildir
ENABLE_POSTGREY=0
POSTGREY_DELAY=300
POSTGREY_MAX_AGE=35
POSTGREY_TEXT="Delayed by Postgrey"
POSTGREY_AUTO_WHITELIST_CLIENTS=5
ENABLE_SASLAUTHD=0
SRS_SENDER_CLASSES=envelope_sender
RELAY_PORT=25
RELAY_PASSWORD=
RSPAMD_CHECK_AUTHENTICATED=1
SPOOF_PROTECTION=1
POSTFIX_MAILBOX_SIZE_LIMIT=100000000
ENABLE_MANAGESIEVE=0
dovecot.cf
#haproxy_trusted_networks = 172.18.0.2 172.18.0.18
haproxy_trusted_networks = 172.18.0.0/16
haproxy_timeout = 3 secs
service imap-login {
# inet_listener imap {
# haproxy = yes
# }
inet_listener imaps {
haproxy = yes
ssl = yes
port = 10993
}
}
service pop3-login {
# inet_listener pop3 {
# haproxy = yes
# }
inet_listener pop3s {
haproxy = yes
ssl = yes
port = 10995
}
}
#service managesieve-login {
# inet_listener sieve {
# haproxy = yes
# }
#}
#TMP
auth_debug = yes
auth_debug_passwords = yes
auth_verbose = yes
mail_debug = yes
postfix-main.cf
#smtpd_tls_auth_only=yes
###smtpd_tls_security_level=may
###smtpd_tls_CApath=/etc/ssl/certs
smtp_tls_loglevel=2
smtpd_tls_loglevel=2
smtp_tls_note_starttls_offer=yes
#smtpd_tls_received_header=yes
###smtpd_tls_protocols=!SSLv2,!SSLv3
# NEW
postscreen_cache_map = proxy:btree:$data_directory/postscreen_cache
postscreen_upstream_proxy_protocol = haproxy
smtpd_use_tls = yes
#smtp_tls_security_level = encrypt
#smtpd_tls_security_level = encrypt
smtp_tls_security_level = may
smtpd_tls_security_level = may
smtpd_tls_wrappermode = yes
# Certs
#smtpd_tls_cert_file = /etc/dms/tls/cert.pem
#smtpd_tls_key_file = /etc/dms/tls/key.pem
smtp_tls_chain_files = /etc/dms/tls/key.pem /etc/dms/tls/cert.pem
smtpd_tls_chain_files = /etc/dms/tls/key.pem /etc/dms/tls/cert.pem
# Debug
debug_peer_level = 3
debug_peer_list = 127.0.0.1
postfix-master.cf
smtp/inet/postscreen_upstream_proxy_protocol=haproxy
submission/inet/smtpd_upstream_proxy_protocol=haproxy
submissions/inet/smtpd_upstream_proxy_protocol=haproxy
# Tmp
smtp/inet/smtpd_tls_security_level=may
smtp/inet/smtpd_tls_auth_only=no
# Try certs
submissions/inet/smtpd_tls_wrappermode=yes
submissions/inet/smtpd_sasl_auth_enable=yes
submissions/inet/smtpd_tls_security_level=encrypt
#submissions/inet/smtpd_tls_cert_file=/etc/dms/tls/cert.pem
#submissions/inet/smtpd_tls_key_file=/etc/dms/tls/key.pem
submissions/inet/smtpd_tls_chain_files=/etc/dms/tls/cert.pem /etc/dms/tls/key.pem
submissions/inet/smtpd_tls_protocols=!SSLv2,!SSLv3
submissions/inet/smtpd_tls_loglevel=2
user-patches.sh
#!/bin/bash
# Duplicate the config for the submission(s) service ports (587 / 465) with adjustments for the PROXY ports (10587 / 10465) and `syslog_name` setting:
postconf -Mf submission/inet | sed -e s/^submission/10587/ -e 's/submission/submission-proxyprotocol/' >> /etc/postfix/master.cf
postconf -Mf submissions/inet | sed -e s/^submissions/10465/ -e 's/submissions/submissions-proxyprotocol/' >> /etc/postfix/master.cf
# Enable PROXY Protocol support for these new service variants:
postconf -P 10587/inet/smtpd_upstream_proxy_protocol=haproxy
postconf -P 10465/inet/smtpd_upstream_proxy_protocol=haproxy
# Create a variant for port 25 too (NOTE: Port 10025 is already assigned in DMS to Amavis):
postconf -Mf smtp/inet | sed -e s/^smtp/12525/ >> /etc/postfix/master.cf
# Enable PROXY Protocol support (different setting as port 25 is handled via postscreen), optionally configure a `syslog_name` to distinguish in logs:
postconf -P 12525/inet/postscreen_upstream_proxy_protocol=haproxy 12525/inet/syslog_name=smtp-proxyprotocol
๐ Reproduction Steps
openssl s_client -connect mail.MY.DOMAIN:25 -servername mail.MY.DOMAIN
CONNECTED(00000003)
depth=2 C = US, O = Internet Security Research Group, CN = ISRG Root X1
verify return:1
depth=1 C = US, O = Let's Encrypt, CN = R11
verify return:1
depth=0 CN = mail.MY.DOMAIN
verify return:1
---
Certificate chain
0 s:CN = mail.MY.DOMAIN
i:C = US, O = Let's Encrypt, CN = R11
a:PKEY: rsaEncryption, 4096 (bit); sigalg: RSA-SHA256
v:NotBefore: Jan 6 21:03:35 2025 GMT; NotAfter: Apr 6 21:03:34 2025 GMT
1 s:C = US, O = Let's Encrypt, CN = R11
i:C = US, O = Internet Security Research Group, CN = ISRG Root X1
a:PKEY: rsaEncryption, 2048 (bit); sigalg: RSA-SHA256
v:NotBefore: Mar 13 00:00:00 2024 GMT; NotAfter: Mar 12 23:59:59 2027 GMT
---
Server certificate
-----BEGIN CERTIFICATE-----
XXXXXXXXXXXXXXXXXX==
-----END CERTIFICATE-----
subject=CN = mail.MY.DOMAIN
issuer=C = US, O = Let's Encrypt, CN = R11
---
No client certificate CA names sent
Peer signing digest: SHA256
Peer signature type: RSA-PSS
Server Temp Key: X25519, 253 bits
---
SSL handshake has read 3631 bytes and written 390 bytes
Verification: OK
---
New, TLSv1.3, Cipher is TLS_AES_128_GCM_SHA256
Server public key is 4096 bit
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
Early data was not sent
Verify return code: 0 (ok)
---
---
Post-Handshake New Session Ticket arrived:
SSL-Session:
Protocol : TLSv1.3
Cipher : TLS_AES_128_GCM_SHA256
Session-ID: XXXXXXXXXXXXX
Session-ID-ctx:
Resumption PSK: XXXXXXXXXXXXXXXXXXXXXXXXXX
PSK identity: None
PSK identity hint: None
SRP username: None
TLS session ticket lifetime hint: 604800 (seconds)
TLS session ticket:
0000 - 19 XX c4 XX 02 XX1 af 03-XX 08 XX 6b 1a 52 XX 7e ...0.!....8k.Rl~
Start Time: 1737070904
Timeout : 7200 (sec)
Verify return code: 0 (ok)
Extended master secret: no
Max Early Data: 0
---
read R BLOCK
closed
openssl s_client -connect mail.MY.DOMAIN:25 -starttls smtp -servername mail.MY.DOMAIN
CONNECTED(00000003)
Didn't find STARTTLS in server response, trying anyway...
40876F24D07F0000:error:0A000126:SSL routines:ssl3_read_n:unexpected eof while reading:../ssl/record/rec_layer_s3.c:317:
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 0 bytes and written 366 bytes
Verification: OK
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
Early data was not sent
Verify return code: 0 (ok)
---
๐ DMS Version
v14.0.0
๐ป Operating System and Architecture
Debian GNU/Linux 10 (buster)
โ๏ธ Container configuration files
services:
mailserver:
image: docker.io/mailserver/docker-mailserver:latest
container_name: mailserver
hostname: mail.MY.DOMAIN
env_file: mailserver.env
volumes:
- ./data/dms/mail-data/:/var/mail/
- ./data/dms/mail-state/:/var/mail-state/
- ./data/dms/mail-logs/:/var/log/mail/
- ./data/dms/config/:/tmp/docker-mailserver/
- ./data/dms/tls/:/etc/dms/tls/
- /var/docker/traefik/config/letsencrypt/acme.json:/etc/letsencrypt/acme.json:ro
- /etc/localtime:/etc/localtime:ro
stop_grace_period: 1m
cap_add:
- NET_ADMIN
healthcheck:
test: "ss --listening --tcp | grep -P 'LISTEN.+:smtp' || exit 1"
timeout: 3s
retries: 0
labels:
- "traefik.enable=true"
- "traefik.http.routers.mail.tls.domains[0].main=mail.MY.DOMAIN"
# Explicit TLS (STARTTLS):
# SMTP
- "traefik.tcp.routers.mail-smtp.rule=HostSNI(`*`)"
- "traefik.tcp.routers.mail-smtp.entrypoints=mail-smtp"
- "traefik.tcp.routers.mail-smtp.service=mail-smtp"
- "traefik.tcp.services.mail-smtp.loadbalancer.server.port=25"
- "traefik.tcp.services.mail-smtp.loadbalancer.proxyProtocol.version=1"
# Implicit TLS is no different, except for optional HostSNI support:
# SMTP-SSL
# - "traefik.tcp.routers.mail-submissions.rule=HostSNI(`*`)"
- "traefik.tcp.routers.mail-submissions.entrypoints=mail-submissions"
- "traefik.tcp.routers.mail-submissions.service=mail-submissions"
- "traefik.tcp.services.mail-submissions.loadbalancer.server.port=465"
- "traefik.tcp.services.mail-submissions.loadbalancer.proxyProtocol.version=1"
# NOTE: Optionally match by SNI rule, this requires TLS passthrough (not compatible with STARTTLS):
- "traefik.tcp.routers.mail-submissions.rule=HostSNI(`mail.MY.DOMAIN`)"
- "traefik.tcp.routers.mail-submissions.tls.passthrough=true"
# - "traefik.tcp.routers.mail-submissions.tls=false"
#SMTP-STARTTLS
# - "traefik.tcp.routers.mail-submission.rule=HostSNI(`*`)"
# - "traefik.tcp.routers.mail-submission.entrypoints=mail-submission"
# - "traefik.tcp.routers.mail-submission.service=mail-submission"
# - "traefik.tcp.services.mail-submission.loadbalancer.server.port=587"
# - "traefik.tcp.services.mail-submission.loadbalancer.proxyProtocol.version=2"
# IMAP
# - "traefik.tcp.routers.mail-imap.rule=HostSNI(`*`)"
# - "traefik.tcp.routers.mail-imap.entrypoints=mail-imap"
# - "traefik.tcp.routers.mail-imap.service=mail-imap"
# - "traefik.tcp.services.mail-imap.loadbalancer.server.port=143"
# IMAP-SSL
# - "traefik.tcp.routers.mail-imaps.rule=HostSNI(`*`)"
- "traefik.tcp.routers.mail-imaps.entrypoints=mail-imaps"
- "traefik.tcp.routers.mail-imaps.service=mail-imaps"
- "traefik.tcp.services.mail-imaps.loadbalancer.server.port=993"
- "traefik.tcp.services.mail-imaps.loadbalancer.proxyProtocol.version=2"
# NOTE: Optionally match by SNI rule, this requires TLS passthrough (not compatible with STARTTLS):
- "traefik.tcp.routers.mail-imaps.rule=HostSNI(`mail.MY.DOMAIN`)"
- "traefik.tcp.routers.mail-imaps.tls.passthrough=true"
# POP3
# - "traefik.tcp.routers.mail-pop3.rule=HostSNI(`*`)"
# - "traefik.tcp.routers.mail-pop3.entrypoints=mail-pop3"
# - "traefik.tcp.routers.mail-pop3.service=mail-pop3"
# - "traefik.tcp.services.mail-pop3.loadbalancer.server.port=110"
# POP3-SSL
# - "traefik.tcp.routers.mail-pop3s.rule=HostSNI(`*`)"
- "traefik.tcp.routers.mail-pop3s.entrypoints=mail-pop3s"
- "traefik.tcp.routers.mail-pop3s.service=mail-pop3s"
- "traefik.tcp.services.mail-pop3s.loadbalancer.server.port=995"
- "traefik.tcp.services.mail-pop3s.loadbalancer.proxyProtocol.version=2"
# NOTE: Optionally match by SNI rule, this requires TLS passthrough (not compatible with STARTTLS):
- "traefik.tcp.routers.mail-pop3s.rule=HostSNI(`mail.MY.DOMAIN`)"
- "traefik.tcp.routers.mail-pop3s.tls.passthrough=true"
# Sieve
# - "traefik.tcp.routers.sieve.rule=HostSNI(`*`)"
# - "traefik.tcp.routers.sieve.entrypoints=mail-managesieve"
# - "traefik.tcp.routers.sieve.service=sieve"
# - "traefik.tcp.services.sieve.loadbalancer.server.port=4190"
networks:
traefik:
ipv4_address: 172.18.0.35
restart: always
roundcube:
image: roundcube/roundcubemail
container_name: roundcube
environment:
- ROUNDCUBEMAIL_DEFAULT_HOST=ssl://mail.MY.DOMAIN
- ROUNDCUBEMAIL_DEFAULT_PORT=993 # Default 143
- ROUNDCUBEMAIL_SMTP_SERVER=ssl://mail.MY.DOMAIN
- ROUNDCUBEMAIL_SMTP_PORT=465 # Default 587
- ROUNDCUBEMAIL_USERNAME_DOMAIN=MY.DOMAIN
# For encrypted connections, prefix the host with tls:// (STARTTLS) or ssl:// (SSL/TLS).
labels:
- "traefik.enable=true"
- "traefik.http.routers.roundcube.rule=Host(`mail.MY.DOMAIN`)"
- "traefik.http.services.roundcube.loadbalancer.server.port=80"
networks:
traefik:
ipv4_address: 172.18.0.18
networks:
traefik:
external: true
๐ Relevant log output
# All displayed here seem to be spam, despite fail2ban
==> docker/mail/data/dms/mail-logs/fail2ban.log <==
2025-01-16 23:17:04,025 fail2ban.actions [1194]: INFO banTime: 15552000
2025-01-16 23:17:04,026 fail2ban.filter [1194]: INFO encoding: UTF-8
2025-01-16 23:17:04,046 fail2ban.jail [1194]: INFO Jail 'postfix' started
2025-01-16 23:17:04,052 fail2ban.jail [1194]: INFO Jail 'dovecot' started
2025-01-16 23:17:04,069 fail2ban.jail [1194]: INFO Jail 'postfix-sasl' started
2025-01-16 23:17:04,085 fail2ban.jail [1194]: INFO Jail 'custom' started
2025-01-16 23:17:04,228 fail2ban.actions [1194]: NOTICE [postfix] Restore Ban 134.209.250.66
2025-01-16 23:17:04,304 fail2ban.actions [1194]: NOTICE [postfix] Restore Ban 185.91.69.110
2025-01-16 23:17:04,332 fail2ban.actions [1194]: NOTICE [postfix] Restore Ban 35.231.253.84
2025-01-16 23:18:44,803 fail2ban.filter [1194]: INFO [postfix] Found 185.247.137.219 - 2025-01-16 23:18:44
==> docker/mail/data/dms/mail-logs/mail.log <==
2025-01-17T00:55:02.968881+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4716><N7xMgNorb8VaGp6f>: Debug: Mailbox INBOX: Mailbox opened
2025-01-17T00:57:02.673013+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4718><ubhVgNorcMVaGp6f>: Debug: Mailbox INBOX: Mailbox opened
2025-01-17T00:57:02.771371+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4147><gMNkcdorEsVaGp6f>: Debug: Mailbox INBOX: Mailbox opened
2025-01-17T00:57:03.070845+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4716><N7xMgNorb8VaGp6f>: Debug: Mailbox INBOX: Mailbox opened
2025-01-17T00:57:48.124330+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4147><gMNkcdorEsVaGp6f>: Disconnected: Logged out in=4797 out=52942 deleted=0 expunged=0 trashed=0 hdr_count=7 hdr_bytes=2266 body_count=7 body_bytes=28901
2025-01-17T00:57:48.124341+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4147><gMNkcdorEsVaGp6f>: Debug: User session is finished
2025-01-17T00:57:48.124347+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4718><ubhVgNorcMVaGp6f>: Disconnected: Logged out in=1987 out=10887 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0
2025-01-17T00:57:48.124352+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4718><ubhVgNorcMVaGp6f>: Debug: User session is finished
2025-01-17T00:57:48.124875+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4716><N7xMgNorb8VaGp6f>: Disconnected: Logged out in=3344 out=14828 deleted=0 expunged=0 trashed=0 hdr_count=1 hdr_bytes=294 body_count=0 body_bytes=0
2025-01-17T00:57:48.124887+01:00 mail dovecot: imap(contact@MY.DOMAIN)<4716><N7xMgNorb8VaGp6f>: Debug: User session is finished
==> docker/mail/data/dms/mail-logs/rspamd.log <==
2025-01-17 00:42:34 #1176(controller) <5t8s4f>; map; http_map_finish: data is not modified for server sa-update.surbl.org, next check at Thu, 16 Jan 2025 23:47:34 GMT (timer based)
2025-01-17 00:44:38 #1176(controller) <1jqufq>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for dbl.spamhaus.org while 'no records with this name' was expected when querying for '1O-KCjNzUYwdfxBQE8hWonnab.dbl.spamhaus.org'(likely DNS spoofing or BL internal issues)
2025-01-17 00:44:51 #1176(controller) <1ccygw>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for dwl.dnswl.org while 'no records with this name' was expected when querying for 'zkAz1jDb.dwl.dnswl.org'(likely DNS spoofing or BL internal issues)
2025-01-17 00:46:08 #1176(controller) <c9hxbz>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for zen.spamhaus.org while 'no records with this name' was expected when querying for '1.0.0.127.zen.spamhaus.org'(likely DNS spoofing or BL internal issues)
2025-01-17 00:47:33 #1176(controller) <k4k3se>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for bl.score.senderscore.com while 'no records with this name' was expected when querying for '1.0.0.127.bl.score.senderscore.com'(likely DNS spoofing or BL internal issues)
2025-01-17 00:50:32 #1176(controller) <5t8s4f>; map; http_map_finish: data is not modified for server sa-update.surbl.org, next check at Thu, 16 Jan 2025 23:55:32 GMT (timer based)
2025-01-17 00:51:32 #1176(controller) <prfoy8>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for list.dnswl.org while 'no records with this name' was expected when querying for '1.0.0.127.list.dnswl.org'(likely DNS spoofing or BL internal issues)
2025-01-17 00:55:28 #1176(controller) <1jqufq>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for dbl.spamhaus.org while 'no records with this name' was expected when querying for 'bbT0uZUdk2Y70_iK6Y3.dbl.spamhaus.org'(likely DNS spoofing or BL internal issues)
2025-01-17 00:55:44 #1176(controller) <imhkkk>; monitored; rspamd_monitored_dns_cb: DNS query blocked on multi.uribl.com (127.0.0.1 returned), possibly due to high volume
2025-01-17 00:57:24 #1176(controller) <1ccygw>; monitored; rspamd_monitored_dns_cb: DNS reply returned 'no error' for dwl.dnswl.org while 'no records with this name' was expected when querying for '598oiv6V0ZOC-Gk.dwl.dnswl.org'(likely DNS spoofing or BL internal issues)
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 17 (9 by maintainers)
Thank you again !
Have removed certs, only use acme.json, working !
DKIM/SPF/DMARC working, no more in spam !
Have fun !