podman: [Quadlet][Rootless] Systemd service prematurely exits

Issue Description

In rootless mode, the systemd service ends up terminating+cleaning up almost immediately after daemonizing the podman process.

Steps to reproduce the issue

Steps to reproduce the issue 0. Tested using the latest release (4.4.4)

Copy [1] to $XDG_CONFIG_HOME/containers/systemd/redis.container
systemctl --user daemon-reload
systemctl --user start redis.service

[1]

[Unit]
Description=Redis container

[Container]
Image=docker.io/redis
PublishPort=6379:6379

[Install]
WantedBy=default.target

Describe the results you received

Service in an inactive state soon after running start, with the ExecStopPost cleanup commands executed.

○ redis.service - Redis container
     Loaded: loaded (/home/user/.config/containers/systemd/redis.container; generated)
     Active: inactive (dead) since Fri 2023-04-07 12:18:56 PDT; 4s ago
   Duration: 4ms
    Process: 904468 ExecStart=/usr/bin/podman run --name=systemd-redis --cidfile=/run/user/1000/redis.cid --replace --rm --log-driver passthrough --cgroups=split --sdnotify=conmon -d --publish 6379:6379 docker.io/redis (code=exited, status=0/SUCCESS)
    Process: 904525 ExecStopPost=/usr/bin/podman rm -f -i --cidfile=/run/user/1000/redis.cid (code=exited, status=0/SUCCESS)
    Process: 904579 ExecStopPost=rm -f /run/user/1000/redis.cid (code=exited, status=0/SUCCESS)
   Main PID: 904468 (code=exited, status=0/SUCCESS)
        CPU: 68ms

Apr 07 12:18:56 host systemd[1143]: Starting Redis container...
Apr 07 12:18:56 host systemd[1143]: Started Redis container.

Describe the results you expected

I expect the service in an active running state. My understanding is that the service files generated here are of Type=Notify, and the flags sent to podman intend for us to use the container monitor (conmon) to send the correct signals to systemd. This doesn’t appear to be happening, and the service appears to just terminate right after running the podman-run command.

podman info output

podman info --debug

host:
  arch: amd64
  buildahVersion: 1.29.0
  cgroupControllers:
  - cpu
  - memory
  - pids
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: /usr/bin/conmon is owned by conmon 1:2.1.7-1
    path: /usr/bin/conmon
    version: 'conmon version 2.1.7, commit: f633919178f6c8ee4fb41b848a056ec33f8d707d'
  cpuUtilization:
    idlePercent: 99.76
    systemPercent: 0.09
    userPercent: 0.15
  cpus: 24
  distribution:
    distribution: arch
    version: unknown
  eventLogger: journald
  hostname: host
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
  kernel: 6.2.9-arch1-1
  linkmode: dynamic
  logDriver: journald
  memFree: 24805396480
  memTotal: 33578450944
  networkBackend: netavark
  ociRuntime:
    name: crun
    package: /usr/bin/crun is owned by crun 1.8.3-1
    path: /usr/bin/crun
    version: |-
      crun version 1.8.3
      commit: 59f2beb7efb0d35611d5818fd0311883676f6f7e
      rundir: /run/user/1000/crun
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL
  os: linux
  remoteSocket:
    exists: true
    path: /run/user/1000/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    seccompProfilePath: /etc/containers/seccomp.json
    selinuxEnabled: false
  serviceIsRemote: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: /usr/bin/slirp4netns is owned by slirp4netns 1.2.0-1
    version: |-
      slirp4netns version 1.2.0
      commit: 656041d45cfca7a4176f6b7eed9e4fe6c11e8383
      libslirp: 4.7.0
      SLIRP_CONFIG_VERSION_MAX: 4
      libseccomp: 2.5.4
  swapFree: 34358685696
  swapTotal: 34358685696
  uptime: 16h 10m 2.00s (Approximately 0.67 days)
plugins:
  authorization: null
  log:
  - k8s-file
  - none
  - passthrough
  - journald
  network:
  - bridge
  - macvlan
  volume:
  - local
registries: {}
store:
  configFile: /home/user/.config/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions: {}
  graphRoot: /home/user/.local/share/containers/storage
  graphRootAllocated: 549739036672
  graphRootUsed: 165679894528
  graphStatus:
    Backing Filesystem: btrfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
    Using metacopy: "false"
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 3
  runRoot: /run/user/1000/containers
  transientStore: false
  volumePath: /home/user/.local/share/containers/storage/volumes
version:
  APIVersion: 4.4.4
  Built: 1680009696
  BuiltTime: Tue Mar 28 06:21:36 2023
  GitCommit: c8223435f49a860c8ac4281a85db39232745a7cb-dirty
  GoVersion: go1.20.2
  Os: linux
  OsArch: linux/amd64
  Version: 4.4.4

Podman in a container

Privileged Or Rootless

Rootless

Upstream Latest Release

Additional environment details

❯ cat /proc/version
Linux version 6.2.9-arch1-1 (linux@archlinux) (gcc (GCC) 12.2.1 20230201, GNU ld (GNU Binutils) 2.40) #1 SMP PREEMPT_DYNAMIC Thu, 30 Mar 2023 14:51:14 +0000

Additional information

Quadlet dry-run output

❯ /usr/lib/podman/quadlet -v -dryrun -user
quadlet-generator[922325]: Loading source unit file /home/user/.config/containers/systemd/redis.container
---redis.service---
[Unit]
Description=Redis container
SourcePath=/home/user/.config/containers/systemd/redis.container
RequiresMountsFor=%t/containers

[X-Container]
Image=docker.io/redis
PublishPort=6379:6379

[Install]
WantedBy=default.target


[Service]
Environment=PODMAN_SYSTEMD_UNIT=%n
KillMode=mixed
ExecStopPost=-/usr/bin/podman rm -f -i --cidfile=%t/%N.cid
ExecStopPost=-rm -f %t/%N.cid
Delegate=yes
Type=notify
NotifyAccess=all
SyslogIdentifier=%N
ExecStart=/usr/bin/podman run --name=systemd-%N --cidfile=%t/%N.cid --replace --rm --log-driver passthrough --cgroups=split --sdnotify=conmon -d --publish 6379:6379 docker.io/redis

Running the ExecStart command from the `redis.service` (removing the log driver) results in the process daemonized and remains persisted.

❯ /usr/bin/podman run --name=systemd-redis --cidfile=/run/user/1000/redis.cid --replace --rm --cgroups=split --sdnotify=conmon -d --publish 6379:6379 docker.io/redis

systemd-redis
6a84965bdd38d8bd230955920543667b92d02b044100a10485686f7f024a1460
❯ podman container ps
CONTAINER ID  IMAGE                           COMMAND       CREATED         STATUS         PORTS                   NAMES
6a84965bdd38  docker.io/library/redis:latest  redis-server  50 seconds ago  Up 50 seconds  0.0.0.0:6379->6379/tcp  systemd-redis

This does not happen with the rootful setup

● redis.service - Redis container
     Loaded: loaded (/etc/containers/systemd/redis.container; generated)
     Active: active (running) since Fri 2023-04-07 12:13:10 PDT; 28s ago
   Main PID: 898999 (conmon)
      Tasks: 6 (limit: 38296)
     Memory: 142.4M
        CPU: 2.735s
     CGroup: /system.slice/redis.service
             ├─libpod-payload-f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317
             │ └─899004 "redis-server *:6379"
             └─runtime
               └─898999 /usr/bin/conmon --api-version 1 -c f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317 -u f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317 -r /usr/bin/crun -b /var/lib/containers/storage/overlay-containers/f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317/userdata -p /run/containers/storage/overlay-containers/f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317/userdata/pidfile -n systemd-redis --exit-dir /run/libpod/exits --full-attach -l passthrough --log-level warning --runtime-arg --log-format=json --runtime-arg --log --runtime-arg=/run/containers/storage/overlay-containers/f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317/userdata/oci-log --conmon-pidfile /run/containers/storage/overlay-containers/f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317/userdata/conmon.pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /var/lib/containers/storage --exit-command-arg --runroot --exit-command-arg /run/containers/storage --exit-command-arg --log-level --exit-command-arg warning --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/libpod --exit-command-arg --network-config-dir --exit-command-arg "" --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /var/lib/containers/storage/volumes --exit-command-arg --transient-store=false --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mountopt=nodev --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --rm --exit-command-arg f6dfff8d41ac52d5e55ba3f464f3dd025633d95fb1da3b07679aa782426ea317

Apr 07 12:13:10 host systemd[1]: Started Redis container.
...

journalctl logs w/ --log-level=debug set on podman run

❯ journalctl --user -b --since 10:36:35 > systemd.log
❯ cat systemd.log

Apr 08 10:36:35 host systemd[1319]: Starting Redis container...
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=info msg="/usr/bin/podman filtering at log level debug"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Called run.PersistentPreRunE(/usr/bin/podman run --name=systemd-redis --cidfile=/run/user/1000/redis.cid --replace --rm --log-driver passthrough --cgroups=split --sdnotify=conmon -d --publish 6379:6379 --log-level=debug docker.io/redis)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using conmon: \"/usr/bin/conmon\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Initializing boltdb state at /home/user/.local/share/containers/storage/libpod/bolt_state.db"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using graph driver overlay"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using graph root /home/user/.local/share/containers/storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using run root /run/user/1000/containers"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using static dir /home/user/.local/share/containers/storage/libpod"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using tmp dir /run/user/1000/libpod/tmp"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using volume path /home/user/.local/share/containers/storage/volumes"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using transient store: false"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Set libpod namespace to \"\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="[graphdriver] trying provided driver \"overlay\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that overlay is supported"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that overlay is supported"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that metacopy is not being used"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that native-diff is usable"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="backingFs=btrfs, projectQuotaSupported=false, useNativeDiff=true, usingMetacopy=false"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Initializing event backend journald"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime krun initialization failed: no valid executable found for OCI runtime krun: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime ocijail initialization failed: no valid executable found for OCI runtime ocijail: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime crun-wasm initialization failed: no valid executable found for OCI runtime crun-wasm: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runc initialization failed: no valid executable found for OCI runtime runc: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runj initialization failed: no valid executable found for OCI runtime runj: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime youki initialization failed: no valid executable found for OCI runtime youki: invalid argument"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using OCI runtime \"/usr/bin/crun\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=info msg="Setting parallel job count to 73"
Apr 08 10:36:35 host systemd[1319]: Started podman-1051772.scope.
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Successfully loaded 1 networks"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Adding port mapping from 6379 to 6379 length 1 protocol \"\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Pulling image docker.io/redis (policy: missing)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Looking up image \"docker.io/redis\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Normalized platform linux/amd64 to {amd64 linux  [] }"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Trying \"docker.io/library/redis:latest\" ..."
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="parsed reference into \"[overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/redis\" as \"docker.io/library/redis:latest\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/redis\" as \"docker.io/library/redis:latest\" in local containers storage ([overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Looking up image \"docker.io/library/redis:latest\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Normalized platform linux/amd64 to {amd64 linux  [] }"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Trying \"docker.io/library/redis:latest\" ..."
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="parsed reference into \"[overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/library/redis:latest\" as \"docker.io/library/redis:latest\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/library/redis:latest\" as \"docker.io/library/redis:latest\" in local containers storage ([overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Looking up image \"docker.io/redis\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Normalized platform linux/amd64 to {amd64 linux  [] }"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Trying \"docker.io/library/redis:latest\" ..."
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="parsed reference into \"[overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/redis\" as \"docker.io/library/redis:latest\" in local containers storage"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Found image \"docker.io/redis\" as \"docker.io/library/redis:latest\" in local containers storage ([overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Inspecting image 31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Inspecting image 31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Inspecting image 31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Inspecting image 31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Inspecting image 31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Image has volume at \"/data\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Adding anonymous image volume at \"/data\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="using systemd mode: false"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="setting container name systemd-redis"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="No hostname set; container's hostname will default to runtime default"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Loading seccomp profile from \"/etc/containers/seccomp.json\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Allocated lock 0 for container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="parsed reference into \"[overlay@/home/user/.local/share/containers/storage+/run/user/1000/containers]@31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="exporting opaque data as blob \"sha256:31f08b90668e9730067b53acbd28e536dadb25c746f4379a8a83c84fb1c48d1a\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that idmapped mounts for overlay are not supported"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Check for idmapped mounts support "
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Created container \"ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Container \"ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf\" has work directory \"/home/user/.local/share/containers/storage/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Container \"ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf\" has run directory \"/run/user/1000/containers/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Creating new volume 78a6d6bdd0c7de0f85a6f1c3ba4b6ceef847713690d837a3110920c9f3db6d85 for container"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Validating options for local driver"
Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.564041279 -0700 PDT m=+0.045495229 volume create 78a6d6bdd0c7de0f85a6f1c3ba4b6ceef847713690d837a3110920c9f3db6d85
Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.57025252 -0700 PDT m=+0.051706470 container create ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that volatile is being used"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="overlay: mount_data=lowerdir=/home/user/.local/share/containers/storage/overlay/l/SIRGWK5MQ4J62RE7SM5XQS5KKX:/home/user/.local/share/containers/storage/overlay/l/HBV4IHGWHDHS33L5TM3YL3VLSD:/home/user/.local/share/containers/storage/overlay/l/TA4ECCZOFO2AEDVYDV6NHGDKIK:/home/user/.local/share/containers/storage/overlay/l/UCRPVYFRU5XXIGJ5JUO6JZDQBJ:/home/user/.local/share/containers/storage/overlay/l/DHPRFFTBULYD2BWXY6AWLIQ3JF:/home/user/.local/share/containers/storage/overlay/l/OYNGQVHLA4AKQV6NYWJRIC6BUD,upperdir=/home/user/.local/share/containers/storage/overlay/b52f960df57fb1b00306b6fadf2831c8b01838752949c7d0f87b56fd17e09906/diff,workdir=/home/user/.local/share/containers/storage/overlay/b52f960df57fb1b00306b6fadf2831c8b01838752949c7d0f87b56fd17e09906/work,,userxattr,volatile"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Made network namespace at /run/user/1000/netns/netns-de9f1c5f-28c2-53ea-38af-21969a448e21 for container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Mounted container \"ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf\" at \"/home/user/.local/share/containers/storage/overlay/b52f960df57fb1b00306b6fadf2831c8b01838752949c7d0f87b56fd17e09906/merged\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Going to mount named volume 78a6d6bdd0c7de0f85a6f1c3ba4b6ceef847713690d837a3110920c9f3db6d85"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Copying up contents from container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf to volume 78a6d6bdd0c7de0f85a6f1c3ba4b6ceef847713690d837a3110920c9f3db6d85"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Created root filesystem for container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf at /home/user/.local/share/containers/storage/overlay/b52f960df57fb1b00306b6fadf2831c8b01838752949c7d0f87b56fd17e09906/merged"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="slirp4netns command: /usr/bin/slirp4netns --disable-host-loopback --mtu=65520 --enable-sandbox --enable-seccomp --enable-ipv6 -c -e 3 -r 4 --netns-type=path /run/user/1000/netns/netns-de9f1c5f-28c2-53ea-38af-21969a448e21 tap0"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"Starting parent driver\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"opaque=map[builtin.readypipepath:/run/user/1000/libpod/tmp/rootlessport442856005/.bp-ready.pipe builtin.socketpath:/run/user/1000/libpod/tmp/rootlessport442856005/.bp.sock]\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"Starting child driver in child netns (\\\"/proc/self/exe\\\" [rootlessport-child])\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"Waiting for initComplete\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"initComplete is closed; parent and child established the communication channel\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=\"Exposing ports [{ 6379 6379 1 tcp}]\"\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport: time=\"2023-04-08T10:36:35-07:00\" level=info msg=Ready\n"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="rootlessport is ready"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Skipping unrecognized mount in /etc/containers/mounts.conf: \"# Configuration file for default mounts in containers (see man 5\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Skipping unrecognized mount in /etc/containers/mounts.conf: \"# containers-mounts.conf for further information)\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Skipping unrecognized mount in /etc/containers/mounts.conf: \"\""
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="/etc/system-fips does not exist on host, not mounting FIPS mode subscription"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="reading hooks from /usr/share/containers/oci/hooks.d"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Workdir \"/data\" resolved to a volume or mount"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Created OCI spec for container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf at /home/user/.local/share/containers/storage/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata/config.json"
Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.546997865 -0700 PDT m=+0.028451815 image pull  docker.io/redis
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="/usr/bin/conmon messages will be logged to syslog"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="running conmon: /usr/bin/conmon" args="[--api-version 1 -c ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf -u ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf -r /usr/bin/crun -b /home/user/.local/share/containers/storage/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata -p /run/user/1000/containers/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata/pidfile -n systemd-redis --exit-dir /run/user/1000/libpod/tmp/exits --full-attach -l passthrough --log-level debug --syslog --conmon-pidfile /run/user/1000/containers/overlay-containers/ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf/userdata/conmon.pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /home/user/.local/share/containers/storage --exit-command-arg --runroot --exit-command-arg /run/user/1000/containers --exit-command-arg --log-level --exit-command-arg debug --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/user/1000/libpod/tmp --exit-command-arg --network-config-dir --exit-command-arg  --exit-command-arg --network-backend --exit-command-arg netavark --exit-command-arg --volumepath --exit-command-arg /home/user/.local/share/containers/storage/volumes --exit-command-arg --transient-store=false --exit-command-arg --runtime --exit-command-arg crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --events-backend --exit-command-arg journald --exit-command-arg --syslog --exit-command-arg container --exit-command-arg cleanup --exit-command-arg --rm --exit-command-arg ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf]"
Apr 08 10:36:35 host redis[1051810]: [conmon:d]: failed to write to /proc/self/oom_score_adj: Permission denied
Apr 08 10:36:35 host conmon[1051810]: conmon ae58d6050dce3eecf446 <ndebug>: failed to write to /proc/self/oom_score_adj: Permission denied
Apr 08 10:36:35 host redis[1051812]: [conmon:d]: failed to write to /proc/self/oom_score_adj: Permission denied
Apr 08 10:36:35 host conmon[1051812]: conmon ae58d6050dce3eecf446 <ndebug>: failed to write to /proc/self/oom_score_adj: Permission denied
Apr 08 10:36:35 host conmon[1051811]: conmon ae58d6050dce3eecf446 <ndebug>: container PID: 1051813
Apr 08 10:36:35 host conmon[1051811]: conmon ae58d6050dce3eecf446 <nwarn>: Failed to add inotify watch for /sys/fs/cgroup/memory.events
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Received: 1051813"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=info msg="Got Conmon PID as 1051811"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Created container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf in OCI runtime"
Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.666843088 -0700 PDT m=+0.148297028 container init ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Starting container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf with command [docker-entrypoint.sh redis-server]"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Started container ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Notify sent successfully"
Apr 08 10:36:35 host systemd[1319]: Started Redis container.
Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.671603545 -0700 PDT m=+0.153057495 container start ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Called run.PersistentPostRunE(/usr/bin/podman run --name=systemd-redis --cidfile=/run/user/1000/redis.cid --replace --rm --log-driver passthrough --cgroups=split --sdnotify=conmon -d --publish 6379:6379 --log-level=debug docker.io/redis)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Shutting down engines"
Apr 08 10:36:35 host systemd[1319]: Started podman-1051824.scope.
Apr 08 10:36:35 host conmon[1051811]: conmon ae58d6050dce3eecf446 <nwarn>: Failed to open cgroups file: /sys/fs/cgroup/memory.events
Apr 08 10:36:35 host podman[1051824]: 2023-04-08 10:36:35.792708388 -0700 PDT m=+0.110797437 container died ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Called cleanup.PersistentPreRunE(/usr/bin/podman --root /home/user/.local/share/containers/storage --runroot /run/user/1000/containers --log-level debug --cgroup-manager systemd --tmpdir /run/user/1000/libpod/tmp --network-config-dir  --network-backend netavark --volumepath /home/user/.local/share/containers/storage/volumes --transient-store=false --runtime crun --storage-driver overlay --events-backend journald --syslog container cleanup --rm ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf)"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using conmon: \"/usr/bin/conmon\""
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Initializing boltdb state at /home/user/.local/share/containers/storage/libpod/bolt_state.db"
Apr 08 10:36:35 host podman[1051824]: 2023-04-08 10:36:35.8185473 -0700 PDT m=+0.136636339 container remove ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host redis[1051824]: ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using graph driver overlay"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using graph root /home/user/.local/share/containers/storage"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using run root /run/user/1000/containers"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using static dir /home/user/.local/share/containers/storage/libpod"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using tmp dir /run/user/1000/libpod/tmp"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using volume path /home/user/.local/share/containers/storage/volumes"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using transient store: false"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Set libpod namespace to \"\""
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="[graphdriver] trying provided driver \"overlay\""
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that overlay is supported"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that overlay is supported"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that metacopy is not being used"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Cached value indicated that native-diff is usable"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="backingFs=btrfs, projectQuotaSupported=false, useNativeDiff=true, usingMetacopy=false"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Initializing event backend journald"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime crun-wasm initialization failed: no valid executable found for OCI runtime crun-wasm: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runc initialization failed: no valid executable found for OCI runtime runc: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runj initialization failed: no valid executable found for OCI runtime runj: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime youki initialization failed: no valid executable found for OCI runtime youki: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime krun initialization failed: no valid executable found for OCI runtime krun: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Configured OCI runtime ocijail initialization failed: no valid executable found for OCI runtime ocijail: invalid argument"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Using OCI runtime \"/usr/bin/crun\""
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=info msg="Setting parallel job count to 73"
Apr 08 10:36:35 host systemd[1319]: Started podman-1051853.scope.
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=error msg="Running container cleanup: no container with name or ID \"ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf\" found: no such container"
Apr 08 10:36:35 host /usr/bin/podman[1051853]: time="2023-04-08T10:36:35-07:00" level=debug msg="Shutting down engines"

As far as I can tell, the MAINPID and READY status are being sent to the NOTIFY_SOCKET

❯ sock=/run/user/1000/systemd/notify
❯ ./unix_socket_dump $sock
MAINPID=1050639
READY=1

About this issue

Original URL
State: closed
Created a year ago
Reactions: 1
Comments: 39 (22 by maintainers)

Most upvoted comments

Thanks for reaching out, @MadhuVK!

The logs do not indicate that the notify message we not sent:

Apr 08 10:36:35 host podman[1051772]: 2023-04-08 10:36:35.671603545 -0700 PDT m=+0.153057495 container start ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Called run.PersistentPostRunE(/usr/bin/podman run --name=systemd-redis --cidfile=/run/user/1000/redis.cid --replace --rm --log-driver passthrough --cgroups=split --sdnotify=conmon -d --publish 6379:6379 --log-level=debug docker.io/redis)"
Apr 08 10:36:35 host redis[1051772]: time="2023-04-08T10:36:35-07:00" level=debug msg="Shutting down engines"
Apr 08 10:36:35 host systemd[1319]: Started podman-1051824.scope.
Apr 08 10:36:35 host conmon[1051811]: conmon ae58d6050dce3eecf446 <nwarn>: Failed to open cgroups file: /sys/fs/cgroup/memory.events
Apr 08 10:36:35 host podman[1051824]: 2023-04-08 10:36:35.792708388 -0700 PDT m=+0.110797437 container died ae58d6050dce3eecf44659b726ac1c72ce2b26a05596d8cb6e394f5d86d2feaf (image=docker.io/library/redis:latest, name=systemd-redis, PODMAN_SYSTEMD_UNIT=redis.service)

Looking at the timestamps, there would should be a much bigger gap since systemd would wait for the start timeout to exceed and then kill the container. The timestamps indicate though that the container dies right after being started.

Can you try running another container with Quadlet just doing a simple sleep infinity?

vrothberg on Apr 11, 2023