buildah: Buildah failing to pull large docker images with error storing to blob file

(Edited by @TomSweeneyRedHat just to make the post more readable in GitHub. No content changes)

I’m running buildah in a privileged pod. Trying to pull a docker image of size 10GB and constantly failing.

Steps to reproduce the issue:

1. buildah pull a really large image with multiple layers.

Describe the results you received:

failed with the below error

DEBU error copying src image ["docker://docker-registry.infra.cloudera.com/cdsw/engine:11"] to dest image ["docker-registry.infra.cloudera.com/cdsw/engine:11"] err: Error writing blob: error storing blob to file "/var/tmp/storage105374735/10": unexpected EOF 
DEBU error pulling image "docker://docker-registry.infra.cloudera.com/cdsw/engine:11": Error writing blob: error storing blob to file "/var/tmp/storage105374735/10": unexpected EOF 
DEBU unable to pull and read image "docker-registry.infra.cloudera.com/cdsw/engine:11": Error writing blob: error storing blob to file "/var/tmp/storage105374735/10": unexpected EOF 
Error writing blob: error storing blob to file "/var/tmp/storage105374735/10": unexpected EOF

Describe the results you expected:

Should be able to pull the image successfully

Output of rpm -q buildah or apt list buildah:

(paste your output here)

Output of buildah version:

Version:         1.12.0-dev
Go Version:      go1.13.5
Image Spec:      1.0.1-dev
Runtime Spec:    1.0.1-dev
CNI Spec:        0.4.0
libcni Version:  v0.7.1
image Version:   5.0.0
Git Commit:      8d6869bc
Built:           Tue Dec 10 18:02:04 2019
OS/Arch:         linux/amd64

Output of podman version if reporting a podman build issue:

(paste your output here)

Output of cat /etc/*release:

NAME=Fedora
VERSION="31 (Container Image)"
ID=fedora
VERSION_ID=31
VERSION_CODENAME=""
PLATFORM_ID="platform:f31"
PRETTY_NAME="Fedora 31 (Container Image)"
ANSI_COLOR="0;34"
LOGO=fedora-logo-icon
CPE_NAME="cpe:/o:fedoraproject:fedora:31"
HOME_URL="https://fedoraproject.org/"
DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f31/system-administrators-guide/"
SUPPORT_URL="https://fedoraproject.org/wiki/Communicating_and_getting_help"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="Fedora"
REDHAT_BUGZILLA_PRODUCT_VERSION=31
REDHAT_SUPPORT_PRODUCT="Fedora"
REDHAT_SUPPORT_PRODUCT_VERSION=31
PRIVACY_POLICY_URL="https://fedoraproject.org/wiki/Legal:PrivacyPolicy"
VARIANT="Container Image"
VARIANT_ID=container
Fedora release 31 (Thirty One)
Fedora release 31 (Thirty One)

Output of uname -a:

Linux s2i-builder-54889679f5-5hh9s 4.18.0-147.0.3.el8_1.x86_64 #1 SMP Mon Nov 11 12:58:36 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Output of cat /etc/containers/storage.conf:

[storage]

driver = "overlay"

runroot = "/var/run/containers/storage"

graphroot = "/var/lib/containers/storage"

[storage.options]
additionalimagestores = [
]
size = ""
mount_program = "/usr/bin/fuse-overlayfs"

override_kernel_check = "true"
mountopt = "nodev,metacopy=on"
[storage.options.thinpool]

   ostree_repo = ""

   skip_mount_home = "false"