tensorflow: bazel absence of ZIP64 support cause tensorflow build fail

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): no
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10 1803
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): v1.11.0-rc1
Python version: 3.6.5
Bazel version (if compiling from source): 0.15.2
GCC/Compiler version (if compiling from source): vs2017 15.8 / cl.exe 19.15.26726
CUDA/cuDNN version: 9.2.148.1/7.2.1
GPU model and memory: 1080ti 11GB
Exact command to reproduce:

bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package
bazel-bin\tensorflow\tools\pip_package\build_pip_package C:/tmp/tensorflow_pkg

Describe the problem

If build artifact large than 4GB, it can’t generate the python package.

A easy way to reproduce the issue

Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 3.5,7.0]: 3.0,3.2,3.5,5.0,5.2,5.3

Source code / logs

Uncompressed input jar has size ???, which exceeds the maximum supported output size 4294967295.
Assuming that ijar will be smaller and hoping for the best.

Unzipping simple_console_for_windows.zip to create runfiles tree...
[./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip]
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip or
        ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip.zip, and cannot find ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip.ZIP, period.

About this issue

Original URL
State: closed
Created 6 years ago
Comments: 15 (10 by maintainers)

Commits related to this issue

Use custom py_binary in tensorflow/contrib/eager/python/examples/densenet/BUILD Address #22390#issuecomment-439610881 PiperOrigin-RevId: 223811309 — committed to tensorflow/tensorflow by tensorflower-gardener 6 years ago

Most upvoted comments

Building the pip package succeeded for me after including the --define=no_tensorflow_py_deps=true.

Error without "no dependencies" flag (Click to expand)

(tf-gpu-src) C:\Users\hbeck3\tf-gpu\tensorflow>bazel-bin\tensorflow\tools\pip_package\build_pip_package C:\Users\hbeck3\tf-gpu\pip-package-cuda10-py3.6.6

Sun Oct 28 13:50:53 WEST 2018 : === Preparing sources in dir: /tmp/tmp.cSTaMzHDFx Unzipping simple_console_for_windows.zip to create runfiles tree… [./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip] End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip or ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip.zip, and cannot find ./bazel-bin/tensorflow/tools/pip_package/simple_console_for_windows.zip.ZIP, period.

(tf-gpu-src) C:\Users\hbeck3\tf-gpu\tensorflow>

Success with "no dependencies" flag (Click to expand)

(tf-gpu-src) C:\Users\hbeck3\tf-gpu\tensorflow>bazel build --define=no_tensorflow_py_deps=true --jobs 1 --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package

[…] INFO: Build completed successfully, 50 total actions

(tf-gpu-src) C:\Users\hbeck3\tf-gpu\tensorflow>bazel-bin\tensorflow\tools\pip_package\build_pip_package C:\Users\hbeck3\tf-gpu\pip-package-cuda10-py3.6.6 […] Sun Oct 28 14:53:58 WEST 2018 : === Output wheel file is in: C:\Users\hbeck3\tf-gpu\pip-package-cuda10-py3.6.6

(tf-gpu-src) C:\Users\hbeck3\tf-gpu\tensorflow>

aaniin on Oct 28, 2018

Unfortunately, we have to rollback a part of 77e2686. If anyone encounter this issue again, please build TensorFlow with --define=no_tensorflow_py_deps=true

meteorcloudy on Oct 15, 2018

@aaniin can you please post your setup as I’m still getting the same error even with --define=no_tensorflow_py_deps=true

Thanks!

dannycarrera on Oct 29, 2018

@meteorcloudy

v1.11.0-rc2 + cherry-pick 2a01b6ad169dc433d002bb61a3a7581cb0662556

It can build with most consumer compute capability.

Thank you for help.

fo40225 on Sep 24, 2018