tensorflow: Cannot Read From Google Storage with tf.io.gfile.GFile under intel-tensorflow==1.14.0
Support for Google Storage (gs protocol) seems to be missing from intel-tensorflow==1.14.0, which is unexpected. I’m aware that this is no core tensorflow issue but I’ve seen that some engineers from Intel are active in this repository.
System information
- Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
 - OS Platform and Distribution (e.g., Linux Ubuntu 16.04): docker image 
intelaipg/intel-optimized-tensorflow:1.14.0-mkl-py3(Ubuntu 18.04.2 LTS) - Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
 - TensorFlow installed from (source or binary): No
 - TensorFlow version (use command below): 1.14.0
 - Python version: 3.6.8
 - Bazel version (if compiling from source): n/a
 - GCC/Compiler version (if compiling from source): n/a
 - CUDA/cuDNN version: n/a
 - GPU model and memory: n/a
 
You can collect some of this information using our environment capture script You can also obtain the TensorFlow version with:
- TF 1.0: 
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)" - TF 2.0: 
python -c "import tensorflow as tf; print(tf.version.GIT_VERSION, tf.version.VERSION)" 
Output: v1.14.0-1-hardened-0-g340d16ee58 1.14.0
Describe the current behavior
Google storage doesn’t seem to be supported for some reason:
> python
Python 3.6.8 (default, Jan 14 2019, 11:02:34)
[GCC 8.0.1 20180414 (experimental) [trunk revision 259383]] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf; tf.io.gfile.GFile("gs://some_bucket/test.txt").read()
[deprecation warning redacted]
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/lib/io/file_io.py", line 122, in read
    self._preread_check()
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/lib/io/file_io.py", line 84, in _preread_check
    compat.as_bytes(self.__name), 1024 * 512)
tensorflow.python.framework.errors_impl.UnimplementedError: File system scheme 'gs' not implemented (file: 'gs://some_bucket/test.txt')
Describe the expected behavior
Verified to work with 1.13.2:
> python
Python 3.6.8 (default, Jan 14 2019, 11:02:34)
[GCC 8.0.1 20180414 (experimental) [trunk revision 259383]] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf; tf.io.gfile.GFile("gs://some_bucket/test.txt").read()
[deprecation warning redacted]
'test\n'
Standalone code to reproduce the issue
See above.
Other info / logs n/a
About this issue
- Original URL
 - State: closed
 - Created 4 years ago
 - Comments: 16 (8 by maintainers)
 
@pks. Thank you! The TF1.14 is out of maintain. But TF 1.15 will be maintained for more months.