snowflake-jdbc: SNOW-1846830: SNOW-1863648 PUT command does not transfer file for JDBC driver from 3.17.0

First reported here: DB Loader not working with Snowflake driver from 3.17

Using command: PUT 'file:///C:/KNIME/test.csv' '@~' AUTO_COMPRESS=FALSE; And then listing with: list '@~'

No file is transferred with drivers from and above 3.17.0

  1. What version of JDBC driver are you using?
  • snowflake-jdbc-3.20.0.jar
  • snowflake-jdbc-3.19.1.jar
  • snowflake-jdbc-3.18.0.jar
  • snowflake-jdbc-3.17.0.jar
  1. What operating system and processor architecture are you using? Windows 11, running KNIME 5.2.2

  2. What version of Java are you using? KNIME 5.2.x ships with JRE 17

  3. What did you do?

Registrated different drivers in KNIME:

drivers/snowflake_test_3.14.1/name=Snowflake Test 3.14.1
drivers/snowflake_test_3.14.1/database_type=snowflake
drivers/snowflake_test_3.14.1/description=Snowflake JDBC Driver Test
drivers/snowflake_test_3.14.1/driver_class=net.snowflake.client.jdbc.SnowflakeDriver
drivers/snowflake_test_3.14.1/paths/0=C:\\KNIME\\snowflake_test\\snowflake-jdbc-3.14.1.jar
drivers/snowflake_test_3.14.1/url_template=jdbc\:snowflake\://novozymes-prod.snowflakecomputing.com/?warehouse\=<warehouse>&role\=[role]&db\=[database]&schema\=[schema]
drivers/snowflake_test_3.14.1/version=3.14.1
drivers/snowflake_test_3.16.1/name=Snowflake Test 3.16.1
drivers/snowflake_test_3.16.1/database_type=snowflake
drivers/snowflake_test_3.16.1/description=Snowflake JDBC Driver Test
drivers/snowflake_test_3.16.1/driver_class=net.snowflake.client.jdbc.SnowflakeDriver
drivers/snowflake_test_3.16.1/paths/0=C:\\KNIME\\snowflake_test\\snowflake-jdbc-3.16.1.jar
drivers/snowflake_test_3.16.1/url_template=jdbc\:snowflake\://novozymes-prod.snowflakecomputing.com/?warehouse\=<warehouse>&role\=[role]&db\=[database]&schema\=[schema]
drivers/snowflake_test_3.16.1/version=3.16.1
drivers/snowflake_test_3.17.0/name=Snowflake Test 3.17.0
drivers/snowflake_test_3.17.0/database_type=snowflake
drivers/snowflake_test_3.17.0/description=Snowflake JDBC Driver Test
drivers/snowflake_test_3.17.0/driver_class=net.snowflake.client.jdbc.SnowflakeDriver
drivers/snowflake_test_3.17.0/paths/0=C:\\KNIME\\snowflake_test\\snowflake-jdbc-3.17.0.jar
drivers/snowflake_test_3.17.0/url_template=jdbc\:snowflake\://novozymes-prod.snowflakecomputing.com/?warehouse\=<warehouse>&role\=[role]&db\=[database]&schema\=[schema]
drivers/snowflake_test_3.17.0/version=3.17.0
drivers/snowflake_test_3.20.0/name=Snowflake Test 3.20.0
drivers/snowflake_test_3.20.0/database_type=snowflake
drivers/snowflake_test_3.20.0/description=Snowflake JDBC Driver Test
drivers/snowflake_test_3.20.0/driver_class=net.snowflake.client.jdbc.SnowflakeDriver
drivers/snowflake_test_3.20.0/paths/0=C:\\KNIME\\snowflake_test\\snowflake-jdbc-3.20.0.jar
drivers/snowflake_test_3.20.0/url_template=jdbc\:snowflake\://novozymes-prod.snowflakecomputing.com/?warehouse\=<warehouse>&role\=[role]&db\=[database]&schema\=[schema]
drivers/snowflake_test_3.20.0/version=3.20.0

And then run the PUT command and list command

image

  1. What did you expect to see?

I expected to see file in user stage.

I validated query_history was listing the commands.

select q.START_TIME, q.EXECUTION_STATUS, q.ERROR_MESSAGE, q.QUERY_TEXT--, q.*
from table(information_schema.query_history()) AS q
--WHERE QUERY_TYPE = 'PUT_FILES'
WHERE USER_NAME = CURRENT_USER
order by q.START_TIME desc;
  1. Can you set logging to DEBUG and collect the logs?

No

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 27 (10 by maintainers)

Most upvoted comments

fix is merged and will be part of the next release

no known ETTR for now, but we’ll keep this thread posted with the progress if any. Right now, the team is working on the fix. Thank you for bearing with us while this is fixed!

The three / in the beginning of the URI is the proper URI format for local Windows paths as described here. This was accepted and properly parsed by the driver until version 3.16.1. So I would consider this a bug in the path handling of the driver and thus would reopen this issue request. It would be also great if you could explain in more detail what method you use or link to the part in the source code that parses the path argument since in the documentation it mentions that it is expecting a URI but also the space in the file name “load data” is not URI encoded e.g. load%20data. Thanks a lot.

Bug located. Seems the has been a change in accepting PATH from 16.1 to 20.0

KNIME generates PATH with an extra /

# Not working
PUT 'file:///C:/KNIME/test.csv' '@~' AUTO_COMPRESS=FALSE;

# Working
PUT 'file://C:/KNIME/test.csv' '@~' AUTO_COMPRESS=FALSE;
PUT 'file://C:\\KNIME\\test.csv' '@~' AUTO_COMPRESS=FALSE;