pystore: Append not working with Dask > 2.1.0
Append stopped working for me in 0.1.12
My reproducible example:
import random
import datetime as dt
import pandas as pd
import pystore as ps
#create df with random numbers and timestamp as index
n = 2
timestamps = [dt.datetime.utcnow() + dt.timedelta(seconds=x) for x in range(n)]
pb = ([{'timestamp': timestamp, 'pb': random.random()} for timestamp in timestamps])
df = pd.DataFrame.from_dict(pb).set_index('timestamp')
store = ps.store('mydatastore')
collection = store.collection('eod')
#write to pystore
collection.write('symbol', df[:-1], overwrite=True)
#append to pystore
collection.append('symbol', df[-1:])
#read
collection.item('symbol').to_pandas()
This works in 0.1.9 Would be grateful for any hint.
Kind regards Steffen
About this issue
- Original URL
- State: closed
- Created 5 years ago
- Comments: 19 (6 by maintainers)
Commits related to this issue
- addressing issues #17, #21, #22 and #23 — committed to ranaroussi/pystore by ranaroussi 5 years ago
Just gave it a spin with
fastparquet==0.3.2
and 'dask==2.3.0` and it works. Happy we can put this to rest. Have a great weekend!will try. newest version on conda channel is
0.3.0
. will do pip install --upgrade which gets me0.3.2
. Will most probably get back on Monday on this.