filprofiler: Many missing allocations on MacOS
hello! getting lots of
=fil-profile= WARNING: Somehow an allocation of size 24 disappeared. This can happen if e.g. a library frees memory with private OS APIs. If this happens only a few times with small allocations, it doesn't really matter. If you see this happening a lot, or with large allocations, please file a bug.
warnings of various sizes (though the vast majority seem to be < 100) when using pandas to wrap SQL results in a dataframe. Unsure if its relevant or not, but this is reading query results from a snowflake DB.
context:
python v3.7.9
macOS catalina v10.15.7
pandas==1.1.5
filprofiler==2021.4.0
example snippet:
from filprofiler.api import profile
import pandas as pd
connection = get_snowflake_connection() # returns SQLAlchemy connectable object
sql = 'select * from test_table;'
result = profile(lambda: pd.read_sql(sql, con=connection), '/Users/rblanchard/fil-result')
and then I run the profiler via
fil-profile python mem_prof.py
About this issue
- Original URL
- State: closed
- Created 3 years ago
- Comments: 15
Release
2021.04.2
with the improved warning messages should be available later today (PyPI) or tomorrow (Conda).