filprofiler: Many missing allocations on MacOS

hello! getting lots of

=fil-profile= WARNING: Somehow an allocation of size 24 disappeared. This can happen if e.g. a library frees memory with private OS APIs. If this happens only a few times with small allocations, it doesn't really matter. If you see this happening a lot, or with large allocations, please file a bug.

warnings of various sizes (though the vast majority seem to be < 100) when using pandas to wrap SQL results in a dataframe. Unsure if its relevant or not, but this is reading query results from a snowflake DB.

context:

python v3.7.9
macOS catalina v10.15.7
pandas==1.1.5
filprofiler==2021.4.0

example snippet:

from filprofiler.api import profile
import pandas as pd 

connection = get_snowflake_connection()  # returns SQLAlchemy connectable object 
sql = 'select * from test_table;'
result = profile(lambda: pd.read_sql(sql, con=connection), '/Users/rblanchard/fil-result')

and then I run the profiler via

fil-profile python mem_prof.py

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 15

Most upvoted comments

Release 2021.04.2 with the improved warning messages should be available later today (PyPI) or tomorrow (Conda).