cmdstanpy: CmdStanModel.Sample method does not track profiling

Summary:

The cmdstanpy.CmdStanModel.sample() does not provide the profiling.csv file that cmdstan generates

Description:

When running cmdstan through the cmdstanpy API, I cannot see the profile.csv file being generated (the one that includes execution times). Is there anyone working on this or any plan to incorporate it?

I have been modifying the source code from the cmdstanpy on my local machine so that it is printed, but don’t wanna start any pull request if anyone is working on this already.

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 20 (14 by maintainers)

Most upvoted comments

Ok, I tested and found the error.

By default profile.csv is saved to current working directory. And we sample 4 chains, each of them will save results to profile.csv (so file is overwritten).

We should add option to save with the filename. But really CmdStan should add timestamp + id on the filename.

@bbbales2

profile_location = Path.cwd() / "profile.csv"
print(profile_location.exists(), "\n", profile_location)

just to let y’all know I’ve got a branch and got things working. need unit tests and then code review.