automlbenchmark: Error when using shared/setup.sh

Hi,

I am trying to add a framework to the benchmark suite. However, when doing python runbenchmark.py framework validation my setup.sh calls the shared/setup.sh and the latter fails at line 42 with the error .../venv/bin/pip: No such file or directory. I already tried using a shorter (54 characters, without white spaces) path, as it seems there can be errors related to that as well.

I also tried running python runbenchmark.py TPOT validation, and got the same error, which suggests the issue is not related to my setup.sh file.

Any ideas as to what it might be?

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 16

Most upvoted comments

@sebhrusen

do you have any existing framework in mind? 😃

I suppose TPOT has recently added support for PyTorch models, that’s why it came to my mind. 😃 I think it trains them only from scratch though, as for now.

gabikadlecova on Aug 20, 2020

Thanks @gabrielasuchopar for your tips.

As a sidenote in this discussion, I will soon PR the initial MindsDB framework integration. Maybe then we can figure out what (if any) is the exact issue, because I tried using docker as @sebhrusen indicated to no avail. The weird thing is that once I bypassed the issue by manually creating the venv, I wrote the integration code and now executing python runbenchmark.py MindsDB -m docker seems to work.

paxcema on Aug 17, 2020