notebook: Unrecognized alias: '--profile=xxx', it will probably have no effect.

The --profile option in jupyter appears to be ignored now when it’s run with the notebook command. The usage for it still lists:

Examples

ipython notebook                       # start the notebook
ipython notebook --profile=sympy       # use the sympy profile
ipython notebook --certfile=mycert.pem # use SSL/TLS certificate

About this issue

Original URL
State: closed
Created 9 years ago
Comments: 34 (13 by maintainers)

Most upvoted comments

Ok, here is what I just did durring the last 1/2 h, for me on OS X

Install apache-spark ($ brew install apache-spark)
install findspark ( pip install -e . after cloning https://github.com/minrk/findspark, and cd findspark)
install java (from here)
fire a notebook (jupyter notebook)

enter the following:

import findspark
import os
findspark.init()

import pyspark
sc = pyspark.SparkContext()
lines = sc.textFile(os.path.exapnduser('~/dev/ipython/setup.py'))
lines_nonempty = lines.filter( lambda x: len(x) > 0 )
lines_nonempty.count()

execute :

Yayyyyy !

Carreau on Aug 25, 2015

(Note, installing/downloading java took 20 minutes)

Carreau on Aug 25, 2015

There is no notion of profile in jupyter and for the notebook.

It’s roughly like asking to dual boot a computer because you want to use vim and emacs, and get 2 hard drive just to set your $EDITOR differently.

As stated in the mailing list thread, you can if you like, it would be something like

$ JUPTYER_CONFIG_DIR=~/jupyter_pyspark_foo jupyter notebook

If should auto create the needed files in ~/jupyter_pyspark_foo, but it is likely not what you want.

You most likely just want a separate kernel, or just import pySpark as a library. Still without knowing more of what you want to do it’s hard to give you an answer…

Carreau on Aug 25, 2015