Carlo Nicolini

Installing Jupyter with a Scala + Spark kernel

Apr 1, 2020

Installazione SCALA + SPARK + Jupyter

  1. Conda

Istruzioni installazione conda e creazione environment con Jupyter-lab

  1. Creazione tunnel tramite Putty SSH

  2. Installazione almond

 ./coursier launch almond:0.9.1 --scala 2.12.10 -- --install --force
jupyter lab --port=8888 --no-browser
  1. Aprire un notebook con Kernel Scala (dovrebbe apparire nella scelta)

Importare Spark

jupyter lab --port=8888 --no-browser
>> import $ivy.`org.apache.spark::spark-sql:2.4.0` 
>> import $ivy.`sh.almond::almond-spark:0.9.1`

Alcune note qua descritte

Further reading

Read more in the tech topic.

Let's talk!

I'm Carlo Nicolini — I am interested on the reliability of AI reasoning systems (interpretability, inference-time methods, probabilistic language programming) and on quantitative portfolio optimization (I am a maintainer of skfolio). If you're working on something in these areas and think we might collaborate, chat, discuss, I'm happy to talk about it!

The best way to reach me is on via DM on LinkedIn.