Valohai blog

Insights from the deep learning industry.

All Posts

Automatic Version Control Meets Jupyter Notebooks

jupyter-notebook-and-valohai

Running a local notebook is great for early data exploration and model tinkering, there’s no doubt about it. But eventually you’ll outgrow it and want to scale up and train the model in the cloud with easy parallel executions, full version control and robust deployment. (Letting you reproduce your experiments and share them with team members at any time.)

Transitioning your local code to running in the cloud can often feel like a complicated task with many steps in an unfamiliar environment. Here at Valohai, we want to help you take your notebook project from the early prototyping phase to production as painlessly as possible, so we’re excited to share that we’ve been developing a Valohai plug-in for Jupyter Notebook.

Valohai-jupyter-notebook-addon

Running your local notebook on the Valohai deep learning platform is just a few clicks away. The plug-in takes care of configuration, triggering the cloud instance, getting the notebook output back in real-time, and finally closing down the cloud instance automatically. You’ll still have all the power-user tools like Valohai CLI and Valohai API at your disposal, but the plug-in will offer a new easier option without any learning curve.

Unlike many other notebook cloud hosting services, you’re not only able to choose any cloud provider (like AWS, Azure or GCP) on-demand, but more importantly your instances are always shut down immediately after the code has executed. There’s no longer any need to budget for persistent instances; you’ll only pay for the time you actually executed your code! And as an added benefit, every training run that you do is automatically version controlled – you can share your experiments with others and reproduce them with the same code, data, hyperparameters and more.

Want to hear more or give the plug-in a try as a beta tester? Don’t hesitate to get in touch. It’s in closed beta at the moment but ready to use for our most eager users!

Sign up for the early access program for the Valohai Jupyter Notebook plugin

Juha Kiili
Juha Kiili
Senior Software Developer with gaming industry background shape-shifted into full-stack ninja. I have the biggest monitor.

Related Posts

Automatic Version Control Meets Jupyter Notebooks

Running a local notebook is great for early data exploration and model tinkering, there’s no doubt about it. But eventually you’ll outgrow it and want to scale up and train the model in the cloud with easy parallel executions, full version control and robust deployment. (Letting you reproduce your experiments and share them with team members at any time.)

Run Jupyter Notebook On Any Cloud Provider

This tutorial will demonstrate how to take a single cell in a local Jupyter Notebook and run it in the cloud, using the Valohai platform and its command-line client (CLI).

Level Up Your ML Code from Notebook to Production

Developing a machine learning model for a new project starts with certain common groundwork and exploration, to understand your data and figure out the approaches to try. A popular choice for this groundwork is Jupyter, an environment where you write Python code interactively. In Jupyter notebook's cells you can evaluate and revise and it is an attractive, visual choice (and many times the right choice) – for this step of data science work. Since Jupyter kernels, the processes backing a notebook’s execution, retain their internal state while the code is being edited and revised, they’re a highly interactive, fast-feedback environment.