Valohai blog

Insights from the deep learning industry.

All Posts

Automatic Version Control Meets Jupyter Notebooks

jupyter-notebook-and-valohai

Running a local notebook is great for early data exploration and model tinkering, there’s no doubt about it. But eventually you’ll outgrow it and want to scale up and train the model in the cloud with easy parallel executions, full version control and robust deployment. (Letting you reproduce your experiments and share them with team members at any time.)

Transitioning your local code to running in the cloud can often feel like a complicated task with many steps in an unfamiliar environment. Here at Valohai, we want to help you take your notebook project from the early prototyping phase to production as painlessly as possible, so we’re excited to share that we’ve been developing a Valohai plug-in for Jupyter Notebook.

Valohai-jupyter-notebook-addon

Running your local notebook on the Valohai deep learning platform is just a few clicks away. Valohai's Jupyter Notebook Extension takes care of configuration, triggering the cloud instance, getting the notebook output back in real-time, and finally closing down the cloud instance automatically. You’ll still have all the power-user tools like Valohai CLI and Valohai API at your disposal, but the plug-in will offer a new easier option without any learning curve.

Unlike many other notebook cloud hosting services, you’re not only able to choose any cloud provider (like AWS, Azure or GCP) on-demand, but more importantly your instances are always shut down immediately after the code has executed. There’s no longer any need to budget for persistent instances; you’ll only pay for the time you actually executed your code! And as an added benefit, every training run that you do is automatically version controlled – you can share your experiments with others and reproduce them with the same code, data, hyperparameters and more.

Want to hear more or give the extension a try? Don’t hesitate to get in touch. The extension is in early access phase at the moment but ready to use for our most eager users!

Sign up for the early access program > 

Juha Kiili
Juha Kiili
Senior Software Developer with gaming industry background shape-shifted into full-stack ninja. I have the biggest monitor.

Related Posts

Valohai's Jupyter Notebook Extension

Valohai is a deep learning platform that helps you execute on-demand experiments in the cloud with full version control. Jupyter Notebook is a popular IDE for the data scientist. It is especially suited for early data exploration and prototyping.

Asynchronous Workflows in Data Science

Pointlessly staring at live logs and waiting for a miracle to happen is a huge time sink for data scientists everywhere. Instead, one should strive for an asynchronous workflow. In this article, we define asynchronous workflows, figure out some of the obstacles and finally guide you to a next article to look at a real-life example in action in Jupyter Notebooks.

Automatic Version Control Meets Jupyter Notebooks

Running a local notebook is great for early data exploration and model tinkering, there’s no doubt about it. But eventually you’ll outgrow it and want to scale up and train the model in the cloud with easy parallel executions, full version control and robust deployment. (Letting you reproduce your experiments and share them with team members at any time.)