Luuk van der Velden

Published in Towards Data Science

·Pinned

Secure MLOps with extended Databricks MLFlow

Manage model target environments safely — MLFlow is an opensource Databricks product that supports part of the Machine Learning model lifecycle. Its model registry allows model versions to be registered under model names to facilitate model deployment. We want to use one MLFlow instance and one Databricks workspace to support multiple deployment targets (acceptance, staging, production…

Mlops

6 min read

Mlops

6 min read

Published in Towards Data Science

·Pinned

The magical fusion between batch and streaming insights

Business needs data driven insights to reach stakeholders and customers as fast as possible and with clearly defined freshness requirements. The Lambda architecture (Marz, 2015) solves these requirements by combining insights from batch processes and real-time streams into an up-to-date data product. We posit that the Lambda architecture remains a…

Azure

12 min read

The magical fusion between batch and streaming insights

Azure

12 min read

Published in Towards Data Science

·Pinned

MLOps: a tale of two Azure pipelines

Continuous AI on Azure — Luuk van der Velden & Rik Jongerius Goal MLOps seeks to deliver fresh and reliable AI products through continuous integration, continuous training and continuous delivery of machine learning systems. When new data becomes available, we update the AI model and deploy it (if improved) with DevOps practices. Azure DevOps pipelines support…

Mlops

10 min read

Mlops

10 min read

Published in Towards Data Science

·Mar 2, 2021

Single-node and distributed Deep Learning on Databricks

by Luuk van der Velden & Rik Jongerius Databricks is an analytics Eco-system now available on most major cloud providers Google, AWS, and Azure. Databricks cluster computations use the distributed Spark engine. Recently introduced single-node Spark clusters do not support distributed computations, why? Single-node Databricks clusters On multi-node clusters a Python interpreter with…

Azure Data Factory

7 min read

Single-node and distributed Deep Learning on Databricks

Azure Data Factory

7 min read

Nov 22, 2020

The Netherlands, a worldwide AI knowledge hub

Kickstart AI was announced on the 10th of October 2019 to boost the development of Dutch AI- talent and technology through the collaboration of companies and universities. The goal is to boost the AI community and make the Netherlands a worldwide relevant AI-knowledge-hub. Kickstart AI acts in the context of…

4 min read

The Netherlands, a worldwide AI knowledge hub

4 min read

Published in Towards Data Science

·Jun 23, 2020

Unifying remote and local AzureML environments

Microsoft and Python Machine Learning: a modern love story, Part 2 of 2 — Microsoft Azure is conquering our hearts as AI practitioners and wooing us with support for open-source frameworks such as PyTorch, Tensorflow and Scikit-learn on AzureML. Here we build a workflow around the tools that MS gives us and it is up to us to decide whether we are tempted. In…

Vscode

7 min read

Unifying remote and local AzureML environments

Vscode

7 min read

Published in Towards Data Science

·Jun 6, 2020

A Python AzureML SDK workflow with VSCode devcontainers

Microsoft and Python Machine Learning: a modern love story, Part 1 of 2 — Microsoft is making great strides in conquering our hearts and mingling with the open source Ecosystem. The same ecosystem they openly worked against in the 00s. I confess I am in the process of being assimilated into the Microsoft world and am feeling good about it. …

Azure

7 min read

Azure

7 min read