datavaluepeople logo

Building a minimal data science platform

Written by Daniel Burkhardt Cerigo

At datavaluepeople we have set up the data science practice for a number of clients, giving us hands-on experience establishing data science platforms across a variety of organisations and tech stacks. Over time, we’ve developed clear opinions on how to do this well.

In October 2023, I gave a talk on the topic at the Data Science Festival OktoberFest 2023.

The talk

Data science teams often support diverse projects across their organisation. As the team grows and tackles more complex projects simultaneously, software and infrastructure challenges emerge.

I walk through building a data science platform step-by-step, from the ground up, starting with a single data scientist and scaling to a full team handling multiple projects. By zeroing in on the emerging pain points at each stage, the platform stays lean - addressing only what’s genuinely needed, and making every investment count. The result is a data science team that are enabled and empowered in their applied-science work, and not bogged down by maintaining a complex platform, nor held back by infrastructure that doesn’t facilitate the needs of their projects.

Slides

View the slides

Recording

Drop me an email if you’re setting up or thinking about setting up the data practice in your org, I’d be happy to hear from you!

Daniel Burkhardt Cerigo

Written by Daniel Burkhardt Cerigo

October 14, 2023

datavaluepeople is a group of artificial intelligence experts. Through applied machine learning, building automated systems, advising, and education, we create value for businesses, organizations, and humans. Drop us an email to speak to us about how we could work with your organisation, or if you are interested in joining our team.

linkedIn icongithub icon
Continue reading