MLOps Live: Recent Episodes
neptune.ai
MLOps Live is a biweekly Q&A show where practitioners doing ML at a reasonable scale answer questions from other ML practitioners. Every episode focused on one specific subject related to MLOps. Only the juicy bits, the things you won’t find in a company blog post.
Find the episode on our Youtube channel
Resources:
ImageBind: Holistic AI learning across six modalities
Frank’s Liu website
Milvus
OSS Chat
Follow us & stay updated:
► Visit our website
► Follow us on Linkedin
► Check our Github
► Follow us on Twitter
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Frank on Linkedin
Connect with Frank on Twitter/X
The episode was recorded on 7 September 2023, and some information may not be up-to-date.
Brought to you by neptune.ai
Find the episode on our Youtube channel
Resources:
Building a Machine Learning Platform [Definitive Guide]
DoorDash’s ML Platform – The Beginning
3 Principles for Building an ML Platform That Will Sustain Hypergrowth
Hien's LinkedIn Survey
Follow us & stay updated:
► Visit our website
► Follow us on Linkedin
► Check our Github
► Follow us on Twitter
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Hien on Linkedin
Brought to you by neptune.ai
Find the episode on our YouTube channel
Resources:
ZenML's big announcement
ZenML on Github
ML Experiment Tracking: What It Is, Why It Matters, and How to Implement ItFollow us & stay updated:
► Visit our website
► Follow us on Linkedin
► Check our Github
► Follow us on Twitter
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Adam on Linkedin
Connect with Hamza on Linkedin
Brought to you by neptune.ai
Find the episode on our YouTube channel
The episode was recorded on 20 July 2023, and some information may not be up-to-date. Stay tuned for an updated version on our blog
Resources:
BentoML
BentoCloud
Learnings From Building the ML Platform at Uber (Michelangelo)
Building a Machine Learning Platform [Definitive Guide]
Follow us & stay updated:
► Visit our website
► Follow us on Linkedin
► Check our Github
► Follow us on Twitter
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Chaoyu on Linkedin
Brought to you by neptune.ai
Find the episode on our YouTube channel
Resources:
The Long Tail: Why the Future of Business is Selling Less of More by Chris Anderson
What Customers Want: Using Outcome-Driven Innovation to Create Breakthrough Products and Services by Anthony Ulwick
The GitLab Handbook
Building a Machine Learning Platform [Definitive Guide]Follow us & stay updated:
► Visit our website
► Follow us on Linkedin
► Check our Github
► Follow us on Twitter
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Olalekan on Linkedin
Brought to you by neptune.ai
Find the episode on our YouTube channel
Resources:
Machine Learning: The High Interest Credit Card of Technical Debt
Meet Michelangelo: Uber’s Machine Learning Platform
Feature Stores and LLMs
Building a Machine Learning Platform [Definitive Guide]
Follow us & stay updated:
► Follow us on Linkedin
► Check our Github
► Join our Slack MLOps Community (#neptune-ai)
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Mike on Linkedin
Brought to you by neptune.ai
On this special, end-of-the-year episode of the ML Platform Podcast, Piotr Niedzwiedzi and Aurimas Griciūnas discuss the state of MLOps and LLMOps, the impact of LLMs on layoffs and ML team composition, unsolved LLM challenges, use cases that don’t align with LLMs, MLOps and LLMOps predictions for 2024, and more.
With LLMs and AI being the center of discussion we also decided to experiment with generative AI for this video. Hope you don’t mind the experimentation.
Find the episode on our YouTube channel
Resources:* MLOps is an extension of DevOps. Not a fork * ML Platform Teams, Features Stores, and Where MLOps Extends DevOps With Aurimas Griciunas * Learnings From Building the ML Platform at Mailchimp With Mikiko Bazeley * The state of applied ML by Tecton * MLOps in 2023 by ClearML
Follow us & stay updated:
► Follow us on Linkedin
► Check our Github
► Join our Slack MLOps Community (#neptune-ai)
Connect with Piotr on Linkedin
Connect with Aurimas on LinkedinBrought to you by neptune.ai
Find the episode on our YouTube channel
Resources:
MLOps Is an Extension of DevOps. Not a Fork
The GitLab Handbook
Follow us & stay updated:
► Follow us on Linkedin
► Check our Github
► Join our Slack MLOps Community (#neptune-ai)
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Eduardo on Linkedin
Brought to you by neptune.ai
Find the episode on our Youtube channel
Resources:
The Full Stack Deep Learning course
Follow us & stay updated:
► Follow us on Linkedin
► Check our Github
► Join our Slack MLOps Community (#neptune-ai)
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Mikiko on Linkedin
Brought to you by neptune.ai
Find the episode on our Youtube channel
Resources:
Hamilton
DagWorks
Follow us & stay updated:
► Follow us on Linkedin
► Check our Github
► Join our Slack MLOps Community (#neptune-ai)
Connect with Piotr on Linkedin
Connect with Aurimas on Linkedin
Connect with Stefan on Linkedin
Brought to you by neptune.ai
Subscribe to our YouTube channel to watch this episode!Learn more about Leanne Fitzpatrick:* Leanne’s LinkedIn
Episode Resources:* Financial Times * TensorFlow * PyTorch
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
To learn more visit neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Marcin Tuszyński:* Marcin’s LinkedIn
Episode Resources:* ReSpo.Vision * Allegro.pl * EY * Torch * Kedro
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify
RSS FeedTo learn more visit neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about David:* David’s LinkedIn
Episode Resources:* GitHub Copilot * OpenAI * PyTorch
If you enjoyed this episode, then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
To learn more visit neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Delina:* Delina’s LinkedIn
Episode Resources:* Mistplay * HelloFresh * Schulich School of Business - York University * University of Toronto School of Continuing Studies * TD * Carly Rian Group
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Andreas and Ivan:* Andreas’ LinkedIn * Ivan’s LinkedIn
Episode Resources:* Continuum Industries * Hyp-ED * Study of physical properties and microstructure of aerogel-cement mortars for improving the fire safety of high-performance concrete linings in tunnels * Using COMSOL® for the Development of the UK’s Second Hyperloop Prototype * Quantum Computing Project
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Silas and Abhijit:* Silas’ LinkedIn * Abhijit’s LinkedIn
Episode Resources:* freeCodeCamp * Innovate Ghana * Theta Tech AI * Stanbic Bank Ghana * Afribbean Tech Collective
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Jason Flaks:* Jason's LinkedIn
Episode Resources:* neptune.ai Website * Xembly Website * Amazon AWS * spaCy * chat GPT * Label Studio * Kubernetes
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Kacper Lukawski:* Kacper’s LinkedIn
Episode Resources:* Qdrant * Codete GmbH * Bye-bye, Miss AI * AI Embassy * Codete GmbH * Kubernetes
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Aurimas Griciūnas:* Aurimas's LinkedIn
Episode Resources:* neptune.ai Website * SwirlAI Website * Qflow * Kafka * Cassandra * Airflow * Kubernetes * Swirl AI newsletter * neptune.ai blog * Designing Machine Learning Systems by Chip Huyen * Fundamentals of Data Engineering by Joe Reis, Matt Housley
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Itay Ben Haim:* Itay's LinkedIn
Episode Resources:* Superwise Website
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Vishnu Rachakonda:* Vishnu's LinkedIn
Episode Resources:* Vishnu's Publication * firsthand's Website
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Shirsha Ray Chaudhuri:* Shirsha's LinkedIn
Episode Resources:* Shirsha's Publication * TR Labs' Website
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
Subscribe to our YouTube channel to watch this episode!
Learn more about Laszlo Sragner:* Laszlo's LinkedIn * Laszlo's Twitter
Episode Resources:* Laszlo’s Newsletter * Hypergolic's Website * Refactoring the Titanic
If you enjoyed this episode then please either:* Subscribe, rate, and review on Apple Podcasts * Follow on Spotify * RSS Feed
Register for the new live eventTo learn more visit Neptune.ai
Previous guests include: Andy McMahon of NatWest Group, Jacopo Tagliabue of Coveo, Adam Sroka of Origami, Amber Roberts of Arize AI, Michal Tadeusiak of deepsense.ai, Danny Leybzon of WhyLabs, Kyle Morris of Banana ML, Federico Bianchi of Università Bocconi, Mateusz Opala of Brainly, Kuba Cieslik of tuul.ai, Adam Becker of Telepath.io and Fernando Rejon & Jakub Zavrel of Zeta Alpha Vector.
Check out our three most downloaded episodes:
- Your First MLOps System: What Does Good Look Like? with Andy McMahon
- MLOps at a Reasonable Scale: Approaches & Challenges with Jacopo Tagliabue
- Solving the Model Serving Component of the MLOps Stack with Chaoyu Yang
MLOps Live is handcrafted by our friends over at: fame.so
In this episode of MLOps Live, Sabine and Stephen are joined by Simon Stiebellehner, a Lead MLOps Engineer at TMNL (Transaction Monitoring Netherlands). Simon explains how DevOps engineers can transition to MLOps engineers, the approaches MLOps engineers use in creating an ML model, and how a vertical prototype is preferable to a horizontal prototype when test-running a model.
Classical software differs from MLOps due mostly to the model's non-deterministic characteristics. There are significant differences between the design of ML models and that of traditional software; these differences stem mostly from the limits imposed by the time and resources required to test and refine a model prototype before it is put into production. As a result, MLOps engineers will need to put in a lot of effort to overcome these obstacles.
In this episode of MLOps Live, Sabine and Stephen are joined by Phil Basford, CTO of AI and ML at Inawisdom.com. Phil talks about what it takes to architect a good ML solution. He goes into more detail, giving use cases for AWS solutions and optimizing resources to make ML, MLOps, and AI in general more agile. They further discuss ML insights for small teams and teams working on budget ML solutions.
Having dealt with numerous clients and businesses, Phil Basford talks about some of the worst ML moments and the lessons that professionals can learn from them. With Phil’s wealth of experience, he talks about safety concerns for teams using AWS, compares different ML systems, and speaks on how culture can affect the architectural and design process of an ML solution.
In this episode of MLOps Live, Sabine and Stephen are joined by Chaoyu Yang, Co-Founder & CEO of BentoML. They discuss model deployment setups and trade-offs for reasonable scale teams, the prevalence of open-source platforms, and how to deploy the best model serving practices for early-stage and established teams.
Since MLOps is still in its infancy, it isn't easy to find established best practices and model deployment examples to operationalize machine learning solutions, as the latter can vary depending on factors such as the type of business use case, the size of the organization, the structure of the organization, and the availability of resources. Regardless of the machine learning model deployment pipeline, Chaoyu provides insights into the model deployment struggles experienced by various ML Engineers and their teams and the solutions they implemented to solve these model serving components.
In this episode of MLOps Live, Sabine and Stephen are joined by Duarte Carmo, Machine Learning Engineer at Amplemarket. Duarte draws on his extensive expertise in the field to offer advice on how to effectively execute MLOps within the constraints of limited manpower and resources of a team at a reasonable scale. He describes in-depth most of the critical problems that early-stage start-ups and small teams would encounter while deploying models and how to solve them.
Unlike large corporations whose methods have popularized the field, most ML teams are small and face distinct challenges. Most companies in the machine learning sector are now functioning at a reasonable scale, which this Q&A session caters to.
In this episode of MLOps Live, Sabine and Stephen are joined by Adam Becker, Co-Founder at Telepath.io. Adam uses real-world examples from what he has observed teams succeed and fail at to tackle questions about AutoML and MLOps. Additionally, they discuss the path of machine learning technology development as well as the realignment of roles within the industry in the near future.
Machine learning has expanded from the realm of academic study to include practical business solutions. It is now necessary to increase both the process's maturity and its level of widespread adoption.
Adam sheds more light on the potential effects of the development of ML, the challenge of deploying ML use cases, and the concerns that data scientists may lose their jobs.
In this episode of MLOps Live, Sabine and Stephen are joined by Amber Roberts, Machine Learning Engineer at Arize AI. They explore the best practices for implementing responsible AI for MLOps that prioritize accountability, fairness, and bias reduction. They further look at the role of observability and explainability in building responsible AI.
Machine learning (ML) applications are now widely used across businesses that want to integrate artificial intelligence (AI) capabilities, moving beyond the realms of academia and research. An increasing interest in the principles, techniques and best practices for using AI ethically and responsibly is growing along with the number of AI and ML solutions.
Amber addresses the diverse questions surrounding aspects of observability, interpretability, privacy, reliability, fairness, transparency, and accountability using her breadth and depth of domain knowledge. She further discusses best practices for monitoring AI applications using tools and procedures that will also be necessary.
In this episode of MLOps Live, Sabine and Stephen are joined by Adam Sroka, Head of Machine Learning Engineering at Origami. They explore principles and frameworks for creating a team culture in MLOps that prioritizes the most important things and sets the team up for success.
Collaboration between teams is necessary to move through the ML life cycle as rapidly and effectively as possible. Adam gives us an idea of what the MLOps culture is at Origami, how he built it, the challenges he encountered, and actions teams can begin taking to build a good MLOps culture. He identifies areas that businesses may capitalize on, including infrastructure, team structure, tools, project ownership, and KPIs for efficient workflow.
Adam has provided clear insights into the methods and tools he has used to build great teams with good quality MLOps culture built over his career. Adam is excited to share his technical and non-technical expertise, and shed some light on what works, especially now that best practices and playbooks for how to build a good MLOps culture and maximize the value from your projects and teams are not yet readily available.
In this episode of MLOps Live, Sabine and Stephen are joined by Andy McMahon, Machine Learning Engineering Lead of the NatWest Group. They explore concepts around building your first MLOps systems and how teams can understand the processes of optimizing level 0 operations and move towards scalability.
As soon as you commit a piece of code, a properly mature MLOps pipeline may be so powerful that it may be put into production immediately. However, attaining this level of maturity is extremely uncommon. Therefore, it becomes crucial to outline the requirements for creating a system that simplifies future operations, lowers failed deployments, and boosts performance.
The goal is to build an MLOps system that you can easily iterate on and would not break when the time for scale and integrating components (such as model registry and feature stores) arrive. Andy demonstrates how a basic model with an optimal MLOps infrastructure will yield value more quickly than a complex model that is thrown over the fence, which may result in resource wastage. Teams can begin by redefining the deliverable expectations, simplifying them to what is truly necessary, utilizing available tools, and constantly realigning operational considerations to the business problem to be solved.
Andy outlines several essential ideas, from the most basic level (MLOps at level 0), which includes no automation, to the most advanced one (MLOps level 1 and 2), which involves automating both machine learning and CI/CD pipelines.
In this episode of the MLOps Live podcast, Mateusz Opala, Senior Machine Learning Engineer at Brainly, answers questions about leveraging unlabeled image data with self-supervised learning or pseudo labeling.
In this episode of the MLOps Live podcast, Michal Tadeusiak, the Director of AI at deepsense.ai, will be answering questions about managing computer vision projects, specifically looking at AI activities spanning computer vision, NLP, and predictive modeling projects.
Today, we’re joined by Fernando Rejon, Senior Infrastructure Engineer at Zeta Alpha Vector, and Jakub Zavrel, Founder and CEO of Zeta Alpha Vector. In addition, they discuss MLOps for neural search applications data engineering, and how this innovation is pushing the bounds of search engines.
In this episode, they explore how they use modern deep learning techniques to build an AI research navigator at Zeta Alpha. They engage in an in-depth discussion based on the challenges with setting up MLOps systems for neural search applications, how to evaluate the quality of embedding-based retrieval, progress and numerous pertinent criteria, contrasting the trade-offs of using in neural (information retrieval) search, and the trade-off with using it in practice and theory to standard information retrieval strategies.
Additionally, they put into perspective the most important components you would need to build a POC neural search application. examine neural search models in both the retrieval and ranking phases from the perspective of scalability and predictability. They also outline conditions under which state-of-the-art results can be obtained. They also discuss the enormous work necessary to build and deploy neural search applications, which necessitates the use of greater processing resources, such as GPUs rather than CPUs, to get desirable output.
In this episode of MLOps Live, Sabine and Stephen are joined by Danny Leybzon, MLOps Architect at WhyLabs. They examine the differences between monitoring and observability in machine learning models for production and methods for efficient implementation and development.
Observability in MLOps is a holistic and comprehensive way to gain insights into the behavior, data, and performance of a machine learning model throughout its lifespan. It allows for detailed root cause analysis of ML model predictions and aids in the development of responsible models.
Although ML monitoring and observability appear to be similar, Danny points out that monitoring is a continuous system that prompts you when there is a problem. Whereas observability refers to the larger picture, a human-in-the-loop root cause analysis system that allows you to figure out what the problem is and then solve it.
Danny further discusses the unique features of WhyLabs in comparison to other conventional monitoring solutions, such as customizable and opinionated self-serve capabilities that allow users to pick particular metrics to track, especially in the absence of ground truth.
Today, we’re joined by Federico Bianchi, a Postdoctoral Researcher at Università Bocconi. He discusses testing recommender systems, the essential features for any platform with that purpose, testing the relevance of these systems, and how to handle the biases they generate.
With the continuous growth of e-commerce and online media in recent years, there are an increasing number of software-as-a-service recommender systems (RSs) accessible today. Users can get new content from recommender systems, which range from news articles (Google News, Yahoo News) to series and flicks (Netflix, Disney+, Prime Videos), and even products (Amazon, eBay). Today, there are so many products and information available on the internet that no single viewer can possibly see everything that is offered. This is where recommendations come in, allowing products and information to be classified according to their expected relevance to the user's preferences.
They compared offline recommendations to online evaluation platforms, which allow researchers to evaluate their systems in live, real-time scenarios with real people.
Federico discusses the benefits of offline modeling and evaluates the speed and convenience of testing algorithms with predetermined datasets. However, because these statistics are not tied to actual users, there are a lot of biases to consider.
In this episode of MLOps Live, Sabine and Stephen are joined by Kyle Morris, Co-Founder of Banana ML. They discuss running ML in production leveraging GPUs. They delve into GPU performance optimization, approaches, infrastructural and memory implications as well as other cases.
With the increased interest in building production-ready, end-to-end ML pipelines, there’s an increasing need to employ the optimal toolset, which can scale quicker. Modern commodity PCs have a multi-core CPU and at least one GPU, resulting in a low-cost, easily accessible heterogeneous environment for high-performance computing, but due to physical constraints, hardware development now results in greater parallelism rather than improved performance for sequential algorithms.
Machine Learning Build/Train and Production Execution frequently employ disparate controls, management, run time platforms, and sometimes languages. As a result, understanding the hardware on which one is running is critical in order to take advantage of any optimization that is feasible.
Today, we’re joined by Kuba Cieslik, CEO and Ai Engineer at tuul.ai. He has experience in building ML products and solutions and has a deep understanding of how to build visual search solutions.
Visual search technology has been around for quite some time, as part of Google Pictures or Pinterest Lens. It has become increasingly popular in e-commerce, allowing customers to simply upload what they're looking for instead of going through a slew of attribute filters. Kuba discusses how one might go about creating such a visual search engine from the ground up, as well as what approaches work and the challenges in such a complex sector.
Today, we’re joined by Jacopo Tagliabue, Director of A.I. at Coveo. He currently combines product thinking and research-like curiosity to build better data-driven systems at scale. They examine how immature data pipelines are impeding a substantial part of industry practitioners from profiting from the latest ML research.
People from super-advanced, hyperscale companies come up with the majority of ideas for machine learning best practices and tools, examples are Big Tech companies like Google, Uber, and Airbnb, with sophisticated ML infrastructure to handle their petabytes of data. However, 98% of businesses aren't using machine learning in production at hyperscale but rather on a smaller (reasonable) scale.
Jacopo discusses how businesses may get started with machine learning at a modest size. Most of these organizations are early adopters of machine learning, and with their good sized proprietary datasets they can also reap the benefits of ML without requiring all of the super-advanced hyper-real-time infrastructure.
MLOps Live is a biweekly Q&A show where practitioners doing ML at a reasonable scale answer questions from other ML practitioners. Every episode focused on one specific subject related to MLOps. Only the juicy bits, the things you won’t find in a company blog post.