ZenML

ZenML

ZenML is a unified, extensible, open-source MLOps framework for creating portable, production-ready MLOps pipelines that work across different infrastructure platforms.

Use it when

  • Multi-cloud/Infrastructure agnostic deployments: When you need pipelines that can run on Kubernetes, AWS SageMaker, GCP Vertex AI, Kubeflow, Apache Airflow.
  • Team collaboration: When data scientists, ML engineers, and MLOps developers need a single framework to collaborate effectively.
  • Automated model deployment: When you want streamlined model deployment that automatically deploys models when defined as a pipeline.
  • Complex ML workflows: When building sophisticated ML pipelines from classical ML to AI agents.
  • Metadata tracking needs: When you need comprehensive tracking of pipelines, runs, components, and artifacts with a user-friendly dashboard.

Watch out

  • Learning curve complexity: Organizations face challenges transitioning from manual, ad-hoc ML workflows to scalable, automated MLOps practices.
  • Infrastructure complexity: Managing multiple compute environments creates operational overhead, and Kubernetes integration can deliver "infinite YAML".
  • Resource management: GPU cost observability issues in Kubernetes environments where tracking resource consumption becomes difficult.
  • Scaling bottlenecks: Manual retraining processes, limited experimentation velocity due to setup overhead, and technical debt accumulation.
  • Multi-persona challenges: Balancing powerful tools for advanced users while maintaining accessibility for those with limited technical backgrounds.

Available in stages

Pipeline Orchestration

Installation

pip install "zenml[server]"

Example stacks

Example stacks coming soon...