MLOps

Table of Contents What Is MLOps? Architecture, MLOps vs DevOps, and LLMOps What Is MLOps? Why MLOps Matters for Production Machine Learning Core Principles of MLOps 1. Automation 2. Reproducibility 3. Scalability 4. Monitoring and Governance MLOps vs DevOps: Key…

Table of Contents DVC Pipelines for MLOps: Build a Reproducible ML Pipeline Introduction Project Setup Understanding the Pipeline Architecture Stage 1: Dataset Preprocessing Stage 2: Model Training and Versioning with DVC Stage 3: Model Evaluation and Metrics Tracking with DVC…

Table of Contents DVC for MLOps: Versioning Your Data and Models the Right Way DVC for MLOps: Data and Model Versioning Explained Project Setup Dataset Versioning with DVC Model Versioning with DVC Configuring DVC Remotes Using DVC Push and Pull…

Table of Contents Scaling, Optimizing, and Exporting Transformers with PyTorch Lightning Introduction to Scaling PyTorch Lightning Transformer Training Configuring Your Development Environment Preparing PyTorch Lightning Models for Scalable Multi-GPU Training Revisiting the Code Architecture Enabling Mixed Precision Training with PyTorch…

Table of Contents Training with PyTorch Lightning: Structured MLOps Development Why PyTorch Lightning Improves Reproducible MLOps Training Pipelines Configuring Your Development Environment Project Structure PyTorch LightningDataModule Explained: Building Efficient Data Pipelines PyTorch LightningModule Explained: Building Modular Deep Learning Models Using…

Table of Contents RAG Observability with Langfuse, vLLM, and FAISS Introduction to Production-Grade RAG and LLM Observability RAG Observability Architecture with Langfuse, vLLM, and FAISS Project Setup Building a Langfuse-Traced Retriever with FAISS Building a Traced LLM Wrapper for vLLM…

Table of Contents Run an Apache Airflow DAG with Docker Compose and PostgreSQL Project Structure PDF Parsing and Text Chunking Logic for Airflow DAG Docker Orchestration and Runtime for Airflow and FastAPI Running the Apache Airflow and FastAPI Document Ingestion…

Table of Contents Apache Airflow Document Ingestion Pipeline for RAG Systems Introduction to Production-Grade Document Ingestion Pipelines Why Airflow Instead of Cron Jobs or Celery? Apache Airflow Document Ingestion Pipeline Architecture Component 1: FastAPI Ingestion Service Component 2: Apache Airflow…

Table of Contents Manual Tracing, Scores, and Evaluation with Langfuse (Self-Hosted) Why Manual Tracing Matters for LLM Observability Decorator vs Manual Tracing: When to Use Which Manual Tracing with the Langfuse Low-Level API Why Manual Tracing Matters (Even If You…