Tutorial

Table of Contents Introduction to Serverless Model Deployment with AWS Lambda and ONNX What Is Serverless Model Deployment? How Does Serverless Deployment Work? Why Use AWS Lambda for AI Model Inference? Limitations of AWS Lambda for AI Inference How Serverless…

Table of Contents Build a VLC Playlist Generator with SmolVLM for Video Highlight Tagging Configuring Your Development Environment Setup and Imports Helper Functions Main VideoHighlightDetector Class Creating the XSPF Playlist Gradio Interface Logic Launch the Gradio Application Output Summary Citation…

Table of Contents Running SmolVLM Locally in Your Browser with Transformers.js Introduction SmolVLM: A Small But Capable Vision-Language Model Transformers.js: Hugging Face Runtime for the Web Why This Pair Is Powerful (and Practical Caveats) Configuring Your Development Environment What Are…

Table of Contents KV Cache Optimization via Multi-Head Latent Attention Recap of KV Cache The Need for KV Cache Optimization Multi-Head Latent Attention (MLA) Low-Rank KV Projection Up-Projection Decoupled Rotary Position Embeddings (RoPE) RoPE in Standard MHA Challenges in MLA:…

Table of Contents Introduction to KV Cache Optimization Using Grouped Query Attention Understanding the KV Cache Grouped Query Attention What Is Grouped Query Attention? How Grouped Query Attention Reduces KV Cache? Implementing KV Caching via Grouped Query Attention Grouped Query…

Table of Contents Building a Streamlit Python UI for LLaVA with OpenAI API Integration Why Streamlit Python for Multimodal Apps? What Is Streamlit Python? The Streamlit Python-Based UI We Will Build in This Lesson Why Not FastAPI or Django? Configuring…

Table of Contents Setting Up LLaVA/BakLLaVA with vLLM: Backend and API Integration Why vLLM for Multimodal Inference The Challenges of Serving Image + Text Prompts at Scale Why Vanilla Approaches Fall Short How vLLM Solves Real-World Production Workloads Configuring Your…

Table of Contents The Rise of Multimodal LLMs and Efficient Serving with vLLM Introduction to Multimodal LLMs What Are Multimodal LLMs? Milestones in Multimodal LLM Evolution Flamingo (DeepMind, 2022) GPT-4V (OpenAI, 2023) LLaVA (Large Language and Vision Assistant, 2023) BakLLaVA…

Table of Contents Post Training Qwen3 for Math Reasoning Using GRPO Group Relative Policy Optimization (GRPO) Challenges with Proximal Policy Optimization (PPO)? Computational Overhead and Memory Requirements Value Function Instability and Representation Collapse Hyperparameter Sensitivity and Training Instability Bias in…