Deep Learning

Table of Contents DeepSeek-V3 from Scratch: Mixture of Experts (MoE) The Scaling Challenge in Neural Networks Mixture of Experts (MoE): Mathematical Foundation and Routing Mechanism SwiGLU Activation in DeepSeek-V3: Improving MoE Non-Linearity Shared Expert in DeepSeek-V3: Universal Processing in MoE…

Table of Contents Build DeepSeek-V3: Multi-Head Latent Attention (MLA) Architecture The KV Cache Memory Problem in DeepSeek-V3 Multi-Head Latent Attention (MLA): KV Cache Compression with Low-Rank Projections Query Compression and Rotary Positional Embeddings (RoPE) Integration Attention Computation with Multi-Head Latent…

Table of Contents Vector Search with FAISS: Approximate Nearest Neighbor (ANN) Explained From Exact to Approximate: Why Indexing Matters The Trouble with Brute-Force Search The Curse of Dimensionality Enter the Approximate Nearest Neighbor (ANN) Accuracy vs. Latency: The Core Trade-Off…

Table of Contents Setting Up LLaVA/BakLLaVA with vLLM: Backend and API Integration Why vLLM for Multimodal Inference The Challenges of Serving Image + Text Prompts at Scale Why Vanilla Approaches Fall Short How vLLM Solves Real-World Production Workloads Configuring Your…

Table of Contents Meet BLIP: The Vision-Language Model Powering Image Captioning What Is Image Captioning and Why Is It Challenging? Why It’s Challenging Why Traditional Vision Tasks Aren’t Enough Configuring Your Development Environment A Brief History of Image Captioning Models…

Table of Contents Training YOLOv12 for Detecting Pothole Severity Using a Custom Dataset Introduction Dataset and Task Overview About the Dataset What Are We Detecting? Defining Pothole Severity Can the Pothole Severity Logic Be Improved? Configuring Your Development Environment Training…

Table of Contents Breaking the CNN Mold: YOLOv12 Brings Attention to Real-Time Object Detection The YOLO Evolution (Quick Recap) YOLOv8: Introducing the C2f Module and OBB Support YOLOv9: Programmable Gradient Information and GELAN YOLOv10: NMS-Free Training and Dual Assignments YOLOv11:…

Table of Contents Building a Multimodal Gradio Chatbot with Llama 3.2 Using the Ollama API What Is Gradio and Why Is It Ideal for Chatbots? The Chatbot You’ll Build Today 🚀 What Is Ollama and the Ollama API Functionality Ollama…

Table of Contents NeRFs Explained: Goodbye Photogrammetry? How Do NeRFs Work? Block #A: We Begin with a 5D Input Block #B: The Neural Network and Its Output Block #C: Volumetric Rendering The NeRF Problem and Evolutions Summary and Next Steps…