Computer Vision

Table of Contents The Rise of Multimodal LLMs and Efficient Serving with vLLM Introduction to Multimodal LLMs What Are Multimodal LLMs? Milestones in Multimodal LLM Evolution Flamingo (DeepMind, 2022) GPT-4V (OpenAI, 2023) LLaVA (Large Language and Vision Assistant, 2023) BakLLaVA…

Table of Contents Preparing the BLIP Backend for Deployment with Redis Caching and FastAPI Introduction What We’re Building in This Lesson Why Redis Caching Matters for Inference What Is Caching? What Is Redis? Configuring Your Development Environment Running a Local…

Table of Contents Meet BLIP: The Vision-Language Model Powering Image Captioning What Is Image Captioning and Why Is It Challenging? Why It’s Challenging Why Traditional Vision Tasks Aren’t Enough Configuring Your Development Environment A Brief History of Image Captioning Models…

Table of Contents Synthetic Data Generation Using the VLM-as-Judge Method Configuring Your Development Environment Set Up and Imports Downloading Images Locally Using Qwen as VLM-as-Judge Converting the JSON File to the Hugging Face Dataset Format Inspecting the Dataset Pushing the…

Table of Contents Synthetic Data Generation Using the BLIP and PaliGemma Models Why VLM-as-Judge and Synthetic VQA Configuring Your Development Environment Set Up and Imports Download Images Locally Inference with the Salesforce BLIP Model Convert JSON File to the Hugging…

Table of Contents Run YOLO Model in the Browser with ONNX, WebAssembly, and Next.js What Is Browser-Based Inference and Why Does It Matter? Why Run YOLO in the Browser? No Server Required Instant Demos and Prototypes Low Latency and High…

Table of Contents Training YOLOv12 for Detecting Pothole Severity Using a Custom Dataset Introduction Dataset and Task Overview About the Dataset What Are We Detecting? Defining Pothole Severity Can the Pothole Severity Logic Be Improved? Configuring Your Development Environment Training…

Table of Contents People Tracker with YOLOv12 and Centroid Tracker Introduction Why People Tracker Monitoring Matters How YOLOv12 Enables Real-Time Applications Configuring Your Development Environment Downloading the Input Video Install gdown Download the Video Visualizing the Inference and Tracking Pipeline…

Table of Contents Chat with Graphic PDFs: Building an AI PDF Summarizer Configuring Your Development Environment Setup and Imports Upload the PDF Load the ColPali Model Index the Document Query the Document Retrieved Result Load the LLaVA Model Preprocess the…