Piyush Thakur

Table of Contents Agentic AI Vision System: Object Segmentation with SAM 3 and Qwen Why Agentic AI Outperforms Traditional Vision Pipelines Why Agentic AI Improves Computer Vision and Segmentation Tasks What We Will Build: An Agentic AI Vision and Segmentation…

Table of Contents SAM 3 for Video: Concept-Aware Segmentation and Object Tracking Configuring Your Development Environment Setup and Imports Text-Prompt Video Tracking Load the SAM3 Video Model Helper Function: Visualizing Video Segmentation Masks, Bounding Boxes, and Tracking IDs Main Pipeline:…

Table of Contents Advanced SAM 3: Multi-Modal Prompting and Interactive Segmentation Configuring Your Development Environment Setup and Imports Loading the SAM 3 Model Downloading a Few Images Multi-Text Prompts on a Single Image Batched Inference Using Multiple Text Prompts Across…

Table of Contents SAM 3: Concept-Based Visual Understanding and Segmentation The Evolution of Segment Anything: From Geometry to Concepts Core Model Architecture and Technical Components The Perception Encoder (PE) and Vision Backbone The Open-Vocabulary Text and Exemplar Encoders The DETR-Based…

Table of Contents Grounded SAM 2: From Open-Set Detection to Segmentation and Tracking Why Segmentation Matters (Beyond Bounding Boxes) Introducing Grounded SAM 2 Where SAM Fits in the Pipeline Why SAM 2 (and not SAM) How Grounded SAM 2 Works…

Table of Contents Grounding DINO: Open Vocabulary Object Detection on Videos Why Language Makes Open-Set Detection Possible GLIP: Grounded Language-Image Pre-Training The DINO Detector (Closed-Set DETR) Grounding DINO Architecture Feature Enhancer (Neck Fusion) and Cross-Attention: The Teacher’s Guidance Language-Guided Query…

Table of Contents Build a VLC Playlist Generator with SmolVLM for Video Highlight Tagging Configuring Your Development Environment Setup and Imports Helper Functions Main VideoHighlightDetector Class Creating the XSPF Playlist Gradio Interface Logic Launch the Gradio Application Output Summary Citation…

Table of Contents Running SmolVLM Locally in Your Browser with Transformers.js Introduction SmolVLM: A Small But Capable Vision-Language Model Transformers.js: Hugging Face Runtime for the Web Why This Pair Is Powerful (and Practical Caveats) Configuring Your Development Environment What Are…

Table of Contents Synthetic Data Generation Using the VLM-as-Judge Method Configuring Your Development Environment Set Up and Imports Downloading Images Locally Using Qwen as VLM-as-Judge Converting the JSON File to the Hugging Face Dataset Format Inspecting the Dataset Pushing the…