Vikram Singh

Table of Contents Pushing Docker App to AWS ECR for Lambda Deployment Using AWS CLI Setting Up AWS CLI and Pushing the FastAPI AI App to AWS ECR for Lambda Deployment What Is AWS CLI and Why Do We Need…

Table of Contents FastAPI Docker Deployment: Preparing ONNX AI Models for AWS Lambda Introduction Why Do We Need an API for AI Inference? Why Use Python FastAPI + Docker Before AWS Lambda Deployment? Configuring Your Development Environment Setting Up Docker…

Table of Contents Converting a PyTorch Model to ONNX for FastAPI (Docker) Deployment Introduction Recap of the Previous Lesson Why This Step Matters What You’ll Learn in This Lesson Technologies Used Configuring Your Development Environment Project Structure Converting ResNetV2-50 (TIMM)…

Table of Contents Introduction to Serverless Model Deployment with AWS Lambda and ONNX What Is Serverless Model Deployment? How Does Serverless Deployment Work? Why Use AWS Lambda for AI Model Inference? Limitations of AWS Lambda for AI Inference How Serverless…

Table of Contents Building a Streamlit Python UI for LLaVA with OpenAI API Integration Why Streamlit Python for Multimodal Apps? What Is Streamlit Python? The Streamlit Python-Based UI We Will Build in This Lesson Why Not FastAPI or Django? Configuring…

Table of Contents Setting Up LLaVA/BakLLaVA with vLLM: Backend and API Integration Why vLLM for Multimodal Inference The Challenges of Serving Image + Text Prompts at Scale Why Vanilla Approaches Fall Short How vLLM Solves Real-World Production Workloads Configuring Your…

Table of Contents The Rise of Multimodal LLMs and Efficient Serving with vLLM Introduction to Multimodal LLMs What Are Multimodal LLMs? Milestones in Multimodal LLM Evolution Flamingo (DeepMind, 2022) GPT-4V (OpenAI, 2023) LLaVA (Large Language and Vision Assistant, 2023) BakLLaVA…

Table of Contents Preparing the BLIP Backend for Deployment with Redis Caching and FastAPI Introduction What We’re Building in This Lesson Why Redis Caching Matters for Inference What Is Caching? What Is Redis? Configuring Your Development Environment Running a Local…

Table of Contents Meet BLIP: The Vision-Language Model Powering Image Captioning What Is Image Captioning and Why Is It Challenging? Why It’s Challenging Why Traditional Vision Tasks Aren’t Enough Configuring Your Development Environment A Brief History of Image Captioning Models…