Build and Deploy LLM Application in AWS Lambda - BedRock - LangChain

Abonia Sojasingarayar · Intermediate ·🧠 Large Language Models ·2y ago

Skills: LLM Engineering90%ML Pipelines60%

Key Takeaways

Builds and deploys a Large Language Model application on AWS Lambda using BedRock and LangChain

Original Description

Building and deploying a Large Language Model (LLM) application on AWS Lambda, leveraging the power of BedRock and LangChain. We explore how to create a serverless LLM chain application that allows users to ask natural language questions. ⭐️ Contents ⭐️ 00:00 Introduction 1:57 Bedrock and Lambda Service 4:23 Create Lambda Function 8:04 Deployment and Test 9:17 Create and Add Custom Lambda Layer 16:47 Test 17:29 Summary and Conclusion 📚 Resources 📚 ▸ ARN for popular packages: https://api.klayers.cloud/api/v2/p3.11/layers/latest/us-east-1/html ▸ Amazon ECR Public Gallery - SAM : https://gallery.ecr.aws/sam/build-python3.10 ▸ Official Documentation: https://aws.amazon.com/blogs/compute/building-a-serverless-document-chat-with-aws-lambda-and-amazon-bedrock/ ▸ Docker: https://docs.docker.com/desktop/install/mac-install/ ▸ Article and Code: https://medium.com/@abonia/build-and-deploy-llm-application-in-aws-cca46c662749 __________________________________________________________________________________________________ 🔔 My Newsletter and Featured Articles: https://abonia1.github.io/newsletter/ 🔗 Linkedin: https://www.linkedin.com/in/aboniasojasingarayar/ 🔗 Find me on Github : https://github.com/Abonia1 🔗 Medium Articles: https://medium.com/@abonia

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

More on: LLM Engineering

View skill →

Build an LLM and RAG-based Chat Application using AlloyDB and LangChain

FULLY LOCAL Mistral AI PDF Processing [Hands-on Tutorial]

FULLY LOCAL Mistral AI PDF Processing [Hands-on Tutorial]

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Ultimate Guide: Deploy Google ADK Agents to Vertex AI & Cloud Run (Step-by-Step Tutorial)

Ultimate Guide: Deploy Google ADK Agents to Vertex AI & Cloud Run (Step-by-Step Tutorial)

Shane | LLM Implementation

How to Make an Asteroids Game Bot (LIVE)

How to Make an Asteroids Game Bot (LIVE)

Using Claude Code + Nano Banana Pro To Create a Dataset of Engineering Drawings

Using Claude Code + Nano Banana Pro To Create a Dataset of Engineering Drawings

Automata Learning Lab

Related Reads

Running NVIDIA Nemotron 3.5 ASR Locally with parakeet.cpp (and how it beat Whisper on my laptop)

Run NVIDIA Nemotron 3.5 ASR locally for offline speech-to-text capabilities without relying on cloud services or incurring API bills

Building Production-Grade LLM Evaluation Pipelines: From Vibes to Metrics

Learn to build production-grade LLM evaluation pipelines by replacing subjective 'vibes' with quantitative metrics

Building Production-Grade LLM Evaluation Pipelines: From Vibes to Metrics

Learn to build production-grade LLM evaluation pipelines to catch hallucinations before deployment, replacing manual 'vibe checks' with automated metrics

AI is more likely than humans to form biases when hiring

AI hiring tools can form biases, even if trained on unbiased data, highlighting the need for careful evaluation and mitigation of these biases

MIT Technology Review

Chapters (7)

Introduction

1:57 Bedrock and Lambda Service

4:23 Create Lambda Function

8:04 Deployment and Test

9:17 Create and Add Custom Lambda Layer

16:47 Test

17:29 Summary and Conclusion

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems

Dave Ebbelaar (LLM Eng)