Menon

Llama 2 in LangChain — FIRST Open Source Conversational Agent!

Generative AI and LLMs

Llama 2 is the best-performing open-source Large Language Model (LLM) to date. In this video, we discover how to use the 70B parameter model fine-tuned for chat (Llama 2 70B Chat) using Hugging Face transformers and LangChain. We will see how to apply Llama 2 as a conversational agent within LangChain. 📌 Code Notebook https://github.com/pinecone-io/examples/blob/master/learn/generation/llm-field-guide/llama-2/llama-2-70b-chat-agent.ipynb 🌲 Subscribe for Latest Articles and Videos: https://www.pinecone.io/newsletter-signup/ 👋🏼 AI Consulting: https://aurelio.ai 👾 Discord: https://discord.gg/c5QtDB9RAP Twitter: https://twitter.com/jamescalam LinkedIn: https://www.linkedin.com/in/jamescalam/ 00:00 Llama 2 Model 02:55 Getting Access to Llama 2 06:12 Initializing Llama 2 70B with Hugging Face 08:17 Quantization and GPU Memory Requirements 11:14 Loading Llama 2 13:05 Stopping Criteria 15:17 Initializing Text Generation Pipeline 16:25 Loading Llama 2 in LangChain 17:08 Creating Llama 2 Conversational Agent 19:46 Prompt Engineering with Llama 2 Chat 22:16 Llama 2 Conversational Agent 24:14 Future of Open Source LLMs #artificialintelligence #nlp #opensource #huggingface #langchain

About the course

The Generative AI and Large Language Models (LLMs) course covers everything you need to know about: - Generative AI - Large Language Models (LLMs) - OpenAI, Cohere, Hugging Face - Managed vs. Open Source - LLM Libraries like LangChain and GPT Index - Long-term memory and retrieval-augmentation And more to come...