RAG on akenji's lab

Building a RAG system using the HyDE method

Sun, 27 Oct 2024 00:00:00 +0000

Introduction

I built a RAG using HyDE (Hypothetical Document Embeddings), a method to improve RAGs. This post summarizes my trial of HyDE. The LLM used was gpt-4o-mini to keep costs down.

Build RAG system

Thu, 15 Aug 2024 00:00:00 +0000

Introduction

By yesterday, I had extracted astronomy-related entries from Wikipedia and created a vector database and keyword base for RAG. Here, I will use those databases to build the RAG system.

The LLMs used are ChatGPT (gpt-4o) and Llama-3-ELYZA-JP-8B.

Create and evaluate databases for RAG

Wed, 14 Aug 2024 00:00:00 +0000

Introduction.

Create a databases that can be used by RAG from the text data created yesterday, prepare a few specific strings, and search and evaluate them.

Creating text data for RAG from Wikipedia dump data

Tue, 13 Aug 2024 00:00:00 +0000

Motivation

I am experimenting with RAG using LangChain and was thinking about what to use for data for checking and decided to use wikipedia dump data. Since the volume of the whole is large, I decided to use data from the astronomy-related categories that I am interested in.

Here, I summarized a series of steps to extract only specific categories of data from the wikipedia dump data.

Try RAG with LlamaIndex

Sat, 25 May 2024 00:00:00 +0000

Motivation

In this post where I tested Chatbot UI, I mentioned that one of my future challenges is to work with RAG (Retrieval Augmented Generation). In this post, I summarized how to achieve RAG using LlamaIndex.

Actually, I tried RAG using Langchain late last year. Since then, I have heard a lot of keywords with LlamaIndex, so I decided to realize RAG using LlamaIndex this time.