https://akenji3.github.io/en/tags/wikipedia/ Recent content in Wikipedia on akenji's lab Hugo en Tue, 13 Aug 2024 00:00:00 +0000 https://akenji3.github.io/en/post/20240813_wikipedia_dump/ Tue, 13 Aug 2024 00:00:00 +0000 https://akenji3.github.io/en/post/20240813_wikipedia_dump/ <h2 id="motivation">Motivation</h2> <p>I am experimenting with RAG using LangChain and was thinking about what to use for data for checking and decided to use wikipedia dump data. Since the volume of the whole is large, I decided to use data from the astronomy-related categories that I am interested in.</p> <p>Here, I summarized a series of steps to extract only specific categories of data from the wikipedia dump data.</p>