LLM on akenji's lab

Conversing with ollama's LLM via Open WebUI as front end

Sat, 23 Nov 2024 00:00:00 +0000

Introduction

Yesterday in this post I summarized launching ollama in a docker container and using LLMs from JupyterLab. In this post, I summarize launching Open WebUI in a container and using it as a front end to connect from a browser at hand to use ollama’s LLMs.

Running LLMs in a local environment using ollama

Fri, 22 Nov 2024 00:00:00 +0000

Motivation

In this post, I mentioned that the LLMs that can build knowledge graphs are OpenAI and Mistral (via API). On the Internet, I have seen examples of GraphRAG environments being built using ollama, as in this post.

I would like to try to build a knowledge graph using LLM in a local environment. In this post, I will summarize the process of installing ollama.

Try PLaMo Beta Version

Sun, 01 Sep 2024 00:00:00 +0000

Introduction

I read this article on August 8th. According to the article, a subsidiary of Preferred Networks (PFE) will start offering a free trial of LLM, which has Japanese language performance that exceeds GPT-4, prior to offering a commercial version.

I immediately applied for the free trial, received an email of acceptance, and waited for the notification of account issuance. I had received the notification e-mail on August 9th, but I had overlooked it and completely forgot that I had applied for it. Recently, after reading this post, I remembered about the free trial, rechecked my email, and found the account notification.

In this post, I will summarize what I tried of the free trial version.

Creating text data for RAG from Wikipedia dump data

Tue, 13 Aug 2024 00:00:00 +0000

Motivation

I am experimenting with RAG using LangChain and was thinking about what to use for data for checking and decided to use wikipedia dump data. Since the volume of the whole is large, I decided to use data from the astronomy-related categories that I am interested in.

Here, I summarized a series of steps to extract only specific categories of data from the wikipedia dump data.

Try RAG with LlamaIndex

Sat, 25 May 2024 00:00:00 +0000

Motivation

In this post where I tested Chatbot UI, I mentioned that one of my future challenges is to work with RAG (Retrieval Augmented Generation). In this post, I summarized how to achieve RAG using LlamaIndex.

Actually, I tried RAG using Langchain late last year. Since then, I have heard a lot of keywords with LlamaIndex, so I decided to realize RAG using LlamaIndex this time.