Using LLM based on DeepSeek-R1-Distill-Qwen-14B/32B with additional Japanese language training

Tue, 28 Jan 2025 00:00:00 +0000

Motivation

I have been studying PINNs and related OpenFOAM for a while, but yesterday there was a big news in LLM area and I decided to use Deep Seek-R1 which had an impact not only on LLM area but also on stock prices. Since I could not use it as it is in my environment, I used a compacted LLM with quantization.

This time, I used Ollama and Open WebUI to use the quantized model from a browser, and I will summarize the contents.

Conversing with ollama's LLM via Open WebUI as front end

Sat, 23 Nov 2024 00:00:00 +0000

Introduction

Yesterday in this post I summarized launching ollama in a docker container and using LLMs from JupyterLab. In this post, I summarize launching Open WebUI in a container and using it as a front end to connect from a browser at hand to use ollama’s LLMs.

Open WebUI on akenji's lab

Using LLM based on DeepSeek-R1-Distill-Qwen-14B/32B with additional Japanese language training

Motivation

Conversing with ollama's LLM via Open WebUI as front end

Introduction