TITAN-V" on akenji's lab https://akenji3.github.io/en/tags/titan-v/ Recent content in TITAN-V" on akenji's lab Hugo en Tue, 02 Jan 2024 00:00:00 +0000 Execution of a Japanese LLM by Quantization https://akenji3.github.io/en/post/20240102_quantization/ Tue, 02 Jan 2024 00:00:00 +0000 https://akenji3.github.io/en/post/20240102_quantization/ <h2 id="motivation">Motivation</h2> <p>In <a href="https://akenji3.github.io/en/post/20231230_japanesellms_en/">this article</a>, I ended on a negative note about quantization, but after a little research I reconsidered it as an interesting area and experimented with quantization, which I I summarize it here.</p>