I am summarizing here what I have found out through research and hands-on work on my area of interest.

Building a Rootless Docker

Motivation

I have been using singularity containers instead of docker. the reason I have avoided using docker is that it requires root privileges to launch containers. I don’t have to worry about it because I’m running it at home.

I forgot the reason why, but I found out that docker has a rootless mode that allows you to run docker in normal user mode, so I decided to give it a try this time.

[Read More]

Speed-up Learning and inference on Pytorch

Motivation

In my home environment where I use NFS to store JupyterLab notebooks, I measured the performance when the NFS server is a RaspberryPi or HP Z240, and found that in the learning loop (state in which epochs are stacked), there is no significant difference whether the NB is stored on an NFS server or locally. I found that there was no significant difference between NBs stored on an NFS server or locally.

Therefore, I have challenged to speed up the learning process, and I summarize the progress/results here.

[Read More]

About the Galaxy Morphological Classification Dataset

In the beginning

In the five articles from this article to this article Galaxy shape(morphological) classification was performed using CNN (VGG16, ResNet) and ViT. In this article, I would like to consider the dataset used for the galaxy morphological classification, as I would like to re-examine the dataset when analyzing errors in the future.

[Read More]

Galaxy Shape Classification by Deep Learning (CNN) (Part 1)

Introduction

I have been studying Deep Learning for a while and thought I would try it out in my field of interest. I like astronomy and am particularly interested in stellar evolution, the formation of elements, and galaxy formation and evolution. I tried to classify the shape of galaxies, which seemed to be relatively easy to do.

[Read More]

Building a GPU Cluster with Kubernetes - the First Steps

Introduction About a month ago, I wrote an article about building a GPU cluster using kubernetes in this article. At that time, the GPU pod was in Pending state and did not work. After that, I managed to get it to work thanks to the advice of a certain person, so I’ll summarize it here. In my environment, there is a problem that the GPU pod does not start up until a certain node is started, and furthermore, I have not been able to specify GPUs in a node, specify nodes, and so on, which is what I assumed, so I decided to call it “the first step”. [Read More]

Change display resolution - xrandr BadMatch support

Motivation Immediately after installing Ubuntu, the display resolution was set to 1368x768. The screen was inconveniently small when working with multiple terminals open, and since I had connected to a display (JAPANNEXT JN-MD-IPS1562FHDR) that can display 1920x1080, I wanted to display it in that resolution. I tried to change the resolution, but got into a bit of trouble, so here is a summary of the process. Sources Ubu [Read More]