CNN on akenji's lab

Modify CNN training code to work with Horovod

Sat, 04 Nov 2023 00:00:00 +0000

Introduction

With Try Horovod in Docker, you can now use Horovod in your own environment (on-premises) and in a Docker environment. The next thing to do is to modify the training code running on a single server to apply it to distributed training using Horovod! For starters, I modified a relatively simple CNN code to allow distributed learning using Horovod, which is summarized in the following article.

Galaxy Shape Classification by Deep Learning (CNN) (Part 1)

Fri, 30 Dec 2022 00:00:00 +0000

Introduction

I have been studying Deep Learning for a while and thought I would try it out in my field of interest. I like astronomy and am particularly interested in stellar evolution, the formation of elements, and galaxy formation and evolution. I tried to classify the shape of galaxies, which seemed to be relatively easy to do.

Galaxy Shape Classification by Deep Learning (CNN)（Part 2）

Fri, 30 Dec 2022 00:00:00 +0000

Continued from previous article.

Why doesn’t the training/testing error improve after repeated epochs? The results of various attempts to answer this question are summarized below.

Galaxy Shape Classification by Deep Learning (CNN)（Part 3）

Fri, 30 Dec 2022 00:00:00 +0000

Continued from previous article.

In the previous, we studied with VGG16, but this time we will use ResNet for the model.