Modify CNN training code to work with Horovod

 Posted on November 4, 2023  |    • Other languages: ja

Introduction

With Try Horovod in Docker, you can now use Horovod in your own environment (on-premises) and in a Docker environment. The next thing to do is to modify the training code running on a single server to apply it to distributed training using Horovod! For starters, I modified a relatively simple CNN code to allow distributed learning using Horovod, which is summarized in the following article.

[Read More]
docker  horovod  Distributed Training  CNN 

Try Horovod in Docker

 Posted on October 14, 2023  |    • Other languages: ja

Motivation

I have been interested in Distributed Training for about a year. I have been experimenting with a distributed learning framework called Horovod on multiple TITAN-V-capable machines. I finally got a distributed training sample working, so I am posting it here.

[Read More]
docker  horovod  Distributed Training