VeryFastVGG

It's faster than me!

Build

Make sure you have gcc, make, cmake, openmp and python installed.

Use commands as follows, and the binary file vgg11_bn will be in the directory build/.

make

If you want to run the binary, you need to get & preprocess data. And the command is

make data

Some other useful commands are

• running vgg11_bn with default arguments

make run

• building a release type binary

make CMAKE_BUILD_TYPE=Release

• removing the directory build/

make clean

• comparing the result with pytorch's

make test

TODO

• Input & Output
• nn.Conv2d
• nn.BatchNorm2d
• nn.ReLU
• nn.MaxPool2d
• nn.Linear
• nn.Dropout
• nn.AdaptiveAvgPool2d
• torch.Flatten
• Timing
• Openmp
• AVX
• Loop unroll
• Way to search optimal parameters

Reference

https://notes.sjtu.edu.cn/s/xegV8P0H-

https://pytorch.org/docs/stable/nn.html