A modified fork of Lingvo, with added definitions of AlexNet and VGG16, pipelined with GPipe. (Definitions are present in lingvo/tasks/image). A report with a set of benchmarking experiments containing different configurations of their training performance can be found here.