> So we replaced the Max-Pooling layer with an Average-Pooling layer,
Why not use: https://en.m.wikipedia.org/wiki/Smooth_maximum
> So we replaced the Max-Pooling layer with an Average-Pooling layer,
Why not use: https://en.m.wikipedia.org/wiki/Smooth_maximum