Enable better vectorization for generic convolution

Break the single dependence chain into two parallel sub-chains.
Provides 2-4% performance uplift as measured on modern ARM systems
when using the generic codepath.