New Post: Can this be done faster?

Thanks Chrisoph. I'll run some comparisons.
Is it faster to select row vectors or column vectors from a dense matrix?
As of now I have observation vectors arranged as col vectors, but this could be arranged as row vectors.
From the example of others in vectorized backprop col vectors seems to be the convention, but I could easily reverse this.