Homology torsion growth in polynomially-growing mapping tori