Arithmetic aspects of short random walks