Motivic and arithmetic aspects of exceptional loci