Symmetries in shifted Poisson geometry and BV quantization