Exact critical values of a symmetric fourth $L$-function and Zagier's conjecture