The Hitchin connection and the Witten-Reshetikhin-Turaev TQFT, II