Minimal model intertwining operators and vector-valued modular forms