$2$-parts of class groups in thin families