From $G$-structures to Pfaffian groupoids