Graphical obstructions to the surjectivity of the higher order Johnson homomorphism