A generalization of Fulton's Conjecture for arbitrary groups