Stability of gamma factors, I