Relative Hofer Geometry and the Asymptotic Hofer-Lipschitz Constant