Specialization of (stable) rationality in families with mild singularities