On Baker's conjecture about knot concordance