On the categorical spectrum of topological quantum field theories