"As much as I love my job on TV, I miss where I started -- signing artists and working with bands," the "X Factor" alum says ...