In an interview with Star, the 'Someone Wake Me Up' hitmaker revealed that the last time he spoke to Cowell was before Christmas, and while he was disappointed that he will not be recording a second album he was "thankful for [his] chance".
"I was only contracted for one album and it didn't work out how I'd hoped. The second single didn't work out either, which was disappointing."
"But I could just feel it wasn't right. I kind of knew it. I've had time to digest this and I'm OK with it now."
Later this month Joe will appear alongside other 'veteran' pop stars such as Melody Thornton from Pussycat Dolls and Cheryl Baker on ITV's 'Popstar to Operastar'.