McCombe made over 200 appearances for the Vale Park outfit after previously enjoying spells with Huddersfield Town and Hereford United, respectively.
After putting pen to paper, the 6 ft 2 defender said: "Hopefully we can kick on from the players' achievements last season and have another good year. I've had quite a bit of interest this summer [from other clubs], but after speaking to Paul (Cox) and the rest of the staff, it seems like this club is heading in the right direction.
"I'm a centre half who gives 100% and I'll be giving everything now for Mansfield," he added.
Manager Paul Cox said: "We've signed an accomplished centre half in John who already has promotions on his CV. He is a commanding player who will add knowledge and experience to our defence."
His contract will commence on 01 July 2013.
Hear more from John on Monday in his first interview exclusively for mansfieldtown.net.