HC upholds withdrawal of ex-min’s security cover, cites lack of threat