Ex-Union minister asks Vedanta to leave