Bhopal: Madhya Pradesh government would be setting up one more thermal power generation unit with an investment of more than Rs4,000 crore at Amarkantak in Anuppur district.