Poor affordability by Gram Panchayats a key cause, it says