A parliamentary body yesterday asked the forest and environment ministry to take punitive action against the owners who have failed to transform their brick factories through the use of environment