Subsidizing the fuel will aggravate the fiscal deficit scenario and give rise to inflationary factors that will affect all and not just the actual users, says Ranbir Singh Butola, chairman of fuel retail market leader Indian Oil Corporation.