Combustion gases exhaust through the flue ... Electric furnaces are easiest to replace and cost the least, while high-efficiency gas furnaces cost the most. A heat pump is a viable alternative ...