Often yes for most of the heating season, because a heat pump moves heat instead of burning fuel and can deliver two to three units of heat for each unit of electricity. In the coldest snaps a gas furnace can be the cheaper source, which is why a hybrid system is the usual recommendation for gas-heated homes. Real savings depend on insulation, rates, and how the balance point is set.