Labour is planning to strip away tax loopholes for second homes if it forms a government.
One in four councils in England have made plans to use new powers to double council tax for owners of second homes, which would affect nearly half of these homes.
But there is an exemption for those who let them out as holiday homes and pay business rates instead.
Labour has suggested it would close this loophole.