Swan's Island is an island town in Hancock County, Maine, United States. It is named after Colonel James Swan, of Fife, Scotland, who purchased the island and some surrounding areas and organized their colonization in the eighteenth century. The population was 355 at the 2020 census. The town is accessible by state ferry service from Bass Harbor.