The downtown Vancouver tower that was a Four Seasons hotel for more than 40 years will be demolished rather than rebranded.