Whitehaven has been designated a "gem town" by the Council for British Architecture due to the historic quality of the town environment and over 170 listed buildings.