The remains of the Castle can be visited
Sherborne Old Castle

Sherborne Old Castle is the ruin of a 12th-century castle. It is located in the county of Dorset in the United Kingdom.
History+
Originally built in the 12th century as a fortified palace for Roger de Caen, Bishop of Salisbury and Chancellor of England, the estate remained church property until the late 16th century. Sir Walter Raleigh, passing through Sherborne on his way to Plymouth, fell in love with the site. Queen Elizabeth I leased the estate to him in 1592. Instead of renovating the old castle, Raleigh decided to construct a new residence, completed in 1594 and known as Sherborne Lodge.
Source: Wikipedia · Licence: CC BY-SA 4.0 · Image: http://commons.wikimedia.org/wiki/File:Sherborne_Old_Castle_01.jpg?uselang=de
This description draws on the facts documented in the linked Wikipedia article; Wikipedia content is licensed under CC BY-SA 4.0. Wording and editing: Mobile History.
Location: 50.9494, -2.5023