The Poggio Castle was built as an imperial stronghold on a pre-existent Byzantine tower, and its presence has been known since 1200 (together with the presence of Guardege and Lugnano). Formerly, its territory was wider than the current one and it included Torrone or Palazzone, property of the town of Tenaglie. Its territory which stands on the banks of the river Tiber, which at the time flowed straight from North to South, was the crossing point where Umbria met the Viterbo area. A boat carried people from the so-called Porto de Luca (below the hill where Madonna del Porto stands). Poggio was part of the Status Alviani reign, but it had, since far-off times, belonged to several feudatories: the Uffreduzzis, the Sensis, the De Nobilis, the Monaldeschis and lastly the Doria Pamphilijs. In 1495 Bartolomeo d'Alviano, who owned the fortress, withstood an attack from Todi: upon signing the peace treaty it was decided that no more rebuilding of the fortress would take place.