At the time of the Domesday Survey Aldeby had a church and became the Priory Church of St Mary. One of the five cells dependant on Norwich Cathedral Priory. It has an interesting Norman West Doorway and in the North Transept has the only chapel in England dedicated to St Fursey. In the south aisle it has carved faces on the ends of the old roof timbers. The roof in the north transept and the south aisle have recently been restored.