The church is a modest building, long, narrow and aisleless.
The choir is long and aisleless; an hexagonal tower between the two, like that existing at Lynn, has perished.
Noticeable for its high roof, low tower and dwarf spire, the church consists of an aisleless nave, chancel (adorned with Chantrey's statue of the 1st duke) and transepts.
The interior is very dark and consists of an aisleless nave, and slightly lower apsidal choir.
The church follows the plan adopted by the Austin canons in their northern abbeys, and has only one aisle to the nave - that to the north; while the choir is long, narrow and aisleless.