The parish of Scottow sits in north-eastern Norfolk, north of the Bure Valley village of Coltishall and south of North Walsham. The ancient centre of the parish is centred on the hall, where All Saints is located; however, the modern village has moved roughly a mile to the east onto the B1150 Norwich to North Walsham road. This movement has been caused by the building of the World War 2 airbase at Coltishall which occupies much of Scottow partish leaving a clusterof farms around the hall cut off from the south.

All Saints is largely 15th century and in the main of the Perpendicular style, the north arcade is later and of the Gothic Decorated era. All Saints sits down an unsurfaced lane south of the main east-west road through the parish. The close presence of the Hall and attendant farms indicates that this was in Mediaeval and later times a closed Estate parish. This trend is illustrated by the families in the village where a comparatively small set of family names is indicative of a community into which it was hard to move.