The parish of Hempstead (there's two in Norfolk hence the qualification "by Holt") is as suggested roughly 2 miles to the south-east of the North Norfolk market town of Holt. The village is tucked away in a warren of narrow lanes between the B1149 Holt to Norwich road and the A148 from Holt to Cromer. The village has quite a compact centre with gathered along the roads forming a T-junction close to the church.

All Saints church is atrnge to behold with its truncated little tower which seems artificially cut-off at the height of the main body of the church. This strange feature originated following the fall of the original tower and was completed in 1744. Most of the remaining features of the church indicate a typical 14th century date.