Semer is a small village approximately 2 miles north of Hadleigh. The picturesque River Brett runs through the centre of the village past All Saints Church, through Ash Street by Union Hill and on towards Hadleigh. For part of its length it forms the eastern parish boundary. The village population is spread over a wide area with dwellings at the Church around Semer Mere, Ash Street / Dairy Farm, Union Hill, Sayers Farm and Drakestone Green. There are approximately 57 households.

The Parish Council holds the Church Meadow and the Cosford Union Workhouse Graveyard in trust for the villagers. The graveyard is a designated area for wildlife.