St. Francis Xavier is located on a peninsula between St. Clement's Bay and Breton Bay in St. Mary's County, Maryland. Located on the same plot as the church is the Rectory, the Manor House and the church hall. The cemetery is located a few tenths of a mile north of the church.

Click here for a virtual tour of the church grounds and cemetery.