Built in 1845, the First Baptist Church in Essex was designed in the Egyptian revival tradition based on an 1844 Presbyterian church in Sag Harbor designed by Minard Lafever. The façade of the church is built to resemble the pylon entrance of an Egyptian temple.