Although this building is now a museum, it used to be a gathering place for Know-Nothings