Kingston Presbyterian Church, Kingston, Indiana Kingston Presbyterian Church, Kingston, Indiana The Kingston Presbyterian Church was founded in 1823 with the current structure built in 1883.