Joshua's second wife was Jane Ordway, born November 12, 1663 in Newbury, daughter of James Ordway and Ann Emery. They were married January 4, 1687-8 (Newbury 2, 419, and Coffin, A Sketch of the History of Newbury, Newburyport, and West Newbury, Boston, 1845).