In 1850, James was listed in the census as James W., James D. in 1860, buried in Texas as James D. Haden. I wonder if this James changed his middle name or even if he had three names - perhaps James William Douglas Haden.
I believe it must be this James who did move to Fannin Co TX, especially since he named children Sophia & Richard and his eldest son was William Jackson Haden.
In 1860, James was still living with his parents in Kentucky.
There is a marriage Record, Fannin Co TX. A James W. Hayden married Mary E. Melton, 21 Dec 1864. However, death certificates in Texas of some of their children give Mary's name as Mary Morrison. And there is no reason to believe James was in Texas this early unless he was with the Western Confederate Army when it was stationed at Bonham. There were other Haden/Hayden/Hadden families in the area whose relationship is unknown. And of course Mary could have been a young widow when James married her.
I never found the family in 1870, although the 1880 census and birth places of the children would seem to indicate the family was in Kentucky.
1880 Town of Bonham, Fannin Co, TX, p.322C, Hh 347
Mary died in Jan of 1885. There is a marriage in Fannin Co for J. D. Haden to Frances C. Sloan, 15 Dec 1886. I can find no other Haden male with these initials to whom this marriage could refer.
An online database says that James Haden [no middle initial] was born 4 Nov 1845 in KY, died 22 Jan 1888 in Fannin Co TX and is buried at Willow Wild Cemetery in Bonham. His wife Mary was born 25 Oct 1847 in KY.
Will J. Haden married Donnie Keeton, 14 Nov 1892, Fannin Co TX
Mary's surname is listed by her son Elijah when he gave the information for the Death Certificate of his brother A. James, as Mary Keene. Other Death Certificates of the children, including Elijah, give her name as Mary Morrison - even the youngest daughter, Mattie. [A. James was born between Elijah and Mattie] There is not significant gap in the ages of the children as one would expect if James Haden had been married to two different Marys.
James D. HADEN and Mary MORRISON had the following children: