In 1863, Jack and his wife (and their first six children) moved from Arkansas to settle in the area still known as Williams Hollow, south of the Lampasas River between Oakalla and Maxdale. Three of their sons married three daughters of William and Harriet Reavis, another prominent local family. They are are buried in the Mahomet Cemetery between Bertram and Florence.

Their children were:


(Jack's son Joe Williams was well-known throughout Burnet County as a photographer in the late 1800s – early 1900s, and is responsible for many if not most of the family portraits and local pictures taken at the time).