Silverman married Mary Patterson Adcock Silverman Goldstein, daughter of John James [Buster] Patterson and Pearle A. Kersey Patterson. (Mary Patterson Adcock Silverman Goldstein died on Feb 13, 1987 in Jacksonville , Florida and was buried forest Lawn Cemetery in Richmond, Virginia.)
