The Tribe (5-4) won for the fourth time in five games.
Julian Boatner's basket with 1:25 left gave the Tribe the lead for good at 59-57, and two free throws had them up by four with 35 seconds left.
Wofford's Indiana Faithfull then drove to the basket, scored and was fouled. His free throw cut the lead to 61-60. The Terriers (3-5) pressed and forced a turnover but Jaylen Allen's floater in the lane missed. Kyle Gaillard wrapped up the win with a pair of free throws with a second left.
William & Mary shot 56.1 percent, led by the strong inside game of Rusthoven, who made 5 of 7 shots.
College basketball fans should be excited about next season's Jimmy V Classic, an event that will feature Duke's heralded freshman class.
Jeff Goodman logs all the coaching changes following the 2015-16 college basketball season.
Can Josh Pastner keep top talent in Georgia? Will Tubby Smith change his recruiting philosophy at Memphis? New coaches face some difficult questions.