The Tribe (5-4) won for the fourth time in five games.
Julian Boatner's basket with 1:25 left gave the Tribe the lead for good at 59-57, and two free throws had them up by four with 35 seconds left.
Wofford's Indiana Faithfull then drove to the basket, scored and was fouled. His free throw cut the lead to 61-60. The Terriers (3-5) pressed and forced a turnover but Jaylen Allen's floater in the lane missed. Kyle Gaillard wrapped up the win with a pair of free throws with a second left.
William & Mary shot 56.1 percent, led by the strong inside game of Rusthoven, who made 5 of 7 shots.
The Big 12/SEC Challenge will again feature Kansas and Kentucky, this time at Rupp Arena. That's not the only exciting matchup in next season's midseason conference showdown.
Northwestern has never made the NCAA tournament, but the Wildcats' upward trajectory suggests 2016-17 could finally be the season it happens.
Dillon Brooks, who led Oregon with 16.7 points per game last season, and Tyler Dorsey will opt out of the NBA draft process and return to the Ducks, sources told ESPN.