McCombs rushed for 94 yards and his fourth-quarter touchdown. McCummings, who also came in at quarterback occasionally, ran for a 3-yard score that gave the Huskies a 14-0 first-half lead.
That came after Williams scored the game's first touchdown on a 58-yard punt return.
Connecticut (2-1) started quickly in going against their former coach, Randy Edsall, who left after 2010 to come to Maryland (2-1). Both sides spent much of the week downplaying talk of any hard feelings.
The Huskies outgained Maryland 148-80 in total yardage in the first half and controlled the ball for 18 minutes, 40 seconds. They also came up with timely plays, converting four of nine third-down situations to keep the Maryland offense off the field.
Connecticut opened the scoring on Williams' 58-yard punt return, and Chad Christen's extra point gave the Huskies a 7-0 lead with 7:05 left in the first quarter.
They took advantage of a short field to score their second touchdown, gaining possession at the Maryland 36 after the Terrapins were forced to punt from their 4. McCummings' 3-yard run seven plays later made it 14-0 with 12:35 left in the half.
Connecticut linebacker Yawin Smallwood sacked Hills and forced a third-quarter fumble that Angelo Pruitt recovered for the Huskies at the Maryland 23. They couldn't pick up a first down, but Christen kicked a 34-yard field goal with 3:29 left in the quarter for a 17-7 lead.
Smallwood caused problems for the Terrapins throughout the game, with four of his 14 tackles going for losses, including three sacks.
After a 75-yard drive, Maryland made it 17-14 on the second play of the fourth quarter when Hills threw a 29-yard touchdown pass to Diggs on third-and-10. The Terrapins' Marcus Leak tipped the pass and Diggs grabbed it for a touchdown to make it 17-14.
But the Huskies answered on their next possession, driving 76 yards to take a 24-14 lead on McCombs' 11-yard touchdown run.
Hills ran for a 10-yard touchdown that cut the Connecticut lead to 24-21 with 4:39 left.
After getting the ball back following a Huskies punt, Maryland reached the Connecticut 39 before its drive stalled with 17 seconds left.
Nike Men's UConn Huskies Blue Football Icon Legend T-ShirtShop
Daryl Gross, who spent a decade as Syracuse's athletic director, will start as Division II Cal State-Los Angeles' AD in July.
Freshman DB Chad Clay didn't last long with the Georgia football team, as the Bulldogs dismissed him following a second arrest in the past four months.
Brenda Tracy, who allegedly was sexually assaulted by four men, including two Oregon State players, in 1998 spoke Wednesday to the Nebraska football team.
A man who claims he told Penn State football coach Joe Paterno in 1976 that he was sexually abused as a teen by Jerry Sandusky asked a judge Wednesday to protect his identity and limit questions.
FOX Sports' Bruce Feldman joins The Paul Finebaum Show to share his thoughts on the upcoming National Championship race.
Urban Meyer, Thad Matta and Ohio State athletic director Gene Smith were among the crowd at the parade for the Cleveland Cavliers on Wednesday.