McCombs rushed for 94 yards and his fourth-quarter touchdown. McCummings, who also came in at quarterback occasionally, ran for a 3-yard score that gave the Huskies a 14-0 first-half lead.
That came after Williams scored the game's first touchdown on a 58-yard punt return.
Connecticut (2-1) started quickly in going against their former coach, Randy Edsall, who left after 2010 to come to Maryland (2-1). Both sides spent much of the week downplaying talk of any hard feelings.
The Huskies outgained Maryland 148-80 in total yardage in the first half and controlled the ball for 18 minutes, 40 seconds. They also came up with timely plays, converting four of nine third-down situations to keep the Maryland offense off the field.
Connecticut opened the scoring on Williams' 58-yard punt return, and Chad Christen's extra point gave the Huskies a 7-0 lead with 7:05 left in the first quarter.
They took advantage of a short field to score their second touchdown, gaining possession at the Maryland 36 after the Terrapins were forced to punt from their 4. McCummings' 3-yard run seven plays later made it 14-0 with 12:35 left in the half.
Connecticut linebacker Yawin Smallwood sacked Hills and forced a third-quarter fumble that Angelo Pruitt recovered for the Huskies at the Maryland 23. They couldn't pick up a first down, but Christen kicked a 34-yard field goal with 3:29 left in the quarter for a 17-7 lead.
Smallwood caused problems for the Terrapins throughout the game, with four of his 14 tackles going for losses, including three sacks.
After a 75-yard drive, Maryland made it 17-14 on the second play of the fourth quarter when Hills threw a 29-yard touchdown pass to Diggs on third-and-10. The Terrapins' Marcus Leak tipped the pass and Diggs grabbed it for a touchdown to make it 17-14.
But the Huskies answered on their next possession, driving 76 yards to take a 24-14 lead on McCombs' 11-yard touchdown run.
Hills ran for a 10-yard touchdown that cut the Connecticut lead to 24-21 with 4:39 left.
After getting the ball back following a Huskies punt, Maryland reached the Connecticut 39 before its drive stalled with 17 seconds left.
Nike Men's UConn Huskies Blue Football Icon Legend T-ShirtShop
UCLA athletic director Dan Guerrero says he's ready to move on from episode in which his decision to vote incorrectly as a Pac-12 rep led to a public admonishment from the commissioner.
SEC Network's Paul Finebaum reacts to the Ole Miss uproar after ESPN's KC Joyner predicted the Rebels will go 7-5 in 2016.
AP's Ralph Russo joins The Paul Finebaum Show to break down what could happen if the Big 12 extends its conference.
Hall of Fame RB Eric Dickerson joins Highly Questionable to share the craziest offers he received while being recruited by colleges, as well as recounts why he decommitted from Oklahoma to go to SMU.
With so many departures and holes to fill across the division, no team is in great shape at linebacker.
ESPN'S KC Joyner joins The Paul Finebaum Show to give his take on the Rebels' strength of schedule and impact of replacing important starters.