McCombs rushed for 94 yards and his fourth-quarter touchdown. McCummings, who also came in at quarterback occasionally, ran for a 3-yard score that gave the Huskies a 14-0 first-half lead.
That came after Williams scored the game's first touchdown on a 58-yard punt return.
Connecticut (2-1) started quickly in going against their former coach, Randy Edsall, who left after 2010 to come to Maryland (2-1). Both sides spent much of the week downplaying talk of any hard feelings.
The Huskies outgained Maryland 148-80 in total yardage in the first half and controlled the ball for 18 minutes, 40 seconds. They also came up with timely plays, converting four of nine third-down situations to keep the Maryland offense off the field.
Connecticut opened the scoring on Williams' 58-yard punt return, and Chad Christen's extra point gave the Huskies a 7-0 lead with 7:05 left in the first quarter.
They took advantage of a short field to score their second touchdown, gaining possession at the Maryland 36 after the Terrapins were forced to punt from their 4. McCummings' 3-yard run seven plays later made it 14-0 with 12:35 left in the half.
Connecticut linebacker Yawin Smallwood sacked Hills and forced a third-quarter fumble that Angelo Pruitt recovered for the Huskies at the Maryland 23. They couldn't pick up a first down, but Christen kicked a 34-yard field goal with 3:29 left in the quarter for a 17-7 lead.
Smallwood caused problems for the Terrapins throughout the game, with four of his 14 tackles going for losses, including three sacks.
After a 75-yard drive, Maryland made it 17-14 on the second play of the fourth quarter when Hills threw a 29-yard touchdown pass to Diggs on third-and-10. The Terrapins' Marcus Leak tipped the pass and Diggs grabbed it for a touchdown to make it 17-14.
But the Huskies answered on their next possession, driving 76 yards to take a 24-14 lead on McCombs' 11-yard touchdown run.
Hills ran for a 10-yard touchdown that cut the Connecticut lead to 24-21 with 4:39 left.
After getting the ball back following a Huskies punt, Maryland reached the Connecticut 39 before its drive stalled with 17 seconds left.
Scott Van Pelt and Stanford Steve look back at "bad beats" from Week 13 in college football.
Michigan State quarterback Connor Cook joins Scott Van Pelt to discuss the Spartans' season and their chances of making the College Football Playoff.
USC named Clay Helton its permanent football coach on Monday, just days after he led the Trojans to the Pac-12 South championship.
SEC Network's Clint Stoerner and Matt Stinchcomb discuss how LSU football will move forward with Les Miles as head coach.
Florida head coach Jim McElwain gives his take on Alabama running back Derrick Henry during a press conference.
SEC Network's Maria Taylor, Dari Nowkhah, Matt Stinchcomb and Clint Stoerner discuss memorable moments from Week 13 of SEC football.