Brown (4-3, 1-3) led 17-14 after Cody Taulbee ran one in from 1 yard out with 3:37 left to play.
However, Dexter Davis returned the ensuing kickoff 46 yards and Ragone completed two passes for 15 yards, then ran for another 6 to set up Loftus' game-tying field goal.
Ragone finished with 165 passing yards and 46 rushing yards.
The Bears took over with 2:12 remaining but Trevor Neimann picked off Patrick Donnelly's third pass of the possession, giving the Quakers (3-4, 3-1) the ball on the Brown 44.
Ragone then ran for 17 yards on two carries and completed a 2-yard pass to Eric Fiore to set up Loftus' game-winning 35-yard field goal.
Donnelly completed 30 of 47 passes but threw four interceptions.
The Paul Finebaum Show talks about LSU against Wisconsin being the most evenly matched game of opening weekend.
Bleacher Report's Barrett Sallee joins the Paul Finebaum Show to discuss his rankings of the toughest environments to play in in SEC football.
Tony Barnhart joins the Paul Finebaum Show to discuss his article about the need for new sexual-assault rules.
Stanford's schedule is exceptionally front-loaded with six of its toughest seven games coming at the beginning of the season.
The Paul Finebaum Show discusses the challenges facing both teams in the 2016 season after losing some of their top players.
The Paul Finebaum Show talks abut the opening weekend matchup between two of the most prominent college football teams in history.