"Our big guy is out," Gordon said, referring to Kemp. "So we've got to make up for it. It's always fun to win, but especially when you come from behind."
Kemp, the National League MVP runner-up last year, landed on the disabled list for the second time with a hamstring injury May 31. The major league-leading Dodgers are 4-2 since he went down again.
Capuano (8-2) gave up four runs and four hits in five innings in one of his least effective starts this season. The lefty has a 2.82 ERA and is tied for the most wins in the majors.
Three relievers combined for three scoreless innings before Kenley Jansen finished for his ninth save, including three in this series.
"I'm a little exhausted," Jansen said. "I got through it. My stuff was just all right."
The Dodgers will try to complete a four-game sweep Thursday afternoon.
Phillies starter Kyle Kendrick (2-5) allowed five runs and four hits in 5 2/3 innings.
After Rollins hit a two-run shot to give the Phillies a 4-2 lead in the fifth, Kendrick quickly gave it back the next inning. He walked pinch hitter Jerry Hairston Jr. to force in a run with two outs before exiting. Raul Valdes came in and allowed Gordon's two-run single that put the Dodgers ahead 5-4.
"I was just looking for something I could put in play," Gordon said.
The Dodgers tacked on an insurance run in the ninth when Jake Diekman walked James Loney with the bases loaded.
Wigginton drove one out to left-center leading off the fifth to tie it at 2. With two outs, Rollins connected to give the Phillies a short-lived lead.
Victorino lined his seventh homer into the left-field seats to put the Phillies up 1-0 in the second. But the Dodgers answered with two in the third.
Help could be on the way for the last-place Phillies, the five-time defending NL East champions who are six games behind first-place Washington. Ryan Howard and Chase Utley played together for the first time in an extended spring training game Wednesday morning in Clearwater, Fla. The team's 3-4 hitters have missed the entire season so far.
Howard, the 2006 NL MVP, has been recovering from surgery to repair a torn left Achilles tendon. Utley, a five-time All-Star, has chronic knee problems.
Utley might have to hurry. Freddy Galvis, who has filled in nicely at second base, left the game during an at-bat in the fifth after injuring his lower back on a swing. The rookie will be placed on the disabled list Thursday, the latest injury for the depleted Phillies.
"Another one of our guys going down, what more can I say?" manager Charlie Manuel said. "It's kind of bad right now, but we have to show up and try to win a game. Nobody is going to feel sorry for us."
Dodgers manager Don Mattingly said Hall of Fame skipper Tommy Lasorda is expected to leave a New York hospital Thursday after suffering a mild heart attack Monday night. "He said to tell everybody hello," Mattingly said. ... Howard was 2-for-4 with two walks in the spring training game. He didn't play the field or run the bases. Utley was 2-for-5 with a double, a homer and a walk. ... Phillies 3B Placido Polanco was out of the lineup after cutting his finger on a tag play Tuesday night. ... A crowd of 44,216 was the 250th straight sellout at Citizens Bank Park, including postseason games. ... Dodgers RF Andre Ethier is hitless in his past 16 at-bats. ... Cole Hamels (8-2, 2.81 ERA) faces Aaron Harang (4-3, 3.90) when the teams wrap up the series Thursday. Hamels is 3-0 with a 1.18 ERA in five career starts versus Los Angeles. Harang is 3-2 with a 5.29 ERA in 12 games against the Phillies.