The Bobcats lost for the third time in five games since snapping their 18-game losing streak. Charlotte has fallen behind early in the past two defeats, something Gordon called their "Achilles heel."
"We've got to give ourselves a better chance to compete early in the game. We can't start out by spotting teams double digit figures and then trying to climb back. It's too hard to do and we don't have that kind of team."
Bobcats coach Mike Dunlap said he's considering lineup changes when his team visits Indiana on Saturday night.
"Absolutely," Dunlap said. "We just have to find guys who can start us and get us going, especially on the defensive end."
Charlotte came in having won 10 of their past 13 meetings with the Raptors, including three of the past four in Toronto, but were never in this one, trailing by double digits from the midpoint of the first quarter onward.
The Bobcats missed seven of their first eight shots and, for the second straight game, never held a lead. Charlotte also trailed throughout in Wednesday's home loss to Utah.
Calderon scored 10 points in the opening quarter, including a pair of 3-pointers, as the Raptors surged out to a 29-16 lead after one.
Anderson said Toronto's starters "just blitzed them right out of the gate."
Dunlap called his team's first-quarter performance "inexcusable."
Kidd-Gilchrist and Walker combined for seven of Charlotte's nine free throws in the second quarter, but Toronto used seven points from rookie Terrence Ross to take a 53-39 lead at the half.
Anderson scored eight points in the third and Davis had six as the Raptors took a commanding 76-58 lead into the fourth.
Toronto made a season-high 15 3-pointers in a 123-88 win at Orlando on Dec. 29. ... Anderson played for the Bobcats in the 2005-06 and 2006-07 seasons, appearing in 53 games. ... The Raptors are 8-0 when holding their opponent below 90 points. ... Charlotte surrendered a season-high 22 second chance points. ... Ross returned after missing Wednesday's win over Philadelphia with a sore left ankle. ... The Raptors conclude a season-long six-game homestand on Sunday when they host Milwaukee.