Marquis Daniels scored nine points for Milwaukee.
Daniels said the game in Boston wasn't the reason for the loss to Cleveland on Saturday.
"We're never going to say we're tired or anything," he said. "Shots weren't falling. Give them all the credit. They played good defense. They had a plan. They came in and stuck with it."
Milwaukee shot 31 of 79 (39.2 percent). Cleveland was 38 of 88 (43.2 percent).
After Milwaukee cut it its deficit to four points with 6:32 left, Zeller made two free throws, and Miles added a jumper to give the Cavaliers an 86-72 lead.
NOTES: Zeller made his third consecutive start in place of Varejao. Zeller missed his first 10 shots before scoring on a putback in the third. ... Referee Haywoode Workman played eight seasons for four teams in the NBA, including 1999-2000 for the Bucks. ... Varejao stayed in Cleveland to receive treatment. ... Cleveland's Luke Walton finished with seven points, six rebounds and four assists in 24 minutes, all season highs.