Sherman said in the telephone interview that his supporters would not be distracted by the confrontation.
"They are not focused on a video that makes good entertainment television for somebody who wants to do a show about congressmen behaving badly," he said.
Berman's campaign said the congressman would respond later Friday.
The veteran lawmakers were pulled into the same district after a voter-approved independent panel redrew California's political boundaries. They were the top vote-getters in the June primary and went on to the general election because of California's new primary system, which sends the top two finishers to the runoff regardless of party affiliation.
Their race for the 30th district seat is one of eight same-party congressional runoffs on California's November ballot.