Pettitte, however, got little offensive backing. New York stranded 10 and went 2 for 8 with runners in scoring position.
"They were tough. We weren't able to get the big hits with runners in scoring position," Pettitte said. "It was a frustrating game and one you hate to lose. It would have been nice to get this one, that's for sure."
After Davis hit a two-run single to put Baltimore up 2-1 in the third inning, Matt Wieters led off the sixth with a double and scored on a single by Mark Reynolds to make it 3-1.
But New York came right back in the seventh. Eduardo Nunez got a double when Davis couldn't catch his blooper to right and Jeter followed with an RBI single. After Suzuki hit into a fielder's choice, Darren O'Day replaced Chen and struck out Rodriguez as Suzuki stole second. Brian Matusz came in and issued an intentional walk to Robinson Cano to set up a matchup with Nick Swisher.
Swisher was 1 for 18 lifetime against Matusz and 1 for his last 32 in postseason play with runners in scoring position. A wild pitch moved up the runners, but the percentages held up, as Swisher hit a routine fly ball to left.
The Yankees used the nifty footwork of Suzuki to take a 1-0 first-inning lead, and it had nothing to do with his speed on the basepaths.
Jeter led off the game with a single and Suzuki reached when Reynolds fumbled a bare-hand pickup at first base for an error.
Rodriguez hit a low line drive at second baseman Robert Andino, who caught it and doubled up Jeter. Cano followed with a drive to the base of the right-field wall for a double. The relay from Davis to Andino to Wieters beat Suzuki to the plate by plenty, but he dodged the tag coming toward home.
Suzuki then circled around the batter's box, juked around the catcher's desperate lunge and touched the plate an instant before Wieters' glove found its mark.
Pettitte retired the first eight batters before Andino hit a bloop single with two outs in the third. Nate McLouth also singled, and a four-pitch walk to J.J. Hardy loaded the bases for Davis, who lined a single to right.
"Obviously the game came down to a mistake to Davis that scored the two runs," Pettitte said. "Effectively a ball in the middle of the zone. That was a serious mistake by me in that situation. I pretty much cost us the game."
Jones followed by grounding a single just beyond the reach of Jeter at shortstop, but Hardy stopped at third after failing to spot third-base coach DeMarlo Hale waving him home. Wieters then popped out with the bases loaded.
In the fourth, the Yankees used two singles and a walk to load the bases with one out. Nunez popped out before Jeter bounced into a forceout.
NOTES: It was the 16th start in a Game 2 for Pettitte, most in baseball history ahead of Tom Glavine (11). ... NY 1B Mark Teixeira let a ball go through his legs in the fifth inning for an error, matching his total for the entire regular season. ... Chen was 2-5 with 3.59 ERA in 10 postseason starts in Japan. He participated in the playoffs from 2008-11. ... Suzuki has reached safely in all 12 of his playoff games. ... Cano has 19 RBIs in 18 postseason games.