Phelps gave up two runs in 5 2-3 innings. The Yankees used four relievers to finish it, with Mariano Rivera closing in a non-save situation.
Ben Zobrist hit an RBI single in the Tampa Bay third and stole second, but Longoria struck out.
Luke Scott hit a single that made it 2-all in the fourth and the Rays went on to load the bases with one out. Matt Joyce hit a fly ball that Almonte caught on the run at medium depth, and his swift throw forced Scott to hold at third base. Desmond Jennings flied out to end the threat.
The Rays had combined for 29 hits in winning their previous two games. They had little to show for their nine hits in this loss.
"I thought we had some good at-bats," James Loney said. "Happens like that sometimes."
NOTES: Rays LHP David Price (left triceps strain) gave up two runs and two hits in 2 1-3 innings for Class-A Charlotte in his first rehabilitation start. The reigning AL Cy Young Award winner struck out four and walked two. ... RHP Alex Colome will be promoted from Triple-A to start for the Rays on Saturday. In his only big league appearance, he didn't permit an earned run in 5 2-3 innings and beat Miami on May 30. ... LHP CC Sabathia (7-5, 3.93 ERA) starts Saturday for the Yankees. He's lost twice to the Rays this season and four straight times overall. ... The Rays signed first-round draft pick Nick Ciuffo. The 18-year-old catcher from South Carolina will join Tampa Bay's team in the rookie level Gulf Coast League. ... Only one other major leaguer has had the first name of Zoilo — 1965 AL MVP Zoilo Versalles.