Marc Sneyd sent Leeds to a one point defeat for the second time in a week as Hull edged home 19-18.
After losing 9-8 at home to Wigan last week, the Rhinos were again beaten by a late drop goal after they had fought back from 14-0 down at the KCOM Stadium.
It meant Hull ended a run of 11 successive defeats to Leeds in Super League to climb above them in the table.
In a low scoring first half, Jake Connor gave Hull the lead on 13 minutes as he burst on to Albert Kelly’s short ball and held off a couple of defenders to slide over the line.
It would be another 20 minutes until the next score, another fine line by Bureta Faraimo, crashing on to another Kelly short ball to power over the line and the Airlie Birds led 8-0 at the break.
After Josh Griffin was held up over the line on the other side, Connor would cross for his second try after taking a Kelly flat pass, Sneyd adding his first conversion of the evening for 14-0.
Leeds finally got on the board on 51 minutes and in some style too as they shifted left for Ryan Hall, who took defenders with him and reached out one handed to ground the ball right on the line, verified by the video referee, and the visitors had a way back in to the match.
There was controversy over their second try, a questionable pass in the build-up to Joel Moon’s try, but the Rhinos weren’t stopping to ask questions as Kallum Watkins’ conversion brought them back within two.
The turn around was completed two minutes later when Matt Parcell crossed the line, despite some suggestions he may have lost the ball, and Watkins conversion had Leeds 18-14 in front.
Hull dug in and they levelled the game with nine minutes to play after Fetuli Talanoa climbed highest for Kelly’s kick, feeding Carlos Tuimavave for their fourth try.
Sneyd missed his third conversion of the night but he kept his nerve with four minutes on the clock to slot over what would be the decisive drop goal.
Hull: Shaul, Faraimo, Connor, Griffin, Talanoa, Kelly, Sneyd, Taylor, Houghton, Bowden, Minichiello, Manu, Hadley. Subs: Tuimavave, Paea, Lane, Matongo.
Leeds: Golding, Briscoe, Watkins, Handley, Hall, Moon, Myler, Delaney, Parcell, Cuthbertson, Ablett, Jones-Buchanan, Ward. Subs: Mullally, Ferres, Smith, Oledzki.