Kaye, 24, has been with the Rovers for three years, after joining from Super League side London (then known as Harlequins) in 2010.
Yorkshire-born Kaye originally came through the professional ranks at Leeds, and he made a try-scoring debut for the Rhinos against the Broncos in 2008.
Featherstone CEO Craig Poskitt had this to say on his departure: “I would like to thank Ben for his services to Featherstone Rovers.
“From all at the club we would like to wish him well and all the best for the future.
“I would also like to confirm the club will be announcing new signings for 2014 in due course.”