The singer, who has become a household name after his stint on this year's The X Factor, has claimed that he is too busy with commitments to the ITV talent show.
The Mirror quoted Rylan: "TOWIE's a great programme and I wish them all the best of luck. But I can't do the show because I've got commitments to the X Factor tour and I've got to be in rehearsals."
But his decision follows a threat by TOWIE cast members Mario Falcone and Kirk Norcross to quit the show if Rylan were recruited as a regular cast member.
Watch MTV News on the hour every hour on MTV - Sky Channel 126 and Virgin Channel 134