Harley pops in to say goodbye to the guys and leaves the show