Don't leave a good place because of FOMO.
I have worked 5+ years at my first work place. Good WLB, growing skills, promotions, good people. Most people who left tried to come back.
Why do you think staying can cost you career advancement wise? What are your goals?
What is unusual about your current position? If your current position is very nieche or skills are not transferable, that could become a risk for your career.