Keep them at bay
The detractors stay the detracted. Leave them be, they aren’t going anywhere, and they don’t do you any harm unless you let them.
Worst of all is yourself. You can’t let your negativity get the better of you. You have to keep pushing yourself forward and seeing where it takes you. Not giving in to the temptation to be lazy or otherwise sub-par.
Do all you can to bring a positive influence, and bring it with all you’ve got, even with all the detractors.