If you truly want success, you will have to go get it. What is not relevant has to wait. Sacrifices need to be made. Grow and become who you want to be, it won't come easy and it will not happen fast... But trust me, it'll be so worth it.
Personally I have let go of those friends that I knew would be an obstacle in my journey and what made it even easier was that they didn't make an effort in our friendship anyways. Now I have found the people who I can take with on my journey, they have the same ultimate goal as me and that is to be Successful! We support and push each other and those are the type of people you need around you!
At the end of the day, with success comes sacrifice!
It's not pretty or going to be easy but you got to do it!