Just my opinion, but I've started a few large IDP leagues and its pretty typical that you are going to have some larger than expected turnover that first year but that's not a bad thing. The guys you keep are your core and the guys that don't stick serve a good purpose because, honestly, if they will start the league with you, they are probably the types that are interested in drafting (so they will do that part with sincere interest and leave solid teams to replace owners with). So if you have guys that bailed already, you got some of that stuff out of the way and you have time to find more. I wouldn't put the kabosh on your league yet.