Don't worry, you can catch the others up in no time.
You can probably build up your arena in 2-3 seasons, which is relatively very short time. I mean, if you get hooked up, you'll probably play the game for 10 seasons minimum(I'm in my 9th, and just warming up :))