Maybe your friends were higher level than you and can go to the next area already, while you need to level up a little. Grizzleheim is set up in sections based on your level, Savarstaad Pass at 20, Vigrid Roughland at 25, etc. You'll get a summons from Merle Ambrose when you reach the level for the next area.