They were too organized to be the ones expelled. Do you remember that time when the Huns were expanding and so the Germanics had to flea westward and the resulting migration caused the Gauls ceased to exist due to replacement?
The Huns were probably the ones most deserving of being expelled, yet that's not what happened.