I think Barbarian comes from much later when the Barbary Pirates were kidnapping people and razing villages and towns to the ground and forcing people into slavery. I think “Goths” and “Vandals” would be more appropriate, but I could be wildly mistaken

Yes, but more specifically the non romans from the north.