Who can add/remove team members in an Enterprise account?

Only the Admin/Owner of the account can add and revmove Editors and Viewers. You can find a detailed breakup of the permissions here.