If you enable OAuth2 authentication; this will be exclusive. So only people registered on your OAuth2 server will be able to connect to fab-manager.
Anyway, the OAuth2 server is yours, so you can configure the users and the policies you want on this server ... It mainly depends on the OAuth2 system you uses and its possibilities.
I hope this answers your question ...