Can I remove a license holder from my event?

Yes!
On the Manage tab of the web platform, select "Manage Users" under Lead Retrieval.

Next, select the garbage can icon next to the appropriate user. You will not be able to remove a user if that user has already started scanning leads at your event.