Can I remove a license holder from my event?

Yes!
On the Manage tab of the web platform, select "Manage Users" under Lead Retrieval.

Next, select the garbage can icon next to the appropriate user. Note: you cannot remove a user that has already begun scanning leads at your event.