Karma for Team

Hi, I would like to use Karma on my Slack space. (more than 1000+ users)
Could you please explain, can we use Karma only for one team (of one channel)? It would be no more than 50 users.
As I test all users that connected to my space are automatically created in the Karma management dashboard. And I can't remove them.

Thank you