Currently, we can assign the contacts manually to users at the messaging module but there is no option to un-assign the contacts when it is assigned.

It will be useful to add the un-assign option at the same time show an event when contacts get unassigned. (E.g: You unassigned this person. - Today 11:00 AM)