use it for one-on-one chats or messaging small friend groups

Those are exactly what I use Matrix for.