I've heard Quassel Core is multi user capable? How do I make use of that?

Yes, Quassel Core can handle multiple users, but we don't have an UI for that yet.

You will find a python script, manageusers.py, in the scripts/ directory. This allows you to add new accounts to the core's database and change passwords for existing ones.