It would also get awkward when you get an unexpected Slack message of "You told Jane that you'd take this point offline, make sure to actually continue the conversation".

At that point, the matrix would become completely inescapable ;)