Yes, being tied to Google account does seem limiting, after all there are more phone numbers than Google Accounts. I have a gut feeling that one of Allo and Duo will be a success.
Email addresses are generally not in your phone's addressbook while phone numbers always are. Also, SMS based phone number verification is quick and easy (and completely automatic on Android without any user action required).