Only sometimes, when it couldn't make a great connection between the two callers.

Now, from my understanding, Microsoft has re-worked Skype to always connect via their Skype servers (as the middle man).