If you publish them to a podcast-compatible RSS feed, yes, of course, you are podcasting. There are plenty of video podcasts.

I know a lot of people conflate "podcast" with "show." Just publishing a podcast feed of your songs might not be something you consider a show per se, and that's fair, but if it's a podcast feed I can subscribe to in my podcast player, then you are podcasting.