Digitalocean has a standard docker+ubuntu setup you can fire up for about that price. However, I haven't had much luck with its stability and switched back to running on bare ubuntu. Docker kept bringing the system down even when I wasnt running any containers!