Not without downloading per se, nor through pure git, but you can pass your remote playbook to stdin while fetching its raw content in http, if you git hosting provider allows for it; example for a playbook I ran from a Github repo:
This will also limit you to only using playbooks that are a single file; while it’s probably not common, playbooks are permitted to refer to ‘local’ content (templates, plugins, etc.) like a role can have, and pulling a single file from a repository won’t support that.