# .htaccess file for noindex

**URL:** <https://forum.ansible.com/t/htaccess-file-for-noindex/36728>\
**Category:** Ansible Project\
**Tags:** aws\
**Created:** [June 13, 2022, 1:37pm UTC](https://forum.ansible.com/t/htaccess-file-for-noindex/36728 "2022-06-13T13:37:23Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![xbldev](https://avatars.discourse-cdn.com/v4/letter/x/e0b2c6/32.png) [@xbldev](https://forum.ansible.com/u/xbldev)\
**Post date:** [June 13, 2022, 1:37pm UTC](https://forum.ansible.com/t/htaccess-file-for-noindex/36728/1 "2022-06-13T13:37:23Z")

</div>

Hi All

New to Ansible/Haproxy, need some help.

I currently have my robots.txt on AWS S3 and have a backend that uses it:

http-request set-path {{ robots\_url }}

I also want to setup a htaccess file in a similar way if possible to stop my cname domains from being crawled, like this answer here:

---

<div class="post-metadata">

**Author:** ![dnmvisser](https://avatars.discourse-cdn.com/v4/letter/d/8e8cbc/32.png) [@dnmvisser](https://forum.ansible.com/u/dnmvisser)\
**Post date:** [June 13, 2022, 4:17pm UTC](https://forum.ansible.com/t/htaccess-file-for-noindex/36728/2 "2022-06-13T16:17:32Z")

</div>

Your message appears to be clipped.  
But apart from that I don't see any ansible related question...?