Synchronize Module always copies

My files directory under roles has the following structure

chat
-ejabberd
-erlang

Need to copy these to the remote server under /srv

So after the copy operation the structure on remote would be

/srv
-chat
-ejabberd
-erlang

Me using the syntax like this

synchronize: src=chat dest=/srv

It works ,but running the playbook again it runs the task again and shows it has changed, although nothing has been changed on the source server from files perspective. The target may have new files but nothing that has been copied previosuly has been updated. Then why does it show that the task has run ?

Got to debug more today and found that after finishing with the synchronise task ,another task is configured to copy a new file to a folder under the target directory.This copies a configuration file and updates it .

Although this file was not part of the original source for synchronise module ,it did update the folder timestamp of directory which was part of the original copy operation.

This resulted in synchronize respond saying that this folder was updated /changed in the next run ,although we did just create a new file .

How can I now configure,so that it ignores new files at destination.