Path of "ansible_ssh_private_key_file" through AWS account

I am currently working with AWS Autoscaling. In order to communicate with the AWS instance, we need ssh keys and that has to be on to your local machine. I need to configure the same server without downloading the keys on to my machine. Is it possible that I can create an inventory and SSH keys can be directly fetched from the AWS account without downloading on to your own machine. ? or can I access that instance with my instance ID or something ?

[awsserver]

55.152.55.55 ansible_ssh_host=ec2-55-152-55-55.compute-1.amazonaws.com ansible_ssh_user=ec2-user ansible_ssh_private_key_file=/home/ec2-user/fuagent/temp.pem