Hi, guys! I have a trouble with many queries to our server from eBay bot. I upload feed with products for the selling. In such feed the several thousands of products with 5-10 images for each. After uploading all products eBay send queries for the images and this too perplex our server and it don't keep up to answer.
Is there any way to reduce the number of requests per minute or second? Maybe in robots.txt is there any way to configure it?
How did you solve such a problem at home?