Site requirements
Make sure that all of the following criteria are met:
The site has at least one page with a list of product offers (for example,
http://www.allcomputers.com/computer-accessories/external-hard-drives
).The content with the product list is static and isn't loaded to the page automatically (for example, as a script). The products are in the HTML code of the page with the list of product offers.
Every product in the list of product offers has a name and a link to a separate page with a detailed description.
Site indexing is allowed in robots.txt. The robot crawls sites at an optimal speed to avoid excessive server loads. If the site data changes more often than the indexing frequency, you can adjust the crawl rate manually. For more information, see Yandex Webmaster Help.
The robots that index the site have the following user agents:- Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
- Mozilla/5.0 (compatible; YaDirectFetcher/1.0; +http://yandex.com/bots)