This option adds the latest spiders file and an updated robots file to your shop. A spiders file is needed to let the shop know whether or not a visitor is a search engine bot (short for robot). This will prevent it from accessing parts of your shop that it should not visit. The robots file is used to guide the bots to where they should, or should not look in your site. For example, if you don't want your images directory listed on the web, then an entry in the robots file should prevent that. A robots file for ssl is also added. This is not available in most shops, whcih can result in duplicate content situations, which is not good, for your site.