This option adds the latest spiders file and an updated robots file to your shop. A spiders file is needed to let the shop know whether or not a visitor is a search engine bot (short for robot). This will prevent it from accessing parts of your shop that it should not visit. The robots file is used to guide the bots to where they should, or should not look in your site. For example, if you don't want your images directory listed on the web, then an entry in the robots file should prevent that.