1. What is HuaweiSymantecSpider?

HuaweiSymantecSpider is a Web page crawling program of the reputation analysis system developed by Huawei Symantec. It crawls Web pages and analyzes their reputations, thereby checking whether these Web pages are embedded with malicious code.

2. What is the benefit for my Web site from HuaweiSymantecSpider?

If malicious code is found in your Web site or page, we will try to contact and send analysis results to you. Meanwhile, we could provide technical support to help you remove the malicious code to secure your Web site.

3. Does HuaweiSymantecSpider crawl personnel information?

No. HuaweiSymantecSpider never stores any private information but analyzes open Web sites.

4. What is the user-agent of HuaweiSymantecSpider?

HuaweiSymantecSpider uses special user-agent tag, that is, HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR; http://www.huaweisymantec.com/cn/IRL/spider).

5. Why does HuaweiSymantecSpider keep crawling my Web site?

HuaweiSymantecSpider may crawl the up-to-date pages in your Web site to detect latest contents. It is possible that the spider downloads a lot of pages in a short time period, but we have strict download policy to ensure normal access to Web pages. If you catch our spider visiting your Web site abnormally, please provide feedback from the complaint platform and offer your Web site access log to facilitate fault tracing.

6. Can HuaweiSymantecSpider bring great performance pressure on my Web site?

No. Different from the traditional crawler, our spider will not crawl deeper or wider in your Web site. Instead, it downloads the lately active pages or malicious code-embedded ones. Moreover, HuaweiSymantecSpider filters crawled contents by Web page type and size, compromising the pressure of access to your Web site server.

7. I deny HuaweiSymantecSpider to visit my Web site, how can I do?

HuaweiSymantecSpider complies with Internet robots standards. You can use the robots.txt file to prevent HuaweiSymantecSpider from visiting your site, or protect certain contents on your Web site against HuaweiSymantecSpider.

To achieve complete crawling protection against HuaweiSymantecSpider by using robots:

User-agent: HuaweiSymantecSpider

Disallow: /

To achieve directory crawling protection against HuaweiSymantecSpider by using robots:

Only crawling Web pages in the /Image/ directly is prohibited.

User-agent: HuaweiSymantecSpider

Disallow: /Image/

HuaweiSymantecSpider will not cause Web site access congestion in case of normal crawling. If you find any access with agent tag "HuaweiSymantecSpider" causes congestion on your Web site, please contact us as soon as possible. Send feedback to DSE-support@huaweisymantec.com. Your Web site access log will be very helpful for our analysis.