Crawl section training (crawler or robot) in Google Webmaster

Post on 1394/10/08 00:03

Googles bot status this menu when you visit the site. You are in this menu errors that had hit them with Googles robots can see.

One of the most important sectors in the Google Webmasterservice, crawl , or in English the creepy . As you know Google to make changes to a different site in the cache store to display in the search results. Robots or crawlers to read (depends on the amount of importance and rank of the site , in the content update , etc.) to your site. This robot is its encounter with the status of the pages of your site in Google Webmaster services in this section. Now, with the introduction of this section we will review the menu.

Note: this section except the parts that is sure to have daily check and correct the errors shown.

Now in the left menu, webmaster tools on the menu, click Crawl up under the menu displayed:

Crawl Errors section

Now on the menu, click Crawl Errors page under open.

As shown in the picture above you can see at the top of page 3 section titles can be seen below.

DNS
- This is a DNS-related errors section of the site. In the event that this section several days you can see the errors, be sure your server and support this position tracking. In the case of a repeat of these errors, the trust Google to your site will be low.
Server Connectivity
- This section is also similar to the DNS section with its associated host and backup represents the connection status to the host robots. This is the case also for error tracking.
Robots.txt fetch
- URRobots.txt file is a text file containing a list of pages that usually should not be indexed on Google. This file is at the lowest level of your site; for example, seo.neper.ir for the site at the address seo.neper.ir/robots.txt . This file plays an important role in your sites not fine by Google. For example, the user logon mode on your pages that sees should be put on the list because the Google robot doesnt have access to their data or search results page, except pages that should not be indexed on Google.

URL Errors

The lower screen to come up to you in this section:

As you can see this section includes a general section 2:

Desktop
- In this section, you will see errors that computers and laptops has been seen.
Smartphone
- This section contains errors that mobile phones and tablets .

Note: the following error status of both are the same and the adequacy of a training section.

As shown in the picture above you can see this site in 3 parts in Desktop mode has errors.

Soft 404

In the log you can see this site in this fault section 231. These errors include error 404 pages that offers the same or pages that may have been on the site for the day and deleted by you. You may even have these pages in your site or others have been given the wrong link.

Access Denied

This section displays the errors that the Google robot doesnt have access to them. The same pages that should be added in URrobots.txt .

Even you may use the link on the page that is linked to a page that Google does not have access.

Not Found

This section also includes pages that have some sort of error 404 . Pictures may also be on this list. For example, the images that youve cleared out your server and Google has indexed them previously.

Other

Other errors in this section.

How to fix Errors in the errors Crowl?

At the top, we turned to the nature of the errors. Now to fix these errors to the form of the following:

Click on one of the following window open up errors:

On top of the open window, the address of the page that contains the error is you can see by clicking on it, you can enter the page.

In the following sections in the lower Details Errors can arrange:

The date of the last time the error has been seen.

On the first time that the error has been seen.

Explanation about the error and cause it.

In the next section Details Errors, other tab with the title Linked From there click on the list of pages and sites it can be seen that the page contains an error in the link page.

Now you have the explanation given by Google and the URL that you see in this section to resolve the problem.

After you fix the problem on the bottom of the window click the Mark As Fixed key click to Google realized error handling by you.

Note: in this episode, Max errors 3 days ago. So you may get an error just today but also tomorrow will see this error. Google 3 days later noticed the error handling by you.

Close the window. In the list of errors as well as you can. The overall selection of the pages and click the mark as fixed کیلک key.

Note: some errors may be, for example, the same happened in the pages of all the relevant pages in your sites details, in this case usually on a page you can solve the problem and the entire pages of this type Can also Mark as fixed.

The main menu in the menu below to browse the Crawl .

Crawl Stats section

Click on the above menu to the following page:

On this page you can see that the chart 3 on the side of each values number written in the following order:

The graph of the number of pages seen by Google based on the day of the robot (Pages crawled per day)

The chart in this section the number of pages that the Google bot has a day left. On the right side of most, the average and the lowest value you can see

Tip: visit the visit depends on the number of content that you can render a day or the number of pages and content on your site. Google to see over time the number of low or high compared to them. The days when Google bot visit is more likely to have your changes on your site.

Diagram of the KB size of the bandwidth used by the Google robot based on the day (downloaded Kilobytes per day)

This section includes a graph of the bandwidth used by Google. Whatever the number is, the more the bot referred to volume ratio. This section is important to Google because of the amount of site speed is important. Whatever the size of the دیتای download more so your page is clearly heavier loaded speed page.

Diagram of the download time of pages by Google based on the day of the robot ((Time spent downloading a page (in milliseconds)

This part also in the relation with the previous section. The speed of the download pages will show. On the right as well as the highest, lowest and average time to load you can see

Note: it may be a day that your site traffic is, the more (more visitors in mind) have a lower load speed. In this case, or have the resources to increase your hosting or your own pages and volume number of the رکوئست.

Google call section (Fetch as Google)

In this section you can find the page in Google still not indexed in Google to enter the index earlier.

The so-called Google page to fetch the log from the time of page load hive and its status to you.

Section URrobots.txt or Tester test file of robots (URrobots.txt Tester)

This page displays your text file URrobots.txt and if it is an error to you. You can also copy your text file or enter the file URL to Google robots to test it.

Section site map (Sitemaps)

Site map a text file of type xml is that specifying the title, the URL of the page, the next time you visit the Google robots to this page and ... It can be specified.

Google this file for understanding the structure of your site and index the content as well as speed.

In this section you have the number of pages in the site map (sitemap) entered and also the number provided by Google to indexed view. Also, if there is an error in the file referred to in this section will be displayed to you.

How to create this file because another entry in the long training will be given.

Section parameters for the URL (URL Parameters)

The parameters on this page that have been used in multiple pages in the site address to you.

For example, usually for pagination parameter lists page is used in URLs or for more detail or grouping may be used the term id in the form below:

http://domain.com/newslist?page=2

http://domain.com/news/detail?id=54656

This parameter is important to Google what they are then applied in the event that you do not have the cognitive of them dont editbecause it may be bad consequences for your website.

Well in this entry are tried that the section Crwal , which is one of the most important categories in the service of Google Webmaster Tools is expression. In the next articles in order of priority of the other sectors of education.