Hey! Today I will tell very important things, missing which you can lose traffic. Often as you work on sites, you need to determine: what pages are indexed, which is not. What pages require additional attention in order for them to enter the index.

This is especially vividly noticeable when working with online stores: when working with a huge number of goods / partitions, all new and new pages are constantly added. Therefore, you need a tough control of the indexation of freshly adjusted pages in order not to lose traffic from search.

In this small lesson, I will tell you how I check the site pages on indexation.

How to check index pages

How I check the index of a particular page with the help of RDS BAR, I already told.

Well, or you can just drive into Yandex this code:

URL: WWW..RU / ABOUT

Or for Google:

Info: https: // Website / ABOUT

Of course, the URL address website / ABOUT. Change on your.

And what to do if you need to check the index of a dozen / hundred, or even more articles? I do as follows:

1. We put wonderful free YCCY program(You can download from here).
2. Run it and go to indexator:
   
   
3. In the left side of the program, download the list of the URL to check the index:
   
   
4. In the settings when working with Yandex, I put a job via Yandex XML. And with what I eat it already told:
   
   
5. Select the search engine you are interested in, note that we are interested in (in our case "indexing") and click on the "Start Check" button:
   
   
6. And voila, to the right you will see a separate list of indexed pages, as well as what is not in the index:
   
   

What to do with non-disgraced pages?

Services to accelerate indexation

I usually do not progress the pages run through different services, I prefer this getbot.guru. Yes, of course, not 100% of the pages are closed with the help of it in the index But still, on average, about 70-80% of the undercase url usually climbs (strongly depends on the adequacy of pages too).

Service, of course, paid, you need to pay for each URL. For those pages that did not come to the index will follow the refund, which is very fair and tempting (depends on the tariff). And already these pages that did not get into the index, I re-send to the service. Again, with the next update, some of these pages enters the index.

I think you can figure it out, nothing is difficult. Register -\u003e Create a project -\u003e Run the project. The only thing may arise in choosing a tariff. I prefer to work with the tariff "Absolute Update" (click on the image to enlarge):

By the way, note that the service can also be checked for indexing pages. The price of a question around 10 kopecks for 1 URL. I prefer a free YCCY, which wrote above.

On the page from the project, the speed of the Yandex is sent, the indexation of the project of the project in Yandex periodically checks, the pages that are not included in the index, the speed is sent again. After completing the task, for the pages that are not included in the index, the automatic return of funds for balance is carried out. We do not use social networks and spam methods to attract speed. For the service of the service used its network of news sites, owners of which we are.

Acceleration of indexing with twitter or news sites

Well, if you do not like the runs using such services, you can use twitter. References on Twitter Search Engines very well "eat" if accounts are more or less adequate.

I have already written about it relatively detailed in the lesson. " There, in addition to Twitter, I disassembled other ways to quick indexing.

Reindexing existing pages

Similarly, you can send a page to overexpath. Checking the page's cache in search engines, you can find out the page or not. How to check the cache page I told in.

Working with the index using the COMPARSER program

YCCY Although the old program, but I really like it. I use it to check the indexation of pages known to me.

If you need to figure out which page pages have not yet come to the index (I already wrote a whole lesson about it). Its principle is simple: it unloads all the URL of the site that you allowed for indexing (this item can be changed in the settings) and checks each page to the index. Or using a simple circulation, the first 1000 pages from the index unloads.

Created a site, but can not find it in search engines? Not a problem! In this material you will learn how to index the site in Yandex and Google, in the shortest time. Probably, about the advantages of a quick hit to the search engine index speak too much. After all, anyone understands that the earlier its site will be shown in search results, the faster new customers will appear. And so that it all earned, you need to get into the search engine base.

By the way, thanks to the correct approach, the new materials of our site are good enough, and most importantly is always quickly indexed by search engines. You may have fallen on this page after contacting the corresponding query in the search bar. From lyrics, let's go to practice.

How to find out the site indexed?

The first thing to do is to learn whether the site is indexed by the search engines. It may be that the site is simply not on the first search page by the query that you entered. It can be highly accurate requests to display on which you need to work on SEO-Promotion, not just do and run the site.

So, for verification we go to all search engines in which it makes sense to go ( Yandex, Google, Mail, Rambler) And in the search query string, we enter the address of the site.

If your resource has not yet been indexed - nothing will be shown in the results of extradition, or other sites will be shown.

How to index the site in Yandex?

To begin with, tell me how to index the site in Yandex. But before, adding your resource, check that it works correctly correctly opened on all devices and contained only unique content. For example, if you add a site at the development stage, you can simply please under the filter - it happened once this happened and had to wait for a whole month so that Yandex realized that we had a high-quality site and removed the sanctions.

To report Yandex on the new site, you need add it to Yandex Webmaster and install Yandex Metric, the first tool is responsible for more information about the resource ( region, Structure, Quick Links) and the one as the site looks in the results of organic issuance, the second for collecting data on the site ( attendance, behavior and other) That according to our experience, it also affects the site indexing and its position in the search. And be sure to make the site map and specify it in the webmasters panel.

How to index the site in Google?

Most often, Google himself quickly promptly finds new sites and drives them into search, but wait when Google comes and makes all the work for us - too arrogant, so let's figure out how to index the site in Google.

After the sites are added, must pass from 3 to 7 daysBefore search engines update the data and index the site.

It always wants new site pages to be shown in the search results, as quickly as possible and for this there are several secret (and very simple) ways, how to speed up the indexation of the site pages in search engines.

3. To do the manipulation described in the 2nd point, only for Google's search engine, go to Search Console. Choose "Scanning" and "See how googlebot" - Alive the address of the new page and click "Scan", after that request indexation.

Site indexing analysis

At the end, it should be noted that even after the successful site indexing in search engines, the work does not end. It is necessary to periodically analyze the indexing site, as well as take off position on popular requests. This will keep your hand on the pulse and not in a situation where a significant part of the production of organic issuance simply disappeared.

It happened to many old sites that used old methods of promotion, after the exit algorithm Yandex Baden-Baden. At the same time, Yandex reported in advance that she launches this algorithm and re-using pages will be excluded from the search, and the same Google, never reports about the release of new algorithms. Therefore, only tired control will allow the leader of the subject or become them!

For the younger site, fast indexation in search engines is particularly important. Because he still has no definite weight (or "trust"). It is especially important in the first months of the life of the site to regularly update. Content must also be high quality.

Fast indexation of the new site in Yandex

In order for your new site to quickly indexed in Yandex, you need to add it to Yandex Webmaster. Next, select the indexing unit -\u003e "Passage Page" (see Fig).

Transfer pages to Yandex Webmaster

For the young site, be sure to include the main page in this list. Parts are frequent when the robot comes to the main page and indexes all the internal links from it. In this way, you can index for a lot more than 20 pages.

Fast site indexing in Google

Similarly to Yandex, to speed up the indexation of the new site in Google, it must be added to Google Webmaster (Google Search Console). You need to select the "Skinning" tab -\u003e "View How GoogleBot".

Function to see how the googleball

And in the form that opens insert the address of the desired page, click "Scanning". After that, you will have the result of the page scanning and the magic button "Request Indexing" will appear.

Functional Request Indexing

Click on the button and see this window:

How to index the site in Google

Here you definitely need to select "Scan This URL and Direct Links". In this case, the robot will try to run through all internal links on the page that you indicated. With a large probability, they will all go to Google index with the highest possible speed!

Indexation of the new site on the old domain

In this case, the task is not so trivial, as it seems. On the domains with history, it is often difficult to index a new site. This process can take weeks or months. It depends on the history of the domain: whether sanctions were previously imposed on it and what.

The scheme of action in this case is simple:

• Add Site to Webmaster Yandex and Google
• Request reindexing through the corresponding functionality
• Wait 2-3 updates.
• If nothing has changed - write in support and solve this issue individually.

Methods of accelerating the indexation of a young site

In addition to the methods that I indicated above, there are some more working:

1. Sharing material on social networks. I recommend using the following: VKontakte, Facebook, Twitter, Google+ (despite the fact that Google's social network is actually dead, it helps speed up the indexation of new pages)
2. Regular updating site. Over time, the site recruits the statistics of the publication of new materials, it helps index new pages. Requisitively update and, maybe you will be able to "feed the speed" (in this case, the indexation of new pages will take 1-10 minutes).
3. News sites: Log in Yandex News. It is not as difficult as it may seem, but the effect will be stunning. On all sites from Yandex news lives speed.
4. Competent Internal Site Structure. Be sure to use transfine, top materials, etc. Increasing the number of internal references on the page (within reasonable limits) will also speed up the indexation

Fast indexation of new pages of the old site

Question - A response to indexing young sites

Do you have questions about the indexation of young sites? Set them in the comments!

Q: Will the new site from indexing?
A: I recommend not to open the site for search robots until it is filled with starting content. As my practice shows, the reification of existing pages is much longer than on the indexation of new ones.

Q: How long does Yandex need to index the new site?
A: On average, it is 1-2 update (from 1 to 3 weeks). But situations may be different.

Q: What could be the problems with the indexation of a young site?
A: Probably the main problem is bad content. For this reason, the site may not index. There were also cases when a young but large site with thousands of pages was rolled out. The search also has more alive memories of Dorvayy, so there is a "special relationship" to young sites with thousands of pages.

Q: Since how many pages open a new site to indexing and how often to update it?
A: You can open to indexing the site and from 1 page. It is important to adhere to a simple rule: immediately not post on the site thousands of pages, because It may be regarded as search spam, and regularly add new materials to the site. Let 1 material in 3 days, but regularly! It is very important!

Q: How often does Yandex index sites?
A: According to official Yandex information, the index frequency can be from 2 days to several weeks. And about the methods of acceleration is written above.

Quite often a new site can not be found in Yandex. Even if you type the name in the search bar. The reasons for this can be different. Sometimes search engines simply do not yet know that a new resource has appeared. To deal with what is the matter and solve the problem, you need to register the site in Yandex.Webmaster.

What is the indexation of the site in Yandex

First, we'll figure out how search engines generally learn about new sites or changes on them. Yandex has a special program called a search robot. This robot walks on the Internet and is looking for new pages. Sometimes he goes to the old - checks if something new did not appear on them.

When the robot finds a useful page, he adds it to his database. This base is called the search index. When we are looking for something in the search, we see sites from this base. Indexing is when the robot adds new documents there.

The robot cannot bypass the whole Internet every day. It does not have enough power. Therefore, he needs to help - report new pages or changes in old ones.

What is Yandex.Vebmaster and why he need

Yandex.Vebmaster is the official service from Yandex. It is necessary to add a site to the robot to find out about its existence. With it, the owners of resources (webmasters) can prove that this is their site.

Still in the webmaster you can see:

• when and where the robot came;
• what pages he indexed, and which - no;
• for some keywords people come from search;
• are there any technical errors.

You can configure the site through this service: Set the region, prices of goods, protect your texts from theft. You can ask the robot re-enter the pages on which you have made changes. Yandex.Vebmaster simplifies moving to https or other domain.

How to add a new site in Yandex.Vebmaster

Go to the webmaster panel. Click "Login." Login and password You can enter the ones that you use to enter Yandex mail. If you still do not have an account, you have to register.

After entering you will get to the page with the list of added resources. If you have not previously used the service, the list will be empty. To add a new resource, press the "+" button.

On the next page, enter your site address and confirm its addition.

In the last stage you need to confirm the rights - Prove Yandex that you are the owner. There are several ways to do this.

How to confirm the rights to the site in Yandex.Vebmaster

The easiest way to confirm rights in Yandex.Vebmaster - add file to site. To do this, click on the HTML File tab.

A small file is running. This file will now be needed, so save it somewhere in the prominent place. For example, on the desktop. Do not rename the file! No need to change anything in it.

Now download this file to your site. Usually for this use file managers, but for users you don't need to do anything. Just go to the back office, click Files. Then at the top of the page - "Add File". Select the file downloaded earlier.

Then go back to the Yandex.Vebmaster panel and click "Check". After successfully confirming the access rights, your site will appear in the Added list. Thus, you reported to Yandex.Vebmaster about the new site.

Meta tag Yandex.Vebmaster

Sometimes the method described above does not work, and the owners cannot confirm the right to the website in the webmaster. In this case, you can try another way: add code string to template.

In webmaster click the tab "Meta Tag". You will see the line you want to add to HTML code.

Users can contact technical support and ask to insert this code. This will be performed as part of free refinement.

When they do it in the webmaster, click "Check". Congratulations, you registered the site in the search engine!

Preliminary configuration Yandex.Vebmaster

The site was added to the search, now the robot will accurately go to you and index it. Usually it takes up to 7 days.

Add a link to Sitemap

In order for the robot faster to index the resource, add a Sitemap.xml to the webmaster. This file contains addresses of all resource pages.

Online stores on this file already configured and must be added to the webmaster automatically. If this did not happen, add a link to the sitemap.xml in the section "Indexing" - "Sitemap files".

Check for robots.txt

In the robots.txt file indicate the pages to which the robot does not need to go. This is a basket, order decor, back office and other technical documents.

By default, it creates robots.txt, which you do not need to make changes. Just in case, we recommend checking if there are no errors in robots. To do this, go to "Tools" - "Robots.txt" analysis.

Set the site site

On the page "Information about the site" - "Regionality" you can ask the site of the site. For online stores, these are those cities, regions and countries for which purchased goods are delivered. If you do not have a store, but a directory or blog, then the region will be the whole world.

Specify the sales region as shown in the screenshot:

What else is webmaster?

On the Search requests page you can see phrases for which you get to you from the search.

In the "Indexing" section displays information about when the robot was on the site and how many pages he found. The subsection "Moving Site" will help you if you decide to install and go to https. The "Page" subsection is also extremely useful. In it, you can specify the robot of the pages on which the information has changed. Then, in the next visit, the robot indexes them first.

On the "Products and Prices" page of the Site Information section, you can provide information about your online store. To do this, the resource must be configured to unload data on goods and prices in YML format. When properly configured in the search for issuing product pages, prices and delivery information will be displayed.

If you want to improve the visibility of your company in Yandex services, you should use the "Useful Services" section. You can specify the phone and address of your store in Yandex.Smitter. This information will be displayed directly in the issuance of Yandex. It will also add you to Yandex.Maps.

Yandex.Metrica - Another important tool of the owner of the Internet resource, showing attendance data. The statistics and dynamics of the site attendance are displayed in the tables convenient for analysis, diagrams and charts.

After connecting to the services of Yandex.Vebmaster and Yandex.Metrica you will receive a sufficient amount of information to manage the positions of the site and its attendance. These are an indispensable tools for site owners who want to promote their resources in Russia most popular in Russia.

The next step in promoting the site - Through the SEARCH CONSOLE service. That's all, good luck in promotion!

Site indexing is the most important, necessary and priority detail in the implementation of its optimization. After all, due to the presence of the search engine index, it is extremely quickly and can accurately respond to all user requests.

What is the site indexation?

The site indexing is called the process of adding content information (content) of the site to the search engine database. It is the index and is the database of search engines. In order for the site to be indexed and appeared in search results, a special search bot should be logged at it. The entire resource, the page behind the page is investigated by a bot according to a specific algorithm. As a result of finding the indexing links, images, articles, etc. At the same time, those sites, the authority of which higher, compared to the rest will be above in the list.

Allocate 2 indexing options PS:

• An independent definition of a search robot of fresh pages or a resource created is this method is good in the presence of active links from other, already indexed sites, to yours. Otherwise, to wait for the search robot infinitely for a long time;
• The package of the URL to the site in the search engine intended for this manual method is - this option allows the new site to queue on the indexing, which will take a long time. The way simple, free and requires addresses only the main page of the resource. This procedure can be performed through the Yandex and Google webmaster panel.

How to prepare a site to indexing?

Immediately it is worth noting that it is extremely undesirable to upload the site at the development stage. Search engines can index unfinished pages with incorrect information, spelling errors, etc. As a result, this will negatively affect the site rating and issuing information from this resource in the search.

Now let's list the moments that you can not forget at the preparation stage of the resource to indexation:

• on Flash files are distributed indexing restrictions, so the site is better to create with HTML;
• this type of data as Java Script is also not indexed by search robots, in connection with this, the site navigation should duplicate text links, and all important information that should be indexed, do not write in Java Script;
• it is necessary to remove all non-working internal links so that each link led to the real page of your resource;
• the structure of the site should allow easily moving from the lower pages to the main and back;
• extra and secondary information and blocks are better to move to the bottom of the page, as well as hide them from bots with special tags.

How often does the indexing occurs?

The site indexation, depending on a number of reasons, can take from several hours to several weeks, up to a whole month. Indexing update, or APA search engines occur with different frequency. According to statistics on average Yandex indexes new pages and sites for a period of 1 to 4 weeks, and Google copes for a period of up to 7 days.

But with proper preliminary preparation of the created resource, these deadlines can be reduced to a minimum. After all, in fact, all PS indexing algorithms and the logic of their work comes down to give the most accurate and current response to the user request. Accordingly, than regularly on your resource, high-quality content will appear, the faster it will undergo indexation.

Indexing acceleration methods

To begin with, the "notify" search engines that you have created a new resource, as mentioned in paragraph above. Also, many recommend adding a new site into social bookmark systems, but I do not do that. It really made it possible to accelerate the indexing several years ago, as the search robots often "visit" for such resources, but, in my opinion, it is better to put a link from the popular social network. Soon will notice the link to your resource, and index it. Such effect can be achieved and with direct links to a new site with already indexed resources.

After several pages have already fallen into the index and the site began to develop to accelerate indexation, you can try to "prebate" the search bot. To do this, it is necessary to periodically publish a new content at about equal intervals (for example, every day 1-2 articles). Of course, the content must be unique, high-quality, competent and non-saturated key phrases. I also recommend creating an XML site map, which will be discussed below and add it in the webmaster panel of both search engines.

Robots.txt and Sitemap files

The Robots TXT text file includes guided search engines. In this case, it makes it possible to prevent the indexation of the selected pages of the site for a given search engine. If you do it manually, it is important that the name of this file is written only by capital letters and was in the root directory of the site, most CMS generate it independently or with plugins.

Sitemap or Site map is a page containing a complete model of the site structure to help "lost users." You can move from the page to the page without using the site navigation. It is advisable to create such a map and in XML format for search engines and enter it into the robots.txt file to improve indexation.

These files can obtain more detailed information in the relevant sections by clicking on the links.

How to prohibit the site to indexing?

Manage, including to prohibit the site or a separate page to indexing, you can using the Robots.txt file already mentioned above. To do this, create a text document with such a name on your PC, place it in the root folder of the site and write in the file from which search engine you want to hide the site. In addition, hide the content of the site from the bots of Google or Yandex can be using a sign *. This instruction in robots.txt will disable the indexation to all search engines.

User-Agent: * Disallow: /

For WordPress sites, it is possible to prohibit the site indexing through the control panel. To do this, in the tinctures of the site, you need to put a tick "Recommend search engines not to index the site." At the same time, Yandex is likely to listen to your wish, but with Google it is not necessary, but some problems may arise.