What is custom robot txt in blog/website

how to block googlebot in robots txt,robots.txt google,robots.txt disallow,robots.txt generator,robots.txt sitemap,robots.txt wordpress,robots.txt no index,google robots txt file tester,robots.txt google ads.

What is custom robot txt in blogger


What is custom robot txt in blogger.

It is very important to put custom robot txt in the blog because your blog by custom robot txt has no problem with Google Webmaster Tool fatch the ALL URL of your website If you go to blogger's custom robot txt and put the code I mentioned, your website's ranking will increase traffic on your website.

What should be in the robot txt file?

The robot txt file contains blog WEBSITE information as you are Google's User-agent here, giving a mission to all search engine crawlers to come to your website and crawl your content and your ALL posts here you tell you about the category of your blog, you also give your TAGS a permit to read the TAGS of your blog to you. Here on Google's webmaster tool, like we generate the sitemap that we put on the webmaster tool you have to submit here on the same side many bloggers when they go to Google's webmaster tool, they see the ERROR of robot TXT when you generate this robot TXT file and put it on your blog, you can see this error webmaster tool. He had to withdraw.

How do I create a robot txt file?

You have to first visit your blogger's dashboard you have to click on the Settings button here as soon as you click on the settings button you see some options where you have to click on SEARCH PREFERENCES in the fifth place where you have to scroll down where you will see crawlers and indexing written there.

Now you have to do the settings here very carefully as it is also written there if you don't know how to do SETTING here, ignore it.

Now you will be looking at custom robots.txt there and you will be looking at adit in front of it and you click on it as soon as you click enable custom robots.txt content there? You have to click on the YES button here now you will be looking at an empty box below.

How do I find a robot txt file from a website?

Now you can use this ROBOT TXT within this empty box. You have to keep in mind here that where the WEBSITE is written, you have to paste the ROOT domain of your website i.e. what your home URL is.

User-agent: *
Disallow: /search
Disallow: /category/
Disallow: /tag/
Allow: /

Sitemap: WEBSITE HOME URL atom.xml?redirect=false&start-index=1&max-results=500


 THE ROBOT TXT FILE
When you put on a website on your blogger and when you go within the webmaster, the ERROR show you are getting there, if you don't get there within 24 hours, you'll have to wait for 15 days here. This
ROBOT TXT FILE is coming to a website after 15 days.

You also paste this
ROBOT TXT FILE by visiting your blogger or website on WordPress you will see here that traffic to your website will increase after the court is active Google's trust offer will increase so that you will also have traffic from Google, google is also coming here and even if you have traffic from the search engine, your website is very quick. will look to rank 

NOTE – A lot of bloggers do a lot of activity to bring traffic to their website as much activity as much as I is OFF PAGR SEO, but if you don't have a robot txt file within your website, you may have a problem bringing traffic here.

Post a Comment

0 Comments