We already know how to add meta tag code and sitemap to the blog. Today we will know what Robots Txt is and why to add it to your blog. Robots Txt is a file that helps to hide some of the privacy of our blog from the search engines of Google, Bing, Yahoo and Yandex. One can only say that Robots Txt acts as the security of our website. That means we want our post pages to appear in the search engine. Category, Label hides these robots
How to add Robots.Txt to a blog
There are many websites online that use free robots text, but today I will give you the code that you do not have to go anywhere else. If you want this code made by Blogger, you can find out more about this at the Blogger Help Forum. I understand the code below and its meaning in detail.
This is a Google Adsense Robot if you use AdSense and you want to hide your AdSense code only then Disallow it. And if you want to apply for AdSense later, do not give it or allow it.
Disallow: User-agentIt is good to have a Disallow for our side visitors, who will show us what our visitors have to show and which ones need to be booked.Disallow: / searchIt helps to keep track of what our website should not show on the search console, such as the Label or Category Search box on our blog.Allow:Allow it to show what our website should show and allow it.
It is very important to keep our sitemap. As I mentioned earlier about Sitemaps. Sitemaps bring new posts to our blog in search engine. Unless you have not yet created a Sitemap, you can view the post by submitting it to Google.
How To Add Robots Txt To Blog | How to Submit Robots Txt in My Blogger
Now copy all the code below and go to the Dashboard of your blog.
- Setting > Search Preference > Custom Robots Txt
- This time an empty box will come up and save the code
Now that the Robots Txt file has been added to your blog, you may want to check your blog.com/robots.txt as follows. Hopefully nobody had trouble understanding it. However, if there is a problem.