How to add Robots.txt file on Blogger? Step by Step-technology

How to add Robots.txt file on Blogger? Step by Step - technologytipssunil
How to add Robots.txt file on Blogger? Step by Step – technologytipssunil

If you do not know what a robots.txt file is? And how to add a custom robots.txt file to Blogger, you can read this article thoroughly.

This is very important for your blog’s SEO, due to its misuse, it can be completely removed from your blog search engine. You can follow this guide to know the benefits and uses of the Robots.txt file.
The direct contact of the Robots.txt file is linked to your blog’s index and crawl rate. Generally, all search engines have their own robots or bots that crawl your blog and links in it and index it into search engines. Because of that, whatever blog you update, it also shows in the whole update search engine and it will crawl your blog in robot.txt.
Add Custom Robots.txt File Blogger
What is robots.txt?
Robots.txt is a text file with a few simple codes, which directs web crawlers, indexes, and indexes which page will crawl your blog.
This file is saved in any website or blog server so that search engine bots can be managed. It is used primarily to stop any non-important webpages (demo pages, archives, labels, etc.).
That is, in simple language, through the Robots.txt file, you have the rights to your blog, which page you want to appear in the search engine and what page you want to hide
Note- Before crawling any web page, the search engine scans the robots.txt file.
By default Blogger’s robots.txt file looks like this, as shown in the screenshot.
To view a custom robot file, you can type slash (/) after your blog’s homepage URL and type in robots.txt and press Enter.
Robots.txt file in Blogger
Now let us see what this Robots.txt code means?
User-agent: Media partners-Google
This code is for Google AdSense robots, which governs the types of AdSense Adsense ads you receive on your blogs and websites.
Consumer Agent: *
This code means all search engine bots can crawl our blog. An asterisk (*) means all robots (Googlebot, yahoo etc).
Decline: / search
This means that the search engine crawl will not occur after your domain name, even before the keyword appears.
Pre-https:https://www.technologytipssunil.ooo/2018/09/how-to-add-robotstxt-file-on-blogger.html
This link is the label name (menu) of our blog. Similarly, the number of labels in our blog will not be indexed.
Allow: /
This code helps you index your blog’s homepage by crawling it.
Sitemap
The sitemap gives search engine information about all current and new posts on our blog. This means that whenever the Web crawler scans our robots.txt file, Sitemap will get the information of all our published posts.
How to add robots.txt file blogger
To add a custom robots.txt file to Blogger, I will first be able to log in to Blogger and log into the dashboard.
– Now you can go to Settings and click on Search Preferences option.
– In this page, you will find a section called Crawlers and Indexing, where there will be an option of custom robots.txt [disabled]. To enable it, you’ll need to edit on Yes and click on Tick.
After this, copy the code below to paste into the box of custom robots.txt and click Save.
Copy Robots.txt Code
User-agent: Media partners-Google
Do not allow:
Consumer Agent: *
Decline: / search
Allow: /
Sitemap: http://example.com/sitemap.xml
Note- http://example.com/sitemap.xml Change the Sitemap inside your Sitemap.
Add robots.txt file to Blogger
I have explained the entire process of adding the custom Blogger.txt file to your Blogger, you can also add a robots.txt file to your blog.
If you want to hide any posts or pages from here, then you should have a proper knowledge of robots.txt because abuse can make your blog completely. Do not tamper with your settings without any knowledge.

If you have any questions related to this topic then you can ask in the comments and you may like our Facebook page (technologytipssunil) for blogging tips for this method.
How to add Robots.txt file on Blogger? Step by Step – technologytipssunil

Be the first to comment

Leave a Reply

Your email address will not be published.


*