How To Create The Perfect Robots.txt File For SEO -Sitemap

Hey what's up guys, do you know how to create robots.txt files for blogger?

If you do not know then there is nothing to be worried about it .

Because in this video i will show you how to create a robots.txt in blogger.

I’m going to show you how to set up a SEO friendly robot.txt file, and then we’ll take a look at how to customize it for blogger and website.

Start by setting the user-agent term. We’re going to set it so that it applies to all web robots.

Do this by using an asterisk after the user-agent term, like this:

User-agent: *

 

Next, type “Disallow: ” but don’t type anything after that.

Disallow:

Since there’s nothing after the disallow, web robots will be directed to crawl your entire site. 

Disallow crawling of an entire site, but allow Mediapartners-Google

User-agent: Mediapartners-Google

Allow: /

You can also link to your XML sitemap.

Sitemap: https://yoursite.com/sitemap.xml

Finally we have created a SEO friendly robots txt file that looks like this;

[    User-agent: Mediapartners-Google

     Disallow:

     User-agent:

     Disallow: /search

    Allow: /

     Sitemap: 

    https://YourSite.com/sitemap.xml

  ]

Or you can check on others website or blog what robots.txt they are using.

For example: https://salvrhw.blogspot.com is a url and you want to look what robots.txt have used here.

https://salvrhw24.blogspot.com/robots.txt

Hope you like the post. So, please leave your feedback in comment section.

Tags: 

custom robots.txt, custom robots.txt for blogger, custom robots.txt blogger for SEO,

how to create robots.txt file for blogger, how to create a robots.txt file, how to create a robots.txt, what is robots.txt, how to create a robots.txt in blogger, robot.txt for blogger, custom robots.txt generator for blogger, blogger seo settings, how to create robots.txt file for seo, sitemap generator for blogger, what is sitemap,

how to generate robots.txt file, how to generate robots.txt file for blogger, how to create robots.txt for blogger, how to create a robots.txt file for my site, how to create robots.txt file for website.

✅Read More:

Google Adsense Approval Tips 2022 | How to get google adsense approval fast

Payoneer -Get $25 Sign Up Bonus And Free Prepaid Mastercard

What's the best freelancing marketplace ?

Design your high converting social media ad image with professional Graphic Designer 

Online Earning Site in Bangladesh 2022 #1

How can I make money using PayPal | Get free $50 in Paypal

How to deactivate facebook account | fb account deactivate

Facebook video download without watermark | Facebook video downloader

I will do high quality photoshop editing or photo manipulation

Payoneer is an international global payment method | get $25 bonus free

I will create wordpress website design, WordPress development