What is the Robots.txt File and How to Create It?

 

Follow the instructions below to How to Create It?:

 

What is the robots.txt File 

A robots.txt file tells program crawlers which URLs the crawler can access on your site. This is used mainly to avoid overloading your site with requests; it's not a mechanism for keeping an internet page out of Google. To keep an internet page out of Google, block indexing with noindex or password-protect the page.

How To Create it?

First of All you have to open your Website Panel. and Click on Plugin Button. So Here we Have to Click add new Button.

 


Then Here We Have to Search YOAST SEO. So As you can this here just we have to click on install Button. Wait a Few Seconds and Click on Active Button.

 

 

in The Left side you Can See SEO Bar. We Have To Click It.

 

 

and Now Click on Tools Section and After That Click On File Editor.

 

 

So You Can See Now Your Txt File Has Been Automatically Generated.

 

 

So Let's Test it. if It Works. To Test You Have Search Your Domain Name and Also add Robots.txt. You Can See Your Robots.txt is Perfectly Working.

 

  • hospedajeweb, robots.txt, webhospedaje, robots
  • 0 Los Usuarios han Encontrado Esto Útil
¿Fue útil la respuesta?

Artículos Relacionados

What is the Sitemap and How to Create It?

  Follow the instructions below to How to Create It?: 1st Step What is the Sitemap?...

How to Edit the Meta Title and Description (SEO) that is Displayed in the Google Search Engine in WordPress?

  Follow the instructions below on How to Edit the Meta Title and Description? So first of...