{"version":"1.0","provider_name":"Glosario de DreamHost","provider_url":"https:\/\/glossary.dream.press\/glossary","author_name":"Nikola Ivanov","author_url":"https:\/\/glossary.dream.press\/glossary\/author\/nikola\/","title":"Archivo Robots.txt - Glosario de DreamHost","type":"rich","width":600,"height":338,"html":"<blockquote class=\"wp-embedded-content\" data-secret=\"G63oa36GLz\"><a href=\"https:\/\/glossary.dream.press\/glossary\/es\/seo\/archivo-robots-txt\/\">Archivo Robots.txt<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/glossary.dream.press\/glossary\/es\/seo\/archivo-robots-txt\/embed\/#?secret=G63oa36GLz\" width=\"600\" height=\"338\" title=\"&#8220;Archivo Robots.txt&#8221; &#8212; Glosario de DreamHost\" data-secret=\"G63oa36GLz\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script>\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/glossary.dream.press\/glossary\/wp-includes\/js\/wp-embed.min.js\n<\/script>\n","description":"Los archivos robot.txt no son estrictamente necesarios. Sin ellos, los robots rastrear\u00e1n el sitio seg\u00fan su gu\u00eda predeterminada. Sin embargo, la mayor\u00eda de los sitios pueden beneficiarse de incluir un archivo robot.txt para ayudar a guiar a los rastreadores. Se puede usar un archivo robot.txt para alentar o disuadir el rastreo de ciertas p\u00e1ginas. Por [&hellip;]"}