{"version":"1.0","provider_name":"DreamHost Glossary","provider_url":"https:\/\/glossary.dream.press\/glossary","author_name":"Nikola Ivanov","author_url":"https:\/\/glossary.dream.press\/glossary\/author\/nikola\/","title":"Archivo Robots.txt - DreamHost Glossary","type":"rich","width":600,"height":338,"html":"<blockquote class=\"wp-embedded-content\" data-secret=\"9UCYA6m28q\"><a href=\"https:\/\/glossary.dream.press\/glossary\/es\/seo\/archivo-robots-txt\/\">Archivo Robots.txt<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/glossary.dream.press\/glossary\/es\/seo\/archivo-robots-txt\/embed\/#?secret=9UCYA6m28q\" width=\"600\" height=\"338\" title=\"&#8220;Archivo Robots.txt&#8221; &#8212; DreamHost Glossary\" data-secret=\"9UCYA6m28q\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/* ]]> *\/\n<\/script>\n","description":"Los archivos robot.txt no son estrictamente necesarios. Sin ellos, los robots rastrear\u00e1n el sitio seg\u00fan su gu\u00eda predeterminada. Sin embargo, la mayor\u00eda de los sitios pueden beneficiarse de incluir un archivo robot.txt para ayudar a guiar a los rastreadores. Se puede usar un archivo robot.txt para alentar o disuadir el rastreo de ciertas p\u00e1ginas. Por [&hellip;]"}