{"id":748,"date":"2022-09-12T18:32:09","date_gmt":"2022-09-12T18:32:09","guid":{"rendered":"https:\/\/glossary.dream.press\/glossary\/%group%\/log-file\/"},"modified":"2026-08-07T20:30:23","modified_gmt":"2026-08-07T20:30:23","slug":"log-file","status":"publish","type":"glossary","link":"https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/","title":{"rendered":"Log File"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Log files are the raw material of technical <a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/seo\/\">search engine optimization<\/a>. Because access logs are written on the server itself, they capture crawler requests that browser-based analytics tools mostly miss. That&#8217;s how SEOs find wasted <a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/crawl-budget\/\">crawl budget<\/a> and <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/404-error\/\">404 errors<\/a> nobody noticed. The practice of studying them is called <a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/log-file-analysis\/\">log file analysis<\/a>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Contents of a log file entry<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Every line in an access log records the same core facts: the <a href=\"https:\/\/www.dreamhost.com\/glossary\/domains\/ip-address\/\">IP address<\/a> of the client making the request (a visitor&#8217;s device or a search engine bot), a timestamp, the requested <a href=\"https:\/\/www.dreamhost.com\/glossary\/domains\/url\/\">URL<\/a>, the status code the server returned, and the <a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/user-agent\/\">user agent<\/a> string identifying the requesting browser or bot. Most servers also record the size of each response in bytes. Depending on the server&#8217;s configuration, an entry can include how long the server took to serve the request. That&#8217;s server processing time, not the full <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/page-load-time\/\">page load<\/a> a visitor experiences.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Here&#8217;s a sample entry in Apache&#8217;s <a href=\"https:\/\/httpd.apache.org\/docs\/2.4\/mod\/mod_log_config.html\">Combined Log Format<\/a>:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><code>203.0.113.7 - - [02\/Aug\/2026:09:14:07 +0000] \"GET \/blog\/pricing\/ HTTP\/1.1\" 200 5312 \"-\" \"Mozilla\/5.0 (compatible; Googlebot\/2.1; +http:\/\/www.google.com\/bot.html)\"<\/code><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Reading left to right:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>203.0.113.7<\/code>: the IP address of the client that made the request.<\/li>\n\n\n\n<li><code>- -<\/code>: two identity fields, almost always just dashes.<\/li>\n\n\n\n<li><code>[02\/Aug\/2026:09:14:07 +0000]<\/code>: the date, time, and timezone offset.<\/li>\n\n\n\n<li><code>\"GET \/blog\/pricing\/ HTTP\/1.1\"<\/code>: the request line: method, URL path, and protocol.<\/li>\n\n\n\n<li><code>200<\/code>: the HTTP status code. 200 means success; 404 would mean the page wasn&#8217;t found.<\/li>\n\n\n\n<li><code>5312<\/code>: the size of the response in bytes, excluding headers.<\/li>\n\n\n\n<li><code>\"-\"<\/code>: the referring page; a dash means there wasn&#8217;t one.<\/li>\n\n\n\n<li><code>\"Mozilla\/5.0 (compatible; Googlebot\/2.1; +http:\/\/www.google.com\/bot.html)\"<\/code>: the user agent. This one claims to be Google&#8217;s crawler, Googlebot.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">One caution: the user agent is whatever the client claims to be, and anyone can send Googlebot&#8217;s string, so a bot&#8217;s name in your logs isn&#8217;t proof of its identity. Google documents how to verify its crawlers, either by checking the IP against Google&#8217;s published crawler ranges or with a reverse DNS lookup. Confirm suspicious traffic before you act on it.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Access logs vs. error logs<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">When logging is enabled, web servers commonly produce two logs, though a configuration can add more or send entries to a separate logging service:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Access log:<\/strong> one line per request. It answers who asked for which URL, when, and what status code they got back.<\/li>\n\n\n\n<li><strong>Error log:<\/strong> a record of server-side problems, such as failing scripts, PHP warnings, and the details behind 500 errors.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The decision rule: for traffic and SEO questions, open the access log. For a broken site, open the error log.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Log files vs. Google Analytics<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The two count different things, which is why their numbers never match:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Log files<\/strong> are written on the server for every request it receives. Search engine bots, visitors with JavaScript blocked, and requests for images and other non-HTML files all show up.<\/li>\n\n\n\n<li><strong><a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/google-analytics\/\">Google Analytics<\/a><\/strong> runs JavaScript in the visitor&#8217;s browser. Most bots never show up in its reports, but it adds behavioral data a server never sees: sessions, traffic sources, and conversions.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Use logs to study <a href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/crawling\/\">crawlers<\/a> and troubleshoot the server; use analytics to study people.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Where to find your log files<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Most hosts expose logs in three places: the <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/control-panel\/\">control panel<\/a>, a <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/file-manager\/\">File Manager<\/a>, or an <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/ftp\/\">FTP\/SFTP<\/a> client. DreamHost, for example, shows both access and error logs in the panel under Manage Websites > Logs, with filters for status code and time range.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Don&#8217;t assume old logs will wait for you. Servers rotate log files regularly, often daily, and how long past days stay available depends on your <a href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/hosting-provider\/\">hosting provider<\/a>. DreamHost&#8217;s help center, for example, documents that it <a href=\"https:\/\/help.dreamhost.com\/hc\/en-us\/articles\/35845703281556-The-Website-Logs-page\">stores HTTP logs by default for 7 days<\/a>, a limit the same article ties to the GDPR, Europe&#8217;s data-privacy law. If you need crawl history for SEO analysis, download your logs on a schedule and archive them yourself. Remember that logs can only answer for the time window and fields your server was configured to keep.<\/p>\n","protected":false},"featured_media":0,"parent":0,"menu_order":0,"template":"","meta":{"_acf_changed":false,"_yoast_wpseo_focuskw":"","_yoast_wpseo_title":"What Is a Log File? %%sep%% %%sitename%%","_yoast_wpseo_metadesc":"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.","_yoast_wpseo_opengraph-title":"","_yoast_wpseo_opengraph-description":"","_yoast_wpseo_twitter-title":"","_yoast_wpseo_twitter-description":""},"group":[20],"class_list":["post-748","glossary","type-glossary","status-publish","hentry","group-seo"],"acf":{"cta":"SEO Marketing","faqs":[{"question":"Can log files tell me who visited my website?","answer":"Usually not by name. But logs can hold personal or sensitive data: IP addresses, authenticated usernames, and URLs or query strings that carry emails or tokens. Restrict who can read your logs, avoid logging secrets, and delete old logs on a schedule."},{"question":"Do log files slow down my website?","answer":"Usually not under normal traffic. Each entry is one small server-side write. Very high volume, verbose logging, slow storage, or a disk filled by unrotated logs can hurt, though. Rotate logs, cap how long you keep them, and monitor disk space."},{"question":"Where are log files stored on the server?","answer":"It varies. Logs commonly live in a logs directory in your user's home path, reachable over SFTP, but the exact location and file names differ by host and server software, so check your host's documentation."}],"term_definition":"A log file is a chronological record of events generated by a server, application, operating system, or device. The type site owners use most is the web server's access log, which records each request: the client's IP address, timestamp, requested URL, user agent, and status code. SEOs analyze access logs to see how search engines crawl a site.","h2_more":"More About Log Files","title_tag":"What Is a Log File?"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What Is a Log File? - DreamHost Glossary<\/title>\n<meta name=\"description\" content=\"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.\" \/>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Is a Log File? - DreamHost Glossary\" \/>\n<meta property=\"og:description\" content=\"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dreamhost.com\/glossary\/seo\/log-file\/\" \/>\n<meta property=\"og:site_name\" content=\"DreamHost Glossary\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-07T20:30:23+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What Is a Log File? - DreamHost Glossary","description":"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"What Is a Log File? - DreamHost Glossary","og_description":"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.","og_url":"https:\/\/www.dreamhost.com\/glossary\/seo\/log-file\/","og_site_name":"DreamHost Glossary","article_modified_time":"2026-08-07T20:30:23+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/","url":"https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/","name":"What Is a Log File? - DreamHost Glossary","isPartOf":{"@id":"https:\/\/glossary.dream.press\/glossary\/#website"},"datePublished":"2022-09-12T18:32:09+00:00","dateModified":"2026-08-07T20:30:23+00:00","description":"A log file is a time-stamped record of server or application events. See what an access log entry contains, why SEOs analyze logs, and where to find yours.","breadcrumb":{"@id":"https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/glossary.dream.press\/glossary\/seo\/log-file\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.dreamhost.com\/glossary\/"},{"@type":"ListItem","position":2,"name":"Terms","item":"https:\/\/www.dreamhost.com\/glossary\/%group%\/"},{"@type":"ListItem","position":3,"name":"Log File"}]},{"@type":"WebSite","@id":"https:\/\/glossary.dream.press\/glossary\/#website","url":"https:\/\/glossary.dream.press\/glossary\/","name":"DreamHost Glossary","description":"","publisher":{"@id":"https:\/\/glossary.dream.press\/glossary\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/glossary.dream.press\/glossary\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/glossary.dream.press\/glossary\/#organization","name":"DreamHost","url":"https:\/\/glossary.dream.press\/glossary\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/glossary.dream.press\/glossary\/#\/schema\/logo\/image\/","url":"https:\/\/glossary.dream.press\/glossary\/wp-content\/uploads\/2022\/10\/dreamhost-glossary-social.jpg","contentUrl":"https:\/\/glossary.dream.press\/glossary\/wp-content\/uploads\/2022\/10\/dreamhost-glossary-social.jpg","width":2400,"height":1256,"caption":"DreamHost"},"image":{"@id":"https:\/\/glossary.dream.press\/glossary\/#\/schema\/logo\/image\/"}}]}},"lang":"en","translations":{"en":748,"es":1490,"fr":7647,"nl":7676,"it":8680,"pt":9712,"de":9758,"pl":9764,"ru":9895,"uk":9913},"pll_sync_post":{},"_links":{"self":[{"href":"https:\/\/glossary.dream.press\/glossary\/wp-json\/wp\/v2\/glossary\/748","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/glossary.dream.press\/glossary\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/glossary.dream.press\/glossary\/wp-json\/wp\/v2\/types\/glossary"}],"wp:attachment":[{"href":"https:\/\/glossary.dream.press\/glossary\/wp-json\/wp\/v2\/media?parent=748"}],"wp:term":[{"taxonomy":"group","embeddable":true,"href":"https:\/\/glossary.dream.press\/glossary\/wp-json\/wp\/v2\/group?post=748"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}