{"id":35214,"date":"2025-06-24T11:42:45","date_gmt":"2025-06-24T11:42:45","guid":{"rendered":"https:\/\/www.seobility.net\/?page_id=35214"},"modified":"2026-03-19T11:07:27","modified_gmt":"2026-03-19T11:07:27","slug":"bot-info-page","status":"publish","type":"page","link":"https:\/\/www.seobility.net\/en\/bot\/","title":{"rendered":"Bot Info Page"},"content":{"rendered":"<div>\n<p>The Seobility Bot crawls sites to gather SEO-Information.<\/p>\n<h2 class=\"h3\">Blocking the bot completely<\/h2>\n<p>In order to stop requests from the Seobility Bot add the following Line to your Robots.txt:<\/p>\n<pre>User-agent: SeobilityBot (SEO Tool; https:\/\/www.seobility.net\/sites\/bot.html)\r\nDisallow: \/<\/pre>\n<p>For automated discovery of our bots, you can also fetch the IP list from here: <a href=\"https:\/\/www.seobility.net\/bots.json\">https:\/\/www.seobility.net\/bots.json<\/a><br \/>\n&nbsp;<br \/>\n<small>If you see the bot misbehaving severly, please <a href=\"\/contact\">contact us<\/a>.<\/small><\/p>\n<h2 class=\"h3\">General vs. specific directives<\/h2>\n<p>The Seobility Bot will follow all * directives as long as no Seobility directive is provided in the file. For Example:<\/p>\n<pre>User-agent: * \r\nDisallow: \/secret.html<\/pre>\n<p>secret.html <strong>will not<\/strong> be crawled<\/p>\n<pre>User-agent: * \r\nDisallow: \/secret.html\r\n\r\nUser-agent: Seobility\r\nDisallow: \/login.html<\/pre>\n<p>secret.html <strong>will<\/strong> be crawled, login.html <strong>will not<\/strong> be crawled.<\/p>\n<h2 class=\"h3\">Only allow Seobility to crawl your site<\/h2>\n<p>If you want to grant access only to Seobility and deny all other bots then you can use the following robots.txt entry. This technique can be used to test SEO changes on a subdomain (<abbr title=\"for example\">e.g.<\/abbr> https:\/\/test.example.com\/) before releasing the changes.<\/p>\n<pre>User-agent: *\r\nDisallow: \/\r\n\r\nUser-agent: Seobility\r\nDisallow:<\/pre>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The Seobility Bot crawls sites to gather SEO-Information. Blocking the bot completely In order to stop requests from the Seobility Bot add the following Line to your Robots.txt: User-agent: SeobilityBot (SEO Tool; https:\/\/www.seobility.net\/sites\/bot.html) Disallow: \/ For automated discovery of our bots, you can also fetch the IP list from here: https:\/\/www.seobility.net\/bots.json &nbsp; If you see [&hellip;]<\/p>\n","protected":false},"author":40,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-35214","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Bot Info Page &#8211; Seobility<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.seobility.net\/en\/bot\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bot Info Page &#8211; Seobility\" \/>\n<meta property=\"og:description\" content=\"The Seobility Bot crawls sites to gather SEO-Information. Blocking the bot completely In order to stop requests from the Seobility Bot add the following Line to your Robots.txt: User-agent: SeobilityBot (SEO Tool; https:\/\/www.seobility.net\/sites\/bot.html) Disallow: \/ For automated discovery of our bots, you can also fetch the IP list from here: https:\/\/www.seobility.net\/bots.json &nbsp; If you see [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.seobility.net\/en\/bot\/\" \/>\n<meta property=\"og:site_name\" content=\"Seobility\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/seobility.net\/\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-19T11:07:27+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.seobility.net\/wp-content\/uploads\/2025\/06\/seobility-og-image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@seobility_net\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.seobility.net\/en\/bot\/\",\"url\":\"https:\/\/www.seobility.net\/en\/bot\/\",\"name\":\"Bot Info Page &#8211; Seobility\",\"isPartOf\":{\"@id\":\"https:\/\/www.seobility.net\/en\/#website\"},\"datePublished\":\"2025-06-24T11:42:45+00:00\",\"dateModified\":\"2026-03-19T11:07:27+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.seobility.net\/en\/bot\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.seobility.net\/en\/bot\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.seobility.net\/en\/bot\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.seobility.net\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Bot Info Page\",\"item\":\"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages\/35214\/\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.seobility.net\/en\/#website\",\"url\":\"https:\/\/www.seobility.net\/en\/\",\"name\":\"Seobility\",\"description\":\"Online SEO Software &amp; Tools For Better Rankings\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.seobility.net\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Bot Info Page &#8211; Seobility","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.seobility.net\/en\/bot\/","og_locale":"en_US","og_type":"article","og_title":"Bot Info Page &#8211; Seobility","og_description":"The Seobility Bot crawls sites to gather SEO-Information. Blocking the bot completely In order to stop requests from the Seobility Bot add the following Line to your Robots.txt: User-agent: SeobilityBot (SEO Tool; https:\/\/www.seobility.net\/sites\/bot.html) Disallow: \/ For automated discovery of our bots, you can also fetch the IP list from here: https:\/\/www.seobility.net\/bots.json &nbsp; If you see [&hellip;]","og_url":"https:\/\/www.seobility.net\/en\/bot\/","og_site_name":"Seobility","article_publisher":"https:\/\/www.facebook.com\/seobility.net\/","article_modified_time":"2026-03-19T11:07:27+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/www.seobility.net\/wp-content\/uploads\/2025\/06\/seobility-og-image.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@seobility_net","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.seobility.net\/en\/bot\/","url":"https:\/\/www.seobility.net\/en\/bot\/","name":"Bot Info Page &#8211; Seobility","isPartOf":{"@id":"https:\/\/www.seobility.net\/en\/#website"},"datePublished":"2025-06-24T11:42:45+00:00","dateModified":"2026-03-19T11:07:27+00:00","breadcrumb":{"@id":"https:\/\/www.seobility.net\/en\/bot\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.seobility.net\/en\/bot\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.seobility.net\/en\/bot\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.seobility.net\/en\/"},{"@type":"ListItem","position":2,"name":"Bot Info Page","item":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages\/35214\/"}]},{"@type":"WebSite","@id":"https:\/\/www.seobility.net\/en\/#website","url":"https:\/\/www.seobility.net\/en\/","name":"Seobility","description":"Online SEO Software &amp; Tools For Better Rankings","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.seobility.net\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages\/35214","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/users\/40"}],"replies":[{"embeddable":true,"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/comments?post=35214"}],"version-history":[{"count":2,"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages\/35214\/revisions"}],"predecessor-version":[{"id":38265,"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/pages\/35214\/revisions\/38265"}],"wp:attachment":[{"href":"https:\/\/www.seobility.net\/en\/wp-json\/wp\/v2\/media?parent=35214"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}