DNSApe

Accent Color

AI Readiness

How well prepared is github.com for AI agents and the agentic web?

13 /100
AI Readiness Score
F
1/8 checks passing

AI Specs

1/5
llms.txt
Found (28766 bytes)
Plain-text site summary aimed at LLM consumers.
https://github.com/llms.txt HTTP 200 ✓ satisfies this check text/plain 
# GitHub

> GitHub is a developer platform for building, shipping, and maintaining software. It provides cloud-based Git repository hosting, CI/CD via GitHub Actions, project management with Issues and Projects, code review via pull requests, AI-powered development with GitHub Copilot, and APIs (REST and GraphQL) for automation and integration.

## How to use

To retrieve full article content, page lists, or search results programmatically, please use the APIs below. To find a specific article, use the **Search API** with a query. To browse all available pages, use the **Page List API** to get a list of paths, then fetch individual articles with the **Article API**. The `/api/article/body` endpoint returns markdown, ideal for LLM consumption. These APIs return structured markdown and JSON and are the preferred way for LLMs and automated tools to access GitHub documentation.

* [Versions API](https://docs.github.com/api/pagelist/versions): Lists all available documentation versions.
* [Languages API](https://docs.github.com/api/pagelist/languages): Lists all available languages.
* [Page List API](https://docs.github.com/api/pagelist/en/free-pro-team@latest): Returns every docs page path for a given language and version.
* [Article API](https://docs.github.com/api/article): Returns the full rendered content and context of any docs page as JSON. Example: `curl "https://docs.github.com/api/article?pathname=/en/get-started/start-your-journey/about-github-and-git"`
* [Article Body API](https://docs.github.com/api/article/body): Returns the full rendered content of any docs page as markdown. Example: `curl "https://docs.github.com/api/article/body?pathname=/en/get-started/start-your-journey/about-github-and-git"`
* [Search API](https://docs.github.com/api/search/v1): Search across all docs content. Example: `curl "https://docs.github.com/api/search/v1?query=actions&language=en&version=free-pro-team@latest"`
* [GitHub MCP server](https://github.com/github/github-mcp-server)
… (truncated)
agents.txt
Not found
Discovery file listing AI agents and capabilities.
→ Publish /.well-known/agents.txt listing agent endpoints.
https://github.com/.well-known/agents.txt HTTP 404 text/plain; charset=utf-8
HTTP 404 — endpoint not served.
ai-plugin.json
Not found
OpenAI/ChatGPT plugin manifest.
→ Publish /.well-known/ai-plugin.json describing your plugin (schema_version, name_for_human, etc.).
https://github.com/.well-known/ai-plugin.json HTTP 404 application/json; charset=utf-8
HTTP 404 — endpoint not served.
OpenAPI spec
Not found
Machine-readable API specification.
→ Publish your OpenAPI spec at /openapi.json so agents can discover your API surface.
https://github.com/openapi.json HTTP 410 application/json; charset=utf-8
HTTP 410 — endpoint not served.
Markdown content negotiation
No markdown content negotiation
Serves text/markdown when an agent requests Accept: text/markdown.
→ Return text/markdown for the root URL when the client sends Accept: text/markdown (per RFC 7231 content negotiation).
https://github.com/ HTTP 406 text/html; charset=utf-8
HTTP 406 — endpoint not served.

Discovery

0/3
MCP endpoint
No MCP endpoint or Server Card found
Model Context Protocol server for AI agents.
→ Publish /.well-known/mcp/server-card.json or expose an MCP server at /mcp or /api/mcp.
The scanner probes several known locations; one positive response passes the check.
https://github.com/.well-known/mcp/server-card.json HTTP 404 application/json; charset=utf-8
HTTP 404 — endpoint not served.
https://github.com/.well-known/mcp HTTP 404 text/html; charset=utf-8
HTTP 404 — endpoint not served.
https://github.com/mcp HTTP 200 text/html; charset=utf-8 

<!DOCTYPE html>
<html
  lang="en"
  
  data-color-mode="auto" data-light-theme="light" data-dark-theme="dark"
  data-a11y-animated-images="system" data-a11y-link-underlines="true"
  
  >




  <head>
    <meta charset="utf-8">
  <link rel="dns-prefetch" href="https://github.githubassets.com">
  <link rel="dns-prefetch" href="https://avatars.githubusercontent.com">
  <link rel="dns-prefetch" href="https://github-cloud.s3.amazonaws.com">
  <link rel="dns-prefetch" href="https://user-images.githubusercontent.com/">
  <link rel="preconnect" href="https://github.githubassets.com" crossorigin>
  <link rel="preconnect" href="https://avatars.githubusercontent.com">

  


  <link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/light-4fded0090af0ad58.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/dark-06381ff23d863842.css" /><link crossorigin="anonymous" media="all" rel="stylesheet" href="https://github.githubassets.com/assets/dark_high_contrast-9023e6605402defb.css" /><link data-color-theme="light" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light-4fded0090af0ad58.css" /><link data-color-theme="light_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css" /><link data-color-theme="light_colorblind" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_colorblind-3a437477a570cc40.css" /><link data-color-theme="light_colorblind_high_contrast" crossorigin="anonymous" media="all" rel="stylesheet" data-href="https://github.githubassets.com/assets/light_colorblind_high_contrast-39b6c209db5491c9.css" /><link 
… (truncated)
https://github.com/api/mcp HTTP 404 text/html; charset=utf-8
HTTP 404 — endpoint not served.
x402 payments
Not found
Agentic micropayments via HTTP 402 (see x402.org).
→ Publish /.well-known/x402.json with x402Version, payTo, and a non-empty services[] array.
https://github.com/.well-known/x402.json HTTP 404 application/json; charset=utf-8
HTTP 404 — endpoint not served.
robots.txt AI bots
robots.txt found but no AI-bot rules
Explicit User-agent rules for AI crawlers.
→ Add User-agent stanzas for GPTBot, ClaudeBot, Google-Extended, PerplexityBot to /robots.txt.
https://github.com/robots.txt HTTP 200 text/plain 
# If you would like to crawl GitHub contact us via https://support.github.com?tags=dotcom-robots
# We also provide an extensive API: https://docs.github.com
User-agent: bingbot
Disallow: /ekansa/Open-Context-Data
Disallow: /ekansa/opencontext-*
Disallow: /account-login
Disallow: */tarball/
Disallow: */zipball/
Disallow: /Explodingstuff/
Disallow: /copilot/
Disallow: /copilot/c/

User-agent: adidxbot
Disallow: /ekansa/Open-Context-Data
Disallow: /ekansa/opencontext-*
Disallow: /account-login
Disallow: */tarball/
Disallow: */zipball/
Disallow: /Explodingstuff/
Disallow: /copilot/
Disallow: /copilot/c/

User-agent: BingPreview
Disallow: /ekansa/Open-Context-Data
Disallow: /ekansa/opencontext-*
Disallow: /account-login
Disallow: */tarball/
Disallow: */zipball/
Disallow: /Explodingstuff/
Disallow: /copilot/
Disallow: /copilot/c/

User-agent: baidu
crawl-delay: 1


User-agent: *

Disallow: /*/*/pulse
Disallow: /*/*/projects
Disallow: /*/*/forks
Disallow: /*/*/issues/new
Disallow: /*/*/milestones/new
Disallow: /*/*/issues/search
Disallow: /*/*/commits/
Disallow: /*/*/branches
Disallow: /*/*/contributors
Disallow: /*/*/tags
Disallow: /*/*/stargazers
Disallow: /*/*/watchers
Disallow: /*/*/network
Disallow: /*/*/graphs
Disallow: /*/*/compare

Disallow: /*/tree/
Disallow: /gist/
Disallow: /*/download
Disallow: /*/revisions
Disallow: /*/commits/*?author
Disallow: /*/commits/*?path
Disallow: /*/comments
Disallow: /*/archive/
Disallow: /*/blame/
Disallow: /*/raw/
Disallow: /*/cache/
Disallow: /.git/
Disallow: */.git/
Disallow: /*.git$
Disallow: /search/advanced
Disallow: /search$
Disallow: /*q=
Disallow: /*.atom$

Disallow: /ekansa/Open-Context-Data
Disallow: /ekansa/opencontext-*
Disallow: */tarball/
Disallow: */zipball/

Disallow: /*source=*
Disallow: /*ref_cta=*
Disallow: /*plan=*
Disallow: /*return_to=*
Disallow: /*ref_loc=*
Disallow: /*setup_organization=*
Disallow: /*source_repo=*
Disallow: /*ref_page=*
Disallow: /*source=*
Disallow: /*referrer=*
Disallow: /*report=*
Disall
… (truncated)
Scanned 0 seconds ago 
{
    "host": "github.com",
    "score": 13,
    "grade": "F",
    "passed": 1,
    "total": 8,
    "groups": {
        "AI Specs": [
            {
                "id": "llms_txt",
                "group": "AI Specs",
                "label": "llms.txt",
                "description": "Plain-text site summary aimed at LLM consumers.",
                "status": "pass",
                "detail": "Found (28766 bytes)",
                "remediation": "Publish /llms.txt with a markdown-style site overview (see llmstxt.org).",
                "evidence": [
                    {
                        "url": "https://github.com/llms.txt",
                        "status": 200,
                        "content_type": "text/plain",
                        "body": "# GitHub\n\n> GitHub is a developer platform for building, shipping, and maintaining software. It provides cloud-based Git repository hosting, CI/CD via GitHub Actions, project management with Issues and Projects, code review via pull requests, AI-powered development with GitHub Copilot, and APIs (REST and GraphQL) for automation and integration.\n\n## How to use\n\nTo retrieve full article content, page lists, or search results programmatically, please use the APIs below. To find a specific article, use the **Search API** with a query. To browse all available pages, use the **Page List API** to get a list of paths, then fetch individual articles with the **Article API**. The `/api/article/body` endpoint returns markdown, ideal for LLM consumption. These APIs return structured markdown and JSON and are the preferred way for LLMs and automated tools to access GitHub documentation.\n\n* [Versions API](https://docs.github.com/api/pagelist/versions): Lists all available documentation versions.\n* [Languages API](https://docs.github.com/api/pagelist/languages): Lists all available languages.\n* [Page List API](https://docs.github.com/api/pagelist/en/free-pro-team@latest): Returns every docs page path for a given language and version.\n* [Article API](https://docs.github.com/api/article): Returns the full rendered content and context of any docs page as JSON. Example: `curl \"https://docs.github.com/api/article?pathname=/en/get-started/start-your-journey/about-github-and-git\"`\n* [Article Body API](https://docs.github.com/api/article/body): Returns the full rendered content of any docs page as markdown. Example: `curl \"https://docs.github.com/api/article/body?pathname=/en/get-started/start-your-journey/about-github-and-git\"`\n* [Search API](https://docs.github.com/api/search/v1): Search across all docs content. Example: `curl \"https://docs.github.com/api/search/v1?query=actions&language=en&version=free-pro-team@latest\"`\n* [GitHub MCP server](https://github.com/github/github-mcp-server)",
                        "truncated": true
                    }
                ]
            },
            {
                "id": "agents_txt",
                "group": "AI Specs",
                "label": "agents.txt",
                "description": "Discovery file listing AI agents and capabilities.",
                "status": "fail",
                "detail": "Not found",
                "remediation": "Publish /.well-known/agents.txt listing agent endpoints.",
                "evidence": [
                    {
                        "url": "https://github.com/.well-known/agents.txt",
                        "status": 404,
                        "content_type": "text/plain; charset=utf-8",
                        "body": "Not Found",
                        "truncated": false
                    }
                ]
            },
            {
                "id": "ai_plugin",
                "group": "AI Specs",
                "label": "ai-plugin.json",
                "description": "OpenAI/ChatGPT plugin manifest.",
                "status": "fail",
                "detail": "Not found",
                "remediation": "Publish /.well-known/ai-plugin.json describing your plugin (schema_version, name_for_human, etc.).",
                "evidence": [
                    {
                        "url": "https://github.com/.well-known/ai-plugin.json",
                        "status": 404,
                        "content_type": "application/json; charset=utf-8",
                        "body": "{\n    \"error\": \"Not Found\"\n}",
                        "truncated": false
                    }
                ]
            },
            {
                "id": "openapi",
                "group": "AI Specs",
                "label": "OpenAPI spec",
                "description": "Machine-readable API specification.",
                "status": "fail",
                "detail": "Not found",
                "remediation": "Publish your OpenAPI spec at /openapi.json so agents can discover your API surface.",
                "evidence": [
                    {
                        "url": "https://github.com/openapi.json",
                        "status": 410,
                        "content_type": "application/json; charset=utf-8",
                        "body": "{\n    \"message\": \"Hello there, wayfaring stranger. If you\u2019re reading this then you probably didn\u2019t see our blog post a couple of years back announcing that this API would go away: http://git.io/17AROg Fear not, you should be able to get what you need from the shiny new Events API instead.\",\n    \"documentation_url\": \"https://docs.github.com/v3/activity/events/#list-public-events-performed-by-a-user\"\n}",
                        "truncated": false
                    }
                ]
            },
            {
                "id": "markdown_negotiation",
                "group": "AI Specs",
                "label": "Markdown content negotiation",
                "description": "Serves text/markdown when an agent requests Accept: text/markdown.",
                "status": "fail",
                "detail": "No markdown content negotiation",
                "remediation": "Return text/markdown for the root URL when the client sends Accept: text/markdown (per RFC 7231 content negotiation).",
                "evidence": [
                    {
                        "url": "https://github.com/",
                        "status": 406,
                        "content_type": "text/html; charset=utf-8",
                        "body": "",
                        "truncated": false
                    }
                ]
            }
        ],
        "Discovery": [
            {
                "id": "mcp",
                "group": "Discovery",
                "label": "MCP endpoint",
                "description": "Model Context Protocol server for AI agents.",
                "status": "fail",
                "detail": "No MCP endpoint or Server Card found",
                "remediation": "Publish /.well-known/mcp/server-card.json or expose an MCP server at /mcp or /api/mcp.",
                "evidence": [
                    {
                        "url": "https://github.com/.well-known/mcp/server-card.json",
                        "status": 404,
                        "content_type": "application/json; charset=utf-8",
                        "body": "{\n    \"error\": \"Not Found\"\n}",
                        "truncated": false
                    },
                    {
                        "url": "https://github.com/.well-known/mcp",
                        "status": 404,
                        "content_type": "text/html; charset=utf-8",
                        "body": "\n\n\n\n\n\n\n\n<!DOCTYPE html>\n<html\n  lang=\"en\"\n  \n  data-color-mode=\"auto\" data-light-theme=\"light\" data-dark-theme=\"dark\"\n  data-a11y-animated-images=\"system\" data-a11y-link-underlines=\"true\"\n  \n  >\n\n\n\n\n  <head>\n    <meta charset=\"utf-8\">\n  <link rel=\"dns-prefetch\" href=\"https://github.githubassets.com\">\n  <link rel=\"dns-prefetch\" href=\"https://avatars.githubusercontent.com\">\n  <link rel=\"dns-prefetch\" href=\"https://github-cloud.s3.amazonaws.com\">\n  <link rel=\"dns-prefetch\" href=\"https://user-images.githubusercontent.com/\">\n  <link rel=\"preconnect\" href=\"https://github.githubassets.com\" crossorigin>\n  <link rel=\"preconnect\" href=\"https://avatars.githubusercontent.com\">\n\n      <link crossorigin=\"anonymous\" rel=\"preload\" as=\"script\" href=\"https://github.githubassets.com/assets/global-banner-disable-7217e941c22f8801.js\" />\n\n  <link rel=\"preload\" href=\"https://github.githubassets.com/assets/MonaSansVF-wdth-wght-opsz-902d64c7ad02.woff2\" as=\"font\" type=\"font/woff2\" crossorigin>\n\n\n  <link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark-06381ff23d863842.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark_high_contrast-9023e6605402defb.css\" /><link data-color-theme=\"light\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link data-color-theme=\"light_high_contrast\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link data-color-theme=\"light_colorblind\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" ",
                        "truncated": true
                    },
                    {
                        "url": "https://github.com/mcp",
                        "status": 200,
                        "content_type": "text/html; charset=utf-8",
                        "body": "\n\n<!DOCTYPE html>\n<html\n  lang=\"en\"\n  \n  data-color-mode=\"auto\" data-light-theme=\"light\" data-dark-theme=\"dark\"\n  data-a11y-animated-images=\"system\" data-a11y-link-underlines=\"true\"\n  \n  >\n\n\n\n\n  <head>\n    <meta charset=\"utf-8\">\n  <link rel=\"dns-prefetch\" href=\"https://github.githubassets.com\">\n  <link rel=\"dns-prefetch\" href=\"https://avatars.githubusercontent.com\">\n  <link rel=\"dns-prefetch\" href=\"https://github-cloud.s3.amazonaws.com\">\n  <link rel=\"dns-prefetch\" href=\"https://user-images.githubusercontent.com/\">\n  <link rel=\"preconnect\" href=\"https://github.githubassets.com\" crossorigin>\n  <link rel=\"preconnect\" href=\"https://avatars.githubusercontent.com\">\n\n  \n\n\n  <link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark-06381ff23d863842.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark_high_contrast-9023e6605402defb.css\" /><link data-color-theme=\"light\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link data-color-theme=\"light_high_contrast\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link data-color-theme=\"light_colorblind\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light_colorblind-3a437477a570cc40.css\" /><link data-color-theme=\"light_colorblind_high_contrast\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light_colorblind_high_contrast-39b6c209db5491c9.css\" /><link ",
                        "truncated": true
                    },
                    {
                        "url": "https://github.com/api/mcp",
                        "status": 404,
                        "content_type": "text/html; charset=utf-8",
                        "body": "\n\n\n\n\n\n\n\n<!DOCTYPE html>\n<html\n  lang=\"en\"\n  \n  data-color-mode=\"auto\" data-light-theme=\"light\" data-dark-theme=\"dark\"\n  data-a11y-animated-images=\"system\" data-a11y-link-underlines=\"true\"\n  \n  >\n\n\n\n\n  <head>\n    <meta charset=\"utf-8\">\n  <link rel=\"dns-prefetch\" href=\"https://github.githubassets.com\">\n  <link rel=\"dns-prefetch\" href=\"https://avatars.githubusercontent.com\">\n  <link rel=\"dns-prefetch\" href=\"https://github-cloud.s3.amazonaws.com\">\n  <link rel=\"dns-prefetch\" href=\"https://user-images.githubusercontent.com/\">\n  <link rel=\"preconnect\" href=\"https://github.githubassets.com\" crossorigin>\n  <link rel=\"preconnect\" href=\"https://avatars.githubusercontent.com\">\n\n      <link crossorigin=\"anonymous\" rel=\"preload\" as=\"script\" href=\"https://github.githubassets.com/assets/global-banner-disable-7217e941c22f8801.js\" />\n\n  <link rel=\"preload\" href=\"https://github.githubassets.com/assets/MonaSansVF-wdth-wght-opsz-902d64c7ad02.woff2\" as=\"font\" type=\"font/woff2\" crossorigin>\n\n\n  <link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark-06381ff23d863842.css\" /><link crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" href=\"https://github.githubassets.com/assets/dark_high_contrast-9023e6605402defb.css\" /><link data-color-theme=\"light\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light-4fded0090af0ad58.css\" /><link data-color-theme=\"light_high_contrast\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" data-href=\"https://github.githubassets.com/assets/light_high_contrast-cf8e26bc17e62ebc.css\" /><link data-color-theme=\"light_colorblind\" crossorigin=\"anonymous\" media=\"all\" rel=\"stylesheet\" ",
                        "truncated": true
                    }
                ]
            },
            {
                "id": "x402",
                "group": "Discovery",
                "label": "x402 payments",
                "description": "Agentic micropayments via HTTP 402 (see x402.org).",
                "status": "fail",
                "detail": "Not found",
                "remediation": "Publish /.well-known/x402.json with x402Version, payTo, and a non-empty services[] array.",
                "evidence": [
                    {
                        "url": "https://github.com/.well-known/x402.json",
                        "status": 404,
                        "content_type": "application/json; charset=utf-8",
                        "body": "{\n    \"error\": \"Not Found\"\n}",
                        "truncated": false
                    }
                ]
            },
            {
                "id": "robots_ai",
                "group": "Discovery",
                "label": "robots.txt AI bots",
                "description": "Explicit User-agent rules for AI crawlers.",
                "status": "fail",
                "detail": "robots.txt found but no AI-bot rules",
                "remediation": "Add User-agent stanzas for GPTBot, ClaudeBot, Google-Extended, PerplexityBot to /robots.txt.",
                "evidence": [
                    {
                        "url": "https://github.com/robots.txt",
                        "status": 200,
                        "content_type": "text/plain",
                        "body": "# If you would like to crawl GitHub contact us via https://support.github.com?tags=dotcom-robots\n# We also provide an extensive API: https://docs.github.com\nUser-agent: bingbot\nDisallow: /ekansa/Open-Context-Data\nDisallow: /ekansa/opencontext-*\nDisallow: /account-login\nDisallow: */tarball/\nDisallow: */zipball/\nDisallow: /Explodingstuff/\nDisallow: /copilot/\nDisallow: /copilot/c/\n\nUser-agent: adidxbot\nDisallow: /ekansa/Open-Context-Data\nDisallow: /ekansa/opencontext-*\nDisallow: /account-login\nDisallow: */tarball/\nDisallow: */zipball/\nDisallow: /Explodingstuff/\nDisallow: /copilot/\nDisallow: /copilot/c/\n\nUser-agent: BingPreview\nDisallow: /ekansa/Open-Context-Data\nDisallow: /ekansa/opencontext-*\nDisallow: /account-login\nDisallow: */tarball/\nDisallow: */zipball/\nDisallow: /Explodingstuff/\nDisallow: /copilot/\nDisallow: /copilot/c/\n\nUser-agent: baidu\ncrawl-delay: 1\n\n\nUser-agent: *\n\nDisallow: /*/*/pulse\nDisallow: /*/*/projects\nDisallow: /*/*/forks\nDisallow: /*/*/issues/new\nDisallow: /*/*/milestones/new\nDisallow: /*/*/issues/search\nDisallow: /*/*/commits/\nDisallow: /*/*/branches\nDisallow: /*/*/contributors\nDisallow: /*/*/tags\nDisallow: /*/*/stargazers\nDisallow: /*/*/watchers\nDisallow: /*/*/network\nDisallow: /*/*/graphs\nDisallow: /*/*/compare\n\nDisallow: /*/tree/\nDisallow: /gist/\nDisallow: /*/download\nDisallow: /*/revisions\nDisallow: /*/commits/*?author\nDisallow: /*/commits/*?path\nDisallow: /*/comments\nDisallow: /*/archive/\nDisallow: /*/blame/\nDisallow: /*/raw/\nDisallow: /*/cache/\nDisallow: /.git/\nDisallow: */.git/\nDisallow: /*.git$\nDisallow: /search/advanced\nDisallow: /search$\nDisallow: /*q=\nDisallow: /*.atom$\n\nDisallow: /ekansa/Open-Context-Data\nDisallow: /ekansa/opencontext-*\nDisallow: */tarball/\nDisallow: */zipball/\n\nDisallow: /*source=*\nDisallow: /*ref_cta=*\nDisallow: /*plan=*\nDisallow: /*return_to=*\nDisallow: /*ref_loc=*\nDisallow: /*setup_organization=*\nDisallow: /*source_repo=*\nDisallow: /*ref_page=*\nDisallow: /*source=*\nDisallow: /*referrer=*\nDisallow: /*report=*\nDisall",
                        "truncated": true
                    }
                ]
            }
        ]
    },
    "scanned_at": "2026-06-24T00:24:23+00:00"
}