Search Console triage

Fix crawl ambiguity without guessing redirects or bloating the sitemap.

Ontario has product pages, proof pages, answer pages, and machine evidence. Search Console should be used to prioritize the pages that help agents verify x402 endpoints before payment, not to force-index every receipt.

Rule: Fix a 404 only when the URL is internally linked, in a sitemap, externally valuable, or clearly a legacy route. Do not create redirects for random probe URLs, typo traffic, or spam paths.

How to handle Search Console reasons

GSC reasonMeaningOntario actionCommand / evidence
Not found (404)Google requested a URL that returned missing.Export the exact URLs. Redirect only valuable or internally linked URLs. Leave random probes alone.python3 scripts/gsc_export_triage.py export.csv
Discovered - currently not indexedGoogle knows the URL but has not crawled/indexed it yet.Request indexing only for `/sitemap-core.xml` URLs. Wait on receipts and low-priority generated pages.core sitemap
Crawled - currently not indexedGoogle crawled but did not select the page for indexing.If core, improve title, unique proof, internal links, and above-fold value. If receipt/supporting evidence, keep it in evidence sitemap and monitor.evidence sitemap
Page with redirectGoogle found a URL that redirects to canonical.Usually acceptable. Keep canonicals and internal links pointing at the final URL.curl -I https://ontarioprotocol.com/verify

Priority URLs to request indexing

Use this list after major deploys. It is intentionally smaller than the full sitemap.

  1. https://ontarioprotocol.com/
  2. https://ontarioprotocol.com/verify
  3. https://ontarioprotocol.com/tools/x402-readiness-checker
  4. https://ontarioprotocol.com/discover
  5. https://ontarioprotocol.com/reports
  6. https://ontarioprotocol.com/docs
  7. https://ontarioprotocol.com/docs/x402-endpoint-readiness-quickstart
  8. https://ontarioprotocol.com/docs/agent-payment-preflight
  9. https://ontarioprotocol.com/docs/google-ai-search-checklist
  10. https://ontarioprotocol.com/docs/search-console-indexing-playbook
  11. https://ontarioprotocol.com/trust
  12. https://ontarioprotocol.com/trust/what-ontario-checks
  13. https://ontarioprotocol.com/answers/x402-verifier
  14. https://ontarioprotocol.com/answers/x402-readiness-checker
  15. https://ontarioprotocol.com/answers/verify-endpoint-before-agent-pays
  16. https://ontarioprotocol.com/answers/x402-payment-verification-api
  17. https://ontarioprotocol.com/answers/agent-can-pay-api
  18. https://ontarioprotocol.com/answers/agent-payment-firewall
  19. https://ontarioprotocol.com/answers/x402-paid-api-directory
  20. https://ontarioprotocol.com/proof/
  21. https://ontarioprotocol.com/proof/common-x402-implementation-mistakes
  22. https://ontarioprotocol.com/proof/live-x402-endpoint-readiness-benchmark
  23. https://ontarioprotocol.com/benchmarks
  24. https://ontarioprotocol.com/benchmarks/x402
  25. https://ontarioprotocol.com/compare/x402-verification-tools
  26. https://ontarioprotocol.com/playbooks

CSV triage workflow

# Export a Page Indexing or URL table from Search Console, then run:
python3 scripts/gsc_export_triage.py ~/Downloads/search-console-export.csv

# Optional Markdown summary for a human review note:
python3 scripts/gsc_export_triage.py ~/Downloads/search-console-export.csv --format markdown

Decision checklist

Request indexingHomepage, verifier, discovery, reports, trust, core docs, and high-intent answer pages.
Strengthen contentCore pages that are crawled but not indexed need sharper x402 proof, internal links, and action blocks.
Keep as evidenceCitation receipts and benchmark details support sourceability even if they do not all rank.
Ignore noiseDo not build redirect maps for random 404 probes unless Search Console shows meaningful links.