ai_ml_operations/company_site
2
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases Wiki Activity

Add sitrmap anf robots.txt #3

New Issue
Closed
opened 2025-11-25 05:28:37 -08:00 by westfarn · 1 comment
westfarn commented 2025-11-25 05:28:37 -08:00
Owner
Copy Link
Copy Source
No description provided.
westfarn commented 2026-07-05 05:56:35 -07:00
Author
Owner
Copy Link
Copy Source

Closing — no further work needed.

sitemap.xml and robots.txt are already implemented:

  • GET /robots.txt — crawl rules for major bots, disallows admin/auth/financial/planning paths, references sitemap
  • GET /sitemap.xml — lists all public marketing pages from PUBLIC_PAGE_ENTRIES in public/seo.py

Added as part of agentic browsing / Lighthouse SEO work (see public/seo.py, public/urls.py, and AgenticBrowsingSeoTests in public/tests.py).

Closing — no further work needed. `sitemap.xml` and `robots.txt` are already implemented: - `GET /robots.txt` — crawl rules for major bots, disallows admin/auth/financial/planning paths, references sitemap - `GET /sitemap.xml` — lists all public marketing pages from `PUBLIC_PAGE_ENTRIES` in `public/seo.py` Added as part of agentic browsing / Lighthouse SEO work (see `public/seo.py`, `public/urls.py`, and `AgenticBrowsingSeoTests` in `public/tests.py`).
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
twestfall westfarn (Ryan Westfall)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ai_ml_operations/company_site#3