Improve Lighthouse Agentic Browsing readiness #8

Merged
westfarn merged 1 commits from feature/5-agentic-browsing-readiness into master 2026-07-02 04:36:54 -07:00
Owner

Summary

  • Add robots.txt, sitemap.xml, and llms.txt endpoints so crawlers and AI agents can discover public pages
  • Fix accessibility tree issues: contact form labels, semantic nav/profile dropdown buttons, cookie consent dialog ARIA, and dead href="#" links
  • Reduce layout shift on homepage/contact via hero min-heights, trusted-by marquee sizing, and fixed cookie banner
  • Add regression tests and docs/agentic-browsing.md for Lighthouse agentic-browsing audits

Closes #5. Also addresses overlap with #3 (sitemap + robots.txt).

Test plan

  • python manage.py test public.tests (14 tests pass)
  • Verify GET /robots.txt, /sitemap.xml, /llms.txt return 200 in staging/prod
  • Confirm contact form labels visible and submittable on /contact
  • Run Lighthouse --only-categories=agentic-browsing on homepage and contact page
  • Smoke test mobile nav dropdown and cookie consent banner
## Summary - Add `robots.txt`, `sitemap.xml`, and `llms.txt` endpoints so crawlers and AI agents can discover public pages - Fix accessibility tree issues: contact form labels, semantic nav/profile dropdown buttons, cookie consent dialog ARIA, and dead `href="#"` links - Reduce layout shift on homepage/contact via hero min-heights, trusted-by marquee sizing, and fixed cookie banner - Add regression tests and `docs/agentic-browsing.md` for Lighthouse agentic-browsing audits Closes #5. Also addresses overlap with #3 (sitemap + robots.txt). ## Test plan - [x] `python manage.py test public.tests` (14 tests pass) - [ ] Verify `GET /robots.txt`, `/sitemap.xml`, `/llms.txt` return 200 in staging/prod - [ ] Confirm contact form labels visible and submittable on `/contact` - [ ] Run Lighthouse `--only-categories=agentic-browsing` on homepage and contact page - [ ] Smoke test mobile nav dropdown and cookie consent banner
westfarn added 1 commit 2026-07-02 04:31:00 -07:00
Add robots.txt, sitemap.xml, and llms.txt for crawlers and AI agents, fix accessibility tree gaps in forms and navigation, reduce layout shift on key pages, and document Lighthouse regression checks.

Co-authored-by: Cursor <cursoragent@cursor.com>
westfarn merged commit 846f1b8a37 into master 2026-07-02 04:36:54 -07:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ai_ml_operations/company_site#8