ai_ml_operations/chat_web_app
2
0 Fork 0
Code Issues 19 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Vision: attach an image with a prompt and have the model read it #129

Merged
westfarn merged 1 commits from feat/128-vision-image-prompt into master 2026-10-20 06:13:42 -07:00
Conversation 0 Commits 1 Files Changed 11
+142 -18
westfarn commented 2026-10-20 06:12:11 -07:00
Owner
Copy link
Copy source

Summary

  • Closes #128.
  • Chat composer accepts PNG, JPEG, WebP, and GIF along with existing documents.
  • Selected image shows a thumbnail before send. Filename stays hidden for images. Documents still show the filename.
  • User turn keeps the image after reload, from the prompt image field the backend returns.
  • Oversized or unsupported images show the websocket error on the assistant bubble.
  • Landing copy and llms.txt no longer list vision as roadmap-only.

Needs the matching chat_backend branch feat/128-vision-image-prompt so the model actually reads the image.

Test plan

  • Attach a PNG with a prompt that asks to read text in the image. Answer uses the picture.
  • Thumbnail shows before send, with no filename.
  • Reload the conversation. The image is still on the user turn.
  • CSV/PDF attach still works.
  • Text-only prompt unchanged.
  • A BMP or an image over 8 MB shows an error instead of a silent failure.
## Summary - Closes #128. - Chat composer accepts PNG, JPEG, WebP, and GIF along with existing documents. - Selected image shows a thumbnail before send. Filename stays hidden for images. Documents still show the filename. - User turn keeps the image after reload, from the prompt `image` field the backend returns. - Oversized or unsupported images show the websocket error on the assistant bubble. - Landing copy and `llms.txt` no longer list vision as roadmap-only. Needs the matching `chat_backend` branch `feat/128-vision-image-prompt` so the model actually reads the image. ## Test plan - [ ] Attach a PNG with a prompt that asks to read text in the image. Answer uses the picture. - [ ] Thumbnail shows before send, with no filename. - [ ] Reload the conversation. The image is still on the user turn. - [ ] CSV/PDF attach still works. - [ ] Text-only prompt unchanged. - [ ] A BMP or an image over 8 MB shows an error instead of a silent failure.
westfarn added 1 commit 2026-10-20 06:12:11 -07:00
Let a chat prompt include an image the model can read.
Unit Tests / test (pull_request) Successful in 37s
Details
760b06f3f4 
The composer accepts PNG, JPEG, WebP, and GIF, shows a thumbnail before send, and keeps the image on the user turn after reload. Closes #128.

Co-authored-by: Cursor <cursoragent@cursor.com>
westfarn merged commit 89228719b5 into master 2026-10-20 06:13:42 -07:00
westfarn deleted branch feat/128-vision-image-prompt 2026-10-20 06:13:42 -07:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
twestfall westfarn (Ryan Westfall)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ai_ml_operations/chat_web_app#129