NoteGPT
Tags:: #project #python #coding #ToResearch
Lead:: An app that translates pictures of notes to markdown
Initial Scoping
- user base: me
- how do I want to use this?
- Phone, but laptop too for screenshots
- So web app maybe?
- how do I want to use this?
- ? Good Question: how will we read the words?
- use case:
- I want to take a screenshot of my text messaging
- I want all the text to be ingested and sorted
- If it’s messaging two cattegories
- if it’s a website plain
- I want formatting applied
- Inferring the formatting - AI?
- initial use could be hardcode formatting
- I want to be given a markdown(configurable) output to copy paste or to save
- I want to choose whether to store the screenshot
- Blank slate again
- Use this nord theme on my phone
- I want to interact with react native again for this
- Use case:
- I want to open the app
- I want to press a camera icon
- Be prompted to get phone camera permission
- Phone camera interface
- Take a picture of the handwritten grocery list on a white board
- Handwriting to be ingested
- I want the text sorted, formatted
- be shown with any low confidence (configurable)words underlined in green
- export process as above
- Will this use AI?
- Possible technologies
- Chatgpt api
- Python backend on locally hosted / pythonanywhere server
- Opencv?
- Is there a phone native way to use opencv / nlp
- Must be to just bundle it right
- React native
- Quick prototyping
- This could start as an obsidian add on
- This makes sense
- Use case:
- I have a screenshot in my phone
- I want to press a button above my keyboard, select the screenshot
- Type a title and optionally select where to save it