NoteGPT

Tags:: #project #python #coding #ToResearch
Lead:: An app that translates pictures of notes to markdown

Initial Scoping

• user base: me
  • how do I want to use this?
    • Phone, but laptop too for screenshots
  • So web app maybe?
• ? Good Question: how will we read the words?
• use case:
  • I want to take a screenshot of my text messaging
  • I want all the text to be ingested and sorted
    • If it’s messaging two cattegories
    • if it’s a website plain
  • I want formatting applied
    • Inferring the formatting - AI?
    • initial use could be hardcode formatting
  • I want to be given a markdown(configurable) output to copy paste or to save
  • I want to choose whether to store the screenshot
  • Blank slate again
• Use this nord theme on my phone
• I want to interact with react native again for this
• Use case:
  • I want to open the app
  • I want to press a camera icon
  • Be prompted to get phone camera permission
  • Phone camera interface
  • Take a picture of the handwritten grocery list on a white board
  • Handwriting to be ingested
  • I want the text sorted, formatted
  • be shown with any low confidence (configurable)words underlined in green
  • export process as above
• Will this use AI?
• Possible technologies
  • Chatgpt api
  • Python backend on locally hosted / pythonanywhere server
  • Opencv?
  • Is there a phone native way to use opencv / nlp
    • Must be to just bundle it right
  • React native
    • Quick prototyping
  • This could start as an obsidian add on
    • This makes sense
• Use case:
  • I have a screenshot in my phone
  • I want to press a button above my keyboard, select the screenshot
  • Type a title and optionally select where to save it