Skip to content

Capstone-Projects-2024-Spring/project-synesthesia-reading-app

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Project Name

Report Issue on Jira Deploy Docs Documentation Website Link

Keywords

Section #03, synesthesia, grapheme-color synesthesia, web app, PHP, Python, JavaScript, React, Vercell, Laravel, EC2

Project Abstract

Mara's Proposal: My goal is to design an app based on the phenomenon of synesthesia. Specifically, the app would focus on grapheme-color synesthesia in which graphemes elicit specific colors that remain consistent over time. Van der Veen, Aben, Smits &. Röder (2014) demonstrated that individuals ages 19-49 with grapheme-color synesthesia react slower when presented with graphemes incongruent to their synesthetic color associations. In turn, these individuals’ reaction time improved when presented graphemes in colors congruent to their associations. Similarly, Bryan Alvarez and Lynn Robertson (2013) demonstrated that when primed with graphemes colored congruently to their synesthetic associations, individuals 19-40 years of age with grapheme-color synesthesia had faster reaction times compared to when primed with achromatic graphemes that elicit a synesthetic color. I am hoping to develop an app that would allow people who have grapheme-color synesthesia to read text in their personal color associations. Although to non-synesthetes, text printed in a variety of colors may seem chaotic, but to me (a graphemecolor synesthete), graphemes printed in colors harmonious with my natural color association just feels right.  My proposed app would use artificial intelligence processes similar to those used with word prediction applications. Rather than word prediction, color prediction would convert files to text representing each synesthete’s respective colors. The app will continuously learn the individual’s personal color algorithms along with any anomalies.   Synesthesia co-occurs with neurological differences and learning differences. Specifically: Autism (including Asperger syndrome), ADHD, dyslexia, and dyspraxia. Simon Baron-Cohen, Donielle Johnson, Julian Asher, Sally Wheelwright, Simon Fisher, and Peter Gregerson (2013) demonstrated that in adults the rate of synesthesia was three times higher in people with autism (18.9%) compared to a control group of people without autism (7.22%). David Grant (2017) found that there is a co-occurrence of synesthetic experiences in individuals with ADHD, dyslexia, and dyspraxia. 17% of individuals with ADHD, 9% of dyslexics, and 14% of dyspraxics reported synesthetic experiences. Synesthetic experiences are also reported in 18% of individuals with both ADHD and dyslexia as well as 37% individuals with both ADHD and dyspraxia. This co-occurrence with disabilities suggests that this app could potentially have implications in educational interventions for different learners. 

High Level Requirement

ColorInSync allows people who have grapheme-color synesthesia to read text in their personal color associations.

Conceptual Design

This web application is usable by anyone with a device capable of rendering web pages. The frontend is coded in JavaScript with React and deployed via Vercell. The backend is in PHP with a Laravel Framework and hosted on an Amazon EC2 server. It communicates with a Python flask hosted on the same EC2 server and a PostGres database.

Background

There are no other products or services rendering text in a grapheme-color synesthete's personal color associations.

Required Resources

  • Frontend framework
  • Backend framework
  • database
  • server

Collaborators

elijahbigham
Elijah Bigham
AndrewDKahn
Andrew Kahn
thanhnguyen46
Mohammed Mohammed
alyssatownsend
Alyssa Townsend

Acknowledgements

The code to split compound words in order to color their components separately was based off of Tim Kam's compound-word-splitter by Timotheus Kampik, fatkaratekid, and Tessa Kettelberger. It uses this conversion of Webster's English Dictionary to JSON by Matt Reagan, Brian S, Bhargav Chippada, and Justin Katerberg.