DEVELOPMENT AND APPLICATION OF AN ASSISTIVE APP FOR REAL-TIME OBJECT RECOGNITION FOR PEOPLE WITH VISUAL IMPAIRMENTS AND AUTISM SPECTRUM DISORDER (ASD)

Visualizações: 60

Authors

  • Ilma Rodrigues de Souza Fausto Fluminense Federal University https://orcid.org/0000-0003-3850-5066
  • Emanuel Henrique Souza dos Santos Federal Institute of Education, Science, and Technology of Rondônia
  • Felipe de Oliveira Andrade Federal Institute of Education, Science, and Technology of Rondônia https://orcid.org/0000-0002-4677-0938
  • Lucas Rodrigues Simione Federal Institute of Education, Science, and Technology of Rondônia
  • Victor Oliveira de Almeida Federal Institute of Education, Science, and Technology of Rondônia
  • Ruth Maria Mariani Braz Fluminense Federal University https://orcid.org/0000-0003-2224-9643
  • Fabiana Rodrigues Leta Fluminense Federal University https://orcid.org/0000-0002-6210-3078

DOI:

https://doi.org/10.56579/rei.v7i2.1093

Keywords:

Friendly Eye App, Artificial Intelligence, Google Cloud Vision API, Object Recognition, Neurodiversity

Abstract

This article presents the development of the Olho Amigo App, designed to assist individuals with visual impairments and neurodivergent conditions in identifying everyday objects. The core of this work focuses on the integration of Artificial Intelligence (AI) services, highlighting the prominent use of the Google Cloud Vision API to enhance the app's ability to recognise objects through images captured by mobile devices. The integration process involved creating an account on the Google Cloud Platform (GCP), followed by activating the API and generating secure credentials. These credentials were then implemented into the Flutter code of the Olho Amigo App, ensuring efficient and secure communication between the app and the object recognition services provided by the Google Cloud Vision API. Emphasis on security was crucial, highlighting the safeguarding of API keys and the adoption of recommended practices for secure storage. Communication between the app and the API was established via HTTPS. This integration represents a significant advancement in the quest for technological solutions that promote the inclusion and well-being of individuals with visual impairments and neurodivergent conditions. This study underscores the relevance of AI integration in mobile apps aimed at accessibility, opening avenues for future research and initiatives seeking to broaden access to inclusive and accessible technologies. 

Downloads

Download data is not yet available.

Author Biographies

Ilma Rodrigues de Souza Fausto, Fluminense Federal University

PhD candidate in the Graduate Program in Sciences, Technologies, and Inclusion (PGCTIn) – Academic Doctorate. Dame Commander of the “Cross of Merit in Education” and the “Cross of Merit of the Amazon” awarded by the distinguished Council of the Brazilian Chamber of Culture. Member of the TeCEADI+ Research Group. Master's degree in School Education from PPGEEProf - UNIR. Systems Analyst. EBTT Professor under an Exclusive Dedication Regime. Institute of Education, Science, and Technology of Rondônia - IFRO/Campus Ji-Paraná-RO. Researcher at LabDGE - UFF.

Emanuel Henrique Souza dos Santos, Federal Institute of Education, Science, and Technology of Rondônia

Undergraduate student in Analysis and Systems Development at the Institute of Education, Science, and Technology of Rondônia - IFRO/Campus Ji-Paraná.

Felipe de Oliveira Andrade, Federal Institute of Education, Science, and Technology of Rondônia

Undergraduate student in Analysis and Systems Development at the Federal Institute of Education, Science, and Technology of Rondônia - IFRO/Campus Ji-Paraná.

Lucas Rodrigues Simione, Federal Institute of Education, Science, and Technology of Rondônia

Undergraduate student in Analysis and Systems Development at the Federal Institute of Education, Science, and Technology of Rondônia - IFRO/Campus Ji-Paraná.

Victor Oliveira de Almeida, Federal Institute of Education, Science, and Technology of Rondônia

Undergraduate student in Analysis and Systems Development at the Federal Institute of Education, Science, and Technology of Rondônia - IFRO/Campus Ji-Paraná.

Ruth Maria Mariani Braz, Fluminense Federal University

Co-supervisor in the Graduate Program in Sciences, Technologies, and Inclusion (PGCTIn) – Academic Doctorate. Fluminense University - UFF, Brazil.

Fabiana Rodrigues Leta, Fluminense Federal University

Advisor in the Graduate Program in Sciences, Technologies, and Inclusion (PGCTIn) – Academic Doctorate. Fluminense University - UFF, Brazil.

References

BERNARD, M.; LIDA, B.; RILEY, S.; URUCHURTU, E. Effect of text presentation style on reading performance for adults with dyslexia. Journal of Disability Policy Studies, v. 28, n. 2, p. 100-110, 2017.

BRASIL. Lei n. 13.709, de 14 de agosto de 2018. Dispõe sobre a proteção de dados pessoais e altera a Lei n. 12.965, de 23 de abril de 2014 (Marco Civil da Internet). Diário Oficial da União: seção 1, Brasília, DF, 15 ago. 2018. Disponível em: http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2018/lei/L13709.htm. Acesso em: 25 set. 2024.

FAUSTO, I. R. de S.; ZANI, G. S.; RODRIGUES, M.; BRAZ, R. M. M. Assistive Technology: Accessibility in supermarkets for people with visual disabilities. Research, Society and Development, [S. l.], v. 10, n. 9, p. e41210918353, 2021. DOI: 10.33448/rsd-v10i9.18353. Disponível em: https://rsdjournal.org/index.php/rsd/article/view/18353. Acesso em: 21 abr. 2023.

GIL, Antonio Carlos. Como elaborar projetos de pesquisa. 4. ed. São Paulo: Editora Atlas, 2008.

GOOGLE CLOUD. Google Cloud Vision API Documentation. 2022. Disponível em: https://cloud.google.com/vision/docs. Acesso em: 22 ago. 2023.

JOHNSON, M.; THOMPSON, S.; DAVIS, R. Enhancing the Accessibility of Mobile Applications: A User-Centered Approach. International Journal of Human-Computer Interaction, v. 36, n. 15, p. 1424-1441, 2020.

LAUAND, Soraya; FILARDI, Isabela. Brasil tem apenas 1% de sites com acessibilidade. 2022. Disponível em: https://www.cnnbrasil.com.br/nacional/brasil-tem-apenas-1-de-sites-com-acessibilidade/. Acesso em: 27 maio 2022.

LITTLEFIELD, D. SCRUM: A arte de fazer o dobro do trabalho na metade do tempo. Editora LeYa, 2016.

LIN, C.-Y.; CHANG, Y.-M. Interactive augmented reality using scratch 2.0 to improve physical activities for children with developmental disabilities. Research in Developmental Disabilities, Elsevier, v. 37, p. 1–8, 2015.

NIELSEN, J. F-Shaped Pattern of Reading on the Web: Misunderstood, But Still Relevant. Nielsen Norman Group, 2006. Disponível em: https://www.nngroup.com/articles/f-shaped-pattern-reading-web-contents/. Acesso em: 22 nov. 2023.

PRESSMAN, R. S. Engenharia de Software: Uma Abordagem Profissional. 9. ed. Porto Alegre: AMGH, 2014.

SCUADRA. Como funciona a psicologia das cores? 2021. Disponível em: https://www.scuadra.com.br/blog/como-funciona-a-psicologia-das-cores/. Acesso em: 05 maio 2022.

RELLO, L.; BAEZA-YATES, R.; KANVINDE, G. Font legibility and its influence on reading performance of senior citizens. Universal Access in the Information Society, v. 12, n. 2, p. 181-191, 2013.

SOUZA, A. M.; SILVA, L. C.; TORRES, R. S. Desenvolvimento de aplicativos móveis inclusivos para pessoas com deficiência visual: um estudo de caso. Revista Brasileira de Computação Aplicada, v. 11, n. 3, p. 44-55, 2019.

SOUZA, M. P.; SILVA, S. L. Design Inclusivo: Uma Análise Sobre a Acessibilidade Visual em Produtos Multimídia. Revista de Gestão e Projetos, v. 10, n. 3, p. 47-65, 2019.

WARE, C. Information Visualization: Perception for Design. San Francisco, CA: Morgan Kaufmann, 2000.

Downloads

Published

2025-03-18

How to Cite

Fausto, I. R. de S., Santos, E. H. S. dos, Andrade, F. de O., Simione, L. R., Almeida, V. O. de, Braz, R. M. M., & Leta, F. R. (2025). DEVELOPMENT AND APPLICATION OF AN ASSISTIVE APP FOR REAL-TIME OBJECT RECOGNITION FOR PEOPLE WITH VISUAL IMPAIRMENTS AND AUTISM SPECTRUM DISORDER (ASD). Interdisciplinary Studies Journal, 7(2), 01–27. https://doi.org/10.56579/rei.v7i2.1093

Issue

Vol. 7 No. 2 (2025): Journal of Interdisciplinary Studies

Section

ARTICLES

License

Copyright (c) 2025 Interdisciplinary Studies Journal

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The Journal of Interdisciplinary Studies adopts the Creative Commons Attribution 4.0 International License (CC BY 4.0), which allows for sharing and adapting the work, including for commercial purposes, provided proper attribution is given and the original publication in this journal is acknowledged.

Similar Articles

1 2 3 4 5 6 7 8 > >> 

You may also start an advanced similarity search for this article.