Buenas Prácticas para el Codiseño de Sistemas de Procesamiento Automático de Lenguas de Señas: un Abordaje desde el Diseño Socialmente Consciente

Autores/as

  • Soraia Silva Prietch Sistemas de Informação - Universidade Federal de Rondonópolis (UFR) - Rondonópolis, Mato Grosso https://orcid.org/0000-0002-4552-3142
  • J. Alfredo Sánchez Laboratorio Nacional de Informática Avanzada (LANIA) - Xalapa, Veracruz
  • Josefina Guerrero García Doctorado en Sistemas y Ambientes Educativos (DSAE) - Benemérita Universidad Autónoma de Puebla (BUAP) - Puebla https://orcid.org/0000-0002-3393-610X

DOI:

https://doi.org/10.65234/interaccion.89

Palabras clave:

Procesamiento automático, Lengua de Señas, Codiseño, Buenas Prácticas, Diseño Socialmente Consciente

Resumen

El codiseño de sistemas de procesamiento automático de lengua de señas (PALS) ofrece la oportunidad para crear conciencia mientras se diseña una tecnología que puede ser útil para ambas culturas: Sordas y oyentes. En este artículo, se reporta cómo se generó esta oportunidad al realizar cuatro talleres semio-participativos siguiendo el enfoque de Diseño Socialmente Consciente. El resultado de cada taller alimenta al siguiente, culminando como resultado en recomendaciones de buenas prácticas para el codiseño de sistemas PALS. Las buenas prácticas sociotécnicas se organizaron en los niveles social, pragmático, semántico, sintáctico, empírico y físico, tanto en su aspecto humano como tecnológico. Además de este resultado planificado, nuestro trabajo contribuye al campo de Interacción Humano-Computadora, principalmente en las áreas de accesibilidad, codiseño, e investigación de usuarios, al compartir los pasos seguidos para involucrarnos con una comunidad de lengua de señas en el proceso de codiseño y discutir nuestro trabajo reflexionando sobre cinco llamadas a la acción para la comunidad investigadora que trabaja en el campo de los sistemas PALS.

Referencias

Aran, O., Ari, I., Akarun, L., Sankur, B., Benoit, A., Caplier, A., ... y Carrillo, A. H. (2009). Signtutor: An interactive system for sign language tutoring. IEEE MultiMedia, 16(01), 81-93. DOI: https://doi.org/10.1109/MMUL.2009.17

Baranauskas, M. C. C. (2009). Socially Aware Computing. En: VI International Conference on Engineering and Computer Education (ICECE 2009), 1–5.

Borg, M. y Camilleri, K. P. (2017, agosto). Towards a transcription system of sign language video resources via motion trajectory factorisation. In Proceedings of the 2017 ACM Symposium on Document Engineering (pp. 163-172). DOI: https://doi.org/10.1145/3103010.3103020

Bragg, D., Caselli, N., Hochgesang, J. A., Huenerfauth, M., Katz-Hernandez, L., Koller, O., ... y Ladner, R. E. (2021). The fate landscape of sign language ai datasets: An interdisciplinary perspective. ACM Transactions on Accessible Computing (TACCESS), 14(2), 1-45. DOI: https://doi.org/10.1145/3436996

Bragg, D., Koller, O., Bellard, M., Berke, L., Boudreault, P., Braffort, A., ... y Ringel Morris, M. (2019, octubre). Sign language recognition, generation, and translation: An interdisciplinary perspective. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (pp. 16-31). DOI: https://doi.org/10.1145/3308561.3353774

Connell, B. R., Jones, M., Mace, R., Mueller, J., Mullick, A., Ostroff, E., ... y Vanderheiden, G. (1997). The principles of universal design. Retrieved January, 11, 2005.

Cruz-Aldrete, M. (2019). Niños oyentes de familias sordas:¿ Un bilingüismo silencioso?. Lingüística Mexicana. Nueva Época, 1(3), 41-62. DOI: https://doi.org/10.62190/amla.lmne.2019.1.3.3

da Silva, J. V., Pereira, R., Buchdid, S. B., Duarte, E. F. y Baranauskas, M. C. C. (2016). Sawd-socially aware design: An organizational semiotics-based case tool to support early design activities. In Socially Aware Organisations and Technologies. Impact and Challenges: 17th IFIP WG 8.1 International Conference on Informatics and Semiotics in Organisations, ICISO 2016, Campinas, Brazil, August 1-3, 2016, Proceedings 17 (pp. 59-69). Springer International Publishing. DOI: https://doi.org/10.1007/978-3-319-42102-5_7

Doom, F. (2016). Projeto Giulia: brasileiros criam app que facilita a comunicação entre surdos e ouvintes. Engenharia 360, Tecnologia e inovação. Retrieved March 13, 2023, from http://t.ly/R8Kx.

dos Santos Paim, P., & Prietch, S. S. (2019). Problems and solutions in the design for Deaf Persons who are Sign Language Users to adopt Assistive Technology products. Journal on Interactive Systems, 10(2), 70-81. DOI: https://doi.org/10.5753/jis.2019.554

Gonçalves, F. M., Jensen, F. R., dos Reis, J. C. y Baranauskas, M. C. C. (2018). Enhancing Problem Clarification Artifacts with Online Deliberation. In ICSOFT (pp. 322-329). DOI: https://doi.org/10.5220/0006869103220329

Gugenheimer, J., Plaumann, K., Schaub, F., Di Campli San Vito, P., Duck, S., Rabus, M. y Rukzio, E. (2017, febrero). The impact of assistive technology on communication quality between deaf and hearing individuals. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 669-682). DOI: https://doi.org/10.1145/2998181.2998203

Gürpınar, C., Uluer, P., Akalın, N. y Köse, H. (2020). Sign recognition system for an assistive robot sign tutor for children. International Journal of Social Robotics, 12, 355-369. DOI: https://doi.org/10.1007/s12369-019-00609-9

Hall, E. T. (1990). The silent language. Anchor.

HandTalk. (2012). Retrieved January 6, 2020 from https://www.handtalk.me/br/Aplicativo.

Harris, R., Holmes, H. M. y Mertens, D. M. (2009). Research ethics in sign language communities. Sign Language Studies, 9(2), 104-131. DOI: https://doi.org/10.1353/sls.0.0011

Hayashi, E. C., & Baranauskas, M. C. C. (2010, octubre). Meta-communication in inclusive scenarios: issues and alternatives. In Proceedings of the IX Symposium on Human Factors in Computing Systems (pp. 111-120).

Hou, J., Li, X. Y., Zhu, P., Wang, Z., Wang, Y., Qian, J. y Yang, P. (2019). Signspeaker: A real-time, high-precision smartwatch-based sign language translator. In The 25th Annual International Conference on Mobile Computing and Networking (pp. 1-15). DOI: https://doi.org/10.1145/3300061.3300117

Huenerfauth, M., Marcus, M. y Palmer, M. (2006). Generating American Sign Language classifier predicates for English-to-ASL machine translation (Doctoral dissertation, University of Pennsylvania).

Jemni, M. y Elghoul, O. (2007). An avatar based approach for automatic interpretation of text to Sign language. In Challenges for Assistive Technology (pp. 266-270). IOS Press.

Kolkman, M. (1993). Problem articulation methodology. Ph.D. thesis, University of Twente, Enschede.

Liu, K. (2000). Semiotics in information systems engineering. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511543364

López-Ludeña, V., San Segundo, R., González-Morcillo, C., López, J. C., & Ferreiro, E. (2013). Adapting a speech into sign language translation system to a new domain. In INTERSPEECH (pp. 1164-1168). DOI: https://doi.org/10.21437/Interspeech.2013-316

Martínez Gutiérrez, M. E. (2018). Modelo de redes neuronales para el reconocimiento de señas en un contexto de levantamiento de una denuncia por robo. Tesis de Maestría en Sistemas Interactivos Centrados en el Usuario, Universidad Veracruzana, Xalapa, Veracruz.

Microsoft Research Connections. (2013). Kinect and sign language translation. Retrieved January 6, 2020, from https://www.youtube.com/watch?v=HnkQyUo3134&t=15s.

Miller, A., Malasig, J., Castro, B., Hanson, V. L., Nicolau, H. y Brandão, A. (2017, mayo). The use of smart glasses for lecture comprehension by deaf and hard of hearing students. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (pp. 1909-1915). DOI: https://doi.org/10.1145/3027063.3053117

Paim, P. D. S., & Prietch, S. S. (2019, octubre). Communicability evaluation of video-exam in libras of the ENEM platform. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (pp. 1-11). DOI: https://doi.org/10.1145/3357155.3358478

Paudyal, P., Lee, J., Banerjee, A. y Gupta, S. K. (2017, marzo). Dyfav: Dynamic feature selection and voting for real-time recognition of fingerspelled alphabet using wearables. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (pp. 457-467). DOI: https://doi.org/10.1145/3025171.3025216

Piper, A. M., & Hollan, J. D. (2008, November). Supporting medical conversations between deaf and hearing individuals with tabletop displays. In Proceedings of the 2008 ACM conference on Computer supported cooperative work (pp. 147-156). DOI: https://doi.org/10.1145/1460563.1460587

Prietch, S., Sánchez, J. A., & Guerrero, J. (2022a). A Systematic Review of User Studies as a Basis for the Design of Systems for Automatic Sign Language Processing. ACM Transactions on Accessible Computing, 15(4), 1-33. DOI: https://doi.org/10.1145/3563395

Prietch, S. S., Sánchez, J. A., & García, J. G. (2022b). Understanding cultural aspects of deaf communities in México towards the codesign of automatic sign language processing systems. Journal on Interactive Systems, 13(1), 15-25. DOI: https://doi.org/10.5753/jis.2021.964

Rao, G. A. y Kishore, P. V. V. (2018). Selfie video based continuous Indian sign language recognition system. Ain Shams Engineering Journal, 9(4), 1929-1939. DOI: https://doi.org/10.1016/j.asej.2016.10.013

Rivas, D., Alvarez, M., Tamayo, W., Morales, V., Granizo, R., Vayas, G., ... y Clotet, R. (2017). LeSigLa_EC: learning sign language of Ecuador. In Emerging Technologies for Education: Second International Symposium, SETE 2017, Held in Conjunction with ICWL 2017, Cape Town, South Africa, September 20–22, 2017, Revised Selected Papers 2 (pp. 170-179). Springer International Publishing.

Schefer, R. P., & Zaina, L. A. M. (2016, September). Designing social networking apps on mobile devices: a participatory design experience with deaf students. In Proceedings of the 34th ACM International Conference on the Design of Communication (pp. 1-9). DOI: https://doi.org/10.1145/2987592.2987609

Schuler, D., & Namioka, A. (Eds.). (1993). Participatory design: Principles and practices. CRC Press.

Silva Prietch, S., dos Santos Paim, P., Olmos-Pineda, I., Guerrero García, J., & Gonzalez Calleros, J. M. (2019). The Human and the Context Components in the Design of Automatic Sign Language Recognition Systems. In Human-Computer Interaction: 5th Iberoamerican Workshop, HCI-Collab 2019, Puebla, Mexico, June 19–21, 2019, Revised Selected Papers 5 (pp. 369-380). Springer International Publishing. DOI: https://doi.org/10.1007/978-3-030-37386-3_27

Stamper, R. (1973). Information in business and administrative systems. John Wiley & Sons, Inc..

Vagas-Cerdán, M. D., Rojano-Cáceres, J. R., Ochoa-Rivera, C. A., de los Ángeles Navarro-Guerrero, M., Sánchez-Orea, A., & Saldaña-Vazquez, K. I. (2019). Diseño de la Interfaz para una comunidad virtual orientada a la convivencia de personas sordas y estudiantes universitarios, orientada a fomentar la educación inclusiva: Interface design for a virtual community oriented to the coexistence of deaf people and university students, aimed at promoting inclusive education. Tecnología Educativa Revista CONAIC, 6(1), 62-67. DOI: https://doi.org/10.32671/terc.v6i1.81

Von Agris, U., Zieren, J., Canzler, U., Bauer, B. y Kraiss, K. F. (2008). Recent developments in visual sign language recognition. Universal Access in the Information Society, 6, 323-362. DOI: https://doi.org/10.1007/s10209-007-0104-x

Descargas

Publicado

2023-06-26

Número

Sección

Jornadas de HCI 2022