Análisis de una experiencia multimodal de realidad mixta para la programación de un cobot a través de su gemelo digital
DOI:
https://doi.org/10.65234/interaccion.40Palabras clave:
Interaccion Persona-Robot, Cobot, Realidad Aumentada, Háptica en el aire, Holograma, MultimodalResumen
La programación de un robot mediante el guiado manual requiere que dicho robot se encuentre disponible. Como consecuencia, la productividad de ese robot se reduce debido al tiempo que se encuentra parado mientras se está reprogramando. La posibilidad de reprogramar estos robots para nuevas tareas mediante la interacción con sus gemelos digitales permite paralelizar esta tarea sin interferir en su rendimiento y permite que un operario sin conocimientos técnicos pueda reprogramarlo. En este artículo se propone un sistema que permite realizar la tarea de guiado manual a través de una interfaz visual de realidad mixta. Debido a que los hologramas carecen de tangibilidad, se utiliza un dispositivo basado en ultrasonidos que ofrece una experiencia táctil. También se presentan los resultados de un estudio realizado, donde analizamos la factibilidad y la experiencia de usuario.
Referencias
10 Things To Know About The Single Ease Question (SEQ). (2021, October 14). Retrieved from https://measuringu.com/seq10/
Aggarwal, R., Ward, J., Balasundaram, I., Sains, P., Athanasiou, T., & Darzi, A. (2007). Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann. Surg., 246, 771-779. DOI: https://doi.org/10.1097/SLA.0b013e3180f61b09
Andersson, N., Argyrou, A., Nägele, F., Ubis, F., Campos, U., de Zarate, M., & Wilterdink, R. (2016). AR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools. Procedia CIRP, 193-198. DOI: https://doi.org/10.1016/j.procir.2016.03.022
Bambusek, D., Materna, Z., Kapinus, M., Beran, V., & Smrž, P. (2019). Combining Interactive Spatial Augmented Reality with Head-Mounted Display for End-User Collaborative Robot Programming. 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 1-8. DOI: https://doi.org/10.1109/RO-MAN46459.2019.8956315
Brooks, F. (1988). Grasping reality through illusion - interactive graphics serving science. In CHI ’88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1-11. DOI: https://doi.org/10.1145/57167.57168
Burghardt, A., Szybicki, D., Gierlak, P., Kurc, K., Pietru´s, P., & Cygan, R. (2020). Programming of Industrial Robots Using Virtual Reality and Digital Twins. Appl. Sci., 10, 486. DOI: https://doi.org/10.3390/app10020486
Carter, T., Seah, S., Long, B., Drinkwater, B., & Subramanian, S. (2013). UltraHaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 505-514. DOI: https://doi.org/10.1145/2501988.2502018
Chan, W., Sakr, M., Quintero, C., Croft, E., & Van der Loos, H. (2020). Towards a Multimodal System combining Augmented Reality and Electromyography for Robot Trajectory Programming and Execution. 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 419-424. DOI: https://doi.org/10.1109/RO-MAN47096.2020.9223526
Gallagher, A., Ritter, E., Champion, H., Higgins, G., Fried, M., Moses, G., . . . Satava, R. (2005). Virtual reality simulation for the operating room: Proficiency-based training as a paradigm shift in surgical. Ann. Surg., 241, 364. DOI: https://doi.org/10.1097/01.sla.0000151982.85062.80
Grantcharov, T., Kristiansen, V., Bendix, J., Bardram, L., Rosenberg, J., & Funch-Jensen, P. (2004). Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br. J. Surg., 91, 146-150. DOI: https://doi.org/10.1002/bjs.4407
Hart, S. (2006). NASA-task load index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 904-908. DOI: https://doi.org/10.1177/154193120605000909
Heilig, M. (1962). EE.UU Patente nº 3.050.870.
Hietanen, A., Pieters, R., Lanz, M., Latokartano, J., & Kämäräinen, J. (2020). AR-based interaction for human-robot collaborative manufacturing. Robot. Comput. Integr. Manuf., 63,101891. DOI: https://doi.org/10.1016/j.rcim.2019.101891
Ikits, M., & Brederson, J. (2005). The Visual HapticWorkbench. Visualization Handbook, 431-447. DOI: https://doi.org/10.1016/B978-012387582-2/50024-1
Luckey, P. (14 de August de 2021). Oculus Rift. Obtenido de Wikipedia: https://en.wikipedia.org/wiki/Oculus_Rift
Luebbers, M., Brooks, C., Kim, M., Szafir, D., & Hayes, B. (2019). Augmented Reality Interface for Constrained Learning from Demonstration. In Proceedings of the 2nd InternationalWorkshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI).
Makhataeva, Z., & Varol, H. (2020). Augmented Reality for Robotics: A Review. Robotics, 9, 21. DOI: https://doi.org/10.3390/robotics9020021
Makris, S., Karagiannis, P., Koukas, S., & Matthaiakis, A. (2016). Augmented reality system for operator support in human-robot collaborative assembly. CIRP Ann., 65, 61-64. DOI: https://doi.org/10.1016/j.cirp.2016.04.038
Ni, D., Yew, A., Ong, S., & Nee, A. (2017). Haptic and visual augmented reality interface for programming welding robots. Adv. Manuf., 5. DOI: https://doi.org/10.1007/s40436-017-0184-7
Ong, S., Yew, A., Thanigaivel, N., & Nee, A. (2020). Augmented reality-assisted robot programming system for industrial applications. Robot. Comput. Integr. Manuf., 61,101820. DOI: https://doi.org/10.1016/j.rcim.2019.101820
Ostanin, M., & Klimchik, A. (2019). Interactive Robot Programing Using Mixed Reality. IFAC-PapersOnLine, 51, 50-55. DOI: https://doi.org/10.1016/j.ifacol.2018.11.517
Pettersen, T., Pretlove, J., Skourup, C., Engedal, T., & Lokstad, T. (2003). Augmented reality for programming industrial robots. In Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 319-320. DOI: https://doi.org/10.1109/ISMAR.2003.1240739
Puljiz, D., Stöhr, E., Riesterer, K., Hein, B., & Kröger, T. (2019). Sensorless Hand Guidance using Microsoft Hololens. In Proceedings of the 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 632-633. DOI: https://doi.org/10.1109/HRI.2019.8673145
R Core Team. (2018). R: A Language and Environment for Statistical Computing. Vienna, Austria.
Rivera-Pinto, A., & Kildal, J. (2019). Visuo-Tactile Mixed Reality for Offline Cobot Programming. Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (pp. 403-405). Cambridge: ACM. DOI: https://doi.org/10.1145/3371382.3378290
Rosen, E., Whitney, D., Phillips, E., Chien, G., Tompkin, J., Konidaris, G., & Tellex, S. (2019). Communicating and controlling robot arm motion intent through mixed-reality head-mounted displays. Int. J. Robot. Res., 1513-1526. DOI: https://doi.org/10.1177/0278364919842925
Rosen, E., Whitney, D., Phillips, E., Chien, G., Tompkin, J., Konidaris, G., & Tellex, S. (2020). Communicating robot arm motion intent through mixed reality head-mounted displays. Robotics Research, 301-316. DOI: https://doi.org/10.1007/978-3-030-28619-4_26
Rückert, P., Meiners, F., & Tracht, K. (2018). Augmented Reality for teaching collaborative robots based on a physical simulation. In Tagungsband des 3. Kongresses Montage Handhabung Industrieroboter, 41-48. DOI: https://doi.org/10.1007/978-3-662-56714-2_5
Seymour, N., Gallagher, A., Sanziana, R., O’Brien, M., Vipin, B., & Andersen, D. (2002). Virtual Reality Training Improves Operating Room Performance. Ann. Surg., 236, 458-463. DOI: https://doi.org/10.1097/00000658-200210000-00008
Sodhi, R., Poupyrev, I., Glisson, M., & Israr, A. (2013). AIREAL: Interactive tactile experiences in free air. ACM Trans. Graphics, 32, 134. DOI: https://doi.org/10.1145/2461912.2462007
Student. (1908). The probable error of a mean. Biometrika, 6, 1-25. DOI: https://doi.org/10.2307/2331554
Wilcoxon, F. (1992). Individual comparisons by ranking methods. Breakthroughs in Statistics, 196-202. DOI: https://doi.org/10.1007/978-1-4612-4380-9_16
Xue, C., Qiao, Y., & Murray, N. (2020). Enabling Human-Robot-Interaction for Remote Robotic Operation via Augmented Reality. IEEE 21st International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM), 194-196. DOI: https://doi.org/10.1109/WoWMoM49955.2020.00046
Zhou, Z., Xiong, R., Wang, Y., & Zhang, J. (2020). Advanced Robot Programming: A Review. Curr. Robot. Rep. DOI: https://doi.org/10.1007/s43154-020-00023-4
Descargas
Publicado
Número
Sección
Licencia
Derechos de autor 2026 Andoni Rivera Pinto, Johan Kildal Okiñena, Elena Lazkano Ortega
Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial 4.0.
