I am currently a member of the Crowds + Machines (CroMa) Lab at the University of Michigan, working with Professor Walter S. Lasecki. My research is in human-computer interaction (HCI), with a focus on intelligent communication systems and accessibility. My research projects have dealt with: object segmentation for robotic control, building intelligent communication systems, and providing accessibility for interactions with virtual personal assistants. The projects and publications I have worked on are listed below. More info on CroMa Lab here!
Current ProjectsMy first project presents a solution for real-time transcription of impaired speech, specifically speech produced by people who are deaf or hard of hearing. Since deaf speech is formed without a grounded reference for the intonations and patterns of normal speech, it is often difficult to understand, particularly in the case of ASR systems. To solve this, we introduce a near real-time crowd-powered iterative workflow that effectively transcribes deafspeech.
My second project explores tool-assisted delegation for smarter tasking within everyday forms of online communication mediums, such as email, Slack, and other instant messaging platforms.
Previous PublicationsJ.Y. Song, R. Fok, J. Kim, F. Yang, A.R. Lundgard, W.S. Lasecki. Two Tools are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance. IUI 2018. To appear.
S. Swaminathan, R. Fok, F. Chen, T.K. Huang, I. Lin, R. Jadvani, W.S. Lasecki, J.P. Bigham. WearMail: On-the-Go Access to Information in Your Email with a Privacy-Preserving Human Computation Workflow. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2017). Quebec City, Canada.
S.R. Gouravajhala, J.Y. Song, J. Yim, R. Fok, Y. Huang, F. Yang, K. Wang, Y. An, W.S. Lasecki. Towards Hybrid Intelligence for Robotics. In Collective Intelligence Conference (CI 2017). New York, NY. [POSTER]
J.Y. Song, R. Fok, F. Yang, K. Wang, A.R. Lundgard, W.S. Lasecki. Tool Diversity as a Means of Improving Aggregate Crowd Performance on Image Segmentation Tasks. In HCOMP Workshop on Human Computation for Image and Video Analysis (GroupSight 2017). Quebec City, Quebec. 2017.
J.Y. Song, R. Fok, F. Yang, K. Wang, A.R. Lundgard, W.S. Lasecki: Two Tools Are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance on an Object Segmentation Task. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2017). Quebec City, Canada.