Jim Rehg

Education

• Ph.D., Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 1995
• M.S., Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 1988
• B.S., Electrical Engineering, Virginia Polytechnic Institute, Blacksburg, VA, 1986

Other Professional Employment

• Technical Lead and Research Manager, Codec Avatars group, Meta Reality Labs Research, 2022-present
• Principal Amazon Scholar, Amazon Physical Stores (Amazon Style), 2021-2022
• Principal Amazon Scholar, Amazon Lab126 (Health and Wellness), 2018-2021
• Lead, Computer Vision Group, Cambridge Research Laboratory, Digital Equipment Corporation / Compaq Computer Corporation, Cambridge, MA, 1996-2001
• Member of Technical Staff, Cambridge Research Laboratory, Digital Equipment Corporation / Compaq Computer Corporation, Cambridge, MA, 1995-2001
• Research Intern, NEC Research Institute, Princeton, NJ, Summer 1991

Major Consulting Activities

• Expert witness services (discovery, infringement, and validity; for plaintiff and defense), various clients, occasional
• Principal Amazon Scholar (consulting role on partial leave from Georgia Tech), Amazon, Seattle, WA, 2018-2022

Research Interests

• Computer Vision, Machine Learning, Behavioral Imaging, Autism and Developmental Psychology, Mobile Health, Machine Learning for Healthcare, Medical Imaging, Developmental Machine Learning, and Robotics

Research Topics

• Health Technology

Journal Editorships

• Senior Editor, Computer Vision: A Reference Guide, 2nd Edition, Springer, 2021.
• Editorial Board, International Journal of Computer Vision, January 2004 to August 2016.
• Editor, Computer Vision: A Reference Guide, 1st Edition, Springer, 2014.

Other Scholarly Activities

• Organizing Committee Chair, Dagstuhl Seminar 22422, Developmental Machine Learning: From Human Learning to Machines and Back, Schloss Dagstuhl, Germany, October 2022.
• Co-Organizer, 2nd Intl. Ego4D Workshop, held in conjunction with ECCV 2022, Tel Aviv, Israel, October 2022.
• Co-Organizer and Presenter, Embodied and Robotic Approaches to Studying Infant Development and Learning, pre-conference workshop held in conjunction with International Congress on Infant Studies (ICIS 2022) biennial meeting, Ottawa, Canada, July 7, 2022.
• Co-Organizer, 1st Intl. Ego4D Workshop, held in conjunction with CVPR 2022, New Orleans, LA, June 2022.
• Guest Organizer, 9th Intl. Workshop on Egocentric Perception, Interaction, and Computing (EPIC 2021), held in conjunction with ICCV 2021, Oct 2021 (virtual meeting).

Service on College Committees

• Director, Healthcare Engineering Systems Center, Grainger College of Engineering, UIUC, 2022-present

Service to Federal and State Government

• Panelist and Panel Chair, NSF Expeditions Program Site Visit Review, Nov 18-19, 2021
• Panelist, NSF CISE RI Review Panel P211480, Computer Vision Medium, Mar 4-5, 2021
• Standing Panel Member, NIH/CSR Clinical Informatics and Digital Health (CIDH) Study Section; elected to a four-year term Feb 24, 2021; participates in three review meetings per year
• Panelist, NIH Technology Assisted Clinical Informatics Study Section, ZRG1 HDM-E, Nov 5-6, 2020
• Panelist, NSF Expeditions Program, EIC Prepanel2, Oct 8-9, 2020
• Panelist, NIH Early Screening for Autism Review Panel, ZRG1 BBBP-L, June 13-14, 2019
• Panelist, NSF CISE RI Review Panel P181139, Computer Vision Small, Mar 1-2, 2018
• Phone Reviewer, NIH Diseases and Pathophysiology of the Visual System (DPVS) Study Section, June 19-20, 2017
• Panelist, NIH Biomedical Computing and Health Informatics (BCHI) Study Section, Oct 13-14, 2016
• Panelist, NIH Biomedical Computing and Health Informatics (BCHI) Study Section, June 9-10, 2016
• Panelist, NSF Smart Health and Wellbeing, Exploratory Track (SHB/EXP), July 12-13, 2012

Other Outside Service

• Reviewer for conferences: IEEE International Conference on Computer Vision, IEEE Computer Vision and Pattern Recognition Conference, IEEE International Conference of Face and Gesture Recognition, ACM SIGGRAPH.
• Reviewer for journals: International Journal of Computer Vision, IEEE Transactions on Pattern Analysis and Machine Intelligence, Computer Vision and Image Understanding, IEEE Transactions on Multimedia, Journal of the Optical Society of America, IEEE Transactions on Robotics and Automation.
• Area Chair, IEEE Conference on Computer Vision and Pattern Recognition, New Orleans, LA, June 2022.
• Reviewer, Advances in Neural Information Processing Systems (NeurIPS), December 2020. Ranked in top 10% of reviewers.
• Area Chair, European Conference on Computer Vision, Glasgow, Scotland, August 2020.
• Reviewer, Conference on Machine Learning for Healthcare (ML4HC), Durham, NC, August 2020.
• Area Chair, IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, June 2019.
• Area Chair, IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, June 2015.
• Area Chair, IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, June 2014.
• Associate Editor, IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011.
• Area Chair, Asian Conference on Computer Vision, Xian, China, 2009.
• Area Chair, Asian Conference on Computer Vision, Tokyo, Japan, 2007.
• Program Committee, International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, August 2005.
• Area Chair, IEEE Conference on Computer Vision and Pattern Recognition, Washington, D.C., June 2004.
• Area Chair, IEEE International Conference on Computer Vision, Nice, France, October 2003.
• Program co-Chair, IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Hawaii, July 2017.
• Organizing Committee, Second International Workshop on Video Segmentation, Amsterdam, the Netherlands, October 2016.
• Organizing Committee, EyeWear 2016: First ACM Workshop on EyeWear Computing, Heidelberg, Germany, September 2016.
• Organizing Committee, Dagstuhl Seminar 16042: Eyewear Computing - Augmenting the Human with Head-Mounted Wearable Assistants, Schloss Dagstuhl, Germany, January 2016.
• Organizing Committee, First International Workshop on Video Segmentation, Zurich, Switzerland, September 2014.
• Organizing Committee, First IEEE Workshop on Decoding Subtle Cues from Social Interactions, Sydney, Australia, December 2013.
• Organizing Committee (Chair), First International Symposium on Computational Behavioral Science, Shonan Village Center, Kanazawa, Japan, September 2013.
• Organizing Committee, AAAI 2013 Spring Symposium on Weakly-Supervised Learning from Multimedia, Stanford University, March 2013.
• Program co-Chair, Asian Conference on Computer Vision, Daejeon, Korea, November, 2012.
• Organizing Committee, Second IEEE Workshop on Egocentric Vision, Providence, RI, June 2012.
• Organizing Committee (Chair), First Summer Institute on Computational Behavioral Science, Harris, NY, May 2012.
• Organizing Committee, Sino-USA Summer School in Vision, Learning, and Pattern Recognition, Xi’an, China, July 2010.
• General co-Chair, IEEE Conference on Computer Vision and Pattern Recognition, Miami FL, June 2009.
• Organizing Committee, First IEEE Workshop on Visual Place Categorization (VPC), Miami FL, June 2009.
• Program co-Chair, Intelligent Technologies for Interactive Entertainment Conference (INTETAIN), Playa del Carmen, Mexico, January 2008.
• Short Courses and Tutorials Chair, IEEE International Conference on Computer Vision, Beijing, China, October 2005.
• Workshops Chair, IEEE International Conference on Computer Vision, Nice, France, October 2003.
• Organizing Committee, First IEEE Workshop on Projector-Camera Systems (PROCAMS 2003), Nice, France, October, 2003.
• Organizing Committee, IEEE Workshop on Models versus Exemplars in Computer Vision, Kauai, Hawaii, December 2001.

Research Honors

• Founder Professor (named professorship), Grainger College of Engineering, University of Illinois Urbana-Champaign, 2022
• Co-recipient, with B. Lai, F. Ryan, and M. Liu, Best Student Paper Award, British Machine Vision Conference (BMVC), 2022.
• Finalist, with F. Ryan, W. Jia, M. Liu, and 81 co-authors, Best Paper Award, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2022. 33 finalists were selected out of 8,161 submissions.
• Ph.D. student advisees Fiona Ryan and Maxwell Xu received NSF Graduate Research Fellowships, 2022.
• Abstract co-authored with M. Xu, A. Rozga, N. Brady, J. McDaniel, P. Yoder, and L. Watson was selected for presentation at the Press Release of the 2022 International Society for Autism Research Annual Meeting, May 11, 2022. Seven abstracts were presented to the media, out of more than 2,000 abstract submissions.
• Co-recipient, with M. Liu and Y. Li, 2nd Place Award for Unseen Environments Category, EPIC-Kitchens Action Recognition Challenge, EPIC Workshop, held in conjunction with CVPR, 2020.
• Finalist, with S. Stojanov, S. Mishra, N. A. Thai, N. Dhanda, A. Humayun, C. Yu, and L. B. Smith, Best Paper Award, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2019. 40 finalist papers out of 288 orals selected from 5160 submissions.
• Finalist, with Z. Lv, F. Dellaert, and A. Geiger, Best Paper Award, Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2019. 40 finalist papers out of 288 orals selected from 5160 submissions.
• Co-recipient, with E. Chong, K. Chanda, Z. Ye, A. Southerland, N. Ruiz, R. M. Jones, and A. Rozga, Volume One Distinguished Paper Award, Proc. ACM on Interactive, Mobile, Wearable, and Ubiquitous Technologies (ACM IMWUT), 2018.
• Finalist, with G. Williams, N. Wagener, B. Goldfain, P. Drews, B. Boots, and E. A. Theodorou, Best Overall Paper Prize, IEEE Intl. Conf. on Robotics and Automation (ICRA), 2017.
• Recommender, with E. A. Theodorou, 2017 Qualcomm Innovation Fellowship Winners G. Williams and P. Drews, “Autonomous Racing Using Deep Learning and Game Theoretic Optimization,” 2017.
• Co-recipient, with Z. Ye, Y. Li, Y. Liu, C. Bridges, and A. Rozga, Best Student Paper Award, 11th IEEE Intl. Conf. on Face and Gesture Recognition (FG 2015), 2015.
• Co-recipient, with J. Hernandez, Y. Li, and R. W. Picard, Best Student Paper Award, Intl. Conf. on Wireless Mobile Communication and Healthcare (MobiHealth), 2014.
• Ph.D. advisee Alireza Fathi was co-recipient of the Georgia Tech College of Computing Distinguished Dissertation Award, 2013.
• Co-recipient, with M. M. Crane, J. N. Stirman, C.-Y. Ou, P. T. Kurshan, K. Shen, and H. Lu, Method of the Year Award, Nature Methods, 2012.
• Co-recipient, with G. Hartmann, M. Grundmann, J. Hoffman, D. Tsai, V. Kwatra, O. Madani, S. Vijayanarasimhan, I. Essa, and R. Sukthankar, Best Workshop Paper Award, ECCV Workshop on Web-scale Vision and Social Media, 2012.
• Senior Faculty Distinguished Research Award, Georgia Institute of Technology, 2011.
• Co-recipient, with D. Tsai and M. Flagg, Best Student Paper Prize, British Machine Vision Conference, 2010.
• Ph.D. student advisee Karthik Prabhakar received NSF Graduate Research Fellowship, 2010.
• Finalist, with Y.-Y. Liu, M. Chen, H. Ishikawa, G. Wollstein, and J. Schuman, Best Paper Award, 13th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 10), Beijing, China 2010.
• Finalist for Best Paper Award, with A. Matic, P. Mehta, V. Osmani, and O. Mayora, 4th International ICST Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health 10), Munich, Germany 2010.
• Raytheon Research Fellowship, Georgia Institute of Technology, 2005.
• Co-recipient, with Y. Jing and V. Pavlović, Distinguished Student Paper Award, International Conference on Machine Learning, Bonn, Germany 2005
• Ph.D. student advisee Zhen Hao (Howard) Zhou received NSF Graduate Research Fellowship, 2003.
• CAREER Award, National Science Foundation, 2001.
• Inventor Recognition Award, Digital Equipment Corporation, 1997.
• GSRP Research Fellowship, NASA, 1990-1994.
• General Electric Award, Carnegie Mellon University, 1988-1990.

Recent Courses Taught

• CS 598 CVH - Computer Vision for Health