Home

Research

Publications

Teaching

Instinctive Computing

Ambient Diagnostics

Rock Art Book

Press

My main research interest is to explore Natural Intelligence about how humans and animals perceive dynamic patterns, and how to implement such intelligence in cyber-physical systems. I have worked on a coherent theory about intelligent algorithms based on my ten-year studies at CMU. In 2016, I published my monograph Instinctive Computing by Springer-London. The book strives to connect artificial intelligence to primitive intelligence. It explores the idea that a genuinely intelligent computer would be able to interact naturally with humans. To form this bridge, computers need the ability to recognize, understand, and even possess instincts similar to humans. The book addresses instinctive computing in modern cybernetics, including models of self-awareness, visual thinking, navigation, autonomy, and survivability, thereby reflecting upon systematic thinking in the design of cyber-physical systems.

Augmented Reality

The NIST PSCR/PSIAP program sponsored my AR the past three years for the project Hyper-Reality Helmet for Mapping and Visualizing Public Safety Data and a new grant for the next three years for AR technology in Extreme Reality (EXR) Telemetry Interface for Real-Time Operation and Training. We have also received funding from DoT UTC and Northrop Grumman, etc. The goal of the project is to explore futuristic wearable AR applications within a smart helmet to assist first responders in emergency environments such as smoke, flood, and fire. In contrast to many prevailing AR technologies, our approach focuses on enhancing reality with spectrum imaging, depth mapping, and sensory fusion. In addition, we extended our AR interfaces to haptics. We have developed the haptic interface for the first responders helmet to navigate through dark and smoke-filled buildings. Our team won the First Place Award from the NIST Haptic Interface Challenge in 2019.