Conclusion
Intersensing interface or sense is my thesis topic.
I am exploring gestural interaction .
I am proposing a context based gestural language that constitutes a learning system between human and machine to support user intention with customized gesture and also question the boundary between interfaces and human senses.
Because Technology is our new body part. Data is our new perception.
This project starts from asking:
What means an intuitive or a more natural design interface? And when current computer interface design requires the human body to adapt to the machine. But what if the interface becomes a part of the body, using body movement and cognition?
is one of the reason influencing the design of the interface feels more "natural". We are influenced by our previous experiences. The reason we found the swiping gesture more natural may because we used to flip book. The reason we found the clicking gesture more intuitive may because we used to click on and off button on objects. So what if we build our own interface based on our daily habits and routine?
In the the dual learning paradigm
I created, human and machine, which I named as JD25, adapt to each other for developing a customized gestural language, and there is constant evolution of both systems.
What I mean by learning here is haptic learning.
When the computer is able to make decisions based on a set of data released from user movement, when the user’s body is capable of remembering the haptic patterns and the muscle can easily adopt to new tasks, a haptic memory exists in their systems.
In the end, the mutual learning process will create a set of customized gestural language between human and machine based on user’s habits and practice….
See. Sarah Wang's story
JD25 is an intelligent system interacts with users by voice and gesture.
User can create their customized gesture
it supports user original behavior in the right context
it gives old gestures new meanings
it extends user’s intention
In the end user can develop a new body ability by practicing
Conclusion
When the information that we interact with floats in multi-surface spaces, when the content of the information becomes more complex and personal, it is more important to emphasize the user’s “I” in the interaction and recognize our body as the exploring agent. Then, user experience will become more internal and subconscious.
Technology is our new body part. Data is our new perception.
Design Process
To create this system, I explored varieties of gestural interaction from user commanding to machine responsive, and to gestures which extends user’s intensions, or the interaction wherein the machine adapts to the human or human adapts to the machine, the interaction which is innate or acquired.
Also did experiment in workshops with the idea : haptic memory
Experiment1
I made weaved device from our current gestures existing on smartphones, which might be the most common gesture exists in our lives. I want to physicalize this gestural experience, and emphasize the muscle tension, the sore we get. I cast the gesture, and use fabric to weave in-between the negative space to capture the tension we have in the gesture.
Response:
“This device reminds me the gesture I use on phone.”
“ after playing with this device I feel what I feel after using phone for a long time. ”
Experiment2
I made this gloves with a xyz axis accelerometer and three vibrating motors which is positioned on different parts of the glove. These motors will response to user hand movement with by different strength of vibration. I am using this exercise to view a corresponding relationship of human body and machine.
SaveSaveSave