Temperature Sensory Feedback in Upper-limb Amputees

Performance site: Campus Biotech, Geneva

Background

Recent developments in prosthetics for amputee patients, integrating both the decoding of voluntary motor function and tactile feedback via implanted electrodes, hold the promise of more natural interaction of the patient with the prosthetic limb. Studies have shown that it is possible to encode rich tactile feedback for the patient to perceive the level of stiffness of the objects (Raspopovic 2014), the texture coarseness (Oddo 2016), or position of the fingers of the prosthesis (D’Anna 2019).

Overall the integration of these novel sensory afferences has increased patients’ level of dexterity and embodiment (Valle 2018). However, we are still far from a complete reproduction of the rich haptic perception of an intact hand. In this study, we aim at reducing the gap by introducing temperature feedback for upper-limb amputee patients via a high-performance temperature display.

Beyond the obvious advantage of informing patients if an object is cold, warm or dangerously hot, enhancing existing prosthetics with temperature feedback has the potential to increase the embodiment of the prosthetic, the ability of the patient to discriminate different materials and textures, and create the basis for an affective touch.

Project description:

Haptic perception results from the multimodal integration of tactile, proprioceptive, and temperature modalities (Ernst and Bülthoff, 2004). Each of these modalities has its receptors (encapsulated or with free endings) with specific receptor fields and fibers. Temperature sensation is mediated via free nerve ending receptors in the epidermis. The sensation of cold is mediated by Aδ fibers when warmth is through slow-speed unmyelinated C-fibers.

Studies have shown that changes in temperature feedback influence tactile perception (Gallo, 2015). Here, we investigate thermo-tactile integration using a sensory substitution display.

Activities:

  • Familiarization with the existing temperature display
  • Design a setup with multiple temperatures and vibrator displays covering the fingertips, and the upper arm.
  • Psychometrical tests and characterization:
    • Measure just noticeable difference for temperature feedback on different body parts
    • Study termotactile integration and perception.

Requirements:

Project is 40% hardware, 20% software, 40% experimentation.

Knowledge in programming with Matlab and data analysis.

Best for master projects

Contact: [email protected]

References

Ernst, Marc O., and Heinrich H. Bülthoff. “Merging the senses into a robust percept.” Trends in cognitive sciences 8.4 (2004): 162-169.

Gallo, Simon, et al. “Encoded and crossmodal thermal stimulation through a fingertip-sized haptic display.” Frontiers in Robotics and AI 2 (2015): 25.

Project description:

Existing tactile applications for assistive robotic devices (as prostheses, orthoses, exoskeletons) have underestimated the social aspects of touch and mainly focused on sensation linked to an action.

Here we aim at studying the tactile basis for affective and social touch. Our final goal is to enhance the experience of an amputee patient using a neuroprosthetic device with a temperature display. The introduction of these aspects is essential to induce embodiment and maintain body representation in assistive devices.

Activities:

  • Familiarization with the existing temperature display
  • Understand the neural basis of affective and social touch.
  • Propose and test the encoding for
    • Passive touch (affective, social, self-touch)
    • Wet/dry sensation 

Requirements:

Project is 50% software, 50% experimentation.

Knowledge in programming with Matlab and data analysis.

Best for master projects

Contact: [email protected]

References

Ernst, Marc O., and Heinrich H. Bülthoff. “Merging the senses into a robust percept.” Trends in cognitive sciences 8.4 (2004): 162-169.

Gallo, Simon, et al. “Encoded and crossmodal thermal stimulation through a fingertip-sized haptic display.” Frontiers in Robotics and AI 2 (2015): 25.

Contact

If none of the projects suit you but you are interested in sensory feedback and upper limb prosthesis control in general, please feel free to contact us to discuss potential opportunities.

Solaiman Shokur ([email protected])

Jonathan Muheim ([email protected])

Access map