Research Article Open Access

Robot Control Using Natural Instructions Via Visual and Tactile Sensations

Takuya Ikai1, Shota Kamiya1 and Masahiro Ohka1
  • 1 Nagoya University, Japan
Journal of Computer Science
Volume 12 No. 5, 2016, 246-254


Submitted On: 30 August 2014 Published On: 27 May 2016

How to Cite: Ikai, T., Kamiya, S. & Ohka, M. (2016). Robot Control Using Natural Instructions Via Visual and Tactile Sensations. Journal of Computer Science, 12(5), 246-254.


Stress-free interaction between humans and robots is necessary to support humans in daily life. In order to achieve this, we anticipate the development of new robots equipped with tactile and vision sensors for receiving human instructions. In this article, we focus on spontaneous movements that do not require training, such as pointing and force adjustment and that are suitable for daily care. These movements, which we call natural instructions, involve the transmission of human instructions to robots. In this experiment, we examine a robot equipped with vision and tactile sensors capable of receiving natural instructions. Our new robot accomplishes a retrieving and passing task using the natural instructions of finger pointing and tapping with the palm.

  • 6 Citations



  • Machine Vision
  • Tactile Sensation
  • Natural
  • Instruction
  • Robot