Open Access Open Access  Restricted Access Subscription or Fee Access

Active Vision Approach for Controlling Educational Robotic Arm with Autonomous Object Manipulation

Neerparaj Rai, Bijay Rai


This research presents an autonomous robotic framework for academic, vocational and training purpose. The platform is centred on a six-degree-of-freedom (DOF) serial robotic arm. Two on-board cameras developed a computer vision system for detection and autonomous object/target manipulation placed randomly on a target surface and controlling an educational robotic arm (ERA) to pick it up and move it to a predefined destination. Force sensitive resistor (FSR) has been used as a sensory element for handling soft and sturdy objects. The system applies centre-of-mass based computation, filtering and color segmentation algorithm to locate the target and position of the robotic arm. The proposed platform finds its potential to teach technical courses (like Robotics, Control systems, Electronics, Image-processing and Computer vision) and to implement and validate advanced algorithms for object manipulation and grasping, trajectory generation, path planning, etc. Experimental results demonstrated the effectiveness and robustness of the system.

Keywords: computer vision, robotic arm, autonomous system


Full Text:



Cook AM, Bentz B, Harbottle N, et al. School-Based Use of a Robotic Arm System by Children With Disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2005; 13(4): 452–60p.

Manzoor S, Ul Islam R, Khalid A, et al. An open-source multi-DOF articulated robotic educational platform for autonomous object manipulation. Robotics and Computer-Integrated Manufacturing. 2014; 30: 351–62p.

Cabré TP, Cairol MT, Calafell DF, et al. Project-based learning example: Controlling an educational robotic arm with computer vision. IEEE Revista Iberoamericana De Tecnologias Del Aprendizaje. 2013; 8(3): 135–42p.

Shaikh A, Khaladkar G, Jage R, et al. Robotic Arm Movements Wirelessly Synchronized with Human Arm Movements Using Real Time Image Processing. Proceedings of the 2013 Texas Instruments India Educators’ Conference (TIIEC); 2013 Apr 4–6; Bangalore, India.

Dragusu M, Mihalache AN, Solea R. Practical applications for robotic arms using image processing System Theory. Proceedings of the 2012 16th International Conference on Control and Computing (ICSTCC); 2012 Oct 12–14; Sinaia.

Szabo R, Lie I. Automated colored object sorting application for robotic arms. Proceedings of the 10th International Symposium on Electronics and Telecommunications (ISETC); 2012 Nov 15–16; Timisoara.

Christoforou EG, Ozcan A, Tsekos NV. Robotic Arm for Magnetic Resonance Imaging Guided Interventions. Proceedings of the first IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics; 2006 Feb 20–22; Pisa.

Nunnally PC, Weiss JM, Tsay TIJ, et al. An inexpensive robot arm for computer vision applications. Proceedings of the IEEE Energy and Information Technologies in the Southeast Southeastcon '89; 1989 Apr 9–12; Columbia, SC.

Kragic D, Christensen HI. Survey on visual servoing for manipulation. Stockholm, Sweden: Royal Institute of Technology (KTH); 2002.

Emin A, Erdemir G. Development of a web-based control and robotic applications laboratory for control engineering education. Inf Technol Control. 2011; 40(4): 352–57p.

Manseur R. Visualization tools for robotics education. Proceedings of the International Conference on Engineering Education (ICEE); 2004 Oct 16–21; Florida, USA.

Wang FY, Lever PJA, Pu B. A Robotic Vision System for Object Identification and Manipulation Using Synergetic Pattern Recognition. Robotics & Computer-Integrated Manufacturing. 1993; 10(6): 445–59p.

Web of the Robotic Arm Dexter ER-1 [Internet]. Available from:

Solomon C, Breckon T. Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab. New York, NY, USA: Wiley; 2010.

Vadakkepat P, Lim P, De Silva LC, et al. Multimodal approach to human-face detection and tracking. IEEE Trans Ind Electron. 2008; 55(3): 1385–93p.

Davies ED. Machine Vision—Theory, Algorithms, Practicalities, 3rd Ed. Amsterdam, The Netherlands: Elsevier; 2005.

Komuro T, Ishikawa M. A moment-based 3D object tracking algorithm for high-speed vision. Proceedings of the International Conference on Robotics and Automation; 2007 Apr 10–14; Rome, Italy. 58–63p.

Emin A, Erdemir G. Development of a web-based control and robotic applications laboratory for control engineering education. Inf Technol Control. 2011; 40(4): 352–57p.


  • There are currently no refbacks.