Active Vision Approach for Controlling Educational Robotic Arm with Autonomous Object Manipulation
DOI:
https://doi.org/10.37591/joarb.v1i2.221Abstract
This research presents an autonomous robotic framework for academic, vocational and training purpose. The platform is centred on a six-degree-of-freedom (DOF) serial robotic arm. Two on-board cameras developed a computer vision system for detection and autonomous object/target manipulation placed randomly on a target surface and controlling an educational robotic arm (ERA) to pick it up and move it to a predefined destination. Force sensitive resistor (FSR) has been used as a sensory element for handling soft and sturdy objects. The system applies centre-of-mass based computation, filtering and color segmentation algorithm to locate the target and position of the robotic arm. The proposed platform finds its potential to teach technical courses (like Robotics, Control systems, Electronics, Image-processing and Computer vision) and to implement and validate advanced algorithms for object manipulation and grasping, trajectory generation, path planning, etc. Experimental results demonstrated the effectiveness and robustness of the system.
Keywords: computer vision, robotic arm, autonomous system
References
Cook AM, Bentz B, Harbottle N, et al. School-Based Use of a Robotic Arm System by Children With Disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2005; 13(4): 452–60p.
Manzoor S, Ul Islam R, Khalid A, et al. An open-source multi-DOF articulated robotic educational platform for autonomous object manipulation. Robotics and Computer-Integrated Manufacturing. 2014; 30: 351–62p.
Cabré TP, Cairol MT, Calafell DF, et al. Project-based learning example: Controlling an educational robotic arm with computer vision. IEEE Revista Iberoamericana De Tecnologias Del Aprendizaje. 2013; 8(3): 135–42p.
Shaikh A, Khaladkar G, Jage R, et al. Robotic Arm Movements Wirelessly Synchronized with Human Arm Movements Using Real Time Image Processing. Proceedings of the 2013 Texas Instruments India Educators’ Conference (TIIEC); 2013 Apr 4–6; Bangalore, India.
Dragusu M, Mihalache AN, Solea R. Practical applications for robotic arms using image processing System Theory. Proceedings of the 2012 16th International Conference on Control and Computing (ICSTCC); 2012 Oct 12–14; Sinaia.
Szabo R, Lie I. Automated colored object sorting application for robotic arms. Proceedings of the 10th International Symposium on Electronics and Telecommunications (ISETC); 2012 Nov 15–16; Timisoara.
Christoforou EG, Ozcan A, Tsekos NV. Robotic Arm for Magnetic Resonance Imaging Guided Interventions. Proceedings of the first IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics; 2006 Feb 20–22; Pisa.
Nunnally PC, Weiss JM, Tsay TIJ, et al. An inexpensive robot arm for computer vision applications. Proceedings of the IEEE Energy and Information Technologies in the Southeast Southeastcon '89; 1989 Apr 9–12; Columbia, SC.
Kragic D, Christensen HI. Survey on visual servoing for manipulation. Stockholm, Sweden: Royal Institute of Technology (KTH); 2002.
Emin A, Erdemir G. Development of a web-based control and robotic applications laboratory for control engineering education. Inf Technol Control. 2011; 40(4): 352–57p.
Manseur R. Visualization tools for robotics education. Proceedings of the International Conference on Engineering Education (ICEE); 2004 Oct 16–21; Florida, USA.
Wang FY, Lever PJA, Pu B. A Robotic Vision System for Object Identification and Manipulation Using Synergetic Pattern Recognition. Robotics & Computer-Integrated Manufacturing. 1993; 10(6): 445–59p.
Web of the Robotic Arm Dexter ER-1 [Internet]. Available from: http://www.nexrobotics.com/index.php?page=shop.product_details&flypage=flypage.tpl&product_id=667&category_id=124&option=com_virtuemart&Itemid=45
Solomon C, Breckon T. Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab. New York, NY, USA: Wiley; 2010.
Vadakkepat P, Lim P, De Silva LC, et al. Multimodal approach to human-face detection and tracking. IEEE Trans Ind Electron. 2008; 55(3): 1385–93p.
Davies ED. Machine Vision—Theory, Algorithms, Practicalities, 3rd Ed. Amsterdam, The Netherlands: Elsevier; 2005.
Komuro T, Ishikawa M. A moment-based 3D object tracking algorithm for high-speed vision. Proceedings of the International Conference on Robotics and Automation; 2007 Apr 10–14; Rome, Italy. 58–63p.
Emin A, Erdemir G. Development of a web-based control and robotic applications laboratory for control engineering education. Inf Technol Control. 2011; 40(4): 352–57p.
Downloads
Published
Issue
Section
License
Declaration and Copyright Transfer Form
(to be completed by authors)
I/ We, the undersigned author(s) of the submitted manuscript, hereby declare, that the above manuscript which is submitted for publication in the STM Journals(s), is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere.
- I/We will not withdraw the manuscript after 1 week of submission as I have read the Author Guidelines and will adhere to the guidelines.
- I/We Author(s ) have niether given nor will give this manuscript elsewhere for publishing after submitting in STM Journal(s).
- I/ We have read the original version of the manuscript and am/ are responsible for the thought contents embodied in it. The work dealt in the manuscript is my/ our own, and my/ our individual contribution to this work is significant enough to qualify for authorship.
- I/We also agree to the authorship of the article in the following order:
Author’s name
1. ________________
2. ________________
3. ________________
4. ________________
| We Author(s) tick this box and would request you to consider it as our signature as we agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal. |
