Robot control and online programming by human gestures using a Kinect motion sensor

Slawomir Zolkiewski; Dominik Pioskowik

doi:10.1007/978-3-319-05951-8_56

Robot control and online programming by human gestures using a Kinect motion sensor

Slawomir Zolkiewski
, Dominik Pioskowik

Department of Engineering Processes Automation and Integrated Manufacturing Systems (RMT/RMT2)

Silesian University of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

26 Citations (Scopus)

Abstract

Monitoring and controlling of robots are key competences for robot producers and many research and development projects are carried out to increase robot performance and add new functionality. The paper presents a concept and implementation of online programming, controlling and monitoring an industrial robot using a Kinect sensor as a HMI part. Presented innovative solution is based on human gestures. A communication interface for gestures analysis performed by the robot operator was created using LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through PLC Siemens S7-300 inside a flexible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the ProfibusDP network. The connection between the controller and LabVIEW application has been established using the MPI protocol. A hardware communication protocol used by PLC was converted into the OPC protocol. NUI was used to communicate the Kinect with LabVIEW.

Original language	English
Title of host publication	New Perspectives in Information Systems and Technologies
Publisher	Springer Verlag
Pages	593-604
Number of pages	12
Edition	VOLUME 1
ISBN (Print)	9783319059501
DOIs	https://doi.org/10.1007/978-3-319-05951-8_56
Publication status	Published - 2014
Event	2014 World Conference on Information Systems and Technologies, WorldCIST 2014 - Madeira, Portugal Duration: 15 Apr 2014 → 18 Apr 2014

Publication series

Name	Advances in Intelligent Systems and Computing
Number	VOLUME 1
Volume	275 AISC
ISSN (Print)	2194-5357

Conference

Conference	2014 World Conference on Information Systems and Technologies, WorldCIST 2014
Country/Territory	Portugal
City	Madeira
Period	15/04/14 → 18/04/14

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 9 Industry, Innovation, and Infrastructure

Keywords

Control
HMI (Human-Machine Interface)
Industrial robot
Kinect
LabVIEW
MPI
NUI (Natural User Interface)
OPC
Online programming
PLC (Programmable Logic Controller)
Profibus

ASJC Scopus subject areas

Control and Systems Engineering
General Computer Science

Access to Document

10.1007/978-3-319-05951-8_56

Cite this

@inproceedings{306f0b5836af412683a7c963e305940c,

title = "Robot control and online programming by human gestures using a Kinect motion sensor",

abstract = "Monitoring and controlling of robots are key competences for robot producers and many research and development projects are carried out to increase robot performance and add new functionality. The paper presents a concept and implementation of online programming, controlling and monitoring an industrial robot using a Kinect sensor as a HMI part. Presented innovative solution is based on human gestures. A communication interface for gestures analysis performed by the robot operator was created using LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through PLC Siemens S7-300 inside a flexible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the ProfibusDP network. The connection between the controller and LabVIEW application has been established using the MPI protocol. A hardware communication protocol used by PLC was converted into the OPC protocol. NUI was used to communicate the Kinect with LabVIEW.",

keywords = "Control, HMI (Human-Machine Interface), Industrial robot, Kinect, LabVIEW, MPI, NUI (Natural User Interface), OPC, Online programming, PLC (Programmable Logic Controller), Profibus",

author = "Slawomir Zolkiewski and Dominik Pioskowik",

year = "2014",

doi = "10.1007/978-3-319-05951-8\_56",

language = "English",

isbn = "9783319059501",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer Verlag",

number = "VOLUME 1",

pages = "593--604",

booktitle = "New Perspectives in Information Systems and Technologies",

address = "Germany",

edition = "VOLUME 1",

note = "2014 World Conference on Information Systems and Technologies, WorldCIST 2014 ; Conference date: 15-04-2014 Through 18-04-2014",

}

Zolkiewski, S & Pioskowik, D 2014, Robot control and online programming by human gestures using a Kinect motion sensor. in New Perspectives in Information Systems and Technologies. VOLUME 1 edn, Advances in Intelligent Systems and Computing, no. VOLUME 1, vol. 275 AISC, Springer Verlag, pp. 593-604, 2014 World Conference on Information Systems and Technologies, WorldCIST 2014, Madeira, Portugal, 15/04/14. https://doi.org/10.1007/978-3-319-05951-8_56

Robot control and online programming by human gestures using a Kinect motion sensor. / Zolkiewski, Slawomir; Pioskowik, Dominik.
New Perspectives in Information Systems and Technologies. VOLUME 1. ed. Springer Verlag, 2014. p. 593-604 (Advances in Intelligent Systems and Computing; Vol. 275 AISC, No. VOLUME 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Robot control and online programming by human gestures using a Kinect motion sensor

AU - Zolkiewski, Slawomir

AU - Pioskowik, Dominik

PY - 2014

Y1 - 2014

N2 - Monitoring and controlling of robots are key competences for robot producers and many research and development projects are carried out to increase robot performance and add new functionality. The paper presents a concept and implementation of online programming, controlling and monitoring an industrial robot using a Kinect sensor as a HMI part. Presented innovative solution is based on human gestures. A communication interface for gestures analysis performed by the robot operator was created using LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through PLC Siemens S7-300 inside a flexible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the ProfibusDP network. The connection between the controller and LabVIEW application has been established using the MPI protocol. A hardware communication protocol used by PLC was converted into the OPC protocol. NUI was used to communicate the Kinect with LabVIEW.

AB - Monitoring and controlling of robots are key competences for robot producers and many research and development projects are carried out to increase robot performance and add new functionality. The paper presents a concept and implementation of online programming, controlling and monitoring an industrial robot using a Kinect sensor as a HMI part. Presented innovative solution is based on human gestures. A communication interface for gestures analysis performed by the robot operator was created using LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through PLC Siemens S7-300 inside a flexible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the ProfibusDP network. The connection between the controller and LabVIEW application has been established using the MPI protocol. A hardware communication protocol used by PLC was converted into the OPC protocol. NUI was used to communicate the Kinect with LabVIEW.

KW - Control

KW - HMI (Human-Machine Interface)

KW - Industrial robot

KW - Kinect

KW - LabVIEW

KW - MPI

KW - NUI (Natural User Interface)

KW - OPC

KW - Online programming

KW - PLC (Programmable Logic Controller)

KW - Profibus

UR - https://www.scopus.com/pages/publications/84904599612

U2 - 10.1007/978-3-319-05951-8_56

DO - 10.1007/978-3-319-05951-8_56

M3 - Conference contribution

AN - SCOPUS:84904599612

SN - 9783319059501

T3 - Advances in Intelligent Systems and Computing

SP - 593

EP - 604

BT - New Perspectives in Information Systems and Technologies

PB - Springer Verlag

T2 - 2014 World Conference on Information Systems and Technologies, WorldCIST 2014

Y2 - 15 April 2014 through 18 April 2014

ER -

Robot control and online programming by human gestures using a Kinect motion sensor

Abstract

Publication series

Conference

UN SDGs

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this