Abstract
PURPOSE: The paper aims to define and describe test methods and metrics to assess industrial robot system agility in both simulation and in reality. DESIGN/METHODOLOGY/APPROACH: The paper describes test methods and associated quantitative and qualitative metrics for assessing robot system efficiency and effectiveness which can then be used for the assessment of system agility. FINDINGS: The paper describes how the test methods were implemented in a simulation environment and real world environment. It also shows how the metrics are measured and assessed as they would be in a future competition. PRACTICAL IMPLICATIONS: The test methods described in this paper will push forward the state of the art in software agility for manufacturing robots, allowing small and medium manufacturers to better utilize robotic systems. ORIGINALITY / VALUE: The paper fulfills the identified need for standard test methods to measure and allow for improvement in software agility for manufacturing robots.