Direct Multi-Target Teaching Interface for Autonomous Handling of Multi-Stack Logistics in a Warehouse
Abstract
:1. Introduction
2. The Direct Multi-Target Teaching Method
2.1. Framework
2.2. Data Integration
2.3. HMI and Direct Multi-Target Teaching Operation Design
2.4. Task-Planning
3. Experiment and Results
3.1. Object Box Recognition and Task-Planning
3.2. Interface Usability Evaluation
4. Conclusions
- 1
- Box recognition in the warehouse: Only the box can be accurately recognized within the complex logistics warehouse by combining the box’s attached tag information with the segmentation result.
- 2
- Shortest path for target product pick–place: By creating nodes from the recognized boxes and connecting each node with edges based on the positional relationships of the boxes, it is possible to generate the shortest path and perform autonomous target product pick–place operations regardless of the number of target products.
- 3
- Direct teaching interface usability evaluation: The interface used to perform the above tasks remotely received an average SUS score of 77.5, indicating a high level of usability.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Winkelhaus, S.; Grosse, E.H.; Morana, S. Towards a conceptualization of Order Picking 4.0. Comput. Ind. Eng. 2021, 159, 107511. [Google Scholar] [CrossRef]
- Winkelhaus, S.; Grosse, E.H. Logistics 4.0: A systematic review towards a new logistics system. Int. J. Prod. Res. 2020, 58, 18–43. [Google Scholar] [CrossRef]
- De Koster, R.; Le-Duc, T.; Jan Roodbergen, K. Design and control of warehouse order picking: A literature review. Eur. J. Oper. Res. 2007, 182, 481–501. [Google Scholar] [CrossRef]
- Mecalux International. Available online: https://www.mecalux.com/warehouse-racking-and-shelving/pallet-racking (accessed on 1 July 2024).
- Advanced Warehouse Structures. Available online: https://www.awstructures.com.au/pallet-racking/selective/ (accessed on 1 July 2024).
- Advanced Warehouse Structures. Available online: https://www.awstructures.com.au/wp-content/uploads/2018/03/Steel-shelving-storage-for-small-items-in-warehouse.jpg (accessed on 1 July 2024).
- Lin, R.; Huang, H.; Li, M. An automated guided logistics robot for pallet transportation. Assem. Autom. 2021, 41, 45–54. [Google Scholar] [CrossRef]
- Iinuma, R.; Hori, Y.; Onoyama, H.; Kubo, Y.; Fukao, T. Robotic forklift for stacking multiple pallets with RGB-D cameras. J. Robot. Mechatron. 2021, 33, 1265–1273. [Google Scholar] [CrossRef]
- Beckschäfer, M.; Malberg, S.; Tierney, K. Simulating storage policies for an automated grid-based warehouse system. In Computational Logistics: 8th International Conference, ICCL 2017; Southampton, UK, 18–20 October 2017, Proceedings 8; Springer International Publishing: Heidelberg, Germany, 2017. [Google Scholar]
- Iriondo, A.; Lazkano, E.; Susperregi, L.; Urain, J.; Fernandez, A.; Molina, J. Pick and place operations in logistics using a mobile manipulator controlled with deep reinforcement learning. Appl. Sci. 2019, 9, 348. [Google Scholar] [CrossRef]
- Ghodsian, N.; Benfriha, K.; Olabi, A.; Gopinath, V.; Arnou, A.; el Zant, C.; Charrier, Q.; El Helou, M. Toward designing an integration architecture for a mobile manipulator in production systems: Industry 4.0. Procedia CIRP 2022, 109, 443–448. [Google Scholar] [CrossRef]
- Mao, J.; Xing, H.; Zhang, X. Design of intelligent warehouse management system. Wirel. Pers. Commun. 2018, 102, 1355–1367. [Google Scholar] [CrossRef]
- Lee, C.K.M.; Lv, Y.; Ng, K.; Ho, W.; Choy, K. Design and application of Internet of things-based warehouse management system for smart logistics. Int. J. Prod. Res. 2018, 56, 2753–2768. [Google Scholar] [CrossRef]
- Zhang, Y.; Feng, P. Design and implementation of a new intelligent warehouse management system based on MySQL database technology. Informatica 2022, 46, 3. [Google Scholar]
- Speicher, M.; Cucerca, S.; Krüger, A. VRShop: A mobile interactive virtual reality shopping environment combining the benefits of on-and offline shopping. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2017, 1, 1–31. [Google Scholar] [CrossRef]
- Liang, Y.S.; Pellier, D.; Fiorino, H.; Pesty, S.; Cakmak, M. Simultaneous end-user programming of goals and actions for robotic shelf organization. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; IEEE: Piscataway, NJ, USA, 2018. [Google Scholar]
- Bormann, R.; de Brito, B.F.; Lindermayr, J.; Omainska, M. Towards automated order picking robots for warehouses and retail. In Proceedings of the Computer Vision Systems: 12th International Conference, ICVS 2019, Thessaloniki, Greece, 23–25 September 2019; Proceedings 12. Springer International Publishing: Heidelberg, Germany, 2019. [Google Scholar]
- Zhao, X.; Ding, W.; An, Y.; Du, Y.; Yu, T.; Li, M.; Tang, M.; Wang, J. Fast segment anything. arXiv 2023, arXiv:2306.12156. [Google Scholar]
- Lewis, J.R.; Sauro, J. The factor structure of the system usability scale. In Proceedings of the Human-Centered Design: First International Conference, HCD 2009, Held as Part of HCI International 2009, San Diego, CA, USA, 19–24 July 2009; Proceedings 1. Springer: Berlin/Heidelberg, Germany, 2009. [Google Scholar]
User | System Usability Scale Score |
---|---|
U01 | 65 |
U02 | 80 |
U03 | 80 |
U04 | 85 |
U05 | 75 |
U06 | 80 |
Average | 77.5 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Choi, H.; Jeong, J.; Park, T.; Lee, D. Direct Multi-Target Teaching Interface for Autonomous Handling of Multi-Stack Logistics in a Warehouse. Sensors 2024, 24, 5470. https://doi.org/10.3390/s24175470
Choi H, Jeong J, Park T, Lee D. Direct Multi-Target Teaching Interface for Autonomous Handling of Multi-Stack Logistics in a Warehouse. Sensors. 2024; 24(17):5470. https://doi.org/10.3390/s24175470
Chicago/Turabian StyleChoi, Haegyeom, Jaehyun Jeong, Taezoon Park, and Donghun Lee. 2024. "Direct Multi-Target Teaching Interface for Autonomous Handling of Multi-Stack Logistics in a Warehouse" Sensors 24, no. 17: 5470. https://doi.org/10.3390/s24175470