Leakage-Aware Robotic Grasping: Experiment-Level Explainable Robustness Prediction and Retrospective Effort-Aware Assessment
DOI:
https://doi.org/10.67887/PD2601202007Keywords:
Robotic grasping, grasp robustness, proprioception, group-aware validation, experiment-level evaluation, explainable AI, XGBoost, ensemble learning, retrospective effort-aware assessmentAbstract
Introduction: Robotic grasping produces repeated proprioceptive measurements whose experimental hierarchy can make flat-table evaluation overly optimistic.
Methodology: The paper analyses the Shadow Robot Smart Grasping Sandbox benchmark, comprising 992,641 measurement rows nested within 53,937 simulated grasp experiments with one released robustness target per experiment. The novelty is methodological rather than architectural: compared with prior work on this benchmark centred on grasp classification, failure prediction, or local explainability, we formulate experiment-level robustness regression and combine experiment-disjoint splitting, inverse experiment-size weighting, fold-local preprocessing, identifier-free attribution, robustness diagnostics, and effort-aware assessment in one reproducible pipeline.
Results: On 10,788 unseen holdout experiments, R² was 0.5386 for Linear Regression, 0.6539 for MLP, 0.7104 for XGBoost, and 0.7132 for the stacked ensemble; XGBoost achieved MAE = 9.52, median absolute error = 5.11, and Spearman ρ = 0.915. Five-fold target-decile-stratified validation gave pooled out-of-fold R² = 0.8687, while a single out-of-range holdout target accounted for most squared error.
Conclusion: Paired bootstrapping indicated no material practical advantage from stacking. The results are limited to completed simulated episodes, with physical transfer and prospective online operation left for future validation.
References
D. P. Murphy, "Robotics in Physical Medicine and Rehabilitation," 1st ed., Elsevier, 2023,
https://doi.org/10.1016/C2021-0-00176-0
A. Sarker, T. Ul Islam, and M. R. Islam, "A review on recent trends of bioinspired soft robotics: Actuators, control methods, materials selection, sensors, challenges, and future prospects," Adv. Intell. Syst., vol. 7, no. 3, Art. no. 2400414, 2025, https://doi.org/10.1002/aisy.202400414
H. Zhang, J. Tang, S. Sun, and X. Lan, "Robotic grasping from classical to modern: A survey," arXiv preprint arXiv:2202.03631, 2022, https://doi.org/10.48550/arXiv.2202.03631
N. Dheerthi, A. K. Kumar, S. Sarveswaran, and A. Murugarajan, "A comprehensive analysis of bio-inspired soft robotic arm for healthcare applications," in Multidisciplinary Applications of AI Robotics and Autonomous Systems, IGI Global Scientific Publishing, pp. 1–23, 2024, https://doi.org/10.4018/979-8-3693-5767-5.ch001
W. Dou, G. Zhong, J. Cao, Z. Shi, B. Peng, and L. Jiang, "Soft robotic manipulators: Designs, actuation, stiffness tuning, and sensing," Adv. Mater. Technol., vol. 6, no. 9, Art. no. 2100018, 2021, https://doi.org/10.1002/admt.202100018
O. Vermesan, A. Bröring, E. Z. Tragos, M. Serrano, D. Bacciu, S. Chessa, C. Gallicchio, A. Micheli, M. Dragone, A. Saffiotti, P. Simoens, F. Cavallo, and R. Bahr, "Internet of robotic things—Converging sensing/actuating, hyperconnectivity, artificial intelligence and IoT platforms," in Cognitive Hyperconnected Digital Transformation: Internet of Things Intelligence Evolution, O. Vermesan and J. Bacquet, Eds. River Publishers, pp. 97–155, 2017, https://doi.org/10.13052/rp-9788793609105
Y. Jiang, S. Moseson, and A. Saxena, "Efficient grasping from RGB-D images: Learning using a new rectangle representation," in 2011 IEEE International Conference on Robotics and Automation (ICRA), IEEE, pp. 3304–3311, 2011, https://doi.org/10.1109/ICRA.2011.5980145
K. Damak, M. Boujelbene, C. Acun, A. Alvanpour, S. K. Das, D. O. Popa, and O. Nasraoui, "Robot failure mode prediction with deep learning sequence models," Neural Comput. Appl., vol. 37, pp. 4291–4302, 2025,
https://doi.org/10.1007/s00521-024-10856-1
S. Sabeeh, "Enhancing robotic grasping performance through data-driven analysis," Misan J. Eng. Sci., vol. 3, no. 1, pp. 134–156, 2024, https://doi.org/10.61263/mjes.v3i1.78
R. L. Truby, "Designing soft robots as robotic materials," Acc. Mater. Res., vol. 2, no. 10, pp. 854–857, 2021, https://doi.org/10.1021/accountsmr.1c00071
Y. Wang, Y. Wang, R. T. Mushtaq, and Q. Wei, "Advancements in soft robotics: A comprehensive review on actuation methods, materials, and applications," Polymers, vol. 16, no. 8, p. 1087, 2024, https://doi.org/10.3390/polym16081087
C. Laschi, "Soft robotics," in Robotics Goes MOOC: Design, B. Siciliano, Ed. Cham, Switzerland: Springer Nature Switzerland, pp. 245–271, 2025, https://doi.org/10.1007/978-3-319-75823-7_5
J. Su, K. He, Y. Li, J. Tu, and X. Chen, "Soft materials and devices enabling sensorimotor functions in soft robots," Chem. Rev., vol. 125, no. 12, pp. 5848–5977, 2025, https://doi.org/10.1021/acs.chemrev.4c00906
J. Muru and A. Rassõlkin, "A scoping review of energy consumption in industrial robotics," Machines, vol. 13, no. 7, Art. no. 542, 2025, https://doi.org/10.3390/machines13070542
X. Wang, R. Wei, Z. Chen, H. Pang, H. Li, Y. Yang, Q. Hua, and G. Shen, "Bioinspired intelligent soft robotics: From multidisciplinary integration to next-generation intelligence," Adv. Sci., vol. 12, no. 32, Art. no. e06296, 2025,
https://doi.org/10.1002/advs.202506296
Q. M. Marwan, S. C. Chua, and L. C. Kwek, "Comprehensive review on reaching and grasping of objects in robotics," Robotica, vol. 39, no. 10, pp. 1849–1882, 2021, https://doi.org/10.1017/S0263574721000023
S. Duenser, B. Thomaszewski, R. Poranne, and S. Coros, "Nonlinear compliant modes for large-deformation analysis of flexible structures," ACM Trans. Graph., vol. 42, no. 2, Art. no. 21, pp. 1–11, 2022,
https://doi.org/10.1145/3568952
Y. Kondratenko, I. Atamanyuk, I. Sidenko, G. Kondratenko, and S. Sichevskyi, "Machine learning techniques for increasing efficiency of the robot’s sensor and control information processing," Sensors, vol. 22, no. 3, Art. no. 1062, 2022, https://doi.org/10.3390/s22031062
R. Liu, F. Nageotte, P. Zanne, M. de Mathelin, and B. Dresp-Langley, "Deep reinforcement learning for the control of robotic manipulation: A focussed mini-review," Robotics, vol. 10, no. 1, Art. no. 22, 2021,
https://doi.org/10.3390/robotics10010022
A. Haskard and D. Herath, "Secure robotics: Navigating challenges at the nexus of safety, trust, and cybersecurity in cyber-physical systems," ACM Comput. Surv., vol. 57, no. 9, Art. no. 222, pp. 1–48, 2025,
https://doi.org/10.1145/3723050
S. Daryanavard, "Real-time predictive artificial intelligence: Deep reinforcement learning for closed-loop control systems and open-loop signal processing," Ph.D. dissertation, Univ. Glasgow, Glasgow, U.K., 2024,
https://doi.org/10.5525/gla.thesis.84692
B. Singh, R. Kumar, and V. P. Singh, "Reinforcement learning in robotic applications: A comprehensive survey," Artif. Intell. Rev., vol. 55, pp. 945–990, 2022, https://doi.org/10.1007/s10462-021-09997-9
T. Zhang and H. Mo, "Reinforcement learning for robot research: A comprehensive review and open issues," Int. J. Adv. Robot. Syst., vol. 18, no. 3, pp. 1–22, 2021, https://doi.org/10.1177/17298814211007305
B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, et al.,"RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control," in Proc. 7th Conf. Robot Learn. (CoRL), Proc. Mach. Learn. Res., vol. 229, pp. 2165–2183, 2023. Available from: https://proceedings.mlr.press/v229/zitkovich23a/zitkovich23a.pdf
D. Ghosh, H. R. Walke, K. Pertsch, K. Black, O. Mees, S. Dasari, et al., "Octo: An open-source generalist robot policy," in Proc. Robotics: Science and Systems XX (RSS), Delft, The Netherlands, 2024,
https://doi.org/10.15607/RSS.2024.XX.090
M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, et al.,"OpenVLA: An open-source vision-language-action model," in Proc. 8th Conf. Robot Learn. (CoRL), Proc. Mach. Learn. Res., vol. 270, pp. 2679–2713, 2025. Available from: https://proceedings.mlr.press/v270/kim25c.html
Y. Ze, G. Zhang, K. Zhang, C. Hu, M. Wang, and H. Xu, "3D Diffusion Policy: Generalizable visuomotor policy learning via simple 3D representations," in Proc. Robotics: Science and Systems (RSS) XX, Delft, The Netherlands, 2024, https://doi.org/10.15607/RSS.2024.XX.067
K. Black, N. Brown, D. Driess, A. Esmail, M. R. Equi, C. Finn, et al."π₀: A vision-language-action flow model for general robot control," in Proc. Robotics: Science and Systems XXI (RSS), Los Angeles, CA, USA, 2025, https://doi.org/10.15607/RSS.2025.XXI.010
R. Firoozi, J. Tucker, S. Tian, A. Majumdar, J. Sun, W. Liu, et al., "Foundation models in robotics: Applications, challenges, and the future," Int. J. Robot. Res., vol. 44, no. 5, pp. 701–739, 2025, https://doi.org/10.1177/02783649241281508
K. Kawaharazuka, J. Oh, J. Yamada, I. Posner, and Y. Zhu, "Vision-language-action models for robotics: A review towards real-world applications," IEEE Access, vol. 13, pp. 162467–162504, 2025, https://doi.org/10.1109/ACCESS.2025.3609980
N. Zhang, J. Ren, Y. Dong, X. Yang, R. Bian, J. Li, G. Gu, and X. Zhu, "Soft robotic hand with tactile palm-finger coordination," Nat. Commun., vol. 16, Art. no. 2395, 2025, https://doi.org/10.1038/s41467-025-57741-6
Y. Zhou, W. S. Lee, Y. Gu, and Y. She, "Tactile-reactive gripper with an active palm for dexterous manipulation," npj Robot., vol. 4, Art. no. 13, 2026, https://doi.org/10.1038/s44182-026-00079-y
C. Özkurt, "Machine learning with industrial robots: Exploring the impact of joint angles on Cartesian coordinates using explainable AI," Evol. Intell., vol. 18, Art. no. 22, 2025, https://doi.org/10.1007/s12065-024-01006-6
Z. Xie, X. Liang, and C. Roberto, "Learning-based robotic grasping: A review," Front. Robot. AI, vol. 10, Art. no. 1038658, 2023, https://doi.org/10.3389/frobt.2023.1038658
R. Newbury, M. Gu, L. Chumbley, A. Mousavian, C. Eppner, J. Leitner, et al., "Deep learning approaches to grasp synthesis: A review," IEEE Trans. Robot., vol. 39, no. 5, pp. 3994–4015, 2023, https://doi.org/10.1109/TRO.2023.3280597
A. Depierre, E. Dellandréa, and L. Chen, "Jacquard: A large-scale dataset for robotic grasp detection," in Proc. 2018 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Madrid, Spain, pp. 3511–3516, 2018,
https://doi.org/10.1109/IROS.2018.8593950
E. Jang, A. Irpan, M. Khansari, D. Kappler, F. Ebert, C. Lynch, et al., "BC-Z: Zero-shot task generalization with robotic imitation learning," in Proc. 5th Conf. Robot Learn. (CoRL), Proc. Mach. Learn. Res., vol. 164, pp. 991–1002, 2022. Available from: https://proceedings.mlr.press/v164/jang22a/jang22a.pdf
A. Alvanpour, C. Acun, K. Spurlock, C. K. Robinson, S. K. Das, D. O. Popa, and O. Nasraoui, "Comparative analysis of post hoc explainable methods for robotic grasp failure prediction," Electronics, vol. 14, no. 9, Art. no. 1868, 2025, https://doi.org/10.3390/electronics14091868
C. Acun, A. Ashary, D. O. Popa, and O. Nasraoui, "Optimizing local explainability in robotic grasp failure prediction," Electronics, vol. 14, no. 12, Art. no. 2363, 2025, https://doi.org/10.3390/electronics14122363
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Areeba Raza (Author)

This work is licensed under a Creative Commons Attribution 4.0 International License.