Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-01-24T23:35:34.523Z Has data issue: false hasContentIssue false
  • English
  • Français

Integrating large language models for improved failure mode and effects analysis (FMEA): a framework and case study

Published online by Cambridge University Press:  16 May 2024

Ibtissam El Hassani ,
Tawfik Masrour ,
Nouhan Kourouma ,
Damien Motte  and
Jože Tavčar
Ibtissam El Hassani
Affiliation:
Moulay Ismail University, Morocco University of Quebec at Rimouski, Canada
Tawfik Masrour
Affiliation:
Moulay Ismail University, Morocco University of Quebec at Rimouski, Canada
Nouhan Kourouma
Affiliation:
Moulay Ismail University, Morocco
Damien Motte
Affiliation:
Lund University, Sweden
Jože Tavčar*
Affiliation:
Lund University, Sweden
*
[email protected]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

The manual execution of failure mode and effects analysis (FMEA) is time-consuming and error-prone. This article presents an approach in which large language models (LLMs) are integrated into FMEA. LLMs improve and accelerate FMEA with human in the loop. The discussion looks at software tools for FMEA and emphasizes that the tools must be tailored to the needs of the company. Our framework combines data collection, pre-processing and reliability assessment to automate FMEA. A case study validates this framework and demonstrates its efficiency and accuracy compared to manual FMEA.

Keywords

failure mode and effect analysis (FMEA)large language model (LLM)generative AIproduct qualityknowledge management
Type
Artificial Intelligence and Data-Driven Design
Information
Proceedings of the Design Society , Volume 4: DESIGN 2024 , May 2024 , pp. 2019 - 2028
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2024.

References

Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A. et al. (2016). “TensorFlow: A system for large-scale machine learning”, arXiv, 1605.08695. https://doi.org/10.48550/arXiv.1605.08695Google Scholar
and VDA, AIAG (2019), Failure Mode and Effects Analysis—FMEA Handbook: Design FMEA, Process FMEA, Supplement FMEA for Monitoring and System Response, Automotive Industry Action Group and Verband der Automobilindustrie, Southfield, MI.Google Scholar
AnkurJain (2019), Edmunds-Consumer Car Ratings and Reviews (Version 3), Kaggle. Available at: https://www.kaggle.com/datasets/ankkur13/edmundsconsumer-car-ratings-and-reviews (accessed 4 February 2024).Google Scholar
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S. et al. (2021), “On the opportunities and risks of foundation models”, arXiv, 2108.07258. https://doi.org/10.48550/arXiv.2108.07258Google Scholar
Campbell, J. L., Quincy, C., Osserman, J. and Pedersen, O. K. (2013), "Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement", Sociological Methods & Research, Vol. 42 No. 3, pp. 294-320. https://doi.org/10.1177/0049124113500475CrossRefGoogle Scholar
Dell'Acqua, F., McFowland, E. III, Mollick, E., Lifshitz-Assaf, H., Kellogg, K.C. et al. (2023), “Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality”, HBS Working Paper Series, Working Paper No. 24-013, Harvard Business School. Available at: https://www.hbs.edu/faculty/Pages/item.aspx?num=64700 (accessed 19 November 2023).Google Scholar
Department of Defense (1980), MIL-STD-1629A, Procedures for performing a failure mode, effects and criticality analysis, Department of Defense, Washington, D.C.Google Scholar
Diemert, S., and Weber, J.H., (2023), “Can large language models assist in hazard analysis?”, arXiv, 2303.15473. https://doi.org/10.48550/arXiv.2303.15473Google Scholar
Filz, M.-A., Langner, J.E.B., Herrmann, C. and Thiede., S. (2021), “Data-driven failure mode and effect analysis (FMEA) to enhance maintenance planning”, Computers in Industry, Vol. 129, 103451. https://doi.org/10.1016/j.compind.2021.103451CrossRefGoogle Scholar
Geng, X. and Liu, H. (2023). “OpenLLaMA: An open reproduction of LlaMA”. Available at: https://github.com/openlm-research/open_llama (accessed 11 November 2023).Google Scholar
Hassan, F., Nguyen, T., Le, T. and Le, C. (2023), “Automated prioritization of construction project requirements using machine learning and fuzzy failure mode and effects analysis (FMEA)”, Automation in Construction, Vol. 154, 105013. https://doi.org/10.1016/j.autcon.2023.105013CrossRefGoogle Scholar
Hodkiewicz, M., Klüwer, J.W., Woods, C., Smoker, T. and Low, E. (2021), “An ontology for reasoning over engineering textual data stored in FMEA spreadsheet tables”, Computers in Industry, Vol. 131, 103496. https://doi.org/10.1016/j.compind.2021.103496CrossRefGoogle Scholar
Hu, X., Tian, Y., Nagato, K., Nakao, M. and Liu, A. (2023), “Opportunities and challenges of ChatGPT for design knowledge management”, Procedia CIRP, Vol. 119, pp. 21-28, https://doi.org/10.1016/j.procir.2023.05.001CrossRefGoogle Scholar
Huang, J., Xu, D.-H., Liu, H.-C. and Song, M.-S. (2019), “A new model for failure mode and effect analysis integrating linguistic Z-numbers and projection method”, IEEE Transactions on Fuzzy Systems, Vol. 29, No. 3, pp. 530–538, http://doi.org/10.1109/TFUZZ.2019.2955916CrossRefGoogle Scholar
IATF (2016), IATF 16949:2016, Automotive quality management system standard, International Automotive Task Force.Google Scholar
IEC (1985), IEC 60812, Analysis techniques for system reliability – Procedure for failure mode and effects analysis (FMEA), International Electrotechnical Commission, Geneva.Google Scholar
IEC (2018), IEC 60812, Failure modes and effects analysis (FMEA and FMECA), International Electrotechnical Commission, Geneva.Google Scholar
Kan, D. (2022, November 7), “Car parts that start with A to Z – A thorough exploration”, List Explained. Available at: https://listexplained.com/car-parts-that-start-with-a-to-z/ (accessed 3 June 2023).Google Scholar
“List of auto parts” (2023, March 3), Wikipedia. Available at: https://en.wikipedia.org/wiki/List_of_auto_parts (accessed March 2023).Google Scholar
Liu, H.-C., Chen, X.-Q., Duan, C.-H. and Wang, Y.-M. (2019), “Failure mode and effect analysis using multi-criteria decision-making methods: A systematic literature review”, Computers & Industrial Engineering, Vol. 135, pp. 881-897. https://doi.org/10.1016/j.cie.2019.06.055CrossRefGoogle Scholar
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y. and Potts, C. (2011), “Learning word vectors for sentiment analysis”, in: Lin, D., Matsumoto, Y. and Mihalcea, R. (Eds.), Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Stroudsburg, PA, pp. 142-150. Available at: https://aclanthology.org/P11-1015. Dataset derived from original available at: https://www.kaggle.com/datasets/lakshmi25npathi/imdb-dataset-of-50k-movie-reviews (accessed 4 February 2024).Google Scholar
Na'amnh, S., Salim, M.B., Husti, I. and Daróczi, M. (2021). “Using artificial neural network and fuzzy inference system based prediction to improve failure mode and effects analysis: A case study of the busbars production”, Processes, Vol. 9, No. 8, 1444. https://doi.org/10.3390/pr9081444CrossRefGoogle Scholar
Peddi, S., Lanka, K. and Gopal, P.R.C. (2023) “Modified FMEA using machine learning for food supply chain”, Materials Today: Proceedings, in Press. https://doi.org/10.1016/j.matpr.2023.04.353Google Scholar
SAE (1994), SAE J1739, Potential failure mode and effects analysis in design (design FMEA) and potential failure mode and effects analysis in manufacturing and assembly processes (process FMEA) reference manual, Society of Automotive Engineers, Warrendale, PA.Google Scholar
Soltanali, H. and Ramezani, S. (2023), “Smart failure mode and effects analysis (FMEA) for safety–Critical systems in the context of Industry 4.0”, in: Garg, H. (Ed.) Advances in Reliability, Failure and Risk Analysis, Springer, Singapore, pp. 151-176. https://doi.org/10.1007/978-981-19-9909-3_7CrossRefGoogle Scholar
Spreafico, C. and Sutrisno, A. (2023). “Artificial intelligence assisted social failure mode and effect analysis (FMEA) for sustainable product design”. Sustainability, Vol. 15, No. 11, 8678. https://doi.org/10.3390/su15118678CrossRefGoogle Scholar
Tavčar, J., Benedičič, J. and Žavbi, R. (2019), “Knowledge management support in the engineering change process in small and medium-sized companies”, International Journal of Agile Systems and Management, Vol. 12, No. 4, pp. 354-381. https://doi.org/10.1504/IJASM.2019.104587CrossRefGoogle Scholar
Tavčar, J. and Duhovnik, J. (2014), “Tools and methods stimulate virtual team co-operation at concurrent engineering”, Proceedings of the 21st ISPE Inc. International Conference on Concurrent Engineering, Beijing, China, September 8–11, 2014, IOS Press, Amsterdam, pp. 457-466. https://doi.org/10.3233/978-1-61499-440-4-457CrossRefGoogle Scholar
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F. and Ting, D. S. W. (2023), "Large language models in medicine", Nature Medicine, Vol. 29 No. 8, pp. 1930-1940. https://doi.org/10.1038/s41591-023-02448-8CrossRefGoogle ScholarPubMed
Thomas, D. (2023), “Revolutionizing failure modes and effects analysis with ChatGPT: Unleashing the power of AI language models”, Journal of Failure Analysis and Prevention, Vol. 23, No. 3, pp. 911–913. https://doi.org/10.1007/s11668-023-01659-yCrossRefGoogle Scholar
Wirth, R., Berthold, B., Krämer, A. and Peter, G. (1996), “Knowledge-based support of system analysis for the analysis of failure modes and effects”, Engineering Applications of Artificial Intelligence, Vol. 9, No. 3, pp. 219-229. https://doi.org/10.1016/0952-1976(96)00014-0CrossRefGoogle Scholar
Wu, Z., Liu, W. and Nie, W. (2021), “Literature review and prospect of the development and application of FMEA in manufacturing industry”, The International Journal of Advanced Manufacturing Technology, Vol. 112, No. 5-6, pp. 1409–1436. https://doi.org/10.1007/s00170-020-06425-0CrossRefGoogle Scholar
Yucesan, M., Gul, M. and Celik, E. (2021), “A holistic FMEA approach by fuzzy-based Bayesian network and best-worst method”, Complex & Intelligent Systems, Vol. 7, No. 3, pp. 1547–1564. https://doi.org/10.1007/s40747-021-00279-zCrossRefGoogle Scholar
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X. et al. (2023). “A survey of large language models”, arXiv, 2303.18223, https://doi.org/10.48550/arXiv.2303.18223Google Scholar