Using Markov Decision Process Model for Sustainable Assessment in Industry 4.0
- This thesis investigates the integration of sustainability assessment considering Industry 4.0 technologies and the use of Markov Decision Process capabilities. The manufacturing industry is facing increasing pressure to improve sustainability assessment performance, and Industry 4.0 technologies like Digital Twins, Internet of Things, Big Data Analytics, Cloud Computing, Machine Learning, and Artificial Intelligence have the potential to support these efforts. However, effectively integrating sustainability assessment goals and Industry 4.0 technologies within manufacturing systems can be challenging. The research addresses this challenge by developing a framework for optimizing the flow of operations in a manufacturing system while incorporating sustainability assessment and Industry 4.0 technologies effectively. The framework utilizes the Markov Decision Process to model the decision-making process of the manufacturing system and its decision-makers. From the other side, it includes sustainability assessment goals as constraints or objectives in the Markov Decision Process model. The use of Industry 4.0 technologies is integrated into the framework to gather data and optimize the decision-making process based on that data. The thesis begins by reviewing the literature on sustainability assessment, Industry 4.0 technologies, and their impacts with regard to manufacturing systems. The proposed framework is then presented, and its capabilities are demonstrated through case studies of single and multiple agents on a shop floor. The trend in pioneer manufacturing firms is to implement new technological applications on their shop floor to agile their Manufacturing Execution System. The findings from the case study indicate that the proposed framework can effectively support decision-making at the top-tier level of the enterprise by integrating sustainability assessment and the Industry 4.0 paradigm.