Machine Scheduling Models Based on Reinforcement Learning for Minimizing Due Date Violation and Setup Change

Woosik Yoo, Juhyeok Seo, Dahee Kim, Kwanho Kim

Abstract


Recently, manufacturers have been struggling to efficiently use production equipment as their production methods become more sophisticated and complex. Typical factors hindering the efficiency of the manufacturing process include setup cost due to job change. Especially, in the process of using expensive production equipment such as semiconductor / LCD process, efficient use of equipment is very important. Balancing the tradeoff between meeting the deadline and minimizing setup cost incurred by changes of work type is crucial planning task. In this study, we developed a scheduling model to achieve the goal of minimizing the duedate and setup costs by using reinforcement learning in parallel machines with duedate and work preparation costs. The proposed model is a Deep Q-Network (DQN) scheduling model and is a reinforcement learning-based model. To validate the effectiveness of our proposed model, we compared it against the heuristic model and DNN(deep neural network) based model. It was confirmed that our proposed DQN method causes less due date violation and setup costs than the benchmark methods.

 


Full Text:

PDF

References


Cho, Y. C., Cho, H. C., Kim, J. W., Zhang, L., and Jeon, H. T., “A Study on Optimal Scheduling of Multi-Spinner's Manufacturing Process Using Artificial Neural Network,” International Journal of Fuzzy Logic and Intelligent Systems, Vol. 18, No. 1, pp. 157-160, 2008.

Demirkov, E. and Uzsoy, R., “Decomposition methods for reentrant flow shops with sequence-dependent setup times,” Journal of Scheduling, Vol. 3, No. 3, pp. 155-177, 2010.

Gabel, T. and Riedmiller, M., “Distributed policy search reinforcement learning for job-shop scheduling tasks,” International Journal of Production Research, Vol. 50, No. 1, pp. 41-61, 2012.

Jeong, H. S., Kim, M. W., Lee, B. J., Kim, K. T., and Youn, H. Y., “An Neural Network Approach to Job-shop Scheduling based on Reinforcement Learning,” Proceedings of the Korean Society of Computer Information Conference, Vol. 26, No. 2, pp. 47-48, 2018.

Kang, J., “Feasibility Study on the Reinforcement Learning for a Dynamic Scheduling Problem,” Journal of advanced engineering and technology, Vol. 10, No. 4, pp. 453-456, 2017.

Kang, Y. H., Lee, Y. S., and Shin, H. J., “Problem space based search algorithm for manufacturing process with rework probabilities affecting product quality and tardiness,” Journal of the Korea Academia-Industrial Cooperation Society, Vol. 10, No. 7, pp. 1702-1710, 2009.

Kim, A. K., “Ensemble-based Quality Classification and Deep Reinforcement Learning-based Production Scheduling: Ensemble-based Quality Classification and Deep Reinforcement Learning-based Production Scheduling,” Ph.D. dissertation, KyungHee University, 2018.

Kim, H. S., Park, D. J., and Jeong, I. J., “Railway Capacity Allocation Modeling using Genetic Algorithm,” Transportation Research Record: Journal of the Transportation Research Board, Vol. 2608, pp. 1223-1230, 2016.

Kim, J. Y., “Packet scheduling algorithm using deep Q-Network in wireless network,” M.S dissertation, Yonsei University, 2018.

Lee, D. H. and Kim, K. H., “Deep Learning Based Prediction Method of Long-term Photovoltaic Power Generation Using Meteorological and Seasonal Information,” The Journal of Society for e-Business Studies, Vol. 24, No. 1, pp. 1-16, 2019.

Lee, Y. S., “A study on Developing algorithms for Manufacturing networks using meta-Heuristics,” Ph.D. Thesis, Sangmyung University, 2000.

Mazdeh, M. M., Nakhjavani, A. K., and Zareei, A., “Minimizing Total Weighted Tardiness with Drop Dead Dates in Single Machine Scheduling Problem,” International Journal of Industrial Engineering & Production Research, Vol. 21, No. 2, pp. 89-95, 2010.

Oh, S. W., Lee, H. K., Shin, J. Y., and Lee, J. H., “Antibiotics-Resistant Bacteria Infection Prediction Based on Deep Learning,” The Journal of Society for e-Business Studies, Vol. 24, No. 1, pp. 105-120, 2019.

Ryu, J. W., Kang, M. K., and Kim, M. W., “A Clustering Algorithm based on Heuristic Evolution Algorithm,” Korean Institute of Information Scientists and Engineers, Vol. 27, No. 2, pp. 78-80, 2000.

Shahrabia, J., Adibib, M. A., and Mahootchia, M., “A reinforcement learning approach to parameter estimation in dynamic job shop scheduling,” Computers and Industrial Engineering, Vol. 110, pp. 75-82, 2016.


Refbacks

  • There are currently no refbacks.