Efficient operational planning in district heating systems (DHSs) is essential for minimizing operating costs and maximizing energy efficiency. However, since practitioners must determine future production plans under unknown future demands and costs in real-world energy systems, it is challenging to solve the production planning problems of DHSs. In this paper, we propose a multi-head attention-based TimesNet (MATN) in which a transformer decoder is incorporated that operates solely on a 24 h lookback window without requiring any future information. Specifically, the model is trained in an end-to-end manner, for which the training dataset was built by solving a mixed integer programming (MIP) model. Experimental results demonstrate that the proposed MATN model significantly outperforms baseline deep learning-based methods. A qualitative analysis of the hourly production plans further indicates that MATN generates robust operational plans that mimic those generated by an MIP model, which suggests the effectiveness of the proposed approach in terms of economic efficiency and operational stability without depending on future information.