This study determined the optimal production of furfural (FuR) from liquid hydrolysate xylan liquor obtained through a two-stage pretreatment process using NaOH for de-ashing and EtOH for the delignification of raw rice husk (RH). The de-ashing pretreatment was conducted at 150 °C, with 6.0% (w/v) NaOH and a reaction time of 40 min. The optimal conditions for delignification pretreatment, performed using an organosolv fractionation method with EtOH, were a reaction temperature of 150 °C, 60% (v/v) EtOH, 0.25% (w/v) H2SO4, and a reaction time of 90 min. Through a two-stage pretreatment process, a liquid hydrolysate in the form of xylan liquor was obtained, which was subjected to an acid catalytic conversion process to produce FuR. The process conditions were varied, with reaction temperatures of 130–170 °C, H2SO4 catalyst concentrations of 1.0–3.0 wt.%, and reaction times of 0–90 min. The Response Surface Methodology tool was used to identify the optimal FuR yield from xylan liquor. Ultimately, the optimal process conditions for the acid catalytic conversion were found to be a substrate-to-catalyst ratio of 2:8, a reaction temperature of 168.9 °C, a catalyst concentration of 1.9 wt.%, and a reaction time of 41.24 min, achieving an FuR yield of 67.31%.