기본 정보
연구 분야
프로젝트
발행물
구성원
article|
인용수 0
·2023
Feature Acquisition Using Monte Carlo Tree Search*
Sung-Soo Lim, Diego Klabjan, Mark B. Shapiro
초록

Feature acquisition algorithms address the problem of acquiring informative features while balancing the costs of acquisition to improve the learning performances of ML models. Previous approaches have focused on calculating the expected utility values of features to determine the acquisition sequences. Other approaches formulated the problem as a Markov Decision Process (MDP) and applied reinforcement learning based algorithms. In comparison to previous approaches, we focus on 1) formulating the feature acquisition problem as a MDP and applying Monte Carlo Tree Search, 2) calculating the intermediary rewards for each acquisition step based on model predictions and acquisition costs and 3) simultaneously optimizing model prediction and acquisition costs with multi-objective Monte Carlo Tree Search. With Proximal Policy Optimization and Deep Q-Network algorithms as benchmark, we show the effectiveness of our proposed approach with experimental study.

키워드
Computer scienceMonte Carlo tree searchBenchmark (surveying)Monte Carlo methodFeature (linguistics)Reinforcement learningMarkov decision processTree (set theory)Decision treeMachine learning
타입
article
IF / 인용수
- / 0
게재 연도
2023