TY - GEN
T1 - Prediction approach for ising model estimation
AU - Li, Jinyu
AU - Pan, Yu
AU - Yu, Hongfeng
AU - Zhang, Qi
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/11
Y1 - 2019/11
N2 - We consider the graph estimation for Ising model from observed binary data. Popular approaches in the literature are largely penalized sparse selection procedures that depend on tuning parameters to be selected. The output of such procedures is usually one single sparse graph without any ranking information of the individual edges. In scientific practice, however, it is more desirable to be able to rank all potential edges based on their statistical significance, and select the sparse graph by thresholding. In this paper, we propose a novel PRediction Approach for Ising Model Estimation (PRAIME). The proposed framework reformulates Ising model estimation as the prediction of the observed data, and provides an estimate and a statistical significance measure of the Ising model parameter for each node pair using only the predicted values. Thus it enables the ranking all potential edges and the flexible sparse graph selection by thresholding, and allows the researchers to use the predictive algorithm of their choice. We implemented PRAIME using random forest, illustrated the advantage of PRAIME over the penalized sparse selection approaches in accuracy and flexibility using synthetic data, and applied it to a congress co-sponsorship dataset.
AB - We consider the graph estimation for Ising model from observed binary data. Popular approaches in the literature are largely penalized sparse selection procedures that depend on tuning parameters to be selected. The output of such procedures is usually one single sparse graph without any ranking information of the individual edges. In scientific practice, however, it is more desirable to be able to rank all potential edges based on their statistical significance, and select the sparse graph by thresholding. In this paper, we propose a novel PRediction Approach for Ising Model Estimation (PRAIME). The proposed framework reformulates Ising model estimation as the prediction of the observed data, and provides an estimate and a statistical significance measure of the Ising model parameter for each node pair using only the predicted values. Thus it enables the ranking all potential edges and the flexible sparse graph selection by thresholding, and allows the researchers to use the predictive algorithm of their choice. We implemented PRAIME using random forest, illustrated the advantage of PRAIME over the penalized sparse selection approaches in accuracy and flexibility using synthetic data, and applied it to a congress co-sponsorship dataset.
KW - Graphical model
KW - Ising model
KW - Random forest
UR - http://www.scopus.com/inward/record.url?scp=85078730567&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85078730567&partnerID=8YFLogxK
U2 - 10.1109/ICDMW.2019.00106
DO - 10.1109/ICDMW.2019.00106
M3 - Conference contribution
AN - SCOPUS:85078730567
T3 - IEEE International Conference on Data Mining Workshops, ICDMW
SP - 703
EP - 710
BT - Proceedings - 19th IEEE International Conference on Data Mining Workshops, ICDMW 2019
A2 - Papapetrou, Panagiotis
A2 - Cheng, Xueqi
A2 - He, Qing
PB - IEEE Computer Society
T2 - 19th IEEE International Conference on Data Mining Workshops, ICDMW 2019
Y2 - 8 November 2019 through 11 November 2019
ER -