TY - JOUR
T1 - How Does Bayesian Noisy Self-Supervision Defend Graph Convolutional Networks?
AU - Zhuang, Jun
AU - Hasan, Mohammad Al
N1 - Publisher Copyright:
© 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2022/8
Y1 - 2022/8
N2 - In recent years, it has been shown that, compared to other contemporary machine learning models, graph convolutional networks (GCNs) achieve superior performance on the node classification task. However, two potential issues threaten the robustness of GCNs, label scarcity and adversarial attacks.Intensive studies aim to strengthen the robustness of GCNs from three perspectives, the self-supervision-based method, the adversarial-based method, and the detection-based method. Yet, all of the above-mentioned methods can barely handle both issues simultaneously. In this paper, we hypothesize noisy supervision as a kind of self-supervised learning method and then propose a novel Bayesian graph noisy self-supervision model, namely GraphNS, to address both issues. Extensive experiments demonstrate that GraphNS can significantly enhance node classification against both label scarcity and adversarial attacks. This enhancement proves to be generalized over four classic GCNs and is superior to the competing methods across six public graph datasets.
AB - In recent years, it has been shown that, compared to other contemporary machine learning models, graph convolutional networks (GCNs) achieve superior performance on the node classification task. However, two potential issues threaten the robustness of GCNs, label scarcity and adversarial attacks.Intensive studies aim to strengthen the robustness of GCNs from three perspectives, the self-supervision-based method, the adversarial-based method, and the detection-based method. Yet, all of the above-mentioned methods can barely handle both issues simultaneously. In this paper, we hypothesize noisy supervision as a kind of self-supervised learning method and then propose a novel Bayesian graph noisy self-supervision model, namely GraphNS, to address both issues. Extensive experiments demonstrate that GraphNS can significantly enhance node classification against both label scarcity and adversarial attacks. This enhancement proves to be generalized over four classic GCNs and is superior to the competing methods across six public graph datasets.
KW - Bayesian inference
KW - Defense of graph convolutional networks
KW - Node classification
KW - Noisy Supervision
UR - http://www.scopus.com/inward/record.url?scp=85124348761&partnerID=8YFLogxK
U2 - 10.1007/s11063-022-10750-8
DO - 10.1007/s11063-022-10750-8
M3 - Article
AN - SCOPUS:85124348761
SN - 1370-4621
VL - 54
SP - 2997
EP - 3018
JO - Neural Processing Letters
JF - Neural Processing Letters
IS - 4
ER -