论文标题

迈向多个专业学习者,以通过在线知识蒸馏来解释GNN

Toward Multiple Specialty Learners for Explaining GNNs via Online Knowledge Distillation

论文作者

Bui, Tien-Cuong, Le, Van-Duc, Li, Wen-syan, Cha, Sang Kyun

论文摘要

图形神经网络(GNN)在众多应用和系统中变得越来越普遍,需要对其预测进行解释,尤其是在做出关键决策时。但是,由于图形数据和模型执行的复杂性,解释GNNS是具有挑战性的。尽管额外的计算成本,但由于其建筑的一般性,事后解释方法已被广泛采用。本质上可解释的模型提供了即时的解释,但通常是特定于模型的,只能解释特定的GNN。因此,我们提出了一个名为Scale的新型GNN解释框架,该框架是一般且快速解释预测的。比例尺训练多个专业学习者来解释GNN,因为构建了一个强大的解释器来检查输入图中的相互作用的属性是复杂的。在培训中,Black-Box GNN模型基于在线知识蒸馏范式指导学习者。在解释阶段,预测的解释是由与训练有素的学习者相对应的多个解释者提供的。具体而言,执行带有重新启动过程的边缘掩蔽和随机步行,以分别为图级和节点级预测提供结构说明。功能归因模块提供总体摘要和实例级特征贡献。我们通过定量和定性实验将量表与最新基准进行比较,以证明其解释正确性和执行性能。我们还进行了一系列消融研究,以了解拟议框架的优势和劣势。

Graph Neural Networks (GNNs) have become increasingly ubiquitous in numerous applications and systems, necessitating explanations of their predictions, especially when making critical decisions. However, explaining GNNs is challenging due to the complexity of graph data and model execution. Despite additional computational costs, post-hoc explanation approaches have been widely adopted due to the generality of their architectures. Intrinsically interpretable models provide instant explanations but are usually model-specific, which can only explain particular GNNs. Therefore, we propose a novel GNN explanation framework named SCALE, which is general and fast for explaining predictions. SCALE trains multiple specialty learners to explain GNNs since constructing one powerful explainer to examine attributions of interactions in input graphs is complicated. In training, a black-box GNN model guides learners based on an online knowledge distillation paradigm. In the explanation phase, explanations of predictions are provided by multiple explainers corresponding to trained learners. Specifically, edge masking and random walk with restart procedures are executed to provide structural explanations for graph-level and node-level predictions, respectively. A feature attribution module provides overall summaries and instance-level feature contributions. We compare SCALE with state-of-the-art baselines via quantitative and qualitative experiments to prove its explanation correctness and execution performance. We also conduct a series of ablation studies to understand the strengths and weaknesses of the proposed framework.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源