论文标题

梯度和渠道意识到的动态调度,用于联合边缘学习系统中的空中计算

Gradient and Channel Aware Dynamic Scheduling for Over-the-Air Computation in Federated Edge Learning Systems

论文作者

Du, Jun, Jiang, Bingqing, Jiang, Chunxiao, Shi, Yuanming, Han, Zhu

论文摘要

为了满足预期的大量计算应用程序,联合边缘学习(FEEL)是一种新的范式,具有分布式学习,以携带低延迟和隐私性的能力。为了进一步提高无线数据聚合和模型学习的效率,通过使用无线通道的叠加特征,无线计算(AIRCOMP)成为有希望的解决方案。但是,无线通道的褪色和噪音可能会导致AirComp中的总畸变,从而实现联合学习。此外,收集的数据和边缘设备的能耗的质量也可能影响模型聚集的准确性和效率以及收敛性。为了解决这些问题,这项工作提出了一种动态设备调度机制,该机制可以选择合格的边缘设备以适当的功率控制策略传输其本地模型,以便通过AIRCOMP参与服务器中的模型培训。在这种机制中,数据重要性是通过局部模型参数,通道状况和设备共同能源消耗的梯度来衡量的。特别是,要充分使用分布式数据集并加速联合学习的收敛速度,还保留了未选择的设备的本地更新,并积累了未来的潜在传输,而不是直接被丢弃。此外,为搜索最佳设备选择策略而制定了Lyapunov Drift-Plus Plus-Penalty优化问题。模拟结果验证了所提出的调度机制可以达到更高的测试准确性和更快的收敛速度,并且在不同的通道条件下具有鲁棒性。

To satisfy the expected plethora of computation-heavy applications, federated edge learning (FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency and privacy-preserving. To further improve the efficiency of wireless data aggregation and model learning, over-the-air computation (AirComp) is emerging as a promising solution by using the superposition characteristics of wireless channels. However, the fading and noise of wireless channels can cause aggregate distortions in AirComp enabled federated learning. In addition, the quality of collected data and energy consumption of edge devices may also impact the accuracy and efficiency of model aggregation as well as convergence. To solve these problems, this work proposes a dynamic device scheduling mechanism, which can select qualified edge devices to transmit their local models with a proper power control policy so as to participate the model training at the server in federated learning via AirComp. In this mechanism, the data importance is measured by the gradient of local model parameter, channel condition and energy consumption of the device jointly. In particular, to fully use distributed datasets and accelerate the convergence rate of federated learning, the local updates of unselected devices are also retained and accumulated for future potential transmission, instead of being discarded directly. Furthermore, the Lyapunov drift-plus-penalty optimization problem is formulated for searching the optimal device selection strategy. Simulation results validate that the proposed scheduling mechanism can achieve higher test accuracy and faster convergence rate, and is robust against different channel conditions.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源