Energy-efficient over-the-air computation for federated generative model fine-tuning in unmanned vehicle-assisted disaster relief

  • Yikun Zhao
  • , Lei Feng*
  • , Fanqin Zhou
  • , Wenjing Li
  • , Zehui Xiong
  • , Hongyang Du
  • , Celimuge Wu
  • , Song Guo
  • , Tony Q.S. Quek
  • , Zhu Han
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The utilization of emergent generative artificial intelligence (GAI) within the realm of unmanned vehicles (UVs) can boost edge intelligence and potentially enhance the efficiency and effectiveness of rescue operations. However, to facilitate specialized generative edge intelligence in dynamic UV networks, GAI models need to tap into local data and conduct online fine-tuning, and the dispersed distribution of UVs makes distributed fine-tuning paradigms crucial. Although the federated generative model fine-tuning brings a potential solution, the large number of parameter transmissions involved in its fine-tuning process are often constrained by communication bottlenecks, which are more pronounced for resource-constrained UV networks. To cope with these challenges, we introduce an energy-efficient GAI model fine-tuning framework for the hierarchical UV networks, which employs over-the-air technology to save computational resource costs for unmanned aerial vehicle (UAV) during federated aggregation within a federated learning paradigm. Thereafter, we study the resource allocation problem in the fine-tuning process of the generative model and formulate a joint optimization problem for the bandwidth allocation, power control, computation resource allocation, and denoising factor control, aiming to minimize the system energy consumption. Then, we decouple the original problem into four tractable subproblems, and propose a block coordinate descent algorithm to solve them iteratively. Particularly, we derive a closed-form solution for the denoising factor to minimize the local model uploading transmission energy consumption under a specific AirComp communication error threshold. Simulation based on the state-of-the-art generative models shows that our AirComp-assisted federated generative model fine-tuning scheme can achieve satisfactory customized field-of-view image generation capability compared with the traditional fine-tuning scheme in an energy-efficient way.

Original languageEnglish
JournalIEEE Transactions on Cognitive Communications and Networking
Early online date20 Mar 2025
DOIs
Publication statusEarly online date - 20 Mar 2025
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • federated learning
  • Generative artificial intelligence
  • multi-access computing
  • unmanned vehicle network

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Energy-efficient over-the-air computation for federated generative model fine-tuning in unmanned vehicle-assisted disaster relief'. Together they form a unique fingerprint.

Cite this