Login | Register

Exploring Efficiency in Split Federated Learning under System Heterogeneity: A Study of System Synchronization and Resource Optimization

Title:

Exploring Efficiency in Split Federated Learning under System Heterogeneity: A Study of System Synchronization and Resource Optimization

Gao, Haoran ORCID: https://orcid.org/0009-0007-6084-0713 (2025) Exploring Efficiency in Split Federated Learning under System Heterogeneity: A Study of System Synchronization and Resource Optimization. Masters thesis, Concordia University.

[thumbnail of GAO_MA_F2025 (for Fall).pdf]
Preview
Text (application/pdf)
GAO_MA_F2025 (for Fall).pdf - Accepted Version
Available under License Spectrum Terms of Access.
934kB

Abstract

The rise of intelligent edge services has intensified the demand for scalable and privacy-preserving collaborative learning frameworks. Split Federated Learning (SFL), a hybrid paradigm that combines the layer-wise decoupling of Split Learning with the distributed aggregation of Federated Learning, offers an efficient training approach across heterogeneous devices. However, its scalability remains constrained by device heterogeneity and synchronization delays. This thesis proposes a novel Collaborative Split Federated Learning (CSFL) framework that facilitates real-time cooperative computation through direct device-to-device communication. At its core lies the Collaborative Relay Optimization Mechanism (CROM), in which efficient devices act as computational relays by executing intermediate model segments on behalf of bottleneck devices, thereby achieving balanced workload distribution. To minimize end-to-end training latency, we formulate a joint optimization problem over the model cut-layer and device pairing configuration. This problem is decomposed into two interdependent sub-tasks: cut-layer selection, addressed via a convergent alternating optimization strategy, and device pairing, modeled as a deferred-acceptance-based weighted matching game that aligns local utilities with global objectives. Extensive experiments on VGG-16 using the Tiny-ImageNet dataset under non-IID data partitions demonstrate that CSFL significantly reduces training latency and energy consumption while maintaining accuracy comparable to conventional SFL. Overall, this work advances collaborative edge learning by introducing a unified framework for system-level co-optimization, emphasizing the importance of algorithm-architecture codesign for future intelligent systems.

Divisions:Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering
Item Type:Thesis (Masters)
Authors:Gao, Haoran
Institution:Concordia University
Degree Name:M.A. Sc.
Program:Electrical and Computer Engineering
Date:11 August 2025
Thesis Supervisor(s):Cai, Jun and Okegbile, Samuel
ID Code:996006
Deposited By: Haoran Gao
Deposited On:04 Nov 2025 16:07
Last Modified:04 Nov 2025 16:07
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top