Optimal transportation scheduling is crucial to improve the performance of the panelized construction supply chain. Previous studies lack transportation scheduling approaches for distribution and reverse logistics in panelized construction as a bridge to balance factory and site operations. To address the current gaps, this research proposes a genetic algorithm-based optimization framework to generate optimal distribution and reverse transportation schedules and on-site unloading schedules, considering a diverse transportation fleet (trucks and trailers), multiple sites, multiple panel types, on-site parking limitations, and assembly sequence while ensuring continuity of factory production and on-site operations. The proposed model extends and improves the existing transportation models by considering the distribution and reverse transportation operations and introducing design constraints in the transportation practices of the panelized construction. Results demonstrated that the method achieves transportation fleet efficiency of 98.8% and ensures seamless on-site operations, offering an invaluable planning tool for project managers and enhancing resource allocation for factory and construction sites.