Login | Register

A new algorithm to split and merge ultra-high resolution 3D images

Title:

A new algorithm to split and merge ultra-high resolution 3D images

Gao, Yongping (2017) A new algorithm to split and merge ultra-high resolution 3D images. Masters thesis, Concordia University.

[img]
Preview
Text (application/pdf)
Gao_MCompSc_S2018.pdf - Accepted Version
3MB

Abstract

Splitting and merging ultra-high resolution 3D images is a requirement for parallel or distributed processing operations. Naive algorithms to split and merge 3D blocks from ultra-high resolution images perform very poorly, due to the number of seeks required to reconstruct spatially-adjacent blocks from linear data organizations on disk. The current solution to deal with this problem is to use file formats that preserve spatial proximity on disk, but this comes with additional complexity. We introduce a new algorithm called Multiple reads/writes to split and merge ultra-high resolution 3D images efficiently from simple file formats. Multiple reads/writes only access contiguous bytes in the reconstructed image, which leads to substantial performance improvements compared to existing algorithms. We parallelize our algorithm using multi-threading, which further improves the performance for data stored on a Hadoop cluster. We also show that on-the-fly lossless compression with the lz4 algorithm reduces the split and merge time further.

Divisions:Concordia University > Gina Cody School of Engineering and Computer Science > Computer Science and Software Engineering
Item Type:Thesis (Masters)
Authors:Gao, Yongping
Institution:Concordia University
Degree Name:M. Comp. Sc.
Program:Computer Science
Date:20 December 2017
Thesis Supervisor(s):Glatard, Tristan and Yan, Yuhong
ID Code:983338
Deposited By: YONGPING GAO
Deposited On:11 Jun 2018 03:40
Last Modified:11 Jun 2018 03:40
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Back to top Back to top