Processing Intensive Full-Waveform Aerial Laser Scanning Matlab Jobs through Condor
Internet of Things and Cloud Computing
Volume 1, Issue 1, June 2013, Pages: 5-14
Received: Jun. 23, 2013; Published: Aug. 10, 2013
Views 3427      Downloads 148
Author
Fanar Mansour Abed, Surveying Engineering Department, College of Engineering, University of Baghdad, Baghdad, Iraq
Article Tools
PDF
Follow on us
Abstract
Full-waveform aerial laser scanning is a laser system that records the entire backscattered signal of the laser pulse and stores it in the system recorder for post-processing. Capturing the complete waveform of the backscatter signal enables distinguishing between neighborhood echoes of a range smaller than the pulse length. Full-waveform has shown potential to better describe land cover features through the additional physical information it can provide alongside the standard geometric information. To fully utilize full-waveform for enhanced object recognition and feature extraction, it is essential to develop an automatic and effective routine to manage and process full-waveform datasets in a manner which requires less human effort and reduces time needed to process large laser datasets efficiently. This research tackled this problem through introducing a novel processing strategy for full-waveform data based on a developed pulse detection methodto run through Matlab environment. The solution adopted a grid computing Condor-based approach, which showed significant potential to reduce the time and effort needed to process large datasets such as full-waveform aerial laser scanning to more than 300% in specific conditions.
Keywords
Laser Scanning, Lidar, Full-Waveform, Signal Analysis, Grid Computing, Condor
To cite this article
Fanar Mansour Abed, Processing Intensive Full-Waveform Aerial Laser Scanning Matlab Jobs through Condor, Internet of Things and Cloud Computing. Vol. 1, No. 1, 2013, pp. 5-14. doi: 10.11648/j.iotcc.20130101.12
References
[1]
F. Ackermann, (1999), 'Airborne laser scanning- present status and future expectations', ISPRS Journal of Photogrammetry and Remote Sensing, 54 (2-3), pp. 64-67.
[2]
C. Mallet, and F. Bretar, (2009), 'Full-waveform topographic lidar: State-of-the-art', ISPRS Journal of Photogrammetry and Remote Sensing, 64 (1), 16 p.
[3]
G. Vosselman, and H.-G. Maas, (2010), Airborne and terrestrial laser scanning. Scotland, UK: Whittles Publishing.
[4]
J. Shan, and C. K. Toth, (2009), Topographic laser ranging and scanning - principles and processing. FL, USA: Taylor & Francis.
[5]
B. Jutzi, and U. Stilla, (2006), 'Range determination with waveform recording laser systems using a Wiener Filter', ISPRS Journal of Photogrammetry and Remote sensing, 61 (2), pp. 95–107.
[6]
F. Bretar, A. Chauve, J.-S Bailly, C. Mallet, and A. Jacome, (2009), 'Terrain surfaces and 3-D landcover classification from small footprint full-waveform lidar data: application to badlands', Hydrology and Earth System Sciences, 13 (8), pp. 1531-1545.
[7]
Lin, Y.-C., Mills, J. P. and Smith-Voysey, S. (2010), 'Rigorous pulse detection from full-waveform airborne laser scanning data', International Journal of Remote Sensing, 31 (5), pp. 1303-1324.
[8]
C. Mallet, F. Bretar, M. Roux, U. Soergel, and C. Heipke, (2011), 'Relevance assessment of full-waveform lidar data for urban area classification', ISPRS Journal of Photogrammetry and Remote Sensing, 66 (6), pp. S71-S84.
[9]
M. Doneus, C. Briese, M. Fera, and M. Janner, (2008), 'Archaeological prospection of forested areas using full-waveform airborne laser scanning', Journal of Archaeological Science, 35 (4), pp. 882-893.
[10]
Y.-C Lin, J. Mills, and S. Smith-Voysey, (2008), 'Detection of weak and overlapping pulses from waveform airborne laser scanning data', In: Hill, R., Suárez, J. & Rosette, J. (Eds.), Proceedings of SilviLaser 2008, Edinburgh, United Kingdom, 10 p.
[11]
W. Mücke, (2008), Analysis of full-waveform airborne laser scanning data for the improvement of DTM generation. Master thesis.Vienna University of Technology, 67 p.
[12]
W. Wagner, A. Ullrich, V. Ducic, T. Melzer, and N. Studnicka, (2006), 'Gaussian decomposition and calibration of a novel small-footprint full-waveform digitizing airborne laser scanner', ISPRS Journal of Photogrammetry and Remote Sensing, 60 (2), pp. 100–112.
[13]
Y.-C Lin, (2009), Digital terrain modelling from small-footprint, full-waveform airborne laser scanning data. PhD thesis.Newcastle University, 205 p.
[14]
W. Wagner, A. Roncat, T. Melzer, and A. Ullrich, (2007), 'Waveform analysis techniques in airborne laser scanning', International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36 (3/W52), pp. 413-418.
[15]
G. Mandlburger, C. Briese, and N. Pfeifer, (2007), 'Progress in lidar sensor technology-chance and challenge for DTM generation and data administration', In: Proceedings of The 51st Photogrammetric Week. Stuttgart, Germany, pp. 159-169.
[16]
M. Doneus, and C. Briese, (2006), 'Digital terrain modelling for archaeological interpretation within forested areas using full-waveform lasers canning', In: Proceedings of The 7th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST2006). Nicosia, Cyprus, pp. 155-162.
[17]
Y.-C. Lin, and J. P. Mills, (2009), 'Integration of full-waveform information into the airborne laser scanning data filtering process', International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38 (3/W8), pp. 224-229.
[18]
A. Chauve, F. Bretar, S. Durrieu, M. Pierrot-Deseilligny, and W. Puech, (2009), 'FullAnalyze: A research tool for handling, processing and analysing Full-waveform Lidar data', In: Proceedings of Geoscience and Remote Sensing Symposium, 2009 IEEE International, IGARSS 200,, Cape Town, South Africa, pp. 841-844.
[19]
X. Guan, and H. Wu, (2010), 'Leveraging the power of multi-core platforms for large-scale geospatial data processing: Exemplified by generating DEM from massive lidar point clouds', Computers and Geosciences, 36 (10), pp. 1276-1282.
[20]
S. McGough, P. Robinson, C. Gerrard, P. Haldane, S. Hamlander, D. Sharples, D. Swan, and S. Wheater, (2010), 'Intelligent power management over large clusters ', In: Proceedings of Green Computing and Communications (Green Com 2010). Hangzhou, China, 8 p. :On CD-ROM.
[21]
S. McGough, (2011), 'Parallel computing, myths and truths', Available at: https://researchtools.ncl.ac.uk/portal/site/!gateway/page/!gateway-100 (Accessed: 24 Nov 2011).
[22]
G. Mandlburger, J. Otepka, W. Karel, W. Wagner, and N. Pfeifer, (2009), 'Orientation and processing of airborne laser scanning data (OPALS) - concept and first results of a comprehensive ALS software', International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38 (3/W8), pp. 55-60.
[23]
G. Mandlburger, N. Pfeifer, C. Ressl, C. Briese, A. Roncat, H. Lehner, and W. Mücke, (2010), 'Algorithms and tools for airborne lidar data processing from a scientific perspective', In: Proceedings of The European Lidar Mapping Forum (ELMF) 2010. Hague/ Netherlands: On CD-ROM.
[24]
OPALS (2009), Orientation and processing of airborne laser scanning data. Available at: http://www.ipf.tuwien.ac.at/opals/opals_docu/index.html (Accessed: 18 Sep 2009).
[25]
FullAnalyze (2009), Open source lidar software. Available at: http://code.google.com/p/fullanalyze/ (Accessed: 16 Dec 2009).
[26]
Terrasolid. (2008), 'TerraScan User's Guid ', Available at: http://www.terrasolid.fi/en/users_guide/terrascan_users_guide (Accessed: 03 Feb 2009).
[27]
Riegl. (2008), 'RiAnalyze 560 for Full Waveform Analysis user Manual', Available at: http://www.riegl.com/index.php?id=231 (Accessed: 4 March 2009).
[28]
R. Raman, M. Livny, and M. Solomon, (1998), 'Matchmaking: Distributed resource management for high throughput computing', In: Proceedings of The 7th IEEE International symposium on high performance distributed computing. Chicago, USA, 7p.
[29]
Y. S. Dai, M. Xie, and K. L. Poh, (2002), 'Reliability analysis of grid computing systems', In: Proceedings of the 2002 Pacific Rim International Symposium on Dependable Computing. Tsukuba-City, Ibarski, Japan, pp. 97-104.
[30]
F. Dong, and S. G. Akl, (2006), 'Scheduling algorithms for grid computing: State of the art and open problems', School of computing, Queen's University, Ontario, Canada, 55p.
[31]
Condor (1988), Condor Team. Available at: http://www.cs.wisc.edu/condor/ (Accessed: 15 Oct 2009).
[32]
M. Litzkow, M. Livny, and M. Mutka, (1988), 'Condor - A hunter of idle workstations', In: Proceedings of The 8th International Conference on Distributed Computing Systems. San Jose, California, USA, IEEE-CS, pp. 104-111.
[33]
J. Dean, and S. Ghemawat, (2008), 'Map Reducer: simplified data processing on large clusters', Communications of the ACM,51 (1), pp. 107-113.
[34]
D. Thain, T. Tannenbaum, and M. Livny, (2005), 'Distributed computing in practice: The Condor experience', Concurrency and computation: practice and experience, 17 (2-4), pp. 323-356.
[35]
F. M. Abed, and S. McGough, (2010), 'Processing data intensive Matlab jobs through Condor', In: Proceedings of All Hands Meeting 2010. Cardiff, Wales, UK:On CD-ROM.
[36]
J. Blythe, E. Deelman, Y. Gil, and C. Kesselman, (2003), 'Transport grid computing: a knowledge-based approach', In: Proceedings of The fifth Innovative Applications of Artificial Intelligence conference (IAAI-03). Acapulco, Mexico, 8 p.
[37]
W. Elwasif, J. Plank, and R. Wolski, (2001), 'Data staging effects in wide area task framing applications', In: Proceedings of IEEE ISCC and the Grid Brisbane, Australia, 9 p.
[38]
T. Lindholm, and F. Yellin, (1999), Java virtual machine specification.2nd Ed. Boston, MA, USA Addison-Wesley Longman.
ADDRESS
Science Publishing Group
1 Rockefeller Plaza,
10th and 11th Floors,
New York, NY 10020
U.S.A.
Tel: (001)347-983-5186