The Efficient Implementation of Distributed Indexing with Hadoop for Digital Investigations on Big Data
- Pukyong National University
Busan, Republic of Korea
{taeri, khrhee, shinsu}@pknu.ac.kr - Kongju National University
Gongju, Republic of Korea
hyejoo2010@gmail.com
Abstract
Big Data brings new challenges to the field of e-Discovery or digital forensics and these challenges are mostly connected to the various methods for data processing. Considering that the most important factors are time and cost in determining success or failure of digital investigation, the development of a valid indexing method for efficient search should come first to more quickly and accurately find relevant evidence from Big Data. This paper, therefore, introduces a Distributed Text Processing System based on Hadoop called DTPS and explains about the distinctions between DTPS and other related researches to emphasize the necessity of it. In addition, this paper describes various experimental results in order to find the best implementation strategy in using Hadoop MapReduce for the distributed indexing and to analyze the worth for practical use of DTPS by comparative evaluation of its performance with similar tools. To be short, the ultimate purpose of this research is the development of useful search engine specially aimed at Big Data indexing as a major part for the future e-Discovery cloud service.
Key words
Electronic Discovery, e-Discovery, Digital Forensics, Evidence Search, Indexing Performance, Hadoop MapReduce, Distributed Indexing
Digital Object Identifier (DOI)
https://doi.org/10.2298/CSIS130920063L
Publication information
Volume 11, Issue 3 (August 2014)
Special Issue on Mobile Collaboration Technologies and Internet Services
Year of Publication: 2014
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium
Full text
Available in PDF
Portable Document Format
How to cite
Lee, T., Lee, H., Rhee, K., Shin, S. U.: The Efficient Implementation of Distributed Indexing with Hadoop for Digital Investigations on Big Data. Computer Science and Information Systems, Vol. 11, No. 3, 1037–1054. (2014), https://doi.org/10.2298/CSIS130920063L