决策树算法和MAPREDUCE技术：综述

Bisma Bashir, Farheen Siddiqui
佳米雅综合大学

摘要

在当今时代，大数据和数据挖掘起着非常重要的作用。大数据可以是结构化的，也可以是非结构化的。
这种巨大的数据增长引发了处理这些数据的新技术和工具的开发。不同的算法被用来对大数据进行分类，但是基
于决策树的算法类别被认为是所有其他算法中最好的分类器。决策树算法实现起来简单快速。本文讨论了基于
MapReduce框架的基于决策树的算法。随着数据的增长，决策树算法有一些需要解决的局限性。MapReduce技术是
采用决策树算法进行大数据处理的最佳解决方案。

关键词

大数据；决策树算法；分类技术；ID3；C4.5；MapReduce

参考

[1] Patel, B., & Rana, K. (2014). A Survey on Decision

Tree Algorithm For Classification. IJEDR, 2(1).

[2] Cui, Y., Yang, Y., & Liao, S. (2014). PDTSSE:

A Scalable Parallel Decision Tree Algorithm Based on

MapReduce.

[3] Dai, W., & Ji, W. (2014). A Scalable Parallel Decision

Tree Algorithm Based on MapReduce. A Scalable Parallel

Decision Tree Algorithm Based On Mapreduce, 1, 49-60.

[4] Tiwari, A., & Athavale, V. (2012). A Survey on

Frequently Used Decision Tree Algorithm and There

Performance Analysis. International Journal Of Engineering

And Innovative Technology (IJEIT), 1(6).

[5] Lakshmi, T., Martin, A., Begum, R., & Venkatesan,

V. (2013). An Analysis on Performance of Decision Tree

Algorithms using Student’s Qualitative Data. I. J. Modern

Education And Computer Science, 5, 18-27.

[6] Chauhan, H., & Chauhan, A. (2014). Evaluating

Performance of Decision Tree Algorithms. International Journal

Of Scientific And Research Publications, 4(4).

[7] Yuan, F., Lian, F., Xu, X., & Ji, Z. (2015). Decision

Tree Algorithm Optimization Research Based on MapReduce.

[8] Evangeline, S., & Sudhasini, P. (2016). An

Introduction to Decision Tree algorithm on Various Field of

Applications. International Journal Of Digital Communication

And Networks (IJDCN), 3(3).

[9] Python), A., Python), A., & Team, A. (2017). A

Complete Tutorial on Tree Based Modeling from Scratch (in

R & Python). Analytics Vidhya. Retrieved from https://www.

analyticsvidhya.com/blog/2016/04/complete-tutorial-treebased-modeling-scratch-in-python/#one

[10] (2017). Retrieved from https://www.quora.com/Whatare-the-differences-between-ID3-C4-5-and-CART

[11] Decision Tree. (2017). Saedsayad.com. Retrieved

from http://www.saedsayad.com/decision_tree.htm

[12] Karim, M., & Rahman, R. (2017). Decision Tree and

Nave Bayes Algorithm for Classification and Generation of

Actionable Knowledge for Direct Marketing.

[13] "Mapreduce". En.wikipedia.org. N.p., 2017. Web. 4

Mar. 2017.

[14] What MapReduce can't do. (2017). Analyticbridge.

com. Retrieved from http://www.analyticbridge.com/profiles/

blogs/whatmapreduce-can-t-do

[15] Hadoop MapReduce. (2017). www.tutorialspoint.com.

Retrieved from https://www.tutorialspoint.com/hadoop/hadoop_

mapreduce.htm

[16] Bisma B. An Approach of MapReduce Programming

Model For Cloud Computing. International Journal of Advanced

Research in Computer Science, 8 (2), March 2017, 43-45

[17] 2017. Retrieved from https://www.google.co.in/serch

?q=fundamental+phases+of+mapreduce

[18] Sushant, S, N. Ashishkumar . International Journal of

Science and Research (IJSR) (2013),

[ 1 9 ] W e i , D . W e i , J . ( 2 0 1 4 ) . A M a p R e d u c e

implementation of C4.5 Decision Tree Algorithm. International

Journal of Database Theory and Application, Vol.7, No.1.

[20] Tianyi, Y. and Anne, H, H, N. Implementation

of Decision Tree Using Hadoop Map Reduce. (2016),

International Journal of Biomedical Data Mining. Volume 6

Issue 1