Skip to main content

Advertisement

Log in

Managing email overload with an automatic nonparametric clustering system

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Email overload is a recent problem that there is increasingly difficulty that people have to process the large number of emails received daily. Currently, this problem becomes more and more serious and it has already affected the normal usage of email as a knowledge management tool. It has been recognized that categorizing emails into meaningful groups can greatly save cognitive load to process emails, and thus this is an effective way to manage the email overload problem. However, most current approaches still require significant human input for categorizing emails. In this paper, we develop an automatic email clustering system, underpinned by a new nonparametric text clustering algorithm. This system does not require any predefined input parameters and can automatically generate meaningful email clusters. The evaluation shows our new algorithm outperforms existing text clustering algorithms with higher efficiency and quality in terms of computational time and clustering quality measured by different gauges. The experimental results also well match the labeled human clustering results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aldenderfer MS, Blashfield RK (1984) Cluster analysis. Sage Publications, Thousand Oaks

    Google Scholar 

  2. Baeza-Yates R, Ribeiro-Neto B (1999) Modern information retrieval. Addison-Wesley, Reading

    Google Scholar 

  3. Baker FB, Hubert LJ (1975) Measuring the power of hierarchical cluster analysis. J Am Stat Assoc 70(349):31–38

    Article  MATH  Google Scholar 

  4. Bradley P, Fayyad U (1998) Refining initial points for K-means clustering. In: 5th international conference on machine learning, 1998, pp 91–99

  5. Chen M-S, Han J, Yu PS (1996) Data mining: an overview from a database perspective. IEEE Trans Knowl Data Eng 8(6):866–883

    Article  Google Scholar 

  6. Chuang S-L, Chien L-F (2002) Towards automatic generation of query taxonomy: a hierarchical query clustering approach. In: Second IEEE international conference on data mining, 2002, p 75

  7. Denning P (2002) The profession of IT. Commun ACM 45(3):15–18

    Google Scholar 

  8. Huang S, Chen Z, Yu Y, Ma W-Y (2006) Multitype features coselection for Web document clustering. IEEE Trans Knowl Data Eng 18(4):448–459

    Article  Google Scholar 

  9. Huang Y, Mitchell TM (2006) Text clustering with extended user feedback. In: 29th international ACM SIGIR conference on research and development in information retrieval, 2006, pp 413–420

  10. IDC (2005) IDC examines the future of email as it navigates security threats, compliance requirements, and market alternatives. http://www.idc.com/getdoc.jsp?containerId=prUS20033705, 2005

  11. Kushmerick N, Lau T (2005) Automated e-mail activity management: an unsupervised learning approach. In: 10th international conference on intelligent user interfaces, 2005, pp 67–74

  12. Larsen B, Aone C (1999) Fast and effective text mining using linear-time document clustering. In: ACM SIGKDD 5th international conference on knowledge discovery and data mining, 1999, pp 16–22

  13. Mock K (2001) An experimental framework for email categorization and management. In: 24th ACM international conference on research and development in information retrieval, 2001, pp 392–393

  14. Payne T, Edwards P (1997) Interface agents that learn: an investigation of learning issues in a mail interface. Appl Artif Intell 11(1):1–32

    Article  Google Scholar 

  15. Roussinov DG, Chen H (1999) Document clustering for electronic meetings: an experimental comparison of two techniques. Decis Support Syst 27(1–2):67–79

    Article  Google Scholar 

  16. Roussinov DG, Zhao JL (2003) Automatic discovery of similarity relationships through Web mining. Decis Support Syst 35(1):149–166

    Article  Google Scholar 

  17. Sasaki M, Shinnou H (2005) Spam detection using text clustering. In: International conference on cyberworlds, 2005, p 4

  18. Schuff D, Turetken O, D’Arcy J (2006) A multi-attribute, multi-weight clustering approach to managing “E-mail overload”. Decis Support Syst 42(3):1350–1365

    Article  Google Scholar 

  19. Schuff D, Turetken O, D’Arcy J, Croson D (2007) Managing e-mail overload: solutions and future challenges. IEEE Comput 40(2):31–36

    Google Scholar 

  20. Schultze U, Vandenbosch B (1998) Information overload in a groupware environment: now you see it, now you don’t. J Organ Comput Electron Commer 8(2):127–148

    Google Scholar 

  21. Tabachnick BG, Fidell LS (1996) Using multivariate statistics. Harper Collins College Publishers, New York

    Google Scholar 

  22. Whittaker S, Sidner C (1996) Email overload: exploring personal information management of email. In: ACM SIGCHI conference on human factors in computing systems, 1996, pp 276–283

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yang Xiang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xiang, Y. Managing email overload with an automatic nonparametric clustering system. J Supercomput 48, 227–242 (2009). https://doi.org/10.1007/s11227-008-0216-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-008-0216-y

Keywords

Navigation