Skip to main navigation Skip to search Skip to main content

Scalable and parallel machine learning algorithms for statistical data mining - Practice & experience

  • M. Riedel
  • , M. Goetz
  • , M. Richerzhagen
  • , P. Glock
  • , C. Bodenstein
  • , A. S. Memon
  • , M. S. Memon

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Many scientific datasets (e.g. earth sciences, medical sciences, etc.) increase with respect to their volume or in terms of their dimensions due to the ever increasing quality of measurement devices. This contribution will specifically focus on how these datasets can take advantage of new 'big data' technologies and frameworks that often are based on parallelization methods. Lessons learned with medical and earth science data applications that require parallel clustering and classification techniques such as support vector machines (SVMs) and density-based spatial clustering of applications with noise (DBSCAN) are a substantial part of the contribution. In addition, selected experiences of related 'big data' approaches and concrete mining techniques (e.g. dimensionality reduction, feature selection, and extraction methods) will be addressed too. In order to overcome identified challenges, we outline an architecture framework design that we implement with open available tools in order to enable scalable and parallel machine learning applications in distributed systems.

Original languageEnglish
Title of host publication2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2015 - Proceedings
EditorsVlado Sruk, Zeljko Butkovic, Boris Vrdoljak, Andrej Sokolic, Stjepan Gros, Petar Biljanovic, Karolj Skala, Slobodan Ribaric, Branko Mikac, Marina Cicin-Sain, Mladen Mauher
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages204-209
Number of pages6
ISBN (Electronic)9789532330854
DOIs
Publication statusPublished - 15 Jul 2015
Event38th International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2015 - Opatija, Croatia
Duration: 25 May 2015 → 29 May 2015

Publication series

Name2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2015 - Proceedings

Conference

Conference38th International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2015
Country/TerritoryCroatia
CityOpatija
Period25/05/15 → 29/05/15

Bibliographical note

Funding Information: This project was supported by grants from the National Institute of Diabetes and Digestive and Kidney Diseases (Mayo Clinic O’Brien Urology Research Center, DK100227 and DK83007) and made possible by the Rochester Epidemiology Project (AG034676) and the National Center for Advancing Translational Sciences (UL1 TR002377) from the National Institutes of Health, US Public Health Service. Publisher Copyright: © 2015 MIPRO.

Fingerprint

Dive into the research topics of 'Scalable and parallel machine learning algorithms for statistical data mining - Practice & experience'. Together they form a unique fingerprint.

Cite this