CDFMR: A Distributed Statistical Analysis of Stock Market Data using MapReduce with Cumulative Distribution Function
| dc.contributor.author | Dahiphale, Devendra | |
| dc.contributor.author | Wadkar, Abhijeet | |
| dc.contributor.author | Joshi, Karuna | |
| dc.date.accessioned | 2023-07-21T20:06:00Z | |
| dc.date.available | 2023-07-21T20:06:00Z | |
| dc.date.issued | 2023-08-010 | |
| dc.description | IEEE CLOUD Summit Conference 2023, July 2023 | en_US |
| dc.description.abstract | The stock market generates massive data daily on top of a deluge of historical data. Investors and traders look to stock market data analysis for assurance in their investments, a prime indicator of our global economy. This has led to immense popularity in the topic, and consequently, much research has been done on stock market predictions and future trends. However, due to the relatively slow electronic trading systems and order processing times, the velocity of data, the variety of data, and social factors, there is a need for gaining speed, control, and continuity in data processing (real-time stream processing) considering the amount of data that is being produced daily. Unfortunately, processing this massive amount of data on a single node is inefficient, time-consuming, and unsuitable for real-time processing. Recently, there have been many advancements in Big Data processing technologies such as Hadoop, Cloud MapReduce, and HBase. This paper proposes a MapReduce algorithm for statistical stock market analysis with a Cumulative Distribution Function (CDF). We also highlight the challenges we faced during this work and their solutions. We further showcase how our algorithm is spanned across multiple functions, which are run using multiple MapReduce jobs in a cascaded fashion. | en_US |
| dc.description.uri | https://ieeexplore.ieee.org/document/10207204 | en_US |
| dc.format.extent | 8 pages | en_US |
| dc.genre | conference papers and proceedings | en_US |
| dc.genre | preprints | en_US |
| dc.identifier | doi:10.13016/m2e2ne-7ab2 | |
| dc.identifier.citation | D. Dahiphale, A. Wadkar and K. P. Joshi, "CDFMR: A Distributed Statistical Analysis of Stock Market Data using MapReduce with Cumulative Distribution Function," 2023 IEEE Cloud Summit, Baltimore, MD, USA, 2023, pp. 76-83, doi: 10.1109/CloudSummit57601.2023.00019. | |
| dc.identifier.uri | http://hdl.handle.net/11603/28821 | |
| dc.identifier.uri | https://doi.org/10.1109/CloudSummit57601.2023.00019 | |
| dc.language.iso | en_US | en_US |
| dc.publisher | IEEE | |
| dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
| dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
| dc.relation.ispartof | UMBC Faculty Collection | |
| dc.relation.ispartof | UMBC Student Collection | |
| dc.relation.ispartof | UMBC Information Systems Department | |
| dc.relation.ispartof | UMBC Center for Accelerated Real Time Analysis | |
| dc.rights | © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | |
| dc.subject | UMBC Ebiquity Research Group | |
| dc.title | CDFMR: A Distributed Statistical Analysis of Stock Market Data using MapReduce with Cumulative Distribution Function | en_US |
| dc.type | Text | en_US |
| dcterms.creator | https://orcid.org/0000-0002-3200-4933 | en_US |
| dcterms.creator | https://orcid.org/0000-0002-6354-1686 | en_US |