Loading…
Apache: Big Data 2016 has ended
Register Now or Visit the Website for more Information 
Back To Schedule
Tuesday, May 10 • 2:00pm - 2:50pm
On the Fly Retraining of Predictive Analytical Models Using Spark Streaming: An Equity-price Direction Prediction Case Study - Tijl Carpels, Ghent University

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
FinTech companies are facing the challenge of predicting the direction of equity prices. During this study we have used algorithms provided in Spark Mllib to address this problem. Due to the characteristics of the equity market this happens in a streaming environment requiring us to continuously monitor the performance of the predictive model. When the performance drops below a certain threshold we trigger a batch training of the model. We made a proof of concept using different open-source tools. (Apache Spark and Spark-notebook)
Speakers
avatar for Tijl Carpels

Tijl Carpels

Doctoral Researcher - Data Scientist, Ghent University
Tijl Carpels received his M.Sc. degree in Business Engineering (major: Finance) in 2015 after writing a dissertation in the field of fraud prediction. Afterwards he accepted a research position at Ghent University in order to pursue a PhD in Data Analytics at the Faculty of Economics... Read More →

On the Fly Retraining of Predictive Analytical Models Using Spark Streaming pdf
Tuesday May 10, 2016 2:00pm - 2:50pm PDT
Plaza C
  Spark, Intermediate

Attendees (31)