Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
Automated Machine Learning for Predicting Trends in Time Series Data
Recently, a hybrid Deep Neural Network (DNN) algorithm, TreNet was proposed for predicting trends in time series data. While TreNet was shown to have superior performance to a number of alternative approaches, the validation method used did not take into account the sequential nature of time series...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Department of Computer Science
2022
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867614422907748352 |
|---|---|
| access_status_str | Open Access |
| author | Kouassi, Kouame |
| author2 | Moodley, Deshen |
| author_browse | Kouassi, Kouame Moodley, Deshen |
| author_facet | Moodley, Deshen Kouassi, Kouame |
| author_sort | Kouassi, Kouame |
| collection | Thesis |
| description | Recently, a hybrid Deep Neural Network (DNN) algorithm, TreNet was proposed for predicting trends in time series data. While TreNet was shown to have superior performance to a number of alternative approaches, the validation method used did not take into account the sequential nature of time series data. It also did not deal with model update and model stability, which are important for real-world applications. Furthermore, in the TreNet paper and previous trend prediction research, the Algorithm Selection and Hyperparameter Optimisation (ASHO) is performed manually. However, manual ASHO is expensive and often results in a sub-optimal or mediocre model because it needs extensive experimentation as well as domain specific and Machine Learning (ML) expert knowledge. This dissertation replicates TreNet experiments on the same datasets using a walk-forward validation method, which includes model update. The model is tested over multiple independent runs to evaluate model stability. TreNet, which takes in both raw point data and trend line features, is compared to vanilla DNNs and traditional ML algorithms that take in raw point data features. A recent Automated Machine Learning (AutoML) namely the hybrid Bayesian optimisation and hyperband (BOHB) framework is implemented and evaluated for ASHO. The AutoML models are then compared to the manually tuned models. The results show that in general TreNet still performs better than the vanilla DNN, but not on all datasets as reported in the original TreNet paper. On non-stationary datasets, traditional ML models outperform DNN models. The AutoML experiments found optimal configurations that produced models that surpass or compare well against the average performance and stability levels of configurations found during the experiments with manual tuning for ASHO across four datasets. This work highlights the importance of using an appropriate validation method and evaluating model stability while developing and testing ML models for time series applications. It also demonstrates that AutoML techniques such as BOHB are effective to automatically finding a well-performing models for predicting trends in time series data, thus making ML model development more systematic and less error-prone. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/35744 |
| institution | University of Cape Town (South Africa) |
| language | eng |
| last_indexed | 2026-06-10T12:51:48.077Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2022 |
| publishDateRange | 2022 |
| publishDateSort | 2022 |
| publisher | Department of Computer Science |
| publisherStr | Department of Computer Science |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/35744 Automated Machine Learning for Predicting Trends in Time Series Data Kouassi, Kouame Moodley, Deshen Computer Science Recently, a hybrid Deep Neural Network (DNN) algorithm, TreNet was proposed for predicting trends in time series data. While TreNet was shown to have superior performance to a number of alternative approaches, the validation method used did not take into account the sequential nature of time series data. It also did not deal with model update and model stability, which are important for real-world applications. Furthermore, in the TreNet paper and previous trend prediction research, the Algorithm Selection and Hyperparameter Optimisation (ASHO) is performed manually. However, manual ASHO is expensive and often results in a sub-optimal or mediocre model because it needs extensive experimentation as well as domain specific and Machine Learning (ML) expert knowledge. This dissertation replicates TreNet experiments on the same datasets using a walk-forward validation method, which includes model update. The model is tested over multiple independent runs to evaluate model stability. TreNet, which takes in both raw point data and trend line features, is compared to vanilla DNNs and traditional ML algorithms that take in raw point data features. A recent Automated Machine Learning (AutoML) namely the hybrid Bayesian optimisation and hyperband (BOHB) framework is implemented and evaluated for ASHO. The AutoML models are then compared to the manually tuned models. The results show that in general TreNet still performs better than the vanilla DNN, but not on all datasets as reported in the original TreNet paper. On non-stationary datasets, traditional ML models outperform DNN models. The AutoML experiments found optimal configurations that produced models that surpass or compare well against the average performance and stability levels of configurations found during the experiments with manual tuning for ASHO across four datasets. This work highlights the importance of using an appropriate validation method and evaluating model stability while developing and testing ML models for time series applications. It also demonstrates that AutoML techniques such as BOHB are effective to automatically finding a well-performing models for predicting trends in time series data, thus making ML model development more systematic and less error-prone. 2022-02-18T08:58:08Z 2022-02-18T08:58:08Z 2021 2022-02-17T07:36:08Z Master Thesis Masters MSc http://hdl.handle.net/11427/35744 eng application/pdf Department of Computer Science Faculty of Science |
| spellingShingle | Computer Science Kouassi, Kouame Automated Machine Learning for Predicting Trends in Time Series Data |
| thesis_degree_str | Master's |
| title | Automated Machine Learning for Predicting Trends in Time Series Data |
| title_full | Automated Machine Learning for Predicting Trends in Time Series Data |
| title_fullStr | Automated Machine Learning for Predicting Trends in Time Series Data |
| title_full_unstemmed | Automated Machine Learning for Predicting Trends in Time Series Data |
| title_short | Automated Machine Learning for Predicting Trends in Time Series Data |
| title_sort | automated machine learning for predicting trends in time series data |
| topic | Computer Science |
| url | http://hdl.handle.net/11427/35744 |
| work_keys_str_mv | AT kouassikouame automatedmachinelearningforpredictingtrendsintimeseriesdata |