Show simple item record

Progressively Stacking Differentiable Architecture Search (PS-DARTs) forRecurrent Neural Networks (RNNs)

dc.contributor.advisorBiswas, Gautam
dc.contributor.advisorQuinones , Marcos Grueiro
dc.creatorDu, Yubo
dc.date.accessioned2022-01-10T16:46:59Z
dc.date.created2021-12
dc.date.issued2021-11-19
dc.date.submittedDecember 2021
dc.identifier.urihttp://hdl.handle.net/1803/16988
dc.description.abstractAccurate Multivariate Time Series (MTS) prediction supports a multitude of decision making tasks that impact our daily lives. However, current auto-regression-based approaches and deep learning models cannot deal with MTS that have multiple repetitive patterns. Inspired by the success of Differentiable Neural Architecture Search (DARTs), we propose a progressively stacking differential architecture search (PS-DARTs) to generate predictive models of MTS. Compared with DARTs, PS-DARTs extends its search space by extending the search space for the “optimal” architecture by including all activation functions, input components for each activation function, and decisions on whether to share the weights between two gates. This allows for many more architectures that can capture the dynamics of MTS more accurately. To avoid large increases in search time for the extended space of architectures, PS-DARTs conducts a sequential RNN node search. Compared with auto-regression-based approaches, deep-learning models, and DARTs, PS-DARTs achieves competitive or better results on various datasets with different repetitive patterns, in a similar search time as DARTs.
dc.format.mimetypeapplication/pdf
dc.language.isoen
dc.subjectNeural Architecture Search, Recurrent Neural Network
dc.titleProgressively Stacking Differentiable Architecture Search (PS-DARTs) forRecurrent Neural Networks (RNNs)
dc.typeThesis
dc.date.updated2022-01-10T16:46:59Z
dc.type.materialtext
thesis.degree.nameMS
thesis.degree.levelMasters
thesis.degree.disciplineComputer Science
thesis.degree.grantorVanderbilt University Graduate School
local.embargo.terms2022-12-01
local.embargo.lift2022-12-01
dc.creator.orcid0000-0002-9153-7318


Files in this item

Icon

This item appears in the following Collection(s)

Show simple item record