• About
    • Login
    View Item 
    •   Institutional Repository Home
    • Electronic Theses and Dissertations
    • Electronic Theses and Dissertations
    • View Item
    •   Institutional Repository Home
    • Electronic Theses and Dissertations
    • Electronic Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Browse

    All of Institutional RepositoryCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsDepartmentThis CollectionBy Issue DateAuthorsTitlesSubjectsDepartment

    My Account

    LoginRegister

    Algorithms and Techniques for Automated Deployment and Efficient Management of Large-Scale Distributed Data Analytics Services

    Bhattacharjee, Anirban
    0000-0003-0184-7759
    : https://ir.vanderbilt.edu/xmlui/handle/1803/9849
    : 2020-02-20

    Abstract

    The advent of the Internet of Things (IoT) has enabled smart applications, which provides near real-time and robust predictive data analytics. The backbone of these predictive analytics services is an underlying machine learning (ML) model. Multiple challenges manifest themselves in the context of automated deployment and efficient management of predictive analytics services across the cloud-edge spectrum. First, the development and evaluation of ML models require substantial expertise. Second, provisioning these ML-based data analytics applications often incurs complex deployment and configuration challenges due to handling of diverse ML libraries and frameworks, and incorporating a range of hardware and cloud platforms. Third, to handle the dynamic workload of the prediction requests, the resources need to scale up or down to minimize the operational cost while guaranteeing the Service Level Objective(SLO) of prediction tasks. Fourth, the accuracy of the ML model may degrade over time as new data arrives, which requires continuous model re-training. Model update tasks can be performed along with the background latency-critical tasks on the edge devices. However, this should not hamper the SLO of latency-critical jobs. To address these challenges, this doctoral research makes the following contributions: First, it defines a model-driven, template-based design for the rapid development of machine learning models. Second, it presents an automated service provisioning technique that enables the rapid and agile deployment of application components across the cloud-fog-edge spectrum with minimal domain expertise. Third, it describes our novel algorithms to proactively and dynamically scale the predictive analytics application components to minimize execution time according to the Service Level Objectives (SLO) while optimizing resource usage under variable workloads. Finally, it details a scalable and efficient framework for continual ML, particularly, Deep Learning-based model re-training on heterogeneous edge. The framework minimizes the DL model update time, while guarantees the SLO of the background latency-sensitive jobs.
    Show full item record

    Files in this item

    Thumbnail
    Name:
    BHATTACHARJEE-DISSERTATION-2020.pdf
    Size:
    6.843Mb
    Format:
    PDF
    View/Open
    Name:
    AnirbanThesis.zip
    Size:
    14.47Mb
    Format:
    application/
    View/Open

    This item appears in the following collection(s):

    • Electronic Theses and Dissertations

    Connect with Vanderbilt Libraries

    Your Vanderbilt

    • Alumni
    • Current Students
    • Faculty & Staff
    • International Students
    • Media
    • Parents & Family
    • Prospective Students
    • Researchers
    • Sports Fans
    • Visitors & Neighbors

    Support the Jean and Alexander Heard Libraries

    Support the Library...Give Now

    Gifts to the Libraries support the learning and research needs of the entire Vanderbilt community. Learn more about giving to the Libraries.

    Become a Friend of the Libraries

    Quick Links

    • Hours
    • About
    • Employment
    • Staff Directory
    • Accessibility Services
    • Contact
    • Vanderbilt Home
    • Privacy Policy