Document Type
Article
Journal/Book Title/Conference
Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing
Publisher
Association for Computing Machinery
Publication Date
5-6-2022
First Page
372
Last Page
380
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 4.0 License.
Abstract
With the increasing workload complexity in modern databases, the manual process of index selection is a challenging task. There is a growing need for a database with an ability to learn and adapt to evolving workloads. This paper proposes Indexer++, an autonomous, workload-aware, online index tuner. Unlike existing approaches, Indexer++ imposes low overhead on the DBMS, is responsive to changes in query workloads and swiftly selects indexes. Our approach uses a combination of text analytic techniques and reinforcement learning. Indexer++ consist of two phases: Phase (i) learns workload trends using a novel trend detection technique based on a pre-trained transformer model. Phase (ii) performs online, i.e., continuous or while the DBMS is processing workloads, index selection using a novel online deep reinforcement learning technique using our proposed priority experience sweeping. This paper provides an experimental evaluation of Indexer++ in multiple scenarios using benchmark (TPC-H) and real-world datasets (IMDB). In our experiments, Indexer++ effectively identifies changes in workload trends and selects the set of optimal indexes.
Recommended Citation
Vishal Sharma and Curtis Dyreson. 2022. Indexer++: Workload-Aware Online Index Tuning with Transformers and Reinforcement Learning. In The 37th ACM/SIGAPP Symposium on Applied Computing (SAC ’22), April 25–29, 2022, Virtual Event, . ACM, New York, NY, USA, 9 pages. https://doi.org/10.1145/3477314.3507691