[2012.06743] Are We Ready For Learned Cardinality Estimation?

Cardinality estimation is a fundamental but long unresolved problem in query optimization. Recently, multiple papers from different research groups consistently report that learned models have the potential to replace existing cardinality estimators. In this paper, we ask a forward-thinking question: Are we ready to deploy these learned cardinality models in production? Our study consists of three main parts. Firstly, we focus on the static environment (i.e., no data updates) and compare five new learned methods with eight traditional methods on four real-world datasets under a unified workload setting. The results show that learned models are indeed more accurate than traditional methods, but they often suffer from high training and inference costs. Secondly, we explore whether these learned models are ready for dynamic environments (i.e., frequent data updates). We find that they cannot catch up with fast data up-dates and return large errors for different reasons. For less frequent

1 mentions: @Maxwell_110
Date:

Referring Tweets

@Maxwell_110
@Maxwell_110 DBMS の「cardinality estimation」 における ML model の実用性検証 📝 t.co/XR05zM4wLS データ更新有/無の環境下で,5 つの ML 手法を,学習・推論時間や精度の観点で MySQL 等の従来手法と比較 その結果,ML 手法の精度は高いものの,いくつかの理由で導入はまだ早いと結論づけている t.co/1h2iv7TqX3

Related Entries

[2103.04430v2] TransBTS: Multimodal Brain Tumor Segmentation Using Transformer
Read more [2103.04430v2] TransBTS: Multimodal Brain Tumor Segmentation Using Transformer
0 users, 1 mentions 2021/08/13 10:37
232 - Semantic Segmentation of BraTS2020 - Part 1 - Getting the data ready - YouTube
Read more 232 - Semantic Segmentation of BraTS2020 - Part 1 - Getting the data ready - YouTube
0 users, 1 mentions 2021/09/04 00:09
GitHub - tom-andersson/icenet-paper: Code associated with the paper 'Seasonal Arctic sea ice forecas...
Read more GitHub - tom-andersson/icenet-paper: Code associated with the paper 'Seasonal Arctic sea ice forecas...
0 users, 1 mentions 2021/09/04 01:37
[1604.02532] T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos
Read more [1604.02532] T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos
0 users, 1 mentions 2021/12/15 22:37
[1707.03897] ClustGeo: an R package for hierarchical clustering with spatial constraints
Read more [1707.03897] ClustGeo: an R package for hierarchical clustering with spatial constraints
0 users, 1 mentions 2022/04/26 22:37
GitHub - tidymodels/multilevelmod: Parsnip wrappers for mixed-level and hierarchical models
Read more GitHub - tidymodels/multilevelmod: Parsnip wrappers for mixed-level and hierarchical models
0 users, 1 mentions 2022/05/12 22:38

ML-Newsについて

機械学習の技術に関する情報は流速も早いし、分野も多様でキャッチアップが大変です。Twitterで機械学習用のリストを作っても、普段は機械学習以外の話題が多く流れており、効率的に情報収集するのは困難です。

ML-NewsはSNSを情報源とした機械学習に特化したニュースサイトです。機械学習に関する論文ブログライブラリコンペティション発表資料勉強会などの最新の情報を効率的に収集できます。

機械学習を応用した自然言語処理、画像認識、情報検索などの分野の情報や機械学習で必要になるデータ基盤やMLOpsの話題もカバーしています。
安定したサイト運営のためにGitHub sponsorを募集しています。

お知らせ

  • 2021/12/31: デザインを刷新しました
  • 2021/04/08: 日本語Kaggleのカテゴリを新設しました