Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

system.data_skipping_indices table for data skipping indices #7659

Closed
ifoo opened this issue Nov 6, 2019 · 2 comments · Fixed by #25693
Closed

system.data_skipping_indices table for data skipping indices #7659

ifoo opened this issue Nov 6, 2019 · 2 comments · Fixed by #25693
Labels
comp-skipidx Data skipping indices easy task Good for first contributors feature st-community-taken External developer is working on that

Comments

@ifoo
Copy link

ifoo commented Nov 6, 2019

Currently the only way to get information about existing data skipping indices is via the create_table_query field of the system.tables table (or from the metadata/ directory on the filesystem). Both of them are not easy to parse and are therefore not useful for automated processing.

I'd like to propose a system.* table dedicated to data skipping indices, similar to system.columns.

I would like to see at least the following information in the table:

select * from system.data_skipping_indices

┌─database─┬─table───┬─name──────────┬─type─────┬─expr───────┬─granularity─┐
│ default  │ metrics │ idx_skip_tags │ SET(100) │ tags_field │           4 │
└──────────┴─────────┴───────────────┴──────────┴────────────┴─────────────┘

Additionally, any type of statistics/metrics might be useful, but i don't know the internals of data skipping indices enough to give any meaningful input here.

@ifoo ifoo added the feature label Nov 6, 2019
@filimonov filimonov added the comp-skipidx Data skipping indices label Nov 6, 2019
@alexey-milovidov alexey-milovidov added easy task Good for first contributors help wanted labels Nov 10, 2019
@filimonov
Copy link
Contributor

May be we can just list them inside columns? With a special column type? In that case we will also hale parts_columns 'for free'.

@alexey-milovidov
Copy link
Member

@filimonov In this case we will have to always keep in mind that system.columns is not only for columns. It will break 3rd party tools.

Better to introduce a separate table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp-skipidx Data skipping indices easy task Good for first contributors feature st-community-taken External developer is working on that
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants