Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update system view show_create #15825

Merged
merged 5 commits into from
Mar 18, 2025
Merged

Conversation

shnikd
Copy link
Collaborator

@shnikd shnikd commented Mar 17, 2025

No description provided.

@shnikd shnikd requested a review from a team as a code owner March 17, 2025 11:34
Copy link

🔴 2025-03-17 11:35:46 UTC The validation of the Pull Request description has failed. Please update the description.

PR description is empty. Please fill it out.

@shnikd shnikd force-pushed the show-create-sysview branch from 6ef42ad to b75a212 Compare March 17, 2025 11:37
Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 11:40:29 UTC Pre-commit check linux-x86_64-release-asan for 265ee2b has started.
2025-03-17 11:40:59 UTC Artifacts will be uploaded here
2025-03-17 11:44:29 UTC ya make is running...
2025-03-17 12:02:27 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 11:41:29 UTC Pre-commit check linux-x86_64-relwithdebinfo for 265ee2b has started.
2025-03-17 11:41:54 UTC Artifacts will be uploaded here
2025-03-17 11:45:20 UTC ya make is running...
2025-03-17 12:02:20 UTC Check cancelled

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 12:04:32 UTC Pre-commit check linux-x86_64-release-asan for 8c68412 has started.
2025-03-17 12:04:47 UTC Artifacts will be uploaded here
2025-03-17 12:07:35 UTC ya make is running...
🟡 2025-03-17 13:15:08 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12453 12323 0 60 31 39

2025-03-17 13:16:32 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-17 13:29:37 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
183 (only retried tests) 140 0 1 7 35

2025-03-17 13:29:50 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-17 13:44:09 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
72 (only retried tests) 32 0 1 4 35

🟢 2025-03-17 13:44:19 UTC Build successful.
🟡 2025-03-17 13:44:52 UTC ydbd size 3.8 GiB changed* by +155.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: a2db51c merge: 8c68412 diff diff %
ydbd size 4 046 704 568 Bytes 4 046 863 528 Bytes +155.2 KiB +0.004%
ydbd stripped size 1 400 101 320 Bytes 1 400 145 672 Bytes +43.3 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 17, 2025

2025-03-17 12:07:39 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8c68412 has started.
2025-03-17 12:07:55 UTC Artifacts will be uploaded here
2025-03-17 12:10:43 UTC ya make is running...
🟡 2025-03-17 13:09:09 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
26857 24256 0 3 2483 115

2025-03-17 13:11:47 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-17 13:24:25 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
169 (only retried tests) 55 0 1 3 110

2025-03-17 13:24:33 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-17 13:46:26 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
156 (only retried tests) 49 0 1 0 106

🟢 2025-03-17 13:46:34 UTC Build successful.
🟡 2025-03-17 13:46:57 UTC ydbd size 2.1 GiB changed* by +108.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 6c442ab merge: 8c68412 diff diff %
ydbd size 2 298 238 920 Bytes 2 298 350 304 Bytes +108.8 KiB +0.005%
ydbd stripped size 481 100 768 Bytes 481 127 136 Bytes +25.8 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@@ -253,6 +254,14 @@ class TScanActorBase : public TActorBootstrapped<TDerived> {

AllowedByLimiter = true;

if (TableId.SysViewInfo == ShowCreateName) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

а может тогда выполнение резолва вынести в какую то функцию и переопределить ее для скана в show create table? выглядит странно

}

if (cellsFrom[0].AsBuf() != cellsTo[0].AsBuf() || cellsFrom[1].AsBuf() != cellsTo[1].AsBuf()) {
ReplyErrorAndDie(Ydb::StatusIds::SCHEME_ERROR, "Invalid table range");
return;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

совмещаете фичу и багфиксы в одном PR?

TExprBase currentNode(node);
if (auto maybeReadTable = currentNode.Maybe<TKiReadTable>()) {
auto readTable = maybeReadTable.Cast();
for (auto setting : readTable.Settings()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

костыль какой то? зачем это нужно?

Copy link
Collaborator Author

@shnikd shnikd Mar 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Чтобы вывести настройку для таблицы, что это переписанный Show Create Table

ijon
ijon previously approved these changes Mar 17, 2025
Copy link
Collaborator

@ijon ijon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ydb/core/sys_view -- ok


{
auto result = session.ExecuteQuery(R"(
SELECT * FROM `.sys/show_create` WHERE Path = "/Root/test_show_create" and PathType = "Table";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

а зачем это запрещать?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

нам надо скрыть эту sysview в схеме, не понятно, зачем запрещать к ней делать такой select. много мороки, а профита ноль

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Тогда странно, что ты не можешь подескрайбить этот путь, но при этом можешь выполнить к нему select, выглядит как бага

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

не понимаю сути баги. из за того, что ты это хочешь запретить пишется куча кода, который примерно на выброс

@@ -191,7 +195,7 @@ class TKikimrTablesData : public TThrRefBase {
TKikimrTablesData& operator=(const TKikimrTablesData&) = delete;

TKikimrTableDescription& GetOrAddTable(const TString& cluster, const TString& database, const TString& table,
ETableType tableType = ETableType::Table);
ETableType tableType = ETableType::Table, bool showCreate = false);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

нейминг странный. на каждую новую таблицу будет новая булка добавляться?

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 15:47:30 UTC Pre-commit check linux-x86_64-release-asan for ecffd1b has started.
2025-03-18 15:48:06 UTC Artifacts will be uploaded here
2025-03-18 15:51:42 UTC ya make is running...
2025-03-18 16:01:07 UTC Check cancelled

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 15:47:49 UTC Pre-commit check linux-x86_64-relwithdebinfo for ecffd1b has started.
2025-03-18 15:48:03 UTC Artifacts will be uploaded here
2025-03-18 15:50:51 UTC ya make is running...
2025-03-18 16:01:07 UTC Check cancelled

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 16:04:47 UTC Pre-commit check linux-x86_64-release-asan for c8eca1f has started.
2025-03-18 16:05:18 UTC Artifacts will be uploaded here
2025-03-18 16:08:46 UTC ya make is running...
🟡 2025-03-18 17:24:45 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12469 12369 0 41 23 36

2025-03-18 17:25:50 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-18 17:38:26 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
150 (only retried tests) 110 0 2 6 32

2025-03-18 17:38:35 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-18 17:50:32 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
67 (only retried tests) 31 0 2 4 30

🟢 2025-03-18 17:50:39 UTC Build successful.
🟢 2025-03-18 17:51:09 UTC ydbd size 3.8 GiB changed* by +54.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: e32508c merge: c8eca1f diff diff %
ydbd size 4 049 847 384 Bytes 4 049 903 312 Bytes +54.6 KiB +0.001%
ydbd stripped size 1 401 010 728 Bytes 1 401 024 520 Bytes +13.5 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 16:05:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for c8eca1f has started.
2025-03-18 16:05:51 UTC Artifacts will be uploaded here
2025-03-18 16:08:41 UTC ya make is running...
🟡 2025-03-18 17:07:51 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
26888 24275 0 2 2492 119

2025-03-18 17:10:38 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-18 17:35:02 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
174 (only retried tests) 64 0 1 1 108

2025-03-18 17:35:14 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-18 17:47:00 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
151 (only retried tests) 44 0 1 1 105

🟢 2025-03-18 17:47:09 UTC Build successful.
🟢 2025-03-18 17:47:29 UTC ydbd size 2.1 GiB changed* by +49.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: e32508c merge: c8eca1f diff diff %
ydbd size 2 300 090 632 Bytes 2 300 141 032 Bytes +49.2 KiB +0.002%
ydbd stripped size 481 401 536 Bytes 481 416 768 Bytes +14.9 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 19:01:56 UTC Pre-commit check linux-x86_64-release-asan for 5bcaf80 has started.
2025-03-18 19:02:23 UTC Artifacts will be uploaded here
2025-03-18 19:05:46 UTC ya make is running...
🟡 2025-03-18 20:08:42 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12483 12409 0 26 11 37

2025-03-18 20:09:47 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-18 20:32:41 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
117 (only retried tests) 76 0 1 7 33

2025-03-18 20:32:51 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-18 20:44:54 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
69 (only retried tests) 31 0 1 4 33

🟢 2025-03-18 20:45:03 UTC Build successful.
🟡 2025-03-18 20:45:31 UTC ydbd size 3.8 GiB changed* by +113.7 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 8f3ed78 merge: 5bcaf80 diff diff %
ydbd size 4 049 884 016 Bytes 4 050 000 488 Bytes +113.7 KiB +0.003%
ydbd stripped size 1 401 023 720 Bytes 1 401 070 888 Bytes +46.1 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 18, 2025

2025-03-18 19:02:47 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5bcaf80 has started.
2025-03-18 19:03:02 UTC Artifacts will be uploaded here
2025-03-18 19:06:02 UTC ya make is running...
🟡 2025-03-18 20:00:26 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
26902 24293 0 2 2491 116

2025-03-18 20:02:43 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-18 20:26:10 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
168 (only retried tests) 57 0 0 4 107

🟢 2025-03-18 20:26:17 UTC Build successful.
🟢 2025-03-18 20:26:38 UTC ydbd size 2.1 GiB changed* by +45.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 41df44f merge: 5bcaf80 diff diff %
ydbd size 2 300 143 864 Bytes 2 300 190 184 Bytes +45.2 KiB +0.002%
ydbd stripped size 481 417 856 Bytes 481 428 992 Bytes +10.9 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@@ -177,11 +177,15 @@ class TKikimrTableDescription {
ETableType GetTableType() const { return TableType; }
void SetTableType(ETableType tableType) { TableType = tableType; }

void SetSysViewRewritten(bool flag) { SysViewRewritten = flag; }
bool GetSysViewRewritten() const { return SysViewRewritten; }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

не понимаю что на что переписывается в этом нейминге. в целом конечно стало получше, но может тогда просто написать что это Hidden системная таблица?

NThreading::TFuture<TTableMetadataResult> tableMetaFuture;

NSysView::ISystemViewResolver::TSystemViewPath sysViewPath;
if (settings.SysViewRewritten_ && SystemViewRewrittenResolver->IsSystemViewPath(SplitPath(table), sysViewPath)) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

а QueryReplay будет поддерживать Resolve такой таблицы?

@shnikd shnikd merged commit 01147a2 into ydb-platform:main Mar 18, 2025
12 checks passed
adameat pushed a commit to adameat/ydb that referenced this pull request Mar 20, 2025
blinkov pushed a commit that referenced this pull request Mar 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants