Search before asking
Motivation
including_tables / excluding_tables of compact_database must match the whole databaseName.tableName.
A short-name pattern such as table_* matches no table, and only divided mode reports it (2.0.0 and master):
- divided: fails with
no tables to be compacted ...
- combined, batch: finishes successfully without compacting anything
- combined, streaming: keeps running without compacting anything, with no log above DEBUG
The Flink docs example used this form with mode => 'combined' (see #10452 ).
Solution
- combined, batch: fail at build time when no table matches, as divided does. Is there a reason to keep finishing successfully in this case?
- combined, streaming: log a WARN from the source when no table matches, mentioning the
databaseName.tableName format. Keep running, because a streming job may start before its tables are created.
- divided: mention the
databaseName.tableName format in the error message.
Anything else?
makes a combined batch job with no matching table fail instead of finishing.
Are you willing to submit a PR?
Search before asking
Motivation
including_tables/excluding_tablesofcompact_databasemust match the wholedatabaseName.tableName.A short-name pattern such as
table_*matches no table, and only divided mode reports it (2.0.0 and master):no tables to be compacted ...The Flink docs example used this form with
mode => 'combined'(see #10452 ).Solution
databaseName.tableNameformat. Keep running, because a streming job may start before its tables are created.databaseName.tableNameformat in the error message.Anything else?
makes a combined batch job with no matching table fail instead of finishing.
Are you willing to submit a PR?