Add support out of the box for Table Comments, Column Comments, and cluster_by.

[WilliamMize]

It would be beneficial if we could attach the table comments and column comments to the DLT streaming tables as additional metadata. This would benefit not only anyone consuming data from the tables but also the "Data Intelligence Platform" for more optimal AI retrieval. Cluster_by is in preview but will go to the release/standard channel on DLT eventually.

[ravi-databricks]

@WilliamMize we already added cluster_by in v0.0.9 release. issue_91 have table_comment as attribute in onboarding.json. Can you verify if this looks good?

[WilliamMize]

@ravi-databricks I like it! Still can fall back to silver dlt table{target_table} if the comments are not provided. We aren't using quarantine tables yet, but I saw you added comments there as well, and that will be an excellent touch for others.

Any plans for the column comments?

[ravi-databricks]

@WilliamMize column comments can be implemented by customers using custom transformation shown here