[Ideas] Support Adding Optional Arbitrary Columns to Directory Tables

[xtangcode]

Description

Summary

Allow users to define optional arbitrary columns when creating a directory table, providing enhanced flexibility to manage table rows and store custom metadata.

Detailed Description

Currently, creating a directory table in Apache Cloudberry does not support defining additional columns beyond the default structure. This feature request aims to enable users to specify custom columns at the time of table creation, similar to the flexibility provided by standard SQL CREATE TABLE syntax.

Proposed Syntax Example

CREATE DIRECTORY TABLE table_name ( column_name1 data_type1 [, column_name2 data_type2, ...] );

This syntax aligns with PostgreSQL-style table creation, allowing users to list column names and their respective data types within parentheses. For example:

CREATE DIRECTORY TABLE user_files ( file_size BIGINT, creation_date TIMESTAMP, metadata JSONB );

Use case/motivation

• Flexible Metadata Storage: Users can store additional file attributes (e.g., file size, creation date, owner information) directly in the directory table, enabling more dynamic data modeling.
• Enhanced Data Organization: Allows tighter integration of directory metadata with custom business logic via user-defined columns. (e.g., adding a compliance_tag column for regulated data).

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!