Add documentation for Iceberg support in PrestoCPP

Author: agrawalreetika

presto-docs/src/main/sphinx/connector/iceberg.rst

@@ -308,6 +308,11 @@ the data and delete files of Iceberg tables are stored in S3. An example configu
     hive.s3.endpoint=http://192.168.0.103:9878
     hive.s3.path-style-access=true
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+``HIVE``, ``NESSIE``, ``REST``, and ``HADOOP`` Iceberg catalogs are supported in Presto C++.
+
 Configuration Properties
 ------------------------
 
@@ -319,69 +324,69 @@ Configuration Properties
 
 The following configuration properties are available for all catalog types:
 
-======================================================= ============================================================= ============
-Property Name                                           Description                                                   Default
-======================================================= ============================================================= ============
-``iceberg.catalog.type``                                The catalog type for Iceberg tables. The available values     ``HIVE``
+======================================================= ============================================================= ================================== =================== =========================================
+Property Name                                           Description                                                   Default                            Presto Java Support Presto C++ Support
+======================================================= ============================================================= ================================== =================== =========================================
+``iceberg.catalog.type``                                The catalog type for Iceberg tables. The available values     ``HIVE``                           Yes                 Yes, only needed on coordinator
                                                         are ``HIVE``, ``HADOOP``, and ``NESSIE`` and ``REST``.
 
-``iceberg.hadoop.config.resources``                     The path(s) for Hadoop configuration resources.
+``iceberg.hadoop.config.resources``                     The path(s) for Hadoop configuration resources.                                                  Yes                 Yes, only needed on coordinator
 
                                                         Example: ``/etc/hadoop/conf/core-site.xml.`` This property
                                                         is required if the iceberg.catalog.type is ``hadoop``.
                                                         Otherwise, it will be ignored.
 
-``iceberg.file-format``                                 The storage file format for Iceberg tables. The available     ``PARQUET``
+``iceberg.file-format``                                 The storage file format for Iceberg tables. The available     ``PARQUET``                        Yes                 NA
                                                         values are ``PARQUET`` and ``ORC``.
 
-``iceberg.compression-codec``                           The compression codec to use when writing files. The          ``GZIP``
+``iceberg.compression-codec``                           The compression codec to use when writing files. The          ``GZIP``                           Yes                 NA
                                                         available values are ``NONE``, ``SNAPPY``, ``GZIP``,
                                                         ``LZ4``, and ``ZSTD``.
 
-``iceberg.max-partitions-per-writer``                   The Maximum number of partitions handled per writer.          ``100``
+``iceberg.max-partitions-per-writer``                   The maximum number of partitions handled per writer.          ``100``                            Yes                 NA
 
-``iceberg.minimum-assigned-split-weight``               A decimal value in the range (0, 1] is used as a minimum      ``0.05``
+``iceberg.minimum-assigned-split-weight``               A decimal value in the range (0, 1] is used as a minimum      ``0.05``                           Yes                 Yes
                                                         for weights assigned to each split. A low value may improve
                                                         performance on tables with small files. A higher value may
                                                         improve performance for queries with highly skewed
                                                         aggregations or joins.
 
-``iceberg.enable-merge-on-read-mode``                   Enable reading base tables that use merge-on-read for         ``true``
+``iceberg.enable-merge-on-read-mode``                   Enable reading base tables that use merge-on-read for         ``true``                           Yes                 Yes, only needed on coordinator
                                                         updates.
 
-``iceberg.delete-as-join-rewrite-enabled``              When enabled, equality delete row filtering is applied        ``true``
+``iceberg.delete-as-join-rewrite-enabled``              When enabled, equality delete row filtering is applied        ``true``                           Yes                 Yes
                                                         as a join with the data of the equality delete files.
 
-``iceberg.enable-parquet-dereference-pushdown``         Enable parquet dereference pushdown.                          ``true``
+``iceberg.enable-parquet-dereference-pushdown``         Enable parquet dereference pushdown.                          ``true``                           Yes                 NA
 
-``iceberg.statistic-snapshot-record-difference-weight`` The amount that the difference in total record count matters
+``iceberg.statistic-snapshot-record-difference-weight`` The amount that the difference in total record count matters                                     Yes                 Yes, only needed on coordinator
                                                         when calculating the closest snapshot when picking
                                                         statistics. A value of 1 means a single record is equivalent
                                                         to 1 millisecond of time difference.
 
-``iceberg.pushdown-filter-enabled``                     Experimental: Enable filter pushdown for Iceberg. This is     ``false``
-                                                        only supported with Native Worker.
+``iceberg.pushdown-filter-enabled``                     Experimental: Enable filter pushdown for Iceberg. This is     ``false``                          No                  Yes
+                                                        only supported with Presto C++.
 
-``iceberg.rows-for-metadata-optimization-threshold``    The maximum number of partitions in an Iceberg table to       ``1000``
+``iceberg.rows-for-metadata-optimization-threshold``    The maximum number of partitions in an Iceberg table to       ``1000``                           Yes                 Yes
                                                         allow optimizing queries of that table using metadata. If
                                                         an Iceberg table has more partitions than this threshold,
                                                         metadata optimization is skipped.
 
                                                         Set to ``0`` to disable metadata optimization.
 
-``iceberg.split-manager-threads``                       Number of threads to use for generating Iceberg splits.       ``Number of available processors``
+``iceberg.split-manager-threads``                       Number of threads to use for generating Iceberg splits.       ``Number of available processors`` Yes                 Yes, only needed on coordinator
 
-``iceberg.metadata-previous-versions-max``              The max number of old metadata files to keep in current       ``100``
-                                                        metadata log.
+``iceberg.metadata-previous-versions-max``              The maximum number of old metadata files to keep in           ``100``                            Yes                 NA
+                                                        current metadata log.
 
-``iceberg.metadata-delete-after-commit``                Set to ``true`` to delete the oldest metadata files after     ``false``
+``iceberg.metadata-delete-after-commit``                Set to ``true`` to delete the oldest metadata files after     ``false``                          Yes                 NA
                                                         each commit.
 
-``iceberg.metrics-max-inferred-column``                 The maximum number of columns for which metrics               ``100``
+``iceberg.metrics-max-inferred-column``                 The maximum number of columns for which metrics               ``100``                            Yes                 NA
                                                         are collected.
-``iceberg.max-statistics-file-cache-size``              Maximum size in bytes that should be consumed by the          ``256MB``
+``iceberg.max-statistics-file-cache-size``              Maximum size in bytes that should be consumed by the          ``256MB``                          Yes                 Yes, only needed on coordinator
                                                         statistics file cache.
-======================================================= ============================================================= ============
+======================================================= ============================================================= ================================== =================== =========================================
 
 Table Properties
 ------------------------
@@ -482,34 +487,40 @@ Deprecated Property Name                  New Property Name
 ``metrics_max_inferred_column``           ``write.metadata.metrics.max-inferred-column-defaults``
 =======================================   ===============================================================
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+Table properties are not supported in Presto C++ because write operations have not been implemented.
 
 Session Properties
 ------------------
 
 Session properties set behavior changes for queries executed within the given session.
 
-===================================================== ======================================================================
-Property Name                                         Description
-===================================================== ======================================================================
-``iceberg.delete_as_join_rewrite_enabled``            Overrides the behavior of the connector property
+===================================================== ======================================================================= =================== ==================
+Property Name                                         Description                                                             Presto Java Support Presto C++ Support
+===================================================== ======================================================================= =================== ==================
+``iceberg.delete_as_join_rewrite_enabled``            Overrides the behavior of the connector property                        Yes                 Yes
                                                       ``iceberg.delete-as-join-rewrite-enabled`` in the current session.
-``iceberg.hive_statistics_merge_strategy``            Overrides the behavior of the connector property
+``iceberg.hive_statistics_merge_strategy``            Overrides the behavior of the connector property                        Yes                 Yes
                                                       ``iceberg.hive-statistics-merge-strategy`` in the current session.
-``iceberg.rows_for_metadata_optimization_threshold``  Overrides the behavior of the connector property
+``iceberg.rows_for_metadata_optimization_threshold``  Overrides the behavior of the connector property                        Yes                 Yes
                                                       ``iceberg.rows-for-metadata-optimization-threshold`` in the current
                                                       session.
-``iceberg.target_split_size_bytes``                   Overrides the target split size for all tables in a query in bytes.
+``iceberg.target_split_size_bytes``                   Overrides the target split size for all tables in a query in bytes.     Yes                 Yes
                                                       Set to 0 to use the value in each Iceberg table's
                                                       ``read.split.target-size`` property.
-``iceberg.affinity_scheduling_file_section_size``     When the ``node_selection_strategy`` or
+``iceberg.affinity_scheduling_file_section_size``     When the ``node_selection_strategy`` or                                 Yes                 Yes
                                                       ``hive.node-selection-strategy`` property is set to ``SOFT_AFFINITY``,
                                                       this configuration property will change the size of a file chunk that
                                                       is hashed to a particular node when determining the which worker to
                                                       assign a split to. Splits which read data from the same file within
                                                       the same chunk will hash to the same node. A smaller chunk size will
                                                       result in a higher probability splits being distributed evenly across
                                                       the cluster, but reduce locality.
-===================================================== ======================================================================
+``iceberg.parquet_dereference_pushdown_enabled``      Overrides the behavior of the connector property                        Yes                 No
+                                                      ``iceberg.enable-parquet-dereference-pushdown`` in the current session.
+===================================================== ======================================================================= =================== ==================
 
 Caching Support
 ---------------
@@ -542,6 +553,11 @@ Property Name                                          Description
                                                        this size will not be cached.
 ====================================================   =============================================================   ============
 
+Presto C++ Support
+~~~~~~~~~~~~~~~~~~
+
+Manifest file caching is supported in Presto C++.
+
 Alluxio Data Cache
 ^^^^^^^^^^^^^^^^^^
 
@@ -565,6 +581,11 @@ JMX queries to get the metrics and verify the cache usage::
 
     SHOW TABLES FROM jmx.current like '%alluxio%';
 
+Presto C++ Support
+~~~~~~~~~~~~~~~~~~
+
+Alluxio data caching is applicable for Presto Java. Presto C++ supports Async data cache. See :ref:`async_data_caching_and_prefetching`.
+
 File And Stripe Footer Cache
 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 
@@ -596,6 +617,11 @@ JMX queries to get the metrics and verify the cache usage::
 
     SELECT * FROM jmx.current."com.facebook.presto.hive:name=iceberg_parquetmetadata,type=cachestatsmbean";
 
+Presto C++ Support
+~~~~~~~~~~~~~~~~~~
+
+File and stripe footer cache is not applicable for Presto C++.
+
 Metastore Cache
 ^^^^^^^^^^^^^^^
 
@@ -635,6 +661,11 @@ as part of a SQL query by including them in your SELECT statement.
      ----------------------------------+------------
                   2                    | 3
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+All above extra hidden metadata columns are supported in Presto C++.
+
 Extra Hidden Metadata Tables
 ----------------------------
 
@@ -815,6 +846,10 @@ example uses the earliest snapshot ID: ``2423571386296047175``
       testBranch | BRANCH | 3374797416068698476 | NULL                    | NULL                  | NULL
       testTag    | TAG    | 4686954189838128572 | 10                      | NULL                  | NULL
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+All above extra hidden metadata tables are supported in Presto C++.
 
 Procedures
 ----------
@@ -1098,9 +1133,54 @@ Examples:
 
     CALL iceberg.system.set_table_property('schema_name', 'table_name', 'commit.retry.num-retries', '10');
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+All above procedures are supported in Presto C++.
+
 SQL Support
 -----------
 
+SQL Support Summary for Presto Java and Presto C++:
+
+============================== ============= ============ ============================================================================
+SQL Operation                  Presto Java   Presto C++   Comments
+============================== ============= ============ ============================================================================
+``CREATE SCHEMA``              Yes           Yes
+
+``CREATE TABLE``               Yes           Yes
+
+``CREATE VIEW``                Yes           Yes
+
+``INSERT INTO``                Yes           No
+
+``CREATE TABLE AS SELECT``     Yes           No
+
+``SELECT``                     Yes           Yes          Read is supported in Presto C++ including those with positional delete files.
+
+``ALTER TABLE``                Yes           Yes
+
+``ALTER VIEW``                 Yes           Yes
+
+``TRUNCATE``                   Yes           Yes
+
+``DELETE``                     Yes           No
+
+``DROP TABLE``                 Yes           Yes
+
+``DROP VIEW``                  Yes           Yes
+
+``DROP SCHEMA``                Yes           Yes
+
+``SHOW CREATE TABLE``          Yes           Yes
+
+``SHOW COLUMNS``               Yes           Yes
+
+``DESCRIBE``                   Yes           Yes
+
+``UPDATE``                     Yes           No
+============================== ============= ============ ============================================================================
+
 The Iceberg connector supports querying and manipulating Iceberg tables and schemas
 (databases). Here are some examples of the SQL operations supported by Presto:
 
@@ -1237,6 +1317,11 @@ Transform Name        Source Types
 ``Hour``              ``timestamp``
 ===================== =======================================================================
 
+Presto C++ Support
+~~~~~~~~~~~~~~~~~~
+
+Read from the tables with Partition column transform is supported in Presto C++.
+
 CREATE VIEW
 ^^^^^^^^^^^
 
@@ -1558,13 +1643,23 @@ schema evolution, such as adding, dropping, and renaming columns. With schema
 evolution, users can evolve a table schema with SQL after enabling the Presto
 Iceberg connector.
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+Schema Evolution is supported in Presto C++.
+
 Parquet Writer Version
 ----------------------
 
 Presto now supports Parquet writer versions V1 and V2 for the Iceberg catalog.
 It can be toggled using the session property ``parquet_writer_version`` and the config property ``hive.parquet.writer.version``.
 Valid values for these properties are ``PARQUET_1_0`` and ``PARQUET_2_0``. Default is ``PARQUET_1_0``.
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+Presto C++ supports Parquet writer versions V1.
+
 Example Queries
 ^^^^^^^^^^^^^^^
 
@@ -1871,6 +1966,11 @@ Query Iceberg table by specifying the tag name:
             20 | canada        |         2 | comment
     (3 rows)
 
+Presto C++ Support
+^^^^^^^^^^^^^^^^^^
+
+Time Travel is supported in Presto C++.
+
 Type mapping
 ------------