Trino Fails to Create Table with abfss External Location on Azure Data Lake Gen2

[rajatnt]

I'm trying to create an external table in Trino backed by Azure Data Lake Storage Gen2 using the abfss scheme, but encountering the following error:

trino:default> SHOW SCHEMAS FROM hive
            -> ;
       Schema
--------------------
 default
 information_schema
(2 rows)

Query 20250603_161316_00004_d6rjx, FINISHED, 1 node
Splits: 5 total, 5 done (100.00%)
0.29 [2 rows, 35B] [6 rows/s, 121B/s]

trino:default> CREATE TABLE hive.default.existing_customer_data (
            ->     id bigint,
            ->     name varchar(100),
            ->     email varchar(255),
            ->     created_date date
            -> ) WITH (
            ->     format = 'PARQUET',
            ->     external_location = 'abfss://[email protected]/tables/customer_data'
            -> );
Query 20250603_161322_00005_d6rjx failed: External location is not a valid file system URI: abfss://[email protected]/tables/customer_data

trino:default>

Configuration Details:
catalog/hive.properties

connector.name=hive
hive.metastore.uri=thrift://hive-metastore:9083
hive.metastore-cache-ttl=20m
hive.metastore-refresh-interval=10s
hive.non-managed-table-writes-enabled=true
hive.recursive-directories=true
fs.hadoop.enabled=true

hadoop/core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>abfss://[email protected]/</value>
        <final>true</final>
    </property>
    <property>
        <name>fs.azure.account.auth.type.trinostorage1748920590.dfs.core.windows.net</name>
        <value>OAuth</value>
    </property>
    <property>
        <name>fs.azure.account.oauth.provider.type.trinostorage1748920590.dfs.core.windows.net</name>
        <value>org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider</value>
    </property>
    <property>
        <name>fs.azure.account.oauth2.msi.tenant.trinostorage1748920590.dfs.core.windows.net</name>
        <value><tenant ID></value>
        <description>Replace with your actual tenant ID</description>
    </property>
    <property>
        <name>fs.azure.account.oauth2.msi.endpoint.trinostorage1748920590.dfs.core.windows.net</name>
        <value>http://169.254.169.254/metadata/identity/oauth2/token</value>
    </property>
    <property>
        <name>fs.azure.account.oauth2.client.id.trinostorage1748920590.dfs.core.windows.net</name>
        <value><client ID></value>
        <description>Replace with your actual client ID</description>
    </property>
    <!-- Filesystem implementations -->
    <property>
        <name>fs.abfs.impl</name>
        <value>org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem</value>
    </property>
    <property>
        <name>fs.abfss.impl</name>
        <value>org.apache.hadoop.fs.azurebfs.SecureAzureBlobFileSystem</value>
    </property>
    <property>
        <name>fs.AbstractFileSystem.abfs.impl</name>
        <value>org.apache.hadoop.fs.azurebfs.Abfs</value>
    </property>
    <property>
        <name>fs.AbstractFileSystem.abfss.impl</name>
        <value>org.apache.hadoop.fs.azurebfs.Abfss</value>
    </property>
</configuration>

Docker Compose (Partial)

services:
  trino:
    image: trinodb/trino:latest
    ports:
      - "8080:8080"
    volumes:
      - ./trino-config:/etc/trino
      - ./trino-config/hadoop:/etc/hadoop/conf
    environment:
      - JAVA_TOOL_OPTIONS=-Xmx4G
      - HADOOP_CONF_DIR=/etc/hadoop/conf
    depends_on:
      - hive-metastore

  hive-metastore:
    image: apache/hive:3.1.3
    ...

Notes
Tried with both Trino latest and version 458.
Hive connector is configured for external table writes.
Hadoop config includes abfs(s) implementations and correct OAuth MSI credentials.
This is tried in legacy mode because facing similar issues with the native implementation as well.

Is this a bug in Trino or am I missing something in the configuration (possibly in Hadoop filesystem resolution or Trino Hive connector compatibility with abfss)?

Would appreciate any guidance from the community or maintainers. Thanks!

ps - while I don't want to include this here, I can't help but feel the need to mention that Trino documentation is so poorly written that neither the legacy nor the new methods are explained well or function as they should.

[rajatnt]

Tried a few more scenarios.

Tried using the iceberg connector.

Below is the properties.

connector.name=iceberg
iceberg.catalog.type=hive_metastore
iceberg.register-table-procedure.enabled=true
iceberg.unique-table-location=true
iceberg.register-table-procedure.enabled=true
hive.metastore.uri=thrift://hive-metastore:9083

# Azure OAuth Configuration (instead of access key)
fs.native-azure.enabled=true
azure.auth-type=OAUTH
azure.oauth.client-id=client-id
azure.oauth.secret=secret-id
azure.oauth.tenant-id=tenant-id3
azure.oauth.endpoint=https://login.microsoftonline.com/client-id/oauth2/v2.0/token

With above, used both latest trino docker image and the 466 docker image.

I was trying different ways to connect to azure storage and thought to register an already-existing Iceberg table. So I pre-created the table using Spark in azure using a spark docker container. Post this tried below which is also resulting in failed: Got exception: org.apache.hadoop.fs.UnsupportedFileSystemException No FileSystem for scheme "abfss"

From the trino CLI -

ruser@rubuntu:~/iceberg$ docker ps -a
CONTAINER ID   IMAGE               COMMAND                  CREATED              STATUS                        PORTS                                                               NAMES
6d50f7f360a6   trinodb/trino:466   "/usr/lib/trino/bin/…"   About a minute ago   Up About a minute (healthy)   0.0.0.0:8080->8080/tcp, [::]:8080->8080/tcp                         trino
c9527a5e07ee   apache/hive:3.1.3   "sh -c /entrypoint.sh"   About a minute ago   Up 6 seconds                  10000/tcp, 0.0.0.0:9083->9083/tcp, [::]:9083->9083/tcp, 10002/tcp   hive-metastore
26ad9f3453f3   postgres:13         "docker-entrypoint.s…"   About a minute ago   Up About a minute             0.0.0.0:5432->5432/tcp, [::]:5432->5432/tcp                         postgres
azureuser@rntubuntu:~/iceberg$ ./trino --server http://localhost:8080 --catalog hive --schema default
trino:default> CALL azure.system.register_table(
            ->     schema_name => 'default',
            ->     table_name => 'customers',
            ->     table_location => 'abfss://[email protected]/tables/default/customers'
            -> );
Query 20250604_125938_00001_295cs failed: Got exception: org.apache.hadoop.fs.UnsupportedFileSystemException No FileSystem for scheme "abfss"

trino:default>