Python and pandas Open Sharing example

Before you start

• You downloaded an external sharing profile for the Machine Data Lake analytics table.

• Your Python environment can install and use a version of the Delta Sharing Python connector for Open Sharing.

• You know the share name, schema name, and table name that the client must read.

Install the connector

Install the Delta Sharing Python connector in the Python environment that reads the shared table.

python -m pip install delta-sharing

For current Delta Sharing Python connector guidance, see Python Connector in the Delta Sharing repository.

List shared tables

Use the sharing profile to confirm which tables the client can see.

import delta_sharing

profile_file = r"C:\Users\<user>\.delta_sharing\profiles\mdl-open-sharing.share"
client = delta_sharing.SharingClient(profile_file)

tables = client.list_all_tables()
print(tables)

Read a table into pandas

Build the table URL by appending the fully qualified table name to the profile file path. The table URL format is <profile-file-path>#<share-name>.<schema-name>.<table-name>.

import delta_sharing

profile_file = r"C:\Users\<user>\.delta_sharing\profiles\mdl-open-sharing.share"
table_url = profile_file + "#<share_name>.<schema_name>.<table_name>"

df = delta_sharing.load_as_pandas(table_url)
print(df.head())

For the current Machine Data Lake sharing workflow, read the latest snapshot of the shared table. Do not depend on time travel, Change Data Feed, Delta table versions, or commit history unless Splunk documents support for those features.

For Delta Sharing read examples, see Read Delta Sharing Tables.

Troubleshooting checks