Import Data from Azure Data Lake Storage Gen2

This new data import experience feature was introduced in MicroStrategy 2021 Update 7.

Follow the steps below to import data from Azure Data Lake Storage Gen2.

• Create a Non-OAuth Data Source (Shared Key and Service Account) Using the Data Sources Workflow

• Create an OAuth Database Role Using the Enterprise Security Workflow

• Import Data

Create a Non-OAuth Data Source (Shared Key and Service Account) Using the Data Sources Workflow

This workflow is for shared key and service account DBrole creation for Azure Data Lake Storage 2.

1. Open the Workstation window.
2. In the Navigation pane, click , next to Data Sources.

3. Click Azure Data Lake Storage 2.

   

4. Enter the Name of the database role being created and a Description, if necessary. In Database Version, Cloud Gateway ADLS2 is selected by default.

   

5. In Default Database Connection, click Add New Database Connection.

6. Verify Authentication Mode is set to Standard and set the Authentication Method to Shared Key or Service Account.

7. Test the connection. If the test fails, hover over the Connection Failed text to get more information regarding the error.

   

8. Click Save.

   

9. If necessary, select the pencil icon to modify the connectivity information.

10. Select the Projects you want to associate this database role to.

11. Test your connection.

12. Click Save.

Create an OAuth Database Role Using the Enterprise Security Workflow

This workflow is for user account database role creation for Azure Data Lake Storage 2.

1. Open the Workstation window.

2. In the Navigation pane, click , next to Enterprise Security.

3. Select an Identity provider of Azure.

   

4. The Library Web, Authoring Web, and Workstation URIs are automatically populated. Whitelist these URIs to use the OAuth database role in Library, Web, and Workstation.

5. Complete the remaining fields.

6. Click Save.

7. In the Navigation pane, click , next to Data Sources.

8. Click Azure Data Lake Storage 2.

   

9. Enter the Name of the database role being created and a Description, if necessary. In Database Version, Cloud Gateway ADLS2 is selected by default.

   

10. In Default Database Connection, add a new database connection, making the following changes:

    • Change Authentication Method to OAuth.

    • Select the Authentication Service created for Azure

    • Enter the Azure Storage Account.

    

11. Click Save.

    

12. If necessary, select the pencil icon to modify the connectivity information.

13. Select the Projects you want to associate this database role to.

    The Test button cannot be used for OAuth workflows.

14. Click Save.

Import Data

Once you've successfully created the required database roles, you can start importing data.

1. Open the Workstation window.

2. In the Navigation pane, click , next to Datasets.

3. Select your environment and project, Data Import Cube, and click OK.

   

4. Select the Azure Data Lake Storage 2 database role. The database roles created using the data sources and enterprise security workflows are visible here.

5. Select the database role. All available buckets appear in the adjoining panel. If the database role being selected is for OAuth, a pop-up appears for entering the username/email and password.

6. In the drop-down, select the bucket and browse the folders or files.

7. Double-click files or drag them into the right pane.

8. In the Preview pane, you can view the sample data and adjust the column type.

9. Publish the cube to MicroStrategy with your selected data.