Data Lake Storage Gen2

Overview

Azure Data Lake Storage Gen2 is a set of capabilities dedicated to big data analytics, built on Azure Blob Storage.
Data Lake Storage Gen2 provides file system semantics with Hierarchical directory structure.
The storage drivers are an abstract representation of the container in the Azure. For more information, see the Azure Data Lake Storage Gen2.


This topic describes how to create Azure Data Lake Storage Gen2 storage drivers in the Dataloop platform as part of your Azure integration.

Create an Azure Data Lake Gen2 Storage Driver on the Dataloop Platform

1. Log in to the Dataloop platform.
2. Select Data Management from the left-side panel.
3. Select the Storage Driver tab and then click Create Storage Driver, or click on the Down-arrow and select the Create Storage Driver from the list. A new storage driver pop-up window is displayed.
4. Enter a Name for the storage driver.
5. In the Integration field, select your relevant Azure Integration from the list.
6. In the Type field, select azureDataLakeGen2 from the list.
7. Enter your Container name, the one that is relevant to the integration.
8. (Optional) Select Allow delete items. This option allows Dataloop to remove items from the storage driver when those items are deleted from Dataloop's dataset. It does not delete items from the Dataloop dataset when those are deleted from the storage driver.
9. Click Test to verify the connection.
10. Click Create. A confirmation message is displayed.

To Create a Dataset Based on an External Cloud Storage, see the Create a Dataset Based on an External Cloud Storage.