Microsoft SharePoint is a cloud-based service that helps organizations share and manage content, knowledge, and applications to:
Empower teamwork
Quickly find information
Seamlessly collaborate across the organization
It is used as a secure place to store, organize, share, and access information from any device.
Astera Data Stack lets the user connect to the Microsoft SharePoint Document library. This lets them access files from Microsoft SharePoint and use them within the scope of the tool.
The files can then be extracted via various objects and can be used in ETL pipelines, be it within dataflows, workflows, etc.
Note: Astera currently does not support version control of documents present in SharePoint. The user can only work with the latest version of a file present in SharePoint.
Head over to this link.
Click on App Registrations.
Register a new App.
Open the newly registered App.
Here, you can get the Client ID.
Head over to Certificates and Secrets.
Create a Client Secret.
Note: Save the Client Secret at a safer place for future use as it will disappear.
Go to Authentication, create a new Web Platform, and add a Redirect URI (http://localhost:8050/).
8. Go to App Permissions and add the permissions.
SharePoint Delegated Permissions
The following API permissions are needed to be added to create the credentials.
AllSites.Read
AllSites.Write
Graph APIs.
Sites.Read.All
Sites.ReadWrite.All
Files.Read
Files.ReadWrite
Files.Read.All
Files.ReadWrite.All
This is how you can create credentials for SharePoint.
To start, drag and drop a Cloud Storage Connection object from the Resources section onto the dataflow.
Right-click on the object and select Properties from the context menu.
This will open the Properties screen.
Select the Provider drop-down menu and click on Microsoft SharePoint Document Library.
Selecting this will make more options available.
Credentials:
Site URL: This is where the Site URL is to be entered from where the SharePoint connection is going to be established.
Authentication URL: This is where the value of the authentication URL is entered.
Access Token URL: The access token URL, used alongside the authentication URL, is entered here.
Client ID: This is where the Client ID is provided for authentication.
Client Secret: The client secret is provided here for additional authentication for a secure connection.
Use System Default Browser: This checkbox is selected when the user wants the system browser to open, otherwise Astera opens a browser in a new window.
Note: In Astera, both the Authentication URL and Access Token URL are pre-populated for the SharePoint provider.
Properties:
Root Path: The Root Path is to keep confidential data and information secure from access by unauthorized users. It lets you point out the particular file needed while keeping all the other folders protected.
Once done, Click on Request Token.
This will provide you with the Access Token and Refresh Token which are used for a secure connection.
Note: Selecting the Request Token option might open a prompt to log in to your Microsoft account. However, if you have already done that once, it will not open a prompt again.
Once done, click on Test Connection to see if the connection has been successfully established with the SharePoint document library.
Click OK, then click Ok to close the Properties window.
The Cloud Storage Connection object has been configured with the SharePoint Library.
To start, we will drag and drop an Excel Workbook Source from the Sources section of the toolbox onto the dataflow.
Right-click on the Excel Workbook Source object and select Properties from the context menu.
This will open the Properties screen.
Select the drop-down option next to the file path browser and select Browse Cloud Files from the menu.
This will open a new window.
As you can see above, our configured SharePoint connection is available to use files from.
Click on the connection and select the appropriate file to use in the connection.
Click Open and the file path will be selected.
Click Ok and the Excel Workbook Source object will be configured with the SharePoint library file.
It can now be used in further ETL applications.
This concludes our discussion on the configuration and working of the SharePoint Cloud Connection in Astera.
