If We Have Bulk Data Can We Upload to Sharepoint

To get files from your file system into a SharePoint document library you have a couple of options available. The following guide covers how to synchronise files using an excel spreadsheet into a SharePoint Document Library.

Nosotros take the thought that you have a spreadsheet or CSV file containing the file names, paths to each file and whatsoever additional metadata. This could be user generated or created as an export from another internal system. In cursory you lot only connect to your spreadsheet, connect to SharePoint, map the columns, compare and sync.

We exercise take other options available to sync files to SharePoint with some of these available every bit web log posts, mentioned at the terminate of the folio, and the rest in our documentation.

The instance shown below uploads only a pocket-size sample of documents, yet you tin can use this method to bulk upload thousands of documents.

Contents

1. Requirements
• The Spreadsheet
• Documents in SubFolders
2. Connect to the Excel Spreadsheet
3. Connect to your SharePoint Document Library
4. Map the Source & Target Columns
5. Compare and Preview the Results
6. Synchronise
7. Automate & Schedule

Requirements

Before getting started y'all will demand to ensure that you have the following:

• Windows 10 or Windows Server
• Downloaded & Installed Data Synchronisation Studio
• Accept a Certificate Library created in SharePoint Online
• Have a Spreadsheet containing your metadata and file paths. You lot can encounter the example data we utilize below.

If you do not accept Data Synchronisation Studio you tin go a gratis evaluation edition. To test the automation using Ouvvi please contact us to upgrade your trial key.

The Spreadsheet

In your Excel spreadsheet you lot demand to specify the proper noun of the document and whatever metadata you desire to be uploaded alongside it. In our example nosotros have a range of ten documents with different modified dates and unlike blessing condition'.

Documents in SubFolders

If your documents are independent within folders in your directory, you desire to include the sub-directory folder proper name with the file proper name for example Folder1\doc1.docx. This will ensure that the document tin be found, and your directory structure is replicated in the Document Library. An example spreadsheet tin exist seen here:

Connect to your Excel Spreadsheet

To go started open Information Sync and click onto Connect Datasource link in the source (data source A) window. This volition open the connection window where you lot can connect to your spreadsheet.

To do this find Excel and aggrandize the tree so that you can select the OpenXML Excel Spreadsheet provider from the listing.

Under the FileName field click onto the ellipsis to open the file explorer and locate your spreadsheet containing your metadata. And then just click onto the Connect push to connect.

You will now need to define a couple of connection properties to find the files mentioned in the spreadsheet. In the connection properties window, below the source columns, go to the section Settings.Writer and consummate the following fields:

• BlobBasePath : Enter in the file path to your directory of documents, in our example this is C:\Users\Rebecca\Documents\Demo Documents.
• BlobFileName : Choose the column from the spreadsheet that returns the name of the file, in this example information technology is FileName.

Now you need to connect to your SharePoint Document Library as the Target. Click onto the Connect Datasource link in the Target (datasource B) window and go to the SharePoint section.

Then select SharePoint Online for connecting to a SharePoint Online site or SharePoint ClientAPI to connect to an On-Premise SharePoint site. More details on connecting to SharePoint On-Prem can be found here.

Equally we will need to write to the Modified column in SharePoint we need to utilise the Custom Azure App OAuth method to connect. Alternatively if legacy authentication is still enabled on your site and you are an admin in SharePoint, you can connect using the legacy authentication method. Another alternative is to create the application registration in SharePoint, nosotros have our full documentation on how to connect using ACS hither.

Yous need to enter in the URL to the SharePoint site that the Certificate Library is located. In this example the Document Library is found in a subsite called Examination, so our URL will look similar to: https://company.sharepoint.com/Test.

• To connect to the Root site the URL would look like to: https://visitor.sharepoint.com
• To connect to a subsite of a subsite the URL would look similar to: https://company.sharepoint.com/subsite/subsite2

Follow the details from the documentation to connect to SharePoint using your preferred method, and click Qualify Connectedness to connect.

Now you can select your Document Library from the dropdown list and set the delete behaviour.

We recommend saving the connection to the connexion library so that future projects tin can be speedily set up upwards, to do this click onto Connect and Create Library Connection and enter in a name for the connectedness. This volition add a connection to your SharePoint site/sub-site in the connection library so that you lot can quickly access all the lists and libraries in the hereafter. You only demand to add the connection to each site/subsite once, equally yous can connect to whatsoever of the lists or libraries inside that site from the Connection Library window.

Map your Source and Target Columns

The adjacent step is to map your source columns to your target columns. The mapping in your projection may expect slightly dissimilar if yous use unlike column names.

At a minimum yous need to map a source column to the URLPath column in SharePoint. In this case we map the FileName to the URLPath and set this to be the central column.

The key column must be unique and be able to distinguish each document from each other. As there can not exist duplicate filenames this works for the primal cavalcade.

We're also adding a Title, an approved condition and a modified date to each document. You can see the full schema mapping for this example below:

If you take specified the folder construction that the file is constitute in, in the FileName column this will be handled by Data Sync and the relevant folder will be created in SharePoint if it does not already exist.

Equally of Data Sync Version three.0.1276 you lot tin can map a different filename to the one y'all specified in the BlobFileName field earlier. Additionally the column specified in the BlobFileName property on the source does not need to exist included in the schema map.

This means that if y'all want your files to go to different folders or have a different name, yous simply need to map another filename column (such as TargetFileName in the case spreadsheet) to the URL Path in the schema map.

This would make the schema map look similar to this:

Compare and Preview the Information

One time the schema map has been configured and a key cavalcade set you tin run the comparing and preview the results. To practise this click onto the Compare A -> B push in the toolbar.

This will render the differences between the source and target data. Information Sync volition present the additions, updates and deletes which you can preview by clicking onto each choice.

Please note that deletes are disabled by default. To enable them set EnableDelete on the target to True.

For this example we take 10 records to add together to the certificate library, and we can make certain that the data is appearing every bit nosotros would expect.

Synchronise

Once the comparison results look as expected, we can run the sync to synchronise the changes to SharePoint.

To do this click Synchronise and then Kickoff to begin the sync.

To make sure everything was successful you lot can run the compare again, y'all should have 0 results, or y'all can browse to the Document Library in SharePoint.

Brand certain to salve your Information Sync project and then that you tin can use it again in the future.

From this example we can see all the documents added with their corresponding metadata.

Results with Folders

If you defined folders in your paths and your folders didn't already be and so they will be created in SharePoint and the relevant files added. If the folders already existed then the files will simply be added to the matching binder.

From the example data where the files were listed inside folders, the SharePoint Certificate Library now reflects this:

And clicking inside a folder will prove the documents defined to be in that folder.

If you lot haven't already, brand certain to save your Information Sync projection so that you can schedule it to run on a regular basis or use it once more when you lot need to.

Automate & Schedule

Run via the Run Tool

The Run Tool is an additional programme that comes linked to Information Sync and enables you lot to build out your information integration jobs.

You can use this to grouping Data Sync projects that need to run in society and add boosted footstep types such as calculation an condition report to email yous when the project has run and if in that location were any failures. Each pace is run in the guild it appears in the list and you can apply conditional rules so that the next step tin run if the previous one succeeded or had information changes for example. To find out more please run across our Run Tool Documentation.

To open your project in the Run Tool, in your Information Sync project go to Tools >Open up in Run Tool.

You tin so click onto the green Run button to check it runs as expected. If there are information changes you will be provided with a count of how many items were added updated or deleted

Run via the Command Line

Another pick is to Run the Run Tool project or single Information Sync project from the command line. To do this pass the path to the project file like this:

Run Tool Projection

          %DATASYNCINSTALLPATH%\Simego.DataSync.Run.exe -execute "D:\DSProjects\myproject.dsrun"                  

Data Sync Project

          %DATASYNCINSTALLPATH%\Simego.DataSync.Studio.exe -execute "D:\DSProjects\myproject.dsprj"                  

Automate with Windows Job Scheduler

You can then schedule your Run Tool project to run when y'all need it to using Windows Task Scheduler. For the full details on how to do this see our Task Scheduler Documentation.

Automate with Ouvvi

An culling option, with more scheduling capabilities is to use Ouvvi Automation Server. Ouvvi enables you to fully schedule and manage all of your Data Integration Projects, from Data Sync projects to SQL Statements to Powershell Scripts.

Information technology provides full logging and documentation capabilities to fully manage your integration operations.

To detect out more run across our Ouvvi Documentation or send us an email.

If you want to find out how you tin sync documents directly to SharePoint from the file system bank check out our other web log hither. Alternatively to Synchronise a SharePoint Certificate Library with the file system, see our blog here.

hamiltonsagifen60.blogspot.com

Source: https://www.simego.com/blog/bulk-upload-sharepoint-documents-from-excel

Share this post