Third-Party Data Loads – Web

For large third-party data uploads, you can bypass the web uploader and upload your data to any folder in your Reveal S3 Staging Bucket (you can add the data to either the Persistent or Temporary folders). For this to work properly, the natives and text must be unzipped.

To enable this workflow:

1. Make sure your structured data is unzipped.

2. Drag and drop it to a folder in your Reveal S3 Staging Bucket.

After uploading the data to the Reveal S3 Staging Bucket, manipulate the path to the natives and text in your load file by adding in the S3 path and changing backslashes [ \ ] to forward slashes [ / ] if necessary.

As an example, below is the before and after changes to a native file. This would also follow the same behavior for the text file.

Update Native and Text Paths in DAT Files

1. Make a copy of the original DAT file, so that you are working off of a copy.

2. Open the copy in Notepad++.

3. Press Ctrl+H to open Find and Replace.

4. Set Search Mode to Regular expression.

5. Wrap the target fields.

   1. In the Find field: (þZ:\\20240303_RapidPilot\\[^þ\r\n]*)

   2. In the Replace field: @@@\1@@@

   3. Click Replace All.

      • This wraps any field starting with þ@@@Z:\20240303_RapidPilot\... in @@@ markers.

6. Replace backslashes inside the wrapped fields.

   1. In the Find field: @@@(.*?)\\(.*?@@@)

   2. In the Replace field: @@@\1/\2

   3. Click Replace All repeatedly (2–3 times) until 0 occurrences are replaced.

      • This converts all \ to / only inside the wrapped sections

7. Remove the markers.

   1. Change Search Mode to Normal.

   2. In the Find field: Common path to native/txt.

      • In our example, find: @@@Z:/20240303_RapidPilot/

   3. In the Replace field: Common path to native/text in S3.

      • In our example, replace with: @@@

   4. Click Replace All.

The fields are now converted to S3-style paths while all other fields remain unchanged.

Initiate Processing in Reveal Review

Once the upload process is complete, open the project in Reveal and follow the below steps. After step 8, please refer to the remainder of the standard process (like field mapping) contained within the Load File section in Create Upload Job.

1. Go to Uploads in the navigation panel.

2. Click +Upload.

3. Name your Upload Job.

4. Choose Load Files.

5. Choose Metadata + Renderings.

6. Browse to your manipulated S3 path DAT or CSV file.

7. For Rendering Folder, create a folder anywhere that has nothing in it, and point the system to it. This is not necessary as the data is in S3.

8. Click Next.