This article takes a deep dive into why we built Burst Mode as well as when to consider it. If you just want to learn how to use it skip directly to this article.
Why build a Burst Mode Upload?
The Burst Mode Upload was built for users who want to upload large number of records or those who want to queue up multiple uploads without having to wait for each one to complete.
Without Burst Mode, the data CloudExtend sends to NetSuite must be processed and sent back to Excel within 2 minutes (1 minute on a Mac) or communications between Excel and NetSuite will timeout. Because of this, data is sent in small batches that will take less than 1-2 minutes to process. Depending on the record type this could be anywhere from 10-100 records.
There are three disadvantages to the standard approach
- There is a processing overhead (transmission of data) of 10-30 seconds for each batch sent/received. If you had 100 records being updated in 4 batches this adds 40-120 seconds of added overhead
- You cannot work in CloudExtend Excel while the data is being transmitted/processed
- You cannot submit multiple upload jobs simultaneously
The 'Burst Model Upload' solves these disadvantages.
What is Burst Mode Upload
With Burst Mode Upload all of your data is submitted at once (typically in a few seconds) in very large chunks and sent to CloudExtend servers where it is queued for asynchronous processing in NetSuite. Once the Burst Mode Upload is submitted you can continue working in Excel, even submitting other CloudExtend jobs, and will be notified when the job is completed.
If you save your file you can even close Excel and the next time you open it and load CloudExtend you will be notified of the job status and will update your workbook with the upload results and indicate whether each record was upserted successfully or failed.
Summary of benefits to Burst Mode Upload
- Accommodates large uploads
- Users can immediately begin working with other CloudExtend Excel workbooks and worksheets
- Users can submit other CloudExtend batches
- Once the job is submitted users do not need to monitor it. Users can even close Excel and turn off their computer letting a large update process over lunch (or overnight)
When would I use it?
- If you are submitting large complex batches that NetSuite cannot process in the one to two minutes allocated
- If you have other Excel work to do while batches are processing
- If you have large data sets (note the definition of 'large' is subjective depending on your own needs. For example, one user may be willing to wait for 500 Sales Orders to process in batches of 25 while another may prefer to submit it as one batch, do other work, and then come back to it when complete).
- If your NetSuite account typically has concurrency issues
Burst Mode upload is not supported if your template/fields contains any of the following
- Custom transaction records
- Custom segments
- Multi-select fields
- Custom field of type Phone
Who can use Burst Mode Upload
Users that subscribe to the CloudExtend Excel for NetSuite Enterprise Edition can take advantage of 'Burst Mode Upload' in Preview Mode upon request by contacting firstname.lastname@example.org. It's expected to go live for all Enterprise Edition customers in Q4 2019.
Are there any drawbacks to using the Burst Mode Upload?
While Bust Mode gets your data to NetSuite very quickly, NetSuite may not process your requests immediately. If your NetSuite account is reasonably busy with other work such as requests coming in from other apps or users, NetSuite may not pick up upload job immediately. Therefore the entire job may, in some cases, seem to take longer than regular uploads for smaller sets of records.