Case Study
10,000x cost reduction for loading Oracle NetSuite data
Low-footprint open-source software replaces expensive SaaS data loading tool and enterprise license. $ 2,600 per month shrink to < $1 per month
Challenge
Off-the shelve vendor solutions from NetSuite Analytics Connect and Fivetran would around $2,600 per month and neither Fivetran nor NetSuite Analytics Connect could deliver all the required data. Further, extensive data modeling would be required to integrate the NetSuite data with the other business data.
Solution
We leveraged the NetSuite REST API to fetch saved searches and custom reports. Using the dlt REST API source, we import the data into Snowflake and schedule it weekly via Github actions. Minimal data integration was necessary because we imported already modelled data from saved searches and custom reports instead of raw tables.
Results
The monthly cost shrunk from $2,600 USD to $0.20 because the complete data import pipeline runs for only about 6min once per week. The chosen technology is open-source, easily extensible, and maintenance-free due to stable enterprise APIs.
