Load data into Vertica from an HTTP source using cURL – with example

Category : Code · (2) Comments · by Jul 27th, 2014

Recently I needed to load a CSV located in a public Amazon S3 bucket into Vertica. There’s some Vertica documentation for setting up a User Defined Load (UDL) Source, but here I’ll show you how to bring it all together.

In short, there’s a UDL Source for cURL in /opt/vertica/sdk/examples. You build the UDL from the given cpp code using make, and then create a library and source in Vertica for cURL. Finally, you can use cURL with a COPY statement to load data into a table.