Connector HTTP

Connector HTTP allows you to use the data stored under URL address using HTTP connection in your dataflow as a data source.

 

Requirements

Access to the internet :)

You need to know the URL of your data source.

 

Features

You can use HTTP Basic authentication in order to provide a username and password when making a request. More about HTTP Basic authentication can be found here. 

 

Data In/Data Out

Data In 

N/A

Data Out

Results will be saved as files in the Data Out bucket out/files. The data format will correspond to the data format stored under the URL you are connecting to Meiro Integrations.

More about folder structure here. 

 

Parameters

Host and Path (required)

Host and Path can be found in your URL address: https://this is baseURL/this is path

Example:

For URL: https://web.stanford.edu/class/archive/cs/cs109/cs109.1166/stuff/titanic.csv

The Host is: https://web.stanford.edu

The Path is: /class/archive/cs/cs109/cs109.1166/stuff/titanic.csv

As a result, you will download CSV dataset.

 

HTTP Basic authentication

You can use HTTP Basic authentication to store your username and password. This can be useful if you wish to use URL which requires your login and password. Using Basic authentication, you will be able to log in to the website through the URL address and download the files. 

 

In order to do it, you need to insert your username and password in the URL, based on the template below: 

http://username:password@example.com/ 

 

Example:

This example demonstrates how to download the file from the Dropbox account which requires a login and password. You need to know the link to the files you wish to download, login and password.

User: Meiro 

Password: Meiro12345 

Link to the file: dropbox.com/class/archive.csv. 

For the parameters above, the complete URL would look like: 

https://Meiro:Meiro12345@dropbox.com/class/archive.csv

 

In this case, the parameters of your configurations will look like:

Host: https://Meiro:Meiro12345@dropbox.com

Path: /class/archive.csv

 

In this way, you will log in to Meiro Integrations account in Dropbox through your URL and download CSV files to your Data Out bucket.