Connector HTTP

Connector HTTP allows you to use the data stored under URL address using HTTP connection in your dataflow as a data source.flow.

 

RequirementsFeatures

HTTP Basic authentication

AccessUse HTTP Basic authentication to store your username and password. Through Basic authentication, you will be able to log in to the internetwebsite :)through the URL address. 

YouIn order to do it, you need to insert your username and password in the URL http://username:password@example.com/ 

For example, to download the file from the Dropbox account, you need to know the link to the files you wish to download, Dropbox login and password.

For login Meiro, password Meiro12345 and link: dropbox.com/class/archive.csv, URL would look like

https://Meiro:Meiro12345@dropbox.com/class/archive.csv

For this example the parameters of your dataHTTP source.configurations will look like:

Host: https://Meiro:Meiro12345@dropbox.com

Path: /class/archive.csv

In this way, you will log in to Dropbox account through your URL and download CSV files directly to your Data Out bucket. 

To read more about Basic authentification please refer to this article. 

 

Features

You can use HTTP Basic authentication in order to provide a username and password when making a request. More about HTTP Basic authentication can be found here. 

 

Data In/Data Out

Data In 

N/A

Data Out

Results will be saved as files in the Data Out bucket out/files. The data format will correspond to the data format stored under the URL you are connecting to Meiro Integrations.

More about folder structure here. 

 

Parameters

Host and Path (required)

Host and Path can be found in your URL address: https://this is baseURL/this is path

Example:

For URL: https://web.stanford.edu/class/archive/cs/cs109/cs109.1166/stuff/titanic.csv

The Host is:Host: https://web.stanford.edu

The Path is:Path: /class/archive/cs/cs109/cs109.1166/stuff/titanic.csv

As a result, you will download CSV dataset.

 

HTTP Basic authentication

You can use HTTP Basic authentication to store your username and password. This can be useful if you wish to use URL which requires your login and password. Using Basic authentication, you will be able to log in to the website through the URL address and download the files. 

 

In order to do it, you need to insert your username and password in the URL, based on the template below: 

http://username:password@example.com/ 

 

Example:

This example demonstrates how to download the file from the Dropbox account which requires a login and password. You need to know the link to the files you wish to download, login and password.

User: Meiro 

Password: Meiro12345 

Link to the file: dropbox.com/class/archive.csv. 

For the parameters above, the complete URL would look like: 

https://Meiro:Meiro12345@dropbox.com/class/archive.csv

 

In this case, the parameters of your configurations will look like:

Host: https://Meiro:Meiro12345@dropbox.com

Path: /class/archive.csv

 

In this way, you will log in to Meiro Integrations account in Dropbox through your URL and download CSV files to your Data Out bucket.