Events setup

Endpoint

(required)

Select the endpoint from ME using the dropdown.

Event time extraction

(required)

The reception time in UTC can be used as the event timestamp to receive an event in near real-time. For example: 

"reception_time".

However, when receiving data from third-party endpoints, there may be a delay between the actual event occurrence. Therefore, it is necessary to utilize SQL expressions or transformations to handle such cases appropriately. For example:

"payload ->> 'timestamp'".

Remember: you need to be ensured that the event_time is always in UTC.

User identifier extraction

(required)

SQL definition that can work on the payload. For example:

"payload ->> 'user_id'"

Event filter

(required)

SQL expression that can work on the payload. For example:

"payload ->> 'type' = 'page_view'"

Move

Allows to extract a value from a specified old path, create a new path, place the extracted value in the new path, and delete the old path. This helps organize and restructure the data within the payload, improving data quality and consistency.

{
  "payload": {
    "url": "https://www.meiro.store/blog/",
    "referrer": "https://www.meiro.store/",
    "page_title": "Blog – Meiro.store"
  }
}

{
  "payload": {
    "url": "https://www.meiro.store/blog/",
    "referrer": "https://www.meiro.store/",
    "page": "Blog – Meiro.store"
  }

Map value

Allows extracting the value from the target_old_value path. It then searches for a matching value in the value_maps array, comparing the extracted value with the old value from each value_map. If a match is found, the component takes the corresponding new value from the value_map, creates a new path named target_new_value, and places the new value from the value_map there. This process is similar to a join operation in a database.

{
  "referer_parts": {
    "known": true,
    "medium": "unknown",
    "referer": null,
    "search_term": null,
    "search_parameter": null
  }
}

{
  "referer_parts": {
    "known": true,
    "medium": "medium",
    "referer": null,
    "search_term": null,
    "search_parameter": null
  }
}

Name pop-up banner

Allows extracting the banner_id value from  id_path. It then searches for a matching banner_name from the refreshed web banner data downloaded from the CDP instance. If a match is found, the component creates a new path called name_path in the payload and places the banner_name value there.

Name native banner

The same logic as in the Name pop-up banner is applied to payloads where native web banners data must be enriched.

Czech vocative

This transformation is designed for projects in the Czech Republic, where vocative forms of names are commonly used. It extracts the first name from the specified path using the first_name_path. Then tries to use a vocative library to transform first_name. The transformed name is then placed in a new path specified by result_path.

{
"name": "Marianna"
}

{
"name": "Marianna",
"name_vocative": "Marianno"
}

Czech gender

This transformation is mainly for projects in the Czech Republic because it uses a vocative library that works mostly with first names in the Czech calendar. Transformation extracts first_name from first_name_path path. Then try to use a vocative library to estimate gender from first_name. It creates a new path in result_path and places the estimated gender there.

{
"name": "Marianna"
}

{
"name": "Marianna",
"gender_estimate": "female"
}

Replace in string

Transformation extracts string object from the string_path path. Then apply Python replace method on an extracted object with old and new as an argument. It creates a new path  result_path and places the transformed string there.

{
"geo_ip_data": {
    "latitude": 50.1188,
    "city_name": "Frankfurt am Main",
    "longitude": 8.6843,
    "country_iso": "DE",
    "postal_code": "60313",
    "country_name": "Germany"
}
}

{
"geo_ip_data": {
    "latitude": 50.1188,
    "city_name": "Frankfurt am Main",
    "longitude": 8.6843,
    "country_iso": "DE",
    "postal_code": "60313",
    "country_name": "Deutschland"
}
}

Strip string

Allows extracting string object from string_path path. Then apply the Python replace method on an extracted object with old and new as an argument. It creates a new path  result_path and places the transformed string there.

{
 "cookies": {
    "_ga": "GA1.1.500734751.1682429081"
}

{
 "cookies": {
    "_ga": "1.1.500734751.1682429081"
}

Strip whitespaces

Allows deleting whitespaces from the beginning and end of a string.

{
 "cookies": {
    "_ga": "  GA1.1.500734751.1682429081  "
}

{
 "cookies": {
    "_ga": "GA1.1.500734751.1682429081"
}

Lowercase string

Transformation allows to extract string object from the string_path path. Then applies the Python lower method on an extracted object without any arguments. It creates a new path in result_path and places the transformed string there.

{
"session_id": "MTY4MjQyOTA4MDk0MCZiYWM3NDVhYS03NTUwLTQ3NmUtYmE1NS0wNjg0NDQ0N2EzMDc="
}

{
"session_id": "mty4mjqyota4mdk0mcziywm3ndvhys03ntuwltq3nmutyme1ns0wnjg0ndq0n2ezmdc="
}

Validate email

With the transformation, the string object from the string_path path is extracted. Then applies the Python lower method on an extracted object without any arguments. It creates a new path in result_path and places the transformed string there.

{
	"email": "admin@gmail.com"
}

{
	"email": "admin@gmail.com",
	"validated_email": "admin@gmail.com"
}

Delete

Checks if delete_path exists and removes it.