Skip to content

Commit 3d6a712

Browse files
author
markzegarelli
authored
Merge branch 'master' into DOC-188_Deploy-Journeys
2 parents c7e9873 + daf1f32 commit 3d6a712

File tree

7 files changed

+40
-25
lines changed

7 files changed

+40
-25
lines changed

src/_data/catalog/destination_categories.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# AUTOGENERATED FROM PLATFORM API. DO NOT EDIT
2-
# destination categories last updated 2021-06-01
2+
# destination categories last updated 2021-06-08
33
items:
44
- display_name: Email Marketing
55
slug: email-marketing

src/_data/catalog/destinations.yml

Lines changed: 24 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# AUTOGENERATED FROM PLATFORM API. DO NOT EDIT
2-
# destination data last updated 2021-06-04
2+
# destination data last updated 2021-06-08
33
items:
44
- display_name: ActiveCampaign
55
slug: activecampaign
@@ -6234,6 +6234,17 @@ items:
62346234
required: false
62356235
description: 'If true, timestamps are converted to Unix Time.'
62366236
settings: []
6237+
- name: datacenter
6238+
display_name: Customer.io Datacenter
6239+
type: SELECT
6240+
deprecated: false
6241+
required: false
6242+
select_validators:
6243+
select_options:
6244+
- us
6245+
- eu
6246+
description: Choose your Customer.io gateway for data residency.
6247+
settings: []
62376248
- name: siteId
62386249
display_name: Site ID
62396250
type: STRING
@@ -13035,13 +13046,17 @@ items:
1303513046
deprecated: false
1303613047
required: false
1303713048
description: >-
13038-
If this option is enabled, we will never set $id field to your `userId`
13039-
when you call `.identify()` or `.track()`. Instead, we will only set a
13040-
custom attribute `id` and only set $email as the primary identifier with
13041-
your `traits.email` or `properties.email`. You should be careful when
13042-
enabling this option and understand its full implications. This should
13043-
only be enabled if you are experiencing an issue with duplicate profiles
13044-
being created inside Klaviyo.
13049+
This option is enabled by default to ensure duplicate profiles are not
13050+
being created inside of Klaviyo. When enabled, we will never set $id field
13051+
to your `userId` when you call `.identify()` or `.track()`. Instead, we
13052+
will only set a custom attribute `id` and only set $email as the primary
13053+
identifier with your `traits.email` or `properties.email`.
13054+
13055+
13056+
Klaviyo will not record events/profiles if there isn’t an email address
13057+
associated with that customer.
13058+
13059+
Impact is fewer events/profiles recorded in Klaviyo as a result.
1304513060
settings: []
1304613061
- name: privateKey
1304713062
display_name: Enter your Private Key
@@ -21797,7 +21812,7 @@ items:
2179721812
url: connections/destinations/catalog/smartlook
2179821813
description: Qualitative analytics for websites
2179921814
hidden: false
21800-
status: PUBLIC_BETA
21815+
status: PUBLIC
2180121816
previous_names:
2180221817
- Smartlook
2180321818
logo:

src/_data/catalog/source_categories.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# AUTOGENERATED FROM PLATFORM API. DO NOT EDIT
2-
# source cateogries last updated 2021-06-01
2+
# source cateogries last updated 2021-06-08
33
items:
44
- display_name: Server
55
slug: server

src/_data/catalog/sources.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# AUTOGENERATED FROM PLATFORM API. DO NOT EDIT
2-
# sources last updated 2021-06-01
2+
# sources last updated 2021-06-08
33
items:
44
- display_name: .NET
55
slug: net

src/connections/destinations/catalog/amazon-kinesis-firehose/index.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -12,8 +12,8 @@ This document was last updated on February 05, 2020. If you notice any gaps, out
1212

1313
1. Create at least one Kinesis Firehose delivery stream. You can follow these [instructions](http://docs.aws.amazon.com/firehose/latest/dev/basic-create.html) to create a new delivery stream.
1414
2. Create an IAM policy.
15-
- Sign in to the [Identity and Access Management (IAM) console](https://console.aws.amazon.com/iam/).
16-
- Follow [these instructions](https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_create-console.html#access_policies_create-json-editor) to create an IAM policy on the JSON to allow Segment permission to write to your Kinesis Firehose Stream.
15+
1. Sign in to the [Identity and Access Management (IAM) console](https://console.aws.amazon.com/iam/).
16+
2. Follow [these instructions](https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_create-console.html#access_policies_create-json-editor) to create an IAM policy on the JSON to allow Segment permission to write to your Kinesis Firehose Stream.
1717
- Use the following template policy in the **Policy Document** field. Be sure to change the `{region}`, `{account-id}` and `{stream-name}` with the applicable values.
1818

1919

@@ -36,16 +36,16 @@ This document was last updated on February 05, 2020. If you notice any gaps, out
3636

3737

3838
3. Create an IAM role.
39-
- Follow [these instructions](http://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_create_for-user.html#roles-creatingrole-user-console) to create an IAM role to allow Segment permission to write to your Kinesis Firehose Stream.
40-
- When prompted to enter an Account ID, enter `595280932656`.
41-
- Select the checkbox to enable **Require External ID**.
42-
- Enter your Segment Source ID as the **External ID**. This can be found in Segment by navigating to **Connections > Sources** and choosing the source you want to connect to your Kinesis Firehose destination. Click the **Settings** tab and choose **API Keys**.
39+
1. Follow [these instructions](http://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_create_for-user.html#roles-creatingrole-user-console) to create an IAM role to allow Segment permission to write to your Kinesis Firehose Stream.
40+
2. When prompted to enter an Account ID, enter `595280932656`.
41+
3. Select the checkbox to enable **Require External ID**.
42+
4. Enter your Segment Source ID as the **External ID**. This can be found in Segment by navigating to **Connections > Sources** and choosing the source you want to connect to your Kinesis Firehose destination. Click the **Settings** tab and choose **API Keys**.
4343
- **Note:** If you have multiple sources using Kinesis, enter one of their source IDs here for now and then follow the procedure outlined in the [Multiple Sources](#best-practices) section at the bottom of this doc once you’ve completed this step and saved your IAM role.
44-
- When adding permissions to your new role, find the policy you created in step 2 and attach it.
44+
5. When adding permissions to your new role, find the policy you created in step 2 and attach it.
4545

4646
4. Create a new Kinesis Firehose Destination.
47-
- In the Segment source that you want to connect to your Kinesis Firehose destination, click **Add Destination**.
48-
- Search and select the **Amazon Kinesis Firehose** destination and enter details for [these settings options](#settings).
47+
1. In the Segment source that you want to connect to your Kinesis Firehose destination, click **Add Destination**.
48+
2. Search and select the **Amazon Kinesis Firehose** destination and enter details for [these settings options](#settings).
4949

5050
## Page
5151
Take a look to understand what the [Page method](https://segment.com/docs/connections/spec/page/) does. An example call would look like:

src/connections/destinations/catalog/amplitude/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ Segment's Amplitude destination code is open source and available on GitHub. Fee
1414
- [Android](https://github.com/segment-integrations/analytics-android-integration-amplitude)
1515

1616
> success ""
17-
> **New Amplitude destination available**: Segment's [Destination Actions](/docs/connections/destinations/actions/) allow you to explicitly set up your Amplitude mapping, and configure which events the mappings apply to. See [Amplitude Actions destination](/docs/connections/destinations/catalog/amplitude-actions/) for more information.
17+
> **New Amplitude destination available**: Segment's [Destination Actions](/docs/connections/destinations/actions/) allow you to explicitly set up your Amplitude mapping, and configure which events the mappings apply to. See [Amplitude Actions destination](/docs/connections/destinations/catalog/actions-amplitude/) for more information.
1818
1919

2020

src/guides/duplicate-data.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,10 +2,10 @@
22
title: How does Segment handle duplicate data?
33
---
44

5-
Segment has a special de-duplication service that sits just behind the `api.segment.com` endpoint, and attempts to drop duplicate data. However, that de-duplication api has to hold the entire set of events in memory in order to know whether or not it has seen that event already. Segment stores 24 hours worth of event `message_id`s. This means Segment can de-duplicate any data that appears within a 24 hour rolling window.
5+
Segment has a special de-duplication service that sits just behind the `api.segment.com` endpoint, and attempts to drop duplicate data. However, that de-duplication service has to hold the entire set of events in memory in order to know whether or not it has seen that event already. Segment stores 24 hours worth of event `message_id`s. This means Segment can de-duplicate any data that appears within a 24 hour rolling window.
66

7-
An important point remember is that Segment de-duplicates on the event's `message_id`, _not_ on the contents of an event payload. So if you aren't generating `message_id`s for each event, or are trying to deduplicate data over a longer period than 24 hours, Segment does not have a built-in way to de-duplicate data.
7+
An important point to remember is that Segment de-duplicates on the event's `message_id`, _not_ on the contents of an event payload. So if you aren't generating `message_id`s for each event, or are trying to de-duplicate data over a longer period than 24 hours, Segment does not have a built-in way to de-duplicate data.
88

9-
Since the api layer is de-duping during this window, duplicate events that are further than 24 hours apart from one another must be de-duped in the Warehouse. Segment also dedupes messages going into a Warehouse based on the `message_id`, which is the `id` column in a Segment Warehouse. Note that in these cases you will see duplications in end tools as there is no additional layer prior to sending the event to downstream tools.
9+
Since the API layer is de-duplicating during this window, duplicate events that are further than 24 hours apart from one another must be de-duplicated in the Warehouse. Segment also de-duplicates messages going into a Warehouse based on the `message_id`, which is the `id` column in a Segment Warehouse. Note that in these cases you will see duplications in end tools as there is no additional layer prior to sending the event to downstream tools.
1010

1111
Keep in mind that Segment's libraries all generate `message_id`s for you for each event payload, with the exception of the Segment HTTP API, which assigns each event a unique `message_id` when the message is ingested. You can override these default generated IDs and manually assign a `message_id` if necessary.

0 commit comments

Comments
 (0)