From 739e546ac5efcc2cd8ab21d63ba824edf150c4d0 Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Wed, 18 Nov 2026 13:17:27 +0100 Subject: [PATCH 1/6] docs: document dataset names in the Airbyte integration --- sources/platform/integrations/data-and-storage/airbyte.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index b9598353a1..109a11ba4b 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -32,6 +32,8 @@ To find your **dataset ID**, you need to navigate to the **Storage** tab in Apif ![Datasets in app](../images/datasets-app.png) +You can also enter the name of a [named dataset](/storage#named-and-unnamed-storages) with a `~` prefix, for example `~my-dataset`. For a dataset owned by another user, enter `username~my-dataset`. Each Actor run writes to a new dataset with a new ID by default. If your Actor writes to a named dataset, its name stays the same across runs, so you don't need to update the connector after each run. + To find your Apify API token, you need to navigate to the **Settings** tab and select **API & Integrations**. Copy it and paste it in the relevant field in Airbyte. ![Integrations token](../images/apify-integrations-token.png) From efd621be08c0377e329984332d1bd8306d95a9cd Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Wed, 18 Nov 2026 13:31:53 +0100 Subject: [PATCH 2/6] docs: explain sharing and item accumulation for named datasets in Airbyte --- sources/platform/integrations/data-and-storage/airbyte.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index 109a11ba4b..874b5e741c 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -32,7 +32,9 @@ To find your **dataset ID**, you need to navigate to the **Storage** tab in Apif ![Datasets in app](../images/datasets-app.png) -You can also enter the name of a [named dataset](/storage#named-and-unnamed-storages) with a `~` prefix, for example `~my-dataset`. For a dataset owned by another user, enter `username~my-dataset`. Each Actor run writes to a new dataset with a new ID by default. If your Actor writes to a named dataset, its name stays the same across runs, so you don't need to update the connector after each run. +You can also enter the name of a [named dataset](/storage#named-and-unnamed-storages) with a `~` prefix, for example `~my-dataset`. Airbyte looks up the name in the account that owns your API token. For a dataset owned by another user or organization, enter `username~my-dataset`. The owner must [share the dataset](/storage#share) with you first, or the connection check fails. Each Actor run writes to a new dataset with a new ID by default. If your Actor writes to a named dataset, its name stays the same across runs, so you don't need to update the connector after each run. + +A named dataset keeps the items of every run that writes to it, and Airbyte reads the whole dataset on every sync. To sync only the items of the latest run, make your Actor delete the named dataset at the start of each run and create it again. To find your Apify API token, you need to navigate to the **Settings** tab and select **API & Integrations**. Copy it and paste it in the relevant field in Airbyte. From 6a9a35b95a5af4024577293a901cdc1dbfc322a8 Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Wed, 18 Nov 2026 13:31:58 +0100 Subject: [PATCH 3/6] docs: mention dataset names in the Airbyte setup steps --- sources/platform/integrations/data-and-storage/airbyte.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index 874b5e741c..8c1c25d3bf 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -24,7 +24,7 @@ To do so, you will need to navigate to **Sources** tab in Airbyte and select **A ![Airbyte sources tab](../images/airbyte-sources.png) -You will need to provide a **dataset ID** and your Apify API Token. You can find both of these in [Apify Console](https://console.apify.com). +You will need to provide a **dataset ID** or dataset name and your Apify API Token. You can find both of these in [Apify Console](https://console.apify.com). ![Airbyte source setup](../images/airbyte-source-setup.png) From 91653cdf7b2696161d34ceb0abedbe4d23cefe86 Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Wed, 18 Nov 2026 13:33:11 +0100 Subject: [PATCH 4/6] docs: document dataset names in the Airbyte setup steps --- .../integrations/data-and-storage/airbyte.md | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index f63e80354e..ad3d80e4fc 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -20,15 +20,21 @@ This guide shows you how to set up an Apify dataset as a source in Airbyte and c ## Set up the Apify Dataset source in Airbyte -The Apify Dataset source reads items from a single dataset, identified by its ID. Each Actor run writes to a new default dataset. To keep syncing the results of repeated runs, have your Actor write to a [named dataset](/storage#named-and-unnamed-storages) and use its ID. +The Apify Dataset source reads items from a single dataset, identified by its ID or name. Each Actor run writes to a new default dataset with a new ID. To keep syncing the results of repeated runs, have your Actor write to a [named dataset](/storage#named-and-unnamed-storages) and enter the dataset's name in Airbyte. The name stays the same across runs, so you don't need to update the source after each run. For details, see [Use a dataset name](#use-a-dataset-name). -1. In [Apify Console](https://console.apify.com), open **Storage > Datasets**, select your dataset, and copy its ID. +1. In [Apify Console](https://console.apify.com), open **Storage > Datasets**, select your dataset, and copy its ID or name. 1. Open [**Settings > API & Integrations**](https://console.apify.com/settings/integrations) and copy your API token. 1. In Airbyte, open the **Sources** tab and select **Apify Dataset**. -1. Enter the **Dataset ID** and **API token** you copied, and save the source. +1. Enter the dataset ID or name and the **API token** you copied, and save the source. Your Apify dataset is now available as a source in Airbyte. +### Use a dataset name + +Enter a dataset name with a `~` prefix, for example `~my-dataset`. Airbyte looks up the name in the account that owns your API token. For a dataset owned by another user or organization, enter `username~my-dataset`. The owner must [share the dataset](/storage#share) with you first, or the connection check fails. + +A named dataset keeps the items of every run that writes to it, and Airbyte reads the whole dataset on every sync. To sync only the items of the latest run, make your Actor delete the named dataset at the start of each run and create it again. + ## Connect the source to a destination Setting up the source only tells Airbyte where your data comes from. To move the data, create a *connection*: an Airbyte pipeline that links your Apify Dataset source to a destination and controls how and when the data syncs. To set one up, follow [Set up a connection](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) in the Airbyte documentation. From 3c5f71a1d446a0106403452cb6fd6fb009159ef8 Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Fri, 20 Nov 2026 14:13:35 +0100 Subject: [PATCH 5/6] docs: name the Dataset ID field and the `~` prefix in the Airbyte setup step --- sources/platform/integrations/data-and-storage/airbyte.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index 0ff7d5c9d1..fdb3898800 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -26,7 +26,7 @@ The Apify Dataset source reads items from a single dataset, identified by its ID 1. In [Apify Console](https://console.apify.com), open **Storage > Datasets**, select your dataset, and copy its ID or name. 1. 1. In Airbyte, open the **Sources** tab and select **Apify Dataset**. -1. Enter the dataset ID or name and the **API token** you copied, and save the source. +1. Enter the dataset ID or `~`-prefixed name in the **Dataset ID** field and the **API token** you copied, and save the source. Your Apify dataset is now available as a source in Airbyte. From 9f8c45209760f908cb5859664bbce0fd6273f4b1 Mon Sep 17 00:00:00 2001 From: Vlada Dusek Date: Fri, 20 Nov 2026 14:13:35 +0100 Subject: [PATCH 6/6] docs: link the Airbyte dataset sharing note to the grant access rights section --- sources/platform/integrations/data-and-storage/airbyte.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index fdb3898800..ca3d47450c 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -32,7 +32,7 @@ Your Apify dataset is now available as a source in Airbyte. ### Use a dataset name -Enter a dataset name with a `~` prefix, for example `~my-dataset`. Airbyte looks up the name in the account that owns your API token. For a dataset owned by another user or organization, enter `username~my-dataset`. The owner must [share the dataset](/storage#share) with you first, or the connection check fails. +Enter a dataset name with a `~` prefix, for example `~my-dataset`. Airbyte looks up the name in the account that owns your API token. For a dataset owned by another user or organization, enter `username~my-dataset`. The owner must [share the dataset](/storage/share#grant-access-rights) with you first, or the connection check fails. A named dataset keeps the items of every run that writes to it, and Airbyte reads the whole dataset on every sync. To sync only the items of the latest run, make your Actor delete the named dataset at the start of each run and create it again.