Data Streaming (Integration with Yandex Cloud)

This integration allows you to collect non-aggregated data from Yandex Metrica into your managed ClickHouse cluster in Yandex Cloud.

• Real-time data streaming (streaming upload). The delay between the time of the event and adding its record to ClickHouse is 15 minutes or less.

• Archived data exporting. You can export tag data for the entire period of its existence or for a certain time range. Set the parameters you need when you start an export in the Cloud integration tab in the Yandex Metrica Pro dashboard.

  Warning

  • You can run no more than 10 exports at the same time.
  • The export period must end at least 7 days before the current date. For example, on August 14, you can export data up to and including August 6.

• Extended set of fields compared with the Logs API:

  Category	Fields
  Content analytics data	Article topics and authors. Traffic source. Clicks to other articles on the site. ID of the article that referred to the current article. Article view time. Full scrolls.
  Traffic source details	Yandex Direct ad click ID (YCLID). Ad ID. Placement site. QR code scan.
  Customer and order data from CRM	OrderID hash and UserID hash. Order version. Order creation and update time. Order status. Names and quantities of products in the order.

  • Full list of fields exported at the hit level.

  • Full list of fields exported at the session level.

How it works

Getting started

1. Sign up for Yandex Metrica Pro or Data Streaming.

2. Create a ClickHouse cluster in Yandex Cloud.

3. Set up a connection to the created cluster.

4. In Data Transfer, connect a data source. To do this, select the data type (hits/sessions), required fields, and specify:

   • Tags whose data you want to export.
   • An OAuth token of the user who has edit access to the tag.
   • A date range (when exporting historical data).

5. Create a transfer between the source and the target. If you export historical data, select the Copying transfer type. For streaming, select Replication.

6. Set up transfer status monitoring and alerts.

7. Start the transfer.

To learn more, see the Yandex Cloud documentation.

After the transfer is started, provided that all its parameters are valid and the user has relevant permissions, the transfer will start receiving, processing, and saving data to the specified ClickHouse cluster.

You can delete your tag. Doing so will stop exporting archived data as well as data streaming.

To monitor the transfer process, you can view metrics and logs in Data Transfer. You can also disable the transfer or modify it.

You can manage your transfers to Yandex Cloud in the Yandex Metrica Pro dashboard:

1. Go to the Cloud integration tab.
2. Select an organization tag.
3. Review your active transfers. If needed, remove the tag from a transfer.

Learn more about working with data in Yandex Metrica Pro

Chat with us