-
Notifications
You must be signed in to change notification settings - Fork 257
Vector db project #7961
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Vector db project #7961
Changes from 15 commits
fc87d07
42cb079
28284d1
d6b100c
0807c38
fc037f4
cb31b4b
f743c21
e466b43
05ff401
c2a941d
5427e57
3c74f86
a65f69b
91ee958
9159053
531826d
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,62 @@ | ||||||
| --- | ||||||
| navigation_title: Vector Database projects | ||||||
| applies_to: | ||||||
| serverless: ga | ||||||
| products: | ||||||
| - id: cloud-serverless | ||||||
| - id: elasticsearch | ||||||
| description: >- | ||||||
| Learn how costs for Elasticsearch Vector Database Serverless projects | ||||||
| are calculated across storage, search, ingest, and infrastructure. | ||||||
| --- | ||||||
|
|
||||||
| # {{es}} Vector Database billing dimensions [vector-database-billing] | ||||||
|
|
||||||
| {{es}} Vector Database projects on {{serverless-full}} are priced based on consumption across storage, search, ingest, and infrastructure. | ||||||
|
|
||||||
| Your monthly bill is calculated based on these components: | ||||||
|
|
||||||
| * **Storage** — Measured by the total amount of data stored in your project, in GB. | ||||||
| * **Search** — Measured by reserved search capacity for your stored data. Capacity is controlled by your project's [Search Power](/deploy-manage/deploy/elastic-cloud/project-settings.md#elasticsearch-manage-project-search-power-settings) setting and scales with how much data you store. | ||||||
| * **Ingest** — Measured by the volume of data you ingest into your project over the course of a month, in GB. | ||||||
| * **Infrastructure fee** — Measured by the number of hours your project is running. | ||||||
|
|
||||||
| For current rates, refer to the [Cloud Pricing Table](https://cloud.elastic.co/cloud-pricing-table?productType=serverless) or the [{{serverless-full}} pricing](https://www.elastic.co/pricing/serverless) pages. | ||||||
|
|
||||||
| <!-- Fact-check: add a dedicated Vector Database pricing URL when marketing publishes one. --> | ||||||
|
|
||||||
| ## Storage [vector-database-billing-storage] | ||||||
|
|
||||||
| You are charged per GB of data stored in the project. Storage charges apply for as long as the data remains in the project. | ||||||
|
|
||||||
| ## Search [vector-database-billing-search] | ||||||
|
|
||||||
| Search charges cover the search capacity reserved for your stored data. All stored data is searchable by default, which means it actively contributes to Search charges. | ||||||
|
|
||||||
| [Search Power](/deploy-manage/deploy/elastic-cloud/project-settings.md#elasticsearch-manage-project-search-power-settings) determines how much capacity is reserved. At Search Power **100**, enough capacity is reserved so that 100% of your project data remains available for low-latency search. Higher Search Power values reserve more capacity in proportion to that baseline: for example, **200** reserves about twice as much as **100**. | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. We've added a floor where anything less than 16 GB is billed at 16 GB. It's a little more complex than that, but just barely and not in a way that is negative to customers. Do we want to mention that here? (We also plan on reducing that floor over time.) |
||||||
|
|
||||||
| Increasing Search Power reserves more capacity and raises search charges. Running more queries does not increase search charges. For current rates, refer to the [Cloud Pricing Table](https://cloud.elastic.co/cloud-pricing-table?productType=serverless). | ||||||
|
|
||||||
| ## Ingest [vector-database-billing-ingest] | ||||||
|
|
||||||
| Ingest charges are based on the volume of data written to your project, measured in GB for the billing period. This uses the same definition of billable ingested bytes as other Serverless offerings. | ||||||
|
|
||||||
| ## Infrastructure [vector-database-billing-infrastructure] | ||||||
|
|
||||||
| You are billed an hourly infrastructure fee for every hour that your project is running. | ||||||
|
|
||||||
| ## Managing Vector Database costs [vector-database-billing-managing-costs] | ||||||
|
|
||||||
| Vector Database costs follow your storage footprint, search resource allocation, ingest volume, and the hours your project is available. To balance performance with spend, adjust the controls described in this section. | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. While technically true about the hours that your project is available, we don't have a way to make a project unavailable short of deleting it. The hourly billing is really just a reflection on how we meter: to a customer it should look a lot like a monthly fee that is pro-rated if they start/end in the middle of the month. |
||||||
|
|
||||||
| ### Search Power setting [vector-database-billing-search-power-setting] | ||||||
|
|
||||||
| [Search Power](/deploy-manage/deploy/elastic-cloud/project-settings.md#elasticsearch-manage-project-search-power-settings) reserves search capacity for your project. Start at the default of **100**, measure latency and throughput for your workload, then increase Search Power if you need more capacity. You increase Search Power in increments of 100. Higher Search Power increases search charges in proportion to the setting and your stored data volume. You can increase Search Power up to **1900**. | ||||||
|
|
||||||
| For high availability, you can increase Search Power to **200**. That setting reserves enough capacity for two full copies of your project data to remain available for low-latency search. | ||||||
|
|
||||||
| ## Related billing dimensions [vector-database-billing-related] | ||||||
|
|
||||||
| Shared {{serverless-short}} add-ons such as [data out](serverless-project-billing-dimensions.md#general-serverless-billing-data-out) and [support](serverless-project-billing-dimensions.md#general-serverless-billing-support) may also appear on your bill. See [](serverless-project-billing-dimensions.md). | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
|
||||||
| If you use {{cps}}, additional charges may apply when the feature becomes generally available. For how those charges are calculated, refer to [ {{cps}} Billing](/deploy-manage/cross-project-search-config.md#cps-billing). | ||||||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -54,6 +54,7 @@ $$$elasticsearch-manage-project-search-power-settings$$$ | |
| | Setting | Description | Project Type | | ||
| | :--- | :--- | :--- | | ||
| | **Search Power** | Search Power controls the amount of baseline resources kept ready for your data and the maximum amount of resources the system can allocate to your project under high search load.<br><br>Increase **Search Power** to add resources for improved query throughput and performance as load increases. Decrease it to reduce the amount of provisioned resources, which lowers both active search costs and the reduced rate billed during idle periods, at the cost of more variable query latency. The On-demand setting provides the lowest baseline and idle cost.<br><br>Choose from three Search Power settings:<br><br>**On-demand:** Low cost option. Query latency is variable and maximum throughput is limited, particularly during demand spikes.<br><br>**Performant:** Delivers low _average_ query latency with no practical query throughput limits to meet varying demand.<br><br>**High availability:** Maintains consistent low query latency across most search workloads, from steady baseline to peak demand.<br> | {{es}} | | ||
| | **Search Power** | Search Power reserves search capacity for your project. Unlike {{es}} projects, capacity is not scaled automatically based on query load.<br><br>The default value is **100**, which reserves enough search resources so that 100% of your project data remains available for low-latency search. You can increase Search Power in increments of 100. Higher values reserve proportionally more capacity: for example, **200** reserves about twice the capacity of **100**. You can increase Search Power up to **1900**.<br> | {{es}} Vector Database | | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Does this have Search Power twice?
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Oh, I see, it will only be for VDB. |
||
| | **Search Boost Window** | Non-time series data is always considered search-ready. The **Search Boost Window** determines the volume of time series project data that will be considered search-ready.<br><br>Increasing the window results in a bigger portion of time series project data included in the total search-ready data volume.<br> | {{es}} | | ||
| | **Data Retention** | Data retention policies determine how long your project data is retained.<br>In {{serverless-full}} data retention policies are configured through [data streams](../../../manage-data/lifecycle/data-stream.md) and you can [specify different retention periods](../../../manage-data/lifecycle/data-stream/tutorial-update-existing-data-stream.md#set-lifecycle) for specific data streams in your project.<br><br> {{elastic-sec}} has two additional configuration settings that can be configured to manage your data retention.<br><br>**Maximum data retention period**<br><br>When enabled, this setting determines the maximum length of time that data can be retained in any data streams of this project.<br><br>Editing this setting replaces the data retention set for all data streams of the project that have a longer data retention defined. Data older than the new maximum retention period that you set is permanently deleted.<br><br> **Default data retention period**<br><br>When enabled, this setting determines the default retention period that is automatically applied to all data streams in your project that do not have a custom retention period already set.<br> |Elasticsearch<br>Observability<br>Security | | ||
| | **Project features** | Controls [feature tiers and add-on options](../../../deploy-manage/deploy/elastic-cloud/project-settings.md#project-features-add-ons) for your {{elastic-sec}} project. | Security | | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -25,9 +25,10 @@ There are differences between {{es-serverless}} and {{ech}}. Learn more in [Comp | |
|
|
||
| ## Get started | ||
|
|
||
| Elastic provides three serverless solutions available on {{ecloud}}. Follow these guides to get started with your serverless project: | ||
| Elastic provides four serverless project types available on {{ecloud}}. Follow these guides to get started with your serverless project: | ||
|
|
||
| * **[{{es-serverless}}](/solutions/search/get-started.md)**: Build powerful applications and search experiences using a rich ecosystem of vector search capabilities, APIs, and libraries. | ||
| * **[{{es-serverless}}](/solutions/search/get-started.md)**: Build powerful, scalable search and analytics applications across structured data, logs, metrics, documents, and vectors as part of a broader {{stack}}. | ||
| * **[{{es}} Vector Database](/solutions/vector-database/get-started.md)**: Build embedding-driven workloads such as semantic search, RAG, and AI-powered retrieval. Built-in models, `semantic_text`, and vector-optimized defaults mean less configuration and faster time to production. | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm wondering whether we should mention I'm leaning towards the latter, since we don't highlight other specific field types or configuration options either. |
||
| * **[{{obs-serverless}}](../../../solutions/observability/get-started.md)**: Monitor your own platforms and services using powerful machine learning and analytics tools with your logs, metrics, traces, and APM data. | ||
| * **[{{sec-serverless}}](../../../solutions/security/get-started.md#create-sec-serverless-project)**: Detect, investigate, and respond to threats with SIEM, endpoint protection, and AI-powered analytics capabilities. | ||
|
|
||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very 🤏 style nit: we usually avoid em dashes in dev docs and use a regular dash instead, but not sure if it's in the style guide or just our habit 😄 Very minor, more of a consistency thing