You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _migration-assistant/migration-phases/migrate-metadata/handling-field-type-breaking-changes.md
-8Lines changed: 0 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -73,14 +73,6 @@ The following script demonstrates how to perform common field type conversions,
73
73
* Replacing the deprecated `string` type with `text`.
74
74
* Converting `flattened` to `flat_object` and removing the `index` property if present.
75
75
76
-
{: .note }
77
-
For migrations from Elasticsearch 1.x-5.x, the `string` to `text`/`keyword` conversion is handled automatically by the Migration Assistant. See [Field Data Type Deprecation - string]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-string-type-deprecation/) for more details.
78
-
79
-
{: .note }
80
-
For migrations from Elasticsearch 7.x, the `dense_vector` to `knn_vector` conversion is handled automatically by the Migration Assistant. See [dense_vector to knn_vector conversion]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-dense-vector-conversion/) for more details.
81
-
82
-
{: .note }
83
-
For OpenSearch 2.7+, the `flattened` to `flat_object` conversion is handled automatically by the Migration Assistant. See [Flattened type handling]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-flattened-type/) for more details.
Copy file name to clipboardExpand all lines: _migration-assistant/migration-phases/migrate-metadata/index.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -177,9 +177,9 @@ Metadata migration requires modifying data from the source to the target version
177
177
For guidance on handling specific field type compatibility issues, see:
178
178
-[Transform type mappings]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-type-mapping-deprecation/) - Handle deprecated mapping types from Elasticsearch 6.x
179
179
-[Transform field types]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-field-type-breaking-changes/) - Configure custom field type transformations
180
-
-[Flattened type handling]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-flattened-type/) - Automatic conversion of flattened to flat_object for OpenSearch 2.7+
181
-
-[Field Data Type Deprecation - string]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-string-type-deprecation/) - Automatic conversion of string to text/keyword for Elasticsearch 1.x-5.x
182
-
-[dense_vector to knn_vector conversion]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/handling-dense-vector-conversion/) - Automatic conversion of dense_vector to knn_vector for Elasticsearch 7.x
180
+
-[Transform flattened to flat_object]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/transform-flattened-flat-object/) - Automatic transformation of flattened to flat_object
181
+
-[Transform string to text/keyword]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/transform-string-text-keyword/) - Automatic transformation of string to text/keyword
182
+
-[Transform dense_vector to knn_vector]({{site.url}}{{site.baseurl}}/migration-assistant/migration-phases/migrate-metadata/transform-dense-vector-knn-vector/) - Automatic transformation of dense_vector to knn_vector
Convert mapping type dense_vector to OpenSearch knn_vector.
12
+
Convert field data type dense_vector to OpenSearch knn_vector.
13
13
14
-
This guide explains how the Migration Assistant automatically handles the conversion of Elasticsearch's `dense_vector` field type to OpenSearch's `knn_vector` field type during migration.
14
+
This guide explains how the Migration Assistant automatically handles the transformation of Elasticsearch's `dense_vector` field type to OpenSearch's `knn_vector` field type during migration.
15
15
16
16
## Overview
17
17
18
18
The `dense_vector` field type was introduced in Elasticsearch 7.x for storing dense vectors used in machine learning and similarity search applications. When migrating from Elasticsearch 7.x to OpenSearch, the Migration Assistant automatically converts `dense_vector` fields to OpenSearch's equivalent `knn_vector` type.
19
19
20
-
This conversion includes mapping the vector configuration parameters and enabling the necessary OpenSearch k-NN plugin settings.
20
+
This transformation includes mapping the vector configuration parameters and enabling the necessary OpenSearch k-NN plugin settings.
21
21
22
22
## Compatibility
23
23
24
-
The `dense_vector` to `knn_vector`conversion applies to:
25
-
-**Source clusters**: Elasticsearch 7.x with dense_vector fields
26
-
-**Target clusters**: OpenSearch (any version)
24
+
The `dense_vector` to `knn_vector`transformation applies to:
25
+
-**Source clusters**: Elasticsearch 7.x+
26
+
-**Target clusters**: OpenSearch 1.x+
27
27
-**Automatic conversion**: No configuration required
28
28
29
29
## Automatic conversion logic
30
30
31
31
The Migration Assistant performs the following transformations when converting `dense_vector` to `knn_vector`:
32
32
33
-
### Field type conversion
33
+
### Field type transformation
34
34
- Changes `type: "dense_vector"` to `type: "knn_vector"`
35
35
- Maps `dims` parameter to `dimension`
36
36
- Converts similarity metrics to OpenSearch space types
37
37
- Configures HNSW algorithm with Lucene engine
38
38
39
39
### Similarity mapping
40
-
The conversion maps Elasticsearch similarity functions to OpenSearch space types:
40
+
The transformation maps Elasticsearch similarity functions to OpenSearch space types:
41
41
-`cosine` → `cosinesimil`
42
42
-`dot_product` → `innerproduct`
43
43
-`l2` (default) → `l2`
@@ -54,21 +54,24 @@ During the migration process, you'll see this transformation in the output:
54
54
```
55
55
Transformations:
56
56
dense_vector to knn_vector:
57
-
Convert mapping type dense_vector to OpenSearch knn_vector
57
+
Convert field data type dense_vector to OpenSearch knn_vector
@@ -247,7 +136,7 @@ When any `dense_vector` fields are converted, the following index setting is aut
247
136
248
137
### Migrating from Elasticsearch 7.x
249
138
250
-
The Migration Assistant automatically converts all `dense_vector` fields during metadata migration. The k-NN plugin must be installed and enabled on the target OpenSearch cluster.
139
+
The Migration Assistant automatically transforms all `dense_vector` fields during metadata migration. The k-NN plugin must be installed and enabled on the target OpenSearch cluster.
0 commit comments