Skip to content

Commit

Permalink
Merge branch 'opensearch-project:main' into kalyan/286-ml-commons-add…
Browse files Browse the repository at this point in the history
…-train-support
  • Loading branch information
rawwar authored Oct 27, 2023
2 parents 31fac86 + 5ca5aa8 commit eab5a29
Show file tree
Hide file tree
Showing 6 changed files with 33 additions and 8 deletions.
2 changes: 2 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,8 @@ Inspired from [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)
- Update model upload history - sentence-transformers/distiluse-base-multilingual-cased-v1 (v.1.0.1)(TORCH_SCRIPT) by @dhrubo-os ([#281](https://github.com/opensearch-project/opensearch-py-ml/pull/281))
- Update pretrained_models_all_versions.json (2023-09-14 10:28:41) by @dhrubo-os ([#282](https://github.com/opensearch-project/opensearch-py-ml/pull/282))
- Enable the model upload workflow to add model_content_size_in_bytes & model_content_hash_value to model config automatically @thanawan-atc ([#291](https://github.com/opensearch-project/opensearch-py-ml/pull/291))
- Update pretrained_models_all_versions.json (2023-10-18 18:11:34) by @dhrubo-os ([#322](https://github.com/opensearch-project/opensearch-py-ml/pull/322))
- Update model upload history - sentence-transformers/paraphrase-mpnet-base-v2 (v.1.0.0)(BOTH) by @dhrubo-os ([#321](https://github.com/opensearch-project/opensearch-py-ml/pull/321))

### Fixed
- Enable make_model_config_json to add model description to model config file by @thanawan-atc in ([#203](https://github.com/opensearch-project/opensearch-py-ml/pull/203))
Expand Down
2 changes: 1 addition & 1 deletion requirements-dev.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
#
# Basic requirements
#
pandas>=1.5.2,<3
pandas>=1.5.2,<2
matplotlib>=3.6.2,<4
numpy>=1.24.0,<2
opensearch-py>=2.2.0
Expand Down
2 changes: 1 addition & 1 deletion requirements.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
#
# Basic requirements
#
pandas>=1.5.2,<3
pandas>=1.5.2,<2
matplotlib>=3.6.2,<4
numpy>=1.24.0,<2
opensearch-py>=2.2.0
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -114,25 +114,26 @@
}
},
{
"name": "huggingface/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2",
"name": "huggingface/sentence-transformers/paraphrase-mpnet-base-v2",
"versions": {
"1.0.1": {
"1.0.0": {
"format": [
"onnx",
"torch_script"
],
"description": "This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search."
"description": "This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search."
}
}
},
{
"name": "amazon/neural-sparse/opensearch-neural-sparse-encoding-doc-v1",
"name": "huggingface/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2",
"versions": {
"1.0.0": {
"1.0.1": {
"format": [
"onnx",
"torch_script"
],
"description": "This is a neural sparse encoding model: It transfers text into sparse vector, and then extract nonzero index and value to entry and weights. It serves only in ingestion and customer should use tokenizer model in query."
"description": "This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search."
}
}
}
Expand Down
2 changes: 2 additions & 0 deletions utils/model_uploader/upload_history/MODEL_UPLOAD_HISTORY.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,3 +19,5 @@ The following table shows sentence transformer model upload history.
|2023-08-31 15:22:19|@dhrubo-os|`sentence-transformers/msmarco-distilbert-base-tas-b`|1.0.2|ONNX|N/A|N/A|6042401385|
|2023-08-31 15:22:19|@dhrubo-os|`sentence-transformers/msmarco-distilbert-base-tas-b`|1.0.2|TORCH_SCRIPT|N/A|N/A|6042401385|
|2023-09-13 18:03:32|@dhrubo-os|`sentence-transformers/distiluse-base-multilingual-cased-v1`|1.0.1|TORCH_SCRIPT|N/A|N/A|6178024517|
|2023-10-18 18:06:15|@dhrubo-os|`sentence-transformers/paraphrase-mpnet-base-v2`|1.0.0|ONNX|N/A|N/A|6568285400|
|2023-10-18 18:06:15|@dhrubo-os|`sentence-transformers/paraphrase-mpnet-base-v2`|1.0.0|TORCH_SCRIPT|N/A|N/A|6568285400|
20 changes: 20 additions & 0 deletions utils/model_uploader/upload_history/supported_models.json
Original file line number Diff line number Diff line change
Expand Up @@ -28,5 +28,25 @@
"Embedding Dimension": "N/A",
"Pooling Mode": "N/A",
"Workflow Run ID": "6178024517"
},
{
"Model Uploader": "@dhrubo-os",
"Upload Time": "2023-10-18 18:06:15",
"Model ID": "sentence-transformers/paraphrase-mpnet-base-v2",
"Model Version": "1.0.0",
"Model Format": "ONNX",
"Embedding Dimension": "N/A",
"Pooling Mode": "N/A",
"Workflow Run ID": "6568285400"
},
{
"Model Uploader": "@dhrubo-os",
"Upload Time": "2023-10-18 18:06:15",
"Model ID": "sentence-transformers/paraphrase-mpnet-base-v2",
"Model Version": "1.0.0",
"Model Format": "TORCH_SCRIPT",
"Embedding Dimension": "N/A",
"Pooling Mode": "N/A",
"Workflow Run ID": "6568285400"
}
]

0 comments on commit eab5a29

Please sign in to comment.