Skip to content

Commit 106e449

Browse files
authored
Pin transformers/tokenizers for ML tests (#38291)
1 parent 9caf1a6 commit 106e449

2 files changed

Lines changed: 8 additions & 1 deletion

File tree

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
{
2+
"comment": "Modify this file in a trivial way to cause this test suite to run",
3+
"revision": 3
4+
}

sdks/python/setup.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -199,7 +199,10 @@ def cythonize(*args, **kwargs):
199199
# `cls_token=` or tokenizers reinstates `cls=` as a deprecation alias.
200200
'tokenizers<0.23',
201201
'torch',
202-
'transformers',
202+
# Match tested transformers range.
203+
'transformers>=4.28.0,<4.56.0',
204+
# Keep tokenizers compatible with this transformers range.
205+
'tokenizers>=0.13.3,<0.22.0',
203206
]
204207

205208
ml_adk_dependency = [

0 commit comments

Comments
 (0)