feat: Add max tokens setting for model generations

Adds a new setting to control the maximum number of tokens generated by the model. This provides more control over the length of responses and can be useful for limiting the amount of text generated in certain situations.
This commit is contained in:
n4ze3m
2024-11-09 16:56:47 +05:30
parent 7c805cfe22
commit fd654cafdb
20 changed files with 119 additions and 17 deletions

View File

@@ -70,6 +70,10 @@
"label": "上下文数量",
"placeholder": "输入上下文数量默认2048"
},
"numPredict": {
"label": "最大令牌数 (num_predict)",
"placeholder": "输入最大令牌数例如2048、4096"
},
"seed": {
"label": "随机种子",
"placeholder": "输入随机种子值例如1234",