frozenleaves/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-10-20 17:13:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
374ded5ea40c9026cf36003c737e07c584dbd63d
transformers/docs/source/en/main_classes/text_generation.md
Yuanyuan Chen 374ded5ea4 Fix white space in documentation (#41157) 
* Fix white space

Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>

* Revert changes

Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>

* Fix autodoc

Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>

---------

Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
2025-09-30 09:41:03 -07:00

1.8 KiB
Raw Blame History

Generation

Each framework has a generate method for text generation implemented in their respective GenerationMixin class:

  • PyTorch [~generation.GenerationMixin.generate] is implemented in [~generation.GenerationMixin].

You can parameterize the generate method with a [~generation.GenerationConfig] class instance. Please refer to this class for the complete list of generation parameters, which control the behavior of the generation method.

To learn how to inspect a model's generation configuration, what are the defaults, how to change the parameters ad hoc, and how to create and save a customized generation configuration, refer to the text generation strategies guide. The guide also explains how to use related features, like token streaming.

GenerationConfig

autodoc generation.GenerationConfig - from_pretrained - from_model_config - save_pretrained - update - validate - get_generation_mode

GenerationMixin

autodoc GenerationMixin - generate - compute_transition_scores