0.1.14
Pre-release
Pre-release
This release brings a series of new features, bug fixes, and changes, including:
- Improved compatibility for loading many
transformers
models, including newly tested support forPhi-3
- New capabilities in the
guidance.json
function for generating json, including early support for pydantic schemas. - Support for AzureAI models in new
guidance.models.AzureAIStudio*
classes - Significant dependency reductions on the default guidance installation
- Small grammar optimizations
- Many improvements to the infrastructure, testing, and release pipelines :)
What's Changed
- replace catches of the ImportError exception with the more specific ModuleNotFoundError exception by @paulbkoch in #733
- fix for issue #660 where the call to llama_batch_free is failing during process shutdown by @paulbkoch in #734
- Fix #713 for mistral models in transformers by @slundberg in #740
- Update JSON API and example notebook by @riedgar-ms in #699
- remove redundant options from select() by @mmoskal in #712
- Add support for
prefixItems
,minItems
, andmaxItems
forJSON
array generation by @hudson-ai in #732 - [Docs] Expand documentation by @riedgar-ms in #750
- Generation with
pydantic
schemas by @hudson-ai in #724 - First stab at minimal mypy implementation by @ryanpeach in #738
- remove openai hard dependency by @slundberg in #763
- from guidance import guidance by @ryanpeach in #759
- Run black on codebase by @Harsha-Nori in #765
- add rust bindings by @paulbkoch in #736
- fix Transformers tokenizer issues when models have extended vocabulary and/or special tokens by @Harsha-Nori in #766
- [Install] Rework optional imports by @riedgar-ms in #767
- Update _llama_cpp.py based on new contract of llama_get_logits by @czoccolo in #769
- [Bug] Missing support for AzureAI by @riedgar-ms in #770
- [Doc] Add developer notes by @riedgar-ms in #774
- [Feature] Improved JSON Schema support by @riedgar-ms in #787
- [Bug] Fix Regex for identifying OpenAI models by @alexander-brady in #778
- Fix models like phi-3 which have a mismatched tokenizer definition and model output tensor size by @Harsha-Nori in #792
- [Feature] Add
temperature
to JSON generator by @riedgar-ms in #784 - [Feature] Support for Azure AI Studio by @riedgar-ms in #779
- Add guard for running build from setup.py, redirecting users to pip by @Harsha-Nori in #805
- Many testing and CI improvements by @riedgar-ms
New Contributors
- @mmoskal made their first contribution in #712
- @ryanpeach made their first contribution in #738
- @czoccolo made their first contribution in #769
- @alexander-brady made their first contribution in #778
Full Changelog: 0.1.13...0.1.14