Release/423 release candidate #13036
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
maziyarpanahi
commented
Nov 4, 2022
•
maziyarpanahi
commented
- Adding Control for Annotators with One Column #12997
- Serializable Issue K8s Word Embeddings #13001
- SPARKNLP-642: Fix indexing issue for regex splits without space #13032
- SPARKNLP 643 detecting spark version in a safer way #13035
- Bug fix and enhancements for CoNLLGenerator annotator #13053
- Add ScalaDoc for IAnnotation #13061
- SPARKNLP-621: Add string support to RegexMatcher in addition to a file #13060
- Fix a bug in Vision Transformer annotator that results in NaNs for some models #13048
- Fix the wrong SentencePiece model's name
- we already have `util` so it is confusing which util it should look for during the build
This was
linked to
issues
Nov 4, 2022
* SPARKNLP-643 Extract only the spark version(numbers) * SPARKNLP-643 Replace regex with LooseVersion from distutils
maziyarpanahi
added
enhancement
documentation
models_hub
* SPARKNLP-558 Adding serializable support to BytesKey object * SPARKNLP-558 Adding serializable support to BytesKey object
- it should be `spm.model`
* SPARKNLP-632 Adding control for annotators with only one expected column in Python side * SPARKNLP-632 Adding inputAnnotatorTypes and optionalInputAnnotatorTypes in annotators for Python * SPARKNLP-632 Removing useless prints to terminal * SPARKNLP-632 Adding AnnotatorType initialization in Python * SPARKNLP-632 Removing wrong imports
…me models (#13048) * code for fixing Nans * Remove var and leave a TODO Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* SPARKNLP-645 Update unit tests for CoNLLGenerator * CoNLLGenerator Bugfixes and Improvements both on Scala and Python (#13051) * Test for non-int metadata values in CoNLLGenerator * Fix for non-int metadata values bug in CoNLLGenerator * Include escaping when writing csv in order to preserve special char tokens * Remove unnecessary option from csv write * Addin metadata sentence key parameter in order to selecti which metadata field to use as sentence for CoNLL Generation * Minor formatting in scala, Python refactorization (several bug fixes supporting scala overloaded methods), Python Tests for 2 and 3 arguments Co-authored-by: Andres Fernandez <51669244+jfernandrezj@users.noreply.github.com>
#13060) - new parameter rules where users can provide an array of rules - new parameter delimiter to split the rules
danilojsl
approved these changes
Nov 10, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.