Skip to content

Commit ffb3b2a

Browse files
2024-08-16-deberta_base_zero_shot_classifier_mnli_anli_v3_en (#14369)
* Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_yaojingguo_pipeline_en * Add model 2024-08-17-tinygram_en * Add model 2024-08-17-checkpoint_19000_finetuned2_pipeline_en * Add model 2024-08-17-all_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_train_instruction0_soapl_en * Add model 2024-08-17-cs505_coqe_vit5_train_instruction0_soapl_pipeline_en * Add model 2024-08-17-flan_t5_retacred_all_kongo_small_finetuned_en * Add model 2024-08-17-flan_t5_retacred_all_kongo_small_finetuned_pipeline_en * Add model 2024-08-17-test_trainer1_en * Add model 2024-08-17-test_trainer1_pipeline_en * Add model 2024-08-17-pegasus_samsum_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_20220906_091928_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_20220906_091928_en * Add model 2024-08-17-pegasus_samsum_en * Add model 2024-08-17-flan_t5_base_text_style_transfer_using_examples_en * Add model 2024-08-17-t5_dd_pipeline_en * Add model 2024-08-17-t5_dd_en * Add model 2024-08-17-t5_base_multi_german_wiki_news_airklizz_pipeline_en * Add model 2024-08-17-flan_t5_small_wikitablequestions_pipeline_en * Add model 2024-08-17-t5_pretrain_lr_en * Add model 2024-08-17-flan_t5_base_text_style_transfer_using_examples_pipeline_en * Add model 2024-08-17-flan_t5_small_wikitablequestions_en * Add model 2024-08-17-t5_pretrain_lr_pipeline_en * Add model 2024-08-17-t5_base_multi_german_wiki_news_airklizz_en * Add model 2024-08-17-t5_gec_english_en * Add model 2024-08-17-t5_gec_english_pipeline_en * Add model 2024-08-17-sum_model_0318_20epochs_en * Add model 2024-08-17-sum_model_0318_20epochs_pipeline_en * Add model 2024-08-17-t5_1_1_lm100k_large_864_en * Add model 2024-08-17-t5_1_1_lm100k_large_864_pipeline_en * Add model 2024-08-17-final_final_model_math_large_model_en * Add model 2024-08-17-final_final_model_math_large_model_pipeline_en * Add model 2024-08-17-t5_60m_poli_aff_2016_en * Add model 2024-08-17-t5_small_ft_recipes_100epochs_en * Add model 2024-08-17-t5_60m_poli_aff_2016_pipeline_en * Add model 2024-08-17-seq2seq_en * Add model 2024-08-17-vanilla_mt5_tiny6l_vs16k_en * Add model 2024-08-17-seq2seq_pipeline_en * Add model 2024-08-17-vanilla_mt5_tiny6l_vs16k_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_train_instruction0_soapl_h4_en * Add model 2024-08-17-t5_small_ft_recipes_100epochs_pipeline_en * Add model 2024-08-17-mt5_small_korean_10k_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_train_instruction0_soapl_h4_pipeline_en * Add model 2024-08-17-mt5_small_task3_dataset2_en * Add model 2024-08-17-mt5_small_task3_dataset2_pipeline_en * Add model 2024-08-17-mt5_small_korean_10k_en * Add model 2024-08-17-flan_t5_large_danish_multiwoz2_0_80_en * Add model 2024-08-17-flan_t5_large_medication_lists_en * Add model 2024-08-17-flan_t5_large_danish_multiwoz2_0_80_pipeline_en * Add model 2024-08-17-flan_t5_large_medication_lists_pipeline_en * Add model 2024-08-17-t5_effecient_en * Add model 2024-08-17-t5_effecient_pipeline_en * Add model 2024-08-17-mt5_base_zhquad_qg_ae_trimmed_50000_en * Add model 2024-08-17-mt5_base_zhquad_qg_ae_trimmed_50000_pipeline_en * Add model 2024-08-17-t5_60m_news_cls_2015_pipeline_en * Add model 2024-08-17-t5_ft_billsum_en * Add model 2024-08-17-t5_ft_billsum_pipeline_en * Add model 2024-08-17-t5_small_vanilla_top_v2_en * Add model 2024-08-17-t5_60m_news_cls_2015_en * Add model 2024-08-17-burmese_awesome_opus_books_model_uiji_en * Add model 2024-08-17-burmese_awesome_opus_books_model_uiji_pipeline_en * Add model 2024-08-17-t5_small_vanilla_top_v2_pipeline_en * Add model 2024-08-17-all_mt5_base_10_wikisql_sch_en * Add model 2024-08-17-flan_t5_base_samsum_qualis2006_en * Add model 2024-08-17-flan_t5_base_samsum_qualis2006_pipeline_en * Add model 2024-08-17-ft_aeroqa_1hop_c4_aviationtriples_verb_19_en * Add model 2024-08-17-burmese_awesome_billsum_model_nbui1904_en * Add model 2024-08-17-all_mt5_base_10_wikisql_sch_pipeline_en * Add model 2024-08-17-burmese_awesome_billsum_model_nbui1904_pipeline_en * Add model 2024-08-17-ft_aeroqa_1hop_c4_aviationtriples_verb_19_pipeline_en * Add model 2024-08-17-sst2_t5_large_seed_2_en * Add model 2024-08-17-test1_nivetha_pipeline_en * Add model 2024-08-17-test1_nivetha_en * Add model 2024-08-17-sst2_t5_large_seed_2_pipeline_en * Add model 2024-08-17-vizwiz_flan_t5_base_ft_singlecap_pipeline_en * Add model 2024-08-17-vizwiz_flan_t5_base_ft_singlecap_en * Add model 2024-08-17-ukrainian_mt5_base_gec_en * Add model 2024-08-17-ukrainian_mt5_base_gec_pipeline_en * Add model 2024-08-17-mnli_t5_small_seed_2_en * Add model 2024-08-17-cs505_coqe_vit5_prompting2_aspol_en * Add model 2024-08-17-mnli_t5_small_seed_2_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_huizhoucheng_en * Add model 2024-08-17-cs505_coqe_vit5_prompting2_aspol_pipeline_en * Add model 2024-08-17-summarizer_google_long_t5_local_base_base_faceted_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_huizhoucheng_pipeline_en * Add model 2024-08-17-summarizer_google_long_t5_local_base_base_faceted_pipeline_en * Add model 2024-08-17-multi3woz_english_rg_mt5_small_en * Add model 2024-08-17-multi3woz_english_rg_mt5_small_pipeline_en * Add model 2024-08-17-vit5_base_newformat_en * Add model 2024-08-17-vit5_base_newformat_pipeline_en * Add model 2024-08-17-transcriber_t5_v8_en * Add model 2024-08-17-transcriber_t5_v8_pipeline_en * Add model 2024-08-17-flan_t5_base_eli5_question_generation_54500_pipeline_en * Add model 2024-08-17-flan_t5_base_eli5_question_generation_54500_en * Add model 2024-08-17-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_en * Add model 2024-08-17-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_pipeline_en * Add model 2024-08-17-kltn_coqe_vit5_pasol_en * Add model 2024-08-17-mt5_base_trimmed_italian_60000_en * Add model 2024-08-17-kltn_coqe_vit5_pasol_pipeline_en * Add model 2024-08-17-clickbait_spoiling_multi_en * Add model 2024-08-17-mt5_base_trimmed_italian_60000_pipeline_en * Add model 2024-08-17-clickbait_spoiling_multi_pipeline_en * Add model 2024-08-17-rut5_base_finetuned_xlsum_sum_russian_en * Add model 2024-08-17-inverse_gec_finetuned_en * Add model 2024-08-17-sst2_t5_base_seed_1_pipeline_en * Add model 2024-08-17-inverse_gec_finetuned_pipeline_en * Add model 2024-08-17-burmese_awesome_opus_books_model_minitruesecretary_pipeline_en * Add model 2024-08-17-sst2_t5_base_seed_1_en * Add model 2024-08-17-flan_t5_small_samsum_tupkalenkodi_pipeline_en * Add model 2024-08-17-flan_t5_small_samsum_tupkalenkodi_en * Add model 2024-08-17-burmese_awesome_opus_books_model_minitruesecretary_en * Add model 2024-08-17-rut5_base_finetuned_xlsum_sum_russian_pipeline_en * Add model 2024-08-17-mt5_english_rr_300_en * Add model 2024-08-17-burmese_awesome_model_audino_pipeline_en * Add model 2024-08-17-mt5_english_rr_300_pipeline_en * Add model 2024-08-17-t5_small_grammar_romanian_root_pipeline_ro * Add model 2024-08-17-burmese_awesome_model_audino_en * Add model 2024-08-17-t5_small_grammar_romanian_root_ro * Add model 2024-08-17-mt5_finetuned_amazon_english_spanish_en * Add model 2024-08-17-mt5_finetuned_amazon_english_spanish_pipeline_en * Add model 2024-08-17-bangla_para_v3_360000_en * Add model 2024-08-17-bangla_para_v3_360000_pipeline_en * Add model 2024-08-17-ke_t5_base_korean_finetuned_xsum_en * Add model 2024-08-17-ke_t5_base_korean_finetuned_xsum_pipeline_en * Add model 2024-08-17-flan_t5_small_samsum_rkcmr_en * Add model 2024-08-17-flan_t5_small_samsum_rkcmr_pipeline_en * Add model 2024-08-17-t5_small_finetuned_xsum_pztcookie_en * Add model 2024-08-17-t5_small_finetuned_xsum_pztcookie_pipeline_en * Add model 2024-08-17-t5_small_wikilarge_newsela_with_domain_adaptation_test_smaraa_en * Add model 2024-08-17-t5_small_wikilarge_newsela_with_domain_adaptation_test_smaraa_pipeline_en * Add model 2024-08-17-calculate_model_v1_5_pipeline_en * Add model 2024-08-17-calculate_model_v1_5_en * Add model 2024-08-17-t5_small_finetuned_cnn_2_en * Add model 2024-08-17-t5_small_finetuned_cnn_2_pipeline_en * Add model 2024-08-17-t5_base_adv_top_v2_en * Add model 2024-08-17-nguyenhuuhoai_pipeline_en * Add model 2024-08-17-nguyenhuuhoai_en * Add model 2024-08-17-t5_large_qg_ap_nopeft_en * Add model 2024-08-17-t5_large_qg_ap_nopeft_pipeline_en * Add model 2024-08-17-mt5_empty2_5k_msp_en * Add model 2024-08-17-mt5_empty2_5k_msp_pipeline_en * Add model 2024-08-17-flan_t5_small_1_6_xsum_en * Add model 2024-08-17-burmese_awesome_opus_books_model_jasssz_en * Add model 2024-08-17-flan_t5_small_asap_t4_f4_prompt_adherence_en * Add model 2024-08-17-flan_t5_small_asap_t4_f4_prompt_adherence_pipeline_en * Add model 2024-08-17-homework_w4_pipeline_en * Add model 2024-08-17-homework_w4_en * Add model 2024-08-17-burmese_awesome_opus_books_model_jasssz_pipeline_en * Add model 2024-08-17-flan_t5_small_1_6_xsum_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_akihiro2_en * Add model 2024-08-17-mt5_normail_en * Add model 2024-08-17-mt5_small_finetuned_amazon_english_spanish_akihiro2_pipeline_en * Add model 2024-08-17-mt5_normail_pipeline_en * Add model 2024-08-17-qag_viquad_vit5_en * Add model 2024-08-17-qag_viquad_vit5_pipeline_en * Add model 2024-08-17-flan_t5_large_medistill_28_hierarchical_ep30_en * Add model 2024-08-17-flan_t5_large_medistill_28_hierarchical_ep30_pipeline_en * Add model 2024-08-17-flan_t5_small_asap_t3_f1_prompt_adherence_en * Add model 2024-08-17-flan_t5_small_asap_t3_f1_prompt_adherence_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_4epochs_opus_books_english_tonga_tonga_islands_italian_en * Add model 2024-08-17-flan_t5_base_empathy_classification_en * Add model 2024-08-17-mt5_small_finetuned_4epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en * Add model 2024-08-17-flan_t5_base_empathy_classification_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_base_train_instruction0_soapl_v1_en * Add model 2024-08-17-cs505_coqe_vit5_base_train_instruction0_soapl_v1_pipeline_en * Add model 2024-08-17-flan_t5_base_analogy_nell_en * Add model 2024-08-17-flan_t5_base_analogy_nell_pipeline_en * Add model 2024-08-17-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_rtoguchi_en * Add model 2024-08-17-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_rtoguchi_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_prompting16_aspol_en * Add model 2024-08-17-t5_bug_comment_en * Add model 2024-08-17-t5_bug_comment_pipeline_en * Add model 2024-08-17-t5_small_finetuned_wikihow_sudolife_en * Add model 2024-08-17-cs505_coqe_vit5_prompting16_aspol_pipeline_en * Add model 2024-08-17-burmese_t5_test_pipeline_en * Add model 2024-08-17-t5_small_finetuned_wikihow_sudolife_pipeline_en * Add model 2024-08-17-burmese_t5_test_en * Add model 2024-08-17-oath_frames_flant5_large_en * Add model 2024-08-17-real_prompt_100_500sync_all_gen_t5_base_en * Add model 2024-08-17-oath_frames_flant5_large_pipeline_en * Add model 2024-08-17-real_prompt_100_500sync_all_gen_t5_base_pipeline_en * Add model 2024-08-17-speller_t5_4_en * Add model 2024-08-17-speller_t5_4_pipeline_en * Add model 2024-08-17-t5_base_mediasum_seed33_en * Add model 2024-08-17-t5_base_finetuned_epoch20_en * Add model 2024-08-17-t5_base_mediasum_seed33_pipeline_en * Add model 2024-08-17-flan_t5_small_samsum_zstoimchev_pipeline_en * Add model 2024-08-17-flant5_finetuning_pipeline_en * Add model 2024-08-17-flan_t5_small_samsum_zstoimchev_en * Add model 2024-08-17-t5_base_finetuned_epoch20_pipeline_en * Add model 2024-08-17-amhmt5_base_finetuned_amt5_en * Add model 2024-08-17-summarizer_google_long_t5_tglobal_base_most_frequent_background_conclusion_en * Add model 2024-08-17-amhmt5_base_finetuned_amt5_pipeline_en * Add model 2024-08-17-summarizer_google_long_t5_tglobal_base_most_frequent_background_conclusion_pipeline_en * Add model 2024-08-17-flant5_finetuning_en * Add model 2024-08-17-ptt5_wikilingua_cstnews_en * Add model 2024-08-17-cs505_coqe_vit5_train_instructionn4_sapol_v1_en * Add model 2024-08-17-t5_base_amazon_us_review_pipeline_en * Add model 2024-08-17-cs505_coqe_vit5_train_instructionn4_sapol_v1_pipeline_en * Add model 2024-08-17-t5_base_amazon_us_review_en * Add model 2024-08-17-ptt5_wikilingua_cstnews_pipeline_en * Add model 2024-08-17-mt5_small_trimmed_russian_en * Add model 2024-08-17-quizbot_ai_t5_small_pipeline_en * Add model 2024-08-17-legal_t5_small_multitask_czech_french_pipeline_en * Add model 2024-08-17-mt5_small_trimmed_russian_pipeline_en * Add model 2024-08-17-legal_t5_small_multitask_czech_french_en * Add model 2024-08-17-burmese_awesome_billsum_model_rogerwang87_en * Add model 2024-08-17-quizbot_ai_t5_small_en * Add model 2024-08-17-t5_base_dialogsumgen_xsum_conv_dialogsum_seed36_pipeline_en * Add model 2024-08-17-t5_base_dialogsumgen_xsum_conv_dialogsum_seed36_en * Add model 2024-08-17-mt5_finetuned_english_tonga_tonga_islands_finnish_fi * Add model 2024-08-17-deductor_flant5_large_v1_0_pipeline_en * Add model 2024-08-17-deductor_flant5_large_v1_0_en * Add model 2024-08-17-mt5_base_jaquad_qg_ae_trimmed_50000_en * Add model 2024-08-17-nativesql_with_schema_en * Add model 2024-08-17-mt5_small_finetuned_xsum_thatguyvanquish_en * Add model 2024-08-17-burmese_awesome_billsum_model_rogerwang87_pipeline_en * Add model 2024-08-17-t5_60m_lm_wmt_2019_1_pipeline_en * Add model 2024-08-17-t5_60m_lm_wmt_2019_1_en * Add model 2024-08-17-nativesql_with_schema_pipeline_en * Add model 2024-08-17-mt5_small_finetuned_xsum_thatguyvanquish_pipeline_en * Add model 2024-08-17-mt5_finetuned_english_tonga_tonga_islands_finnish_pipeline_fi * Add model 2024-08-17-mt5_base_jaquad_qg_ae_trimmed_50000_pipeline_en * Add model 2024-08-17-long_t5_local_base_finetuned_justification_v11_en * Add model 2024-08-17-long_t5_local_base_finetuned_justification_v11_pipeline_en * Add model 2024-08-17-mt5_small_paracrawl_multi_small_en * Add model 2024-08-17-mt5_small_paracrawl_multi_small_pipeline_en * Add model 2024-08-17-t5_base_pointer_top_v2_en * Add model 2024-08-17-t5_small_finetuned_xsum_edithram23_en * Add model 2024-08-17-t5_small_finetuned_xsum_edithram23_pipeline_en * Add model 2024-08-17-trevor_en * Add model 2024-08-17-trevor_pipeline_en * Add model 2024-08-17-real_prompt_100_all_gen_t5_small_en * Add model 2024-08-17-real_prompt_100_all_gen_t5_small_pipeline_en * Add model 2024-08-17-burmese_awesome_model_rachaelhumphreys_en * Add model 2024-08-17-burmese_awesome_model_rachaelhumphreys_pipeline_en * Add model 2024-08-17-mt5_small_squad_qa_trimmed_english_120000_en * Add model 2024-08-17-breastcancer_t5_large_en * Add model 2024-08-17-pubmed_mixed_noise_v5_0_2_en * Add model 2024-08-17-pubmed_mixed_noise_v5_0_2_pipeline_en * Add model 2024-08-17-breastcancer_t5_large_pipeline_en * Add model 2024-08-17-mt5_small_squad_qa_trimmed_english_120000_pipeline_en * Add model 2024-08-17-text_shortening_model_v65_en * Add model 2024-08-17-text_shortening_model_v65_pipeline_en * Add model 2024-08-17-t5large_hate_speech_own_adv_instruction_1_en * Add model 2024-08-17-bangla_para_v3_300000_en * Add model 2024-08-17-bangla_para_v3_300000_pipeline_en * Add model 2024-08-17-t5large_hate_speech_own_adv_instruction_1_pipeline_en * Add model 2024-08-17-rut5_small_finetuned_gen_description_2_en * Add model 2024-08-17-rut5_small_finetuned_gen_description_2_pipeline_en --------- Co-authored-by: ahmedlone127 <ahmedlone127@gmail.com>
1 parent 962d9e0 commit ffb3b2a

File tree

1,089 files changed

+84746
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

1,089 files changed

+84746
-0
lines changed
Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
---
2+
layout: model
3+
title: French afrimt5_bbj_french_news T5Transformer from masakhane
4+
author: John Snow Labs
5+
name: afrimt5_bbj_french_news
6+
date: 2024-08-16
7+
tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
8+
task: [Question Answering, Summarization, Translation, Text Generation]
9+
language: fr
10+
edition: Spark NLP 5.4.2
11+
spark_version: 3.0
12+
supported: true
13+
engine: onnx
14+
annotator: T5Transformer
15+
article_header:
16+
type: cover
17+
use_language_switcher: "Python-Scala-Java"
18+
---
19+
20+
## Description
21+
22+
Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_bbj_french_news` is a French model originally trained by masakhane.
23+
24+
{:.btn-box}
25+
<button class="button button-orange" disabled>Live Demo</button>
26+
<button class="button button-orange" disabled>Open in Colab</button>
27+
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_bbj_french_news_fr_5.4.2_3.0_1723843978763.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
28+
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_bbj_french_news_fr_5.4.2_3.0_1723843978763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}
29+
30+
## How to use
31+
32+
33+
34+
<div class="tabs-box" markdown="1">
35+
{% include programmingLanguageSelectScalaPythonNLU.html %}
36+
```python
37+
38+
documentAssembler = DocumentAssembler() \
39+
.setInputCol('text') \
40+
.setOutputCol('document')
41+
42+
t5 = T5Transformer.pretrained("afrimt5_bbj_french_news","fr") \
43+
.setInputCols(["document"]) \
44+
.setOutputCol("output")
45+
46+
pipeline = Pipeline().setStages([documentAssembler, t5])
47+
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
48+
pipelineModel = pipeline.fit(data)
49+
pipelineDF = pipelineModel.transform(data)
50+
51+
```
52+
```scala
53+
54+
val documentAssembler = new DocumentAssembler()
55+
.setInputCols("text")
56+
.setOutputCols("document")
57+
58+
val t5 = T5Transformer.pretrained("afrimt5_bbj_french_news", "fr")
59+
.setInputCols(Array("documents"))
60+
.setOutputCol("output")
61+
62+
val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
63+
val data = Seq("I love spark-nlp").toDS.toDF("text")
64+
val pipelineModel = pipeline.fit(data)
65+
val pipelineDF = pipelineModel.transform(data)
66+
67+
```
68+
</div>
69+
70+
{:.model-param}
71+
## Model Information
72+
73+
{:.table-model}
74+
|---|---|
75+
|Model Name:|afrimt5_bbj_french_news|
76+
|Compatibility:|Spark NLP 5.4.2+|
77+
|License:|Open Source|
78+
|Edition:|Official|
79+
|Input Labels:|[document]|
80+
|Output Labels:|[output]|
81+
|Language:|fr|
82+
|Size:|2.8 GB|
83+
84+
## References
85+
86+
https://huggingface.co/masakhane/afrimt5_bbj_fr_news
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
layout: model
3+
title: French afrimt5_bbj_french_news_pipeline pipeline T5Transformer from masakhane
4+
author: John Snow Labs
5+
name: afrimt5_bbj_french_news_pipeline
6+
date: 2024-08-16
7+
tags: [fr, open_source, pipeline, onnx]
8+
task: [Question Answering, Summarization, Translation, Text Generation]
9+
language: fr
10+
edition: Spark NLP 5.4.2
11+
spark_version: 3.0
12+
supported: true
13+
annotator: PipelineModel
14+
article_header:
15+
type: cover
16+
use_language_switcher: "Python-Scala-Java"
17+
---
18+
19+
## Description
20+
21+
Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_bbj_french_news_pipeline` is a French model originally trained by masakhane.
22+
23+
{:.btn-box}
24+
<button class="button button-orange" disabled>Live Demo</button>
25+
<button class="button button-orange" disabled>Open in Colab</button>
26+
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_bbj_french_news_pipeline_fr_5.4.2_3.0_1723844140147.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
27+
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_bbj_french_news_pipeline_fr_5.4.2_3.0_1723844140147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}
28+
29+
## How to use
30+
31+
32+
33+
<div class="tabs-box" markdown="1">
34+
{% include programmingLanguageSelectScalaPythonNLU.html %}
35+
```python
36+
37+
pipeline = PretrainedPipeline("afrimt5_bbj_french_news_pipeline", lang = "fr")
38+
annotations = pipeline.transform(df)
39+
40+
```
41+
```scala
42+
43+
val pipeline = new PretrainedPipeline("afrimt5_bbj_french_news_pipeline", lang = "fr")
44+
val annotations = pipeline.transform(df)
45+
46+
```
47+
</div>
48+
49+
{:.model-param}
50+
## Model Information
51+
52+
{:.table-model}
53+
|---|---|
54+
|Model Name:|afrimt5_bbj_french_news_pipeline|
55+
|Type:|pipeline|
56+
|Compatibility:|Spark NLP 5.4.2+|
57+
|License:|Open Source|
58+
|Edition:|Official|
59+
|Language:|fr|
60+
|Size:|2.8 GB|
61+
62+
## References
63+
64+
https://huggingface.co/masakhane/afrimt5_bbj_fr_news
65+
66+
## Included Models
67+
68+
- DocumentAssembler
69+
- T5Transformer
Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
---
2+
layout: model
3+
title: English amhat5_small T5Transformer from Samuael
4+
author: John Snow Labs
5+
name: amhat5_small
6+
date: 2024-08-16
7+
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
8+
task: [Question Answering, Summarization, Translation, Text Generation]
9+
language: en
10+
edition: Spark NLP 5.4.2
11+
spark_version: 3.0
12+
supported: true
13+
engine: onnx
14+
annotator: T5Transformer
15+
article_header:
16+
type: cover
17+
use_language_switcher: "Python-Scala-Java"
18+
---
19+
20+
## Description
21+
22+
Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amhat5_small` is a English model originally trained by Samuael.
23+
24+
{:.btn-box}
25+
<button class="button button-orange" disabled>Live Demo</button>
26+
<button class="button button-orange" disabled>Open in Colab</button>
27+
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amhat5_small_en_5.4.2_3.0_1723832153687.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
28+
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amhat5_small_en_5.4.2_3.0_1723832153687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}
29+
30+
## How to use
31+
32+
33+
34+
<div class="tabs-box" markdown="1">
35+
{% include programmingLanguageSelectScalaPythonNLU.html %}
36+
```python
37+
38+
documentAssembler = DocumentAssembler() \
39+
.setInputCol('text') \
40+
.setOutputCol('document')
41+
42+
t5 = T5Transformer.pretrained("amhat5_small","en") \
43+
.setInputCols(["document"]) \
44+
.setOutputCol("output")
45+
46+
pipeline = Pipeline().setStages([documentAssembler, t5])
47+
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
48+
pipelineModel = pipeline.fit(data)
49+
pipelineDF = pipelineModel.transform(data)
50+
51+
```
52+
```scala
53+
54+
val documentAssembler = new DocumentAssembler()
55+
.setInputCols("text")
56+
.setOutputCols("document")
57+
58+
val t5 = T5Transformer.pretrained("amhat5_small", "en")
59+
.setInputCols(Array("documents"))
60+
.setOutputCol("output")
61+
62+
val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
63+
val data = Seq("I love spark-nlp").toDS.toDF("text")
64+
val pipelineModel = pipeline.fit(data)
65+
val pipelineDF = pipelineModel.transform(data)
66+
67+
```
68+
</div>
69+
70+
{:.model-param}
71+
## Model Information
72+
73+
{:.table-model}
74+
|---|---|
75+
|Model Name:|amhat5_small|
76+
|Compatibility:|Spark NLP 5.4.2+|
77+
|License:|Open Source|
78+
|Edition:|Official|
79+
|Input Labels:|[document]|
80+
|Output Labels:|[output]|
81+
|Language:|en|
82+
|Size:|88.2 MB|
83+
84+
## References
85+
86+
https://huggingface.co/Samuael/amhat5-small
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
layout: model
3+
title: English amhat5_small_pipeline pipeline T5Transformer from Samuael
4+
author: John Snow Labs
5+
name: amhat5_small_pipeline
6+
date: 2024-08-16
7+
tags: [en, open_source, pipeline, onnx]
8+
task: [Question Answering, Summarization, Translation, Text Generation]
9+
language: en
10+
edition: Spark NLP 5.4.2
11+
spark_version: 3.0
12+
supported: true
13+
annotator: PipelineModel
14+
article_header:
15+
type: cover
16+
use_language_switcher: "Python-Scala-Java"
17+
---
18+
19+
## Description
20+
21+
Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amhat5_small_pipeline` is a English model originally trained by Samuael.
22+
23+
{:.btn-box}
24+
<button class="button button-orange" disabled>Live Demo</button>
25+
<button class="button button-orange" disabled>Open in Colab</button>
26+
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amhat5_small_pipeline_en_5.4.2_3.0_1723832184882.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
27+
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amhat5_small_pipeline_en_5.4.2_3.0_1723832184882.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}
28+
29+
## How to use
30+
31+
32+
33+
<div class="tabs-box" markdown="1">
34+
{% include programmingLanguageSelectScalaPythonNLU.html %}
35+
```python
36+
37+
pipeline = PretrainedPipeline("amhat5_small_pipeline", lang = "en")
38+
annotations = pipeline.transform(df)
39+
40+
```
41+
```scala
42+
43+
val pipeline = new PretrainedPipeline("amhat5_small_pipeline", lang = "en")
44+
val annotations = pipeline.transform(df)
45+
46+
```
47+
</div>
48+
49+
{:.model-param}
50+
## Model Information
51+
52+
{:.table-model}
53+
|---|---|
54+
|Model Name:|amhat5_small_pipeline|
55+
|Type:|pipeline|
56+
|Compatibility:|Spark NLP 5.4.2+|
57+
|License:|Open Source|
58+
|Edition:|Official|
59+
|Language:|en|
60+
|Size:|88.2 MB|
61+
62+
## References
63+
64+
https://huggingface.co/Samuael/amhat5-small
65+
66+
## Included Models
67+
68+
- DocumentAssembler
69+
- T5Transformer

0 commit comments

Comments
 (0)