Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Development for fl-nlp-hetero-tasks #410

Merged
merged 39 commits into from
Jan 9, 2023
Merged

Conversation

cheneydon
Copy link
Contributor

@cheneydon cheneydon commented Oct 25, 2022

The implementation of FL-hetero-nlp-tasks, including:

  • Some NLP datasets: AGNews, CNN/DM, IMDB, MSQG, NewsQA, SQuAD;
  • Some metrics for NLP tasks: ROUGE, BLEU, METEOR;
  • Label smoothing and warm-up learning rate schedule;
  • New Model, Trainer, Aggregator, Server/Client for Assign-Then-Contrast framework (https://arxiv.org/abs/2212.05789) for FL-hetero-nlp-tasks;
  • Configurations, scripts and unittest

@xieyxclack xieyxclack self-requested a review October 25, 2022 04:14
@xieyxclack xieyxclack added the Feature New feature label Oct 25, 2022
@cheneydon cheneydon changed the title update dataset for hetero-fednlp update codes for hetero-fednlp Oct 26, 2022
@xieyxclack xieyxclack changed the title update codes for hetero-fednlp [WIP] development for fl-nlp-hetero Dec 14, 2022
@xieyxclack xieyxclack added the FedNLP Federated learning in NLP label Dec 14, 2022
Copy link
Collaborator

@xieyxclack xieyxclack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

federatedscope/core/trainers/utils.py Show resolved Hide resolved
@xieyxclack xieyxclack changed the title [WIP] development for fl-nlp-hetero Development for fl-nlp-hetero-tasks Jan 6, 2023
@xieyxclack xieyxclack merged commit 061cc9d into alibaba:master Jan 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature FedNLP Federated learning in NLP
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants