#

transformer-encoder

Here are 74 public repositories matching this topic...

microsoft / DeBERTa

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Sep 29, 2023
Python

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

VITA-Group / TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

pytorch transformer gan transformer-encoder transformer-models

Updated Nov 3, 2022
Python

lilianweng / transformer-tensorflow

Implementation of Transformer Model in Tensorflow

transformer tensorflow-models transformer-encoder attention-is

Updated Mar 25, 2023
Python

wgcban / ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

deep-learning pytorch remote-sensing satellite-imagery attention-mechanism climate-change siamese-network change-detection transformer-encoder transformer-architecture multi-temporal

Updated Jan 31, 2024
Python

zhongkaifu / Seq2SeqSharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

image translation deep-learning neural-network gpu text machine-translation cuda transformer lstm seq2seq sequence-to-sequence tensor encoder-decoder attention-model transformer-encoder transformer-architecture vision-transformer

Updated Nov 14, 2024
C#

jackaduma / SecBERT

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Updated Apr 28, 2023
Python

Vidhiwar / multimodule-ecg-classification

Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification

deep-learning cnn pytorch transformer lstm transformer-encoder mitbih

Updated Oct 4, 2021
Jupyter Notebook

declare-lab / MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

natural-language-processing dialogue-systems conversational-bots transformer-encoder empathetic-responses empathetic-dialogues

Updated Mar 14, 2023
Python

bh1995 / AF-classification

The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.

deep-learning neural-network transformer transformer-encoder ecg-classification

Updated Aug 10, 2021
Python

jiangnanboy / knowledge-automatic-tagging

题目知识点预测标注。Question knowledge point prediction.

pytorch textcnn transformer-encoder knowledge-auto-tagging

Updated Sep 11, 2022
Jupyter Notebook

jaketae / realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention

natural-language-processing pytorch transformer transformer-encoder

Updated May 17, 2021
Python

JinLi711 / UTGN

Universal Transforming Geometric Network for protein structure prediction.

deep-learning protein-structure transformer-encoder

Updated Jul 28, 2020
Python

utahnlp / therapist-observer

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

dialog attention hierarchical-attention-networks focal-loss psychotherapy elmo transformer-encoder acl2019 behavior-coding

Updated Jun 11, 2022
Python

hoangtuanvu / conformer_ocr

Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).

ocr optical-character-recognition conformer transformer-encoder vietnamese-ocr

Updated Dec 27, 2021
Python

heartcored98 / transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

interpretability interpretable-deep-learning transformer-encoder attention-head

Updated Oct 25, 2022
Python

Shikhar-S / EvolvedTransformer

Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP

attention-is-all-you-need classification-model gated-linear-unit transformer-encoder evolved-transformer

Updated Jul 25, 2024
Jupyter Notebook

naokishibuya / simple_transformer

A Transformer Implementation that is easy to understand and customizable.

transformers transformer transformer-encoder transformer-architecture transformer-models transformer-pytorch transformers-models

Updated Dec 20, 2022
Python

microsoft / CASPR

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

business deep-learning tabular-data transformer attention-mechanism transformer-encoder transformer-architecture

Updated Feb 9, 2023
Python

ApurbaSengupta / Lyrics-Generation-using-BERT

Generating English Rock lyrics using BERT

jupyter-notebook songs transformer bert rhyming lyrics-generator pronouncing transformer-encoder bert-model

Updated May 10, 2019
Jupyter Notebook

Improve this page

Add a description, image, and links to the transformer-encoder topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer-encoder topic, visit your repo's landing page and select "manage topics."