This repository was archived by the owner on Jan 21, 2025. It is now read-only.

This repository was archived by the owner on Jan 21, 2025. It is now read-only.

About the mixture of expert model #369

Open

opened

on Dec 19, 2021

Hi , Thanks for your great work. I am reading your implementation of switch transformers(MoE), I am wondering if you have released the code for finetuning the MoE models on downstream tasks or some pre-trained weights?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests