Publications
2022 · arXiv preprint

Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models

Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A. Smith, Luke Zettlemoyer

PDFarXivDOIWebsite

BibTeX

@misc{openalex-w4300886482,
  title = {Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models},
  author = {Margaret Li and Suchin Gururangan and Tim Dettmers and Mike Lewis and Tim Althoff and Noah A. Smith and Luke Zettlemoyer},
  year = {2022},
  howpublished = {arXiv},
  doi = {10.48550/arxiv.2208.03306},
  eprint = {2208.03306},
  archivePrefix = {arXiv}
}