Crystal Nam
2024
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Luca Soldaini
|
Rodney Kinney
|
Akshita Bhagia
|
Dustin Schwenk
|
David Atkinson
|
Russell Authur
|
Ben Bogin
|
Khyathi Chandu
|
Jennifer Dumas
|
Yanai Elazar
|
Valentin Hofmann
|
Ananya Jha
|
Sachin Kumar
|
Li Lucy
|
Xinxi Lyu
|
Nathan Lambert
|
Ian Magnusson
|
Jacob Morrison
|
Niklas Muennighoff
|
Aakanksha Naik
|
Crystal Nam
|
Matthew Peters
|
Abhilasha Ravichander
|
Kyle Richardson
|
Zejiang Shen
|
Emma Strubell
|
Nishant Subramani
|
Oyvind Tafjord
|
Evan Walsh
|
Luke Zettlemoyer
|
Noah Smith
|
Hannaneh Hajishirzi
|
Iz Beltagy
|
Dirk Groeneveld
|
Jesse Dodge
|
Kyle Lo
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
OLMo: Accelerating the Science of Language Models
Dirk Groeneveld
|
Iz Beltagy
|
Evan Walsh
|
Akshita Bhagia
|
Rodney Kinney
|
Oyvind Tafjord
|
Ananya Jha
|
Hamish Ivison
|
Ian Magnusson
|
Yizhong Wang
|
Shane Arora
|
David Atkinson
|
Russell Authur
|
Khyathi Chandu
|
Arman Cohan
|
Jennifer Dumas
|
Yanai Elazar
|
Yuling Gu
|
Jack Hessel
|
Tushar Khot
|
William Merrill
|
Jacob Morrison
|
Niklas Muennighoff
|
Aakanksha Naik
|
Crystal Nam
|
Matthew Peters
|
Valentina Pyatkin
|
Abhilasha Ravichander
|
Dustin Schwenk
|
Saurabh Shah
|
William Smith
|
Emma Strubell
|
Nishant Subramani
|
Mitchell Wortsman
|
Pradeep Dasigi
|
Nathan Lambert
|
Kyle Richardson
|
Luke Zettlemoyer
|
Jesse Dodge
|
Kyle Lo
|
Luca Soldaini
|
Noah Smith
|
Hannaneh Hajishirzi
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Co-authors
- Aakanksha Naik 2
- Abhilasha Ravichander 2
- Akshita Bhagia 2
- Ananya Jha 2
- Arman Cohan 1
- show all...
- Ben Bogin 1
- David Atkinson 2
- Dirk Groeneveld 2
- Dustin Schwenk 2
- Emma Strubell 2
- Evan Walsh 2
- Hamish Ivison 1
- Hannaneh Hajishirzi 2
- Ian Magnusson 2
- Iz Beltagy 2
- Jack Hessel 1
- Jacob Morrison 2
- Jennifer Dumas 2
- Jesse Dodge 2
- Khyathi Chandu 2
- Kyle Lo 2
- Kyle Richardson 2
- Li Lucy 1
- Luca Soldaini 2
- Luke Zettlemoyer 2
- Matthew E. Peters 2
- Mitchell Wortsman 1
- Nathan Lambert 2
- Niklas Muennighoff 2
- Nishant Subramani 2
- Noah A. Smith 2
- Oyvind Tafjord 2
- Pradeep Dasigi 1
- Rodney Kinney 2
- Russell Authur 2
- Sachin Kumar 1
- Saurabh Shah 1
- Shane Arora 1
- Tushar Khot 1
- Valentin Hofmann 1
- Valentina Pyatkin 1
- William Merrill 1
- William Smith 1
- Xinxi Lyu 1
- Yanai Elazar 2
- Yizhong Wang 1
- Yuling Gu 1
- Zejiang Shen 1
Venues
- acl2