The "Summer of Language Models 21 🌸" (in short "BigScience") is a one-year long research workshop on very large language models as used and studied in the field of Natural Language Processing and more generally Artifical Intelligence research. The workshop is conducted from May 2021 to May 2022, with collaborative tasks aimed at creating, sharing and evaluating a very large multilingual dataset and a very large language model as tools for research.
This workshop will foster discussions and reflections around the research questions surrounding large language models (capabilities, limitations, potential improvements, bias, ethics, environmental impact, role in the general AI/cognitive research landscape) as well as the challenges around creating and sharing such models and datasets for research purposes and among the research community.
Save the date! BigScience Episode 2 is co-located with INLG 2021 and is happening on September 20th, 2021.
Attending the BigScience Workshop at INLG is free. Register for the event here.
Zoom and gather.town links as well as Google Calendar invites will be sent out via email.
PROGRAM
All time slots in CEST 1:00 - 1:30pm - Invited Talk: Jade Abbott and Kat Siminyu (Masakhane)
1:45 - 2:30 pm - Short talks from BigScience Working Groups
Data Governance
Evaluation
Carbon Footprint
2:30 - 3:00 pm - Invited Talk: Kyunghyun Cho, Jihyung Moon and Sungjoon Park (KLUE)
3:00 - 3:30 pm - Coffee Break, Social, and Q&A with Masakhane and KLUE in gather.town
3:30 - 4:00 pm - BigScience Technical Talk: Iz Beltagy and Julien Launay, Architecture and Scaling
4:00 - 4:30 pm - BigScience Technical Talk: Stephen Bach and Victor Sanh, Prompt Engineering
4:30 - 5:00 pm - Percy Liang, Stanford Center for Research on Foundation Models
5:00 - 5:30 pm - Stella Biderman, EleutherAI
5:30 - 6:30 pm - Q&A and Social with Percy Liang, Stella Biderman, and the BigScience working group chairs in gather.town