Gemini: A Family of Highly Capable Multimodal Models

Gemini Team ,

Rohan Anil ,

Sebastian Borgeaud ,

Yonghui Wu ,

Jean-Baptiste Alayrac ,

Jiahui Yu ,

Radu Soricut ,

Johan Schalkwyk ,

Andrew M. Dai ,

Anja Hauth ,

Katie Millican ,

David Silver ,

Slav Petrov ,

Melvin Johnson ,

Ioannis Antonoglou ,

Julian Schrittwieser ,

Amelia Glaese ,

Jilin Chen ,

Emily Pitler ,

Timothy Lillicrap ,

Angeliki Lazaridou ,

Orhan Firat ,

James Molloy ,

Michael Isard ,

Paul R. Barham ,

Tom Hennigan ,

Benjamin Lee ,

Fabio Viola ,

Malcolm Reynolds ,

Yuanzhong Xu ,

Ryan Doherty ,

Eli Collins ,

Clemens Meyer ,

Eliza Rutherford ,

Erica Moreira ,

Kareem Ayoub ,

Megha Goel ,

George Tucker ,

Enrique Piqueras ,

Maxim Krikun ,

Iain Barr ,

Nikolay Savinov ,

Ivo Danihelka ,

Becca Roelofs ,

Anaïs White ,

Anders Andreassen ,

Tamara von Glehn ,

Lakshman Yagati ,

Mehran Kazemi ,

Lucas Gonzalez ,

Misha Khalman ,

Jakub Sygnowski ,

Alexandre Frechette ,

Charlotte Smith ,

Laura Culp ,

Lev Proleev ,

Yi Luan ,

Xi Chen ,

James Lottes ,

Nathan Schucher ,

Federico Lebron ,

Alban Rrustemi ,

Natalie Clay ,

Phil Crone ,

Tomas Kocisky ,

Jeffrey Zhao ,

Bartek Perz ,

Dian Yu ,

Heidi Howard ,

Adam Bloniarz ,

Jack W. Rae ,

Han Lu ,

Laurent Sifre ,

Marcello Maggioni ,

Fred Alcober ,

Dan Garrette ,

Megan Barnes ,

Shantanu Thakoor ,

Jacob Austin ,

Gabriel Barth-Maron ,

William Wong ,

Rishabh Joshi ,

Rahma Chaabouni ,

Deeni Fatiha ,

Arun Ahuja ,

Ruibo Liu ,

Yunxuan Li ,

Sarah Cogan ,

Jeremy Chen ,

Chao Jia ,

Chenjie Gu ,

Qiao Zhang ,

Jordan Grimstad ,

Ale Jakse Hartman ,

Martin Chadwick ,

Gaurav Singh Tomar ,

Xavier Garcia ,

Evan Senter ,

Emanuel Taropa ,

Thanumalayan Sankaranarayana Pillai ,

Jacob Devlin ,

Michael Laskin ,

Diego de Las Casas ,

Dasha Valter ,

Connie Tao ,

Lorenzo Blanco ,

Adrià Puigdomènech Badia ,

David Reitter ,

Mianna Chen ,

Jenny Brennan ,

Clara Rivera ,

Sergey Brin ,

Shariq Iqbal ,

Gabriela Surita ,

Jane Labanowski ,

Abhi Rao ,

Stephanie Winkler ,

Emilio Parisotto ,

Yiming Gu ,

Kate Olszewska ,

Yujing Zhang ,

Ravi Addanki ,

Antoine Miech ,

Annie Louis ,

Laurent El Shafey ,

Denis Teplyashin ,

Geoff Brown ,

Elliot Catt ,

Nithya Attaluri ,

Jan Balaguer ,

Jackie Xiang ,

Pidong Wang ,

Zoe Ashwood ,

Anton Briukhov ,

Albert Webson ,

Sanjay Ganapathy ,

Smit Sanghavi ,

Ajay Kannan ,

Ming-Wei Chang ,

Axel Stjerngren ,

Josip Djolonga ,

Yuting Sun ,

Ankur Bapna ,

Matthew Aitchison ,

Pedram Pejman ,

Henryk Michalewski ,

Tianhe Yu ,

Cindy Wang ,

Juliette Love ,

Junwhan Ahn ,

Dawn Bloxwich ,

Kehang Han ,

Peter Humphreys ,

Thibault Sellam ,

James Bradbury ,

Varun Godbole ,

Sina Samangooei ,

Bogdan Damoc ,

Alex Kaskasoli ,

Sébastien M. R. Arnold ,

Vijay Vasudevan ,

Shubham Agrawal ,

Jason Riesa ,

Dmitry Lepikhin ,

Richard Tanburn ,

Srivatsan Srinivasan ,

Hyeontaek Lim ,

Sarah Hodkinson ,

Pranav Shyam ,

Johan Ferret ,

Steven Hand ,

Ankush Garg ,

Tom Le Paine ,

Jian Li ,

Yujia Li ,

Minh Giang ,

Alexander Neitz ,

Zaheer Abbas ,

Sarah York ,

Machel Reid ,

Elizabeth Cole ,

Aakanksha Chowdhery ,

Dipanjan Das ,

Dominika Rogozińska ,

Vitaly Nikolaev ,

Pablo Sprechmann ,

Zachary Nado ,

Lukas Zilka ,

Flavien Prost ,

Luheng He ,

Marianne Monteiro ,

Gaurav Mishra ,

Chris Welty ,

Josh Newlan ,

Dawei Jia ,

Miltiadis Allamanis ,

Clara Huiyi Hu ,

Raoul de Liedekerke ,

Justin Gilmer ,

Carl Saroufim ,

Shruti Rijhwani ,

Shaobo Hou ,

Disha Shrivastava ,

Anirudh Baddepudi ,

Alex Goldin ,

Adnan Ozturel ,

Albin Cassirer ,

Yunhan Xu ,

Daniel Sohn ,

Devendra Sachan ,

Reinald Kim Amplayo ,

Craig Swanson ,

Dessie Petrova ,

Shashi Narayan ,

Arthur Guez ,

Siddhartha Brahma ,

Jessica Landon ,

Miteyan Patel ,

Ruizhe Zhao ,

Kevin Villela ,

Luyu Wang ,

Wenhao Jia ,

Matthew Rahtz ,

Mai Giménez ,

Legg Yeung ,

Hanzhao Lin ,

James Keeling ,

Petko Georgiev ,

Diana Mincu ,

Boxi Wu ,

Salem Haykal ,

Rachel Saputro ,

Kiran Vodrahalli ,

James Qin ,

Zeynep Cankara ,

Abhanshu Sharma ,

Nick Fernando ,

Will Hawkins ,

Behnam Neyshabur ,

Solomon Kim ,

Adrian Hutter ,

Priyanka Agrawal ,

Alex Castro-Ros ,

George van den Driessche ,

Tao Wang ,

Fan Yang ,

Shuo-yiin Chang ,

Paul Komarek ,

Ross McIlroy ,

Mario Lučić ,

Guodong Zhang ,

Wael Farhan ,

Michael Sharman ,

Paul Natsev ,

Paul Michel ,

Yong Cheng ,

Yamini Bansal ,

Siyuan Qiao ,

Kris Cao ,

Siamak Shakeri ,

Christina Butterfield ,

Justin Chung ,

Paul Kishan Rubenstein ,

Shivani Agrawal ,

Arthur Mensch ,

Kedar Soparkar ,

Karel Lenc ,

Timothy Chung ,

Aedan Pope ,

Loren Maggiore ,

Jackie Kay ,

Priya Jhakra ,

Shibo Wang ,

Joshua Maynez ,

Mary Phuong ,

Taylor Tobin ,

Andrea Tacchetti ,

Maja Trebacz ,

Kevin Robinson ,

Yash Katariya ,

Sebastian Riedel ,

Paige Bailey ,

Kefan Xiao ,

Nimesh Ghelani ,

Lora Aroyo ,

Ambrose Slone ,

Neil Houlsby ,

Xuehan Xiong ,

Zhen Yang ,

Elena Gribovskaya ,

Jonas Adler ,

Mateo Wirth ,

Lisa Lee ,

Music Li ,

Thais Kagohara ,

Jay Pavagadhi ,

Sophie Bridgers ,

Anna Bortsova ,

Sanjay Ghemawat ,

Zafarali Ahmed ,

Tianqi Liu ,

Richard Powell ,

Vijay Bolina ,

Mariko Iinuma ,

Polina Zablotskaia ,

James Besley ,

Da-Woon Chung ,

Timothy Dozat ,

Ramona Comanescu ,

Xiance Si ,

Jeremy Greer ,

Guolong Su ,

Martin Polacek ,

Raphaël Lopez Kaufman ,

Simon Tokumine ,

Hexiang Hu ,

Elena Buchatskaya ,

Yingjie Miao ,

Mohamed Elhawaty ,

Aditya Siddhant ,

Nenad Tomasev ,

Jinwei Xing ,

Christina Greer ,

Helen Miller ,

Shereen Ashraf ,

Aurko Roy ,

Zizhao Zhang ,

Ada Ma ,

Angelos Filos ,

Milos Besta ,

Rory Blevins ,

Ted Klimenko ,

Chih-Kuan Yeh ,

Soravit Changpinyo ,

Jiaqi Mu ,

Oscar Chang ,

Mantas Pajarskas ,

Carrie Muir ,

Vered Cohen ,

Charline Le Lan ,

Krishna Haridasan ,

Amit Marathe ,

Steven Hansen ,

Sholto Douglas ,

Rajkumar Samuel ,

Mingqiu Wang ,

Sophia Austin ,

Chang Lan ,

Jiepu Jiang ,

Justin Chiu ,

Jaime Alonso Lorenzo ,

Lars Lowe Sjösund ,

Sébastien Cevey ,

Zach Gleicher ,

Thi Avrahami ,

Anudhyan Boral ,

Hansa Srinivasan ,

Vittorio Selo ,

Rhys May ,

Konstantinos Aisopos ,

Léonard Hussenot ,

Livio Baldini Soares ,

Kate Baumli ,

Michael B. Chang ,

Adrià Recasens ,

Ben Caine ,

Alexander Pritzel ,

Filip Pavetic ,

Fabio Pardo ,

Anita Gergely ,

Justin Frye ,

Vinay Ramasesh ,

Dan Horgan ,

Kartikeya Badola ,

Nora Kassner ,

Subhrajit Roy ,

Ethan Dyer ,

Víctor Campos ,

Alex Tomala ,

Yunhao Tang ,

Dalia El Badawy ,

Elspeth White ,

Basil Mustafa ,

Oran Lang ,

Abhishek Jindal ,

Sharad Vikram ,

Zhitao Gong ,

Sergi Caelles ,

Ross Hemsley ,

Gregory Thornton ,

Fangxiaoyu Feng ,

Wojciech Stokowiec ,

Ce Zheng ,

Phoebe Thacker ,

Çağlar Ünlü ,

Zhishuai Zhang ,

Mohammad Saleh ,

James Svensson ,

Max Bileschi ,

Piyush Patil ,

Ankesh Anand ,

Roman Ring ,

Katerina Tsihlas ,

Arpi Vezer ,

Marco Selvi ,

Toby Shevlane ,

Mikel Rodriguez ,

Tom Kwiatkowski ,

Samira Daruki ,

Keran Rong ,

Allan Dafoe ,

Nicholas FitzGerald ,

Keren Gu-Lemberg ,

Mina Khan ,

Lisa Anne Hendricks ,

Marie Pellat ,

Vladimir Feinberg ,

James Cobon-Kerr ,

Tara Sainath ,

Maribeth Rauh ,

Sayed Hadi Hashemi ,

Richard Ives ,

Yana Hasson ,

YaGuang Li ,

Eric Noland ,

Yuan Cao ,

Nathan Byrd ,

Le Hou ,

Qingze Wang ,

Thibault Sottiaux ,

Michela Paganini ,

Jean-Baptiste Lespiau ,

Alexandre Moufarek ,

Samer Hassan ,

Kaushik Shivakumar ,

Joost van Amersfoort ,

Amol Mandhane ,

Pratik Joshi ,

Anirudh Goyal ,

Matthew Tung ,

Andrew Brock ,

Hannah Sheahan ,

Vedant Misra ,

Cheng Li ,

Nemanja Rakićević ,

Mostafa Dehghani ,

Fangyu Liu ,

Sid Mittal ,

Junhyuk Oh ,

Seb Noury ,

Eren Sezener ,

Fantine Huot ,

Matthew Lamm ,

Nicola De Cao ,

Charlie Chen ,

Gamaleldin Elsayed ,

Ed Chi ,

Mahdis Mahdieh ,

Ian Tenney ,

Nan Hua ,

Ivan Petrychenko ,

Patrick Kane ,

Dylan Scandinaro ,

Rishub Jain ,

Jonathan Uesato ,

Romina Datta ,

Adam Sadovsky ,

Oskar Bunyan ,

Dominik Rabiej ,

Shimu Wu ,

John Zhang ,

Gautam Vasudevan ,

Edouard Leurent ,

Mahmoud Alnahlawi ,

Ionut Georgescu ,

Nan Wei ,

Ivy Zheng ,

Betty Chan ,

Pam G Rabinovitch ,

Piotr Stanczyk ,

Ye Zhang ,

David Steiner ,

Subhajit Naskar ,

Michael Azzam ,

Matthew Johnson ,

Adam Paszke ,

Chung-Cheng Chiu ,

Jaume Sanchez Elias ,

Afroz Mohiuddin ,

Faizan Muhammad ,

Jin Miao ,

Andrew Lee ,

Nino Vieillard ,

Sahitya Potluri ,

Jane Park ,

Elnaz Davoodi ,

Jiageng Zhang ,

Jeff Stanway ,

Drew Garmon ,

Abhijit Karmarkar ,

Zhe Dong ,

Jong Lee ,

Aviral Kumar ,

Luowei Zhou ,

Jonathan Evens ,

William Isaac ,

Zhe Chen ,

Johnson Jia ,

Anselm Levskaya ,

Zhenkai Zhu ,

Chris Gorgolewski ,

Peter Grabowski ,

Yu Mao ,

Alberto Magni ,

Kaisheng Yao ,

Javier Snaider ,

Norman Casagrande ,

Paul Suganthan ,

Evan Palmer ,

Geoffrey Irving ,

Edward Loper ,

Manaal Faruqui ,

Isha Arkatkar ,

Nanxin Chen ,

Izhak Shafran ,

Michael Fink ,

Alfonso Castaño ,

Irene Giannoumis ,

Wooyeol Kim ,

Mikołaj Rybiński ,

Ashwin Sreevatsa ,

Jennifer Prendki ,

David Soergel ,

Adrian Goedeckemeyer ,

Willi Gierke ,

Mohsen Jafari ,

Meenu Gaba ,

Jeremy Wiesner ,

Diana Gage Wright ,

Yawen Wei ,

Harsha Vashisht ,

Yana Kulizhskaya ,

Jay Hoover ,

Maigo Le ,

Lu Li ,

Chimezie Iwuanyanwu ,

Lu Liu ,

Kevin Ramirez ,

Andrey Khorlin ,

Albert Cui ,

Tian LIN ,

Marin Georgiev ,

Marcus Wu ,

Ricardo Aguilar ,

Keith Pallo ,

Abhishek Chakladar ,

Alena Repina ,

Xihui Wu ,

Tom van der Weide ,

Priya Ponnapalli ,

Caroline Kaplan ,

Jiri Simsa ,

Shuangfeng Li ,

Olivier Dousse ,

Fan Yang ,

Jeff Piper ,

Nathan Ie ,

Minnie Lui ,

Rama Pasumarthi ,

Nathan Lintz ,

Anitha Vijayakumar ,

Lam Nguyen Thiet ,

Daniel Andor ,

Pedro Valenzuela ,

Cosmin Paduraru ,

Daiyi Peng ,

Katherine Lee ,

Shuyuan Zhang ,

Somer Greene ,

Duc Dung Nguyen ,

Paula Kurylowicz ,

Sarmishta Velury ,

Sebastian Krause ,

Cassidy Hardin ,

Lucas Dixon ,

Lili Janzer ,

Kiam Choo ,

Ziqiang Feng ,

Biao Zhang ,

Achintya Singhal ,

Tejasi Latkar ,

Mingyang Zhang ,

Quoc Le ,

Elena Allica Abellan ,

Dayou Du ,

Dan McKinnon ,

Natasha Antropova ,

Tolga Bolukbasi ,

Orgad Keller ,

David Reid ,

Daniel Finchelstein ,

Maria Abi Raad ,

Remi Crocker ,

Peter Hawkins ,

Robert Dadashi ,

Colin Gaffney ,

Sid Lall ,

Ken Franko ,

Egor Filonov ,

Anna Bulanova ,

Rémi Leblond ,

Vikas Yadav ,

Shirley Chung ,

Harry Askham ,

Luis C. Cobo ,

Kelvin Xu ,

Felix Fischer ,

Jun Xu ,

Christina Sorokin ,

Chris Alberti ,

Chu-Cheng Lin ,

Colin Evans ,

Hao Zhou ,

Alek Dimitriev ,

Hannah Forbes ,

Dylan Banarse ,

Zora Tung ,

Jeremiah Liu ,

Mark Omernick ,

Colton Bishop ,

Chintu Kumar ,

Rachel Sterneck ,

Ryan Foley ,

Rohan Jain ,

Swaroop Mishra ,

Jiawei Xia ,

Taylor Bos ,

Geoffrey Cideron ,

Ehsan Amid ,

Francesco Piccinno ,

Xingyu Wang ,

Praseem Banzal ,

Petru Gurita ,

Hila Noga ,

Premal Shah ,

Daniel J. Mankowitz ,

Alex Polozov ,

Nate Kushman ,

Victoria Krakovna ,

Sasha Brown ,

MohammadHossein Bateni ,

Dennis Duan ,

Vlad Firoiu ,

Meghana Thotakuri ,

Tom Natan ,

Anhad Mohananey ,

Matthieu Geist ,

Sidharth Mudgal ,

Sertan Girgin ,

Hui Li ,

Jiayu Ye ,

Ofir Roval ,

Reiko Tojo ,

Michael Kwong ,

James Lee-Thorp ,

Christopher Yew ,

Quan Yuan ,

Sumit Bagri ,

Danila Sinopalnikov ,

Sabela Ramos ,

John Mellor ,

Abhishek Sharma ,

Aliaksei Severyn ,

Jonathan Lai ,

Kathy Wu ,

Heng-Tze Cheng ,

David Miller ,

Nicolas Sonnerat ,

Denis Vnukov ,

Rory Greig ,

Jennifer Beattie ,

Emily Caveness ,

Libin Bai ,

Julian Eisenschlos ,

Alex Korchemniy ,

Tomy Tsai ,

Mimi Jasarevic ,

Weize Kong ,

Phuong Dao ,

Zeyu Zheng ,

Frederick Liu ,

Fan Yang ,

Rui Zhu ,

Mark Geller ,

Tian Huey Teh ,

Jason Sanmiya ,

Evgeny Gladchenko ,

Nejc Trdin ,

Andrei Sozanschi ,

Daniel Toyama ,

Evan Rosen ,

Sasan Tavakkol ,

Linting Xue ,

Chen Elkind ,

Oliver Woodman ,

John Carpenter ,

George Papamakarios ,

Rupert Kemp ,

Sushant Kafle ,

Tanya Grunina ,

Rishika Sinha ,

Alice Talbert ,

Abhimanyu Goyal ,

Diane Wu ,

Denese Owusu-Afriyie ,

Cosmo Du ,

Chloe Thornton ,

Jordi Pont-Tuset ,

Pradyumna Narayana ,

Jing Li ,

Sabaer Fatehi ,

John Wieting ,

Omar Ajmeri ,

Benigno Uria ,

Tao Zhu ,

Yeongil Ko ,

Laura Knight ,

Amélie Héliou ,

Ning Niu ,

Shane Gu ,

Chenxi Pang ,

Dustin Tran ,

Yeqing Li ,

Nir Levine ,

Ariel Stolovich ,

Norbert Kalb ,

Rebeca Santamaria-Fernandez ,

Sonam Goenka ,

Wenny Yustalim ,

Robin Strudel ,

Ali Elqursh ,

Balaji Lakshminarayanan ,

Charlie Deck ,

Shyam Upadhyay ,

Hyo Lee ,

Mike Dusenberry ,

Zonglin Li ,

Xuezhi Wang ,

Kyle Levin ,

Raphael Hoffmann ,

Dan Holtmann-Rice ,

Olivier Bachem ,

Summer Yue ,

Sho Arora ,

Eric Malmi ,

Daniil Mirylenka ,

Qijun Tan ,

Christy Koh ,

Soheil Hassas Yeganeh ,

Siim Põder ,

Steven Zheng ,

Francesco Pongetti ,

Mukarram Tariq ,

Yanhua Sun ,

Lucian Ionita ,

Mojtaba Seyedhosseini ,

Pouya Tafti ,

Ragha Kotikalapudi ,

Zhiyu Liu ,

Anmol Gulati ,

Jasmine Liu ,

Xinyu Ye ,

Bart Chrzaszcz ,

Lily Wang ,

Nikhil Sethi ,

Tianrun Li ,

Ben Brown ,

Shreya Singh ,

Wei Fan ,

Aaron Parisi ,

Joe Stanton ,

Chenkai Kuang ,

Vinod Koverkathu ,

Christopher A. Choquette-Choo ,

Yunjie Li ,

TJ Lu ,

Abe Ittycheriah ,

Prakash Shroff ,

Pei Sun ,

Mani Varadarajan ,

Sanaz Bahargam ,

Rob Willoughby ,

David Gaddy ,

Ishita Dasgupta ,

Guillaume Desjardins ,

Marco Cornero ,

Brona Robenek ,

Bhavishya Mittal ,

Ben Albrecht ,

Ashish Shenoy ,

Fedor Moiseev ,

Henrik Jacobsson ,

Alireza Ghaffarkhah ,

Morgane Rivière ,

Alanna Walton ,

Clément Crepy ,

Alicia Parrish ,

Yuan Liu ,

Zongwei Zhou ,

Clement Farabet ,

Carey Radebaugh ,

Praveen Srinivasan ,

Claudia van der Salm ,

Andreas Fidjeland ,

Salvatore Scellato ,

Eri Latorre-Chimoto ,

Hanna Klimczak-Plucińska ,

David Bridson ,

Dario de Cesare ,

Tom Hudson ,

Piermaria Mendolicchio ,

Lexi Walker ,

Alex Morris ,

Ivo Penchev ,

Matthew Mauger ,

Alexey Guseynov ,

Alison Reid ,

Seth Odoom ,

Lucia Loher ,

Victor Cotruta ,

Madhavi Yenugula ,

Dominik Grewe ,

Anastasia Petrushkina ,

Tom Duerig ,

Antonio Sanchez ,

Steve Yadlowsky ,

Amy Shen ,

Amir Globerson ,

Adam Kurzrok ,

Lynette Webb ,

Sahil Dua ,

Dong Li ,

Preethi Lahoti ,

Surya Bhupatiraju ,

Dan Hurt ,

Haroon Qureshi ,

Ananth Agarwal ,

Tomer Shani ,

Matan Eyal ,

Anuj Khare ,

Shreyas Rammohan Belle ,

Lei Wang ,

Chetan Tekur ,

Mihir Sanjay Kale ,

Jinliang Wei ,

Ruoxin Sang ,

Brennan Saeta ,

Tyler Liechty ,

Yi Sun ,

Yao Zhao ,

Stephan Lee ,

Pandu Nayak ,

Doug Fritz ,

Manish Reddy Vuyyuru ,

John Aslanides ,

Nidhi Vyas ,

Martin Wicke ,

Xiao Ma ,

Taylan Bilal ,

Evgenii Eltyshev ,

Daniel Balle ,

Nina Martin ,

Hardie Cate ,

James Manyika ,

Keyvan Amiri ,

Yelin Kim ,

Xi Xiong ,

Kai Kang ,

Florian Luisier ,

Nilesh Tripuraneni ,

David Madras ,

Mandy Guo ,

Austin Waters ,

Oliver Wang ,

Joshua Ainslie ,

Jason Baldridge ,

Han Zhang ,

Garima Pruthi ,

Jakob Bauer ,

Feng Yang ,

Riham Mansour ,

Jason Gelman ,

Yang Xu ,

George Polovets ,

Ji Liu ,

Honglong Cai ,

Warren Chen ,

XiangHai Sheng ,

Emily Xue ,

Sherjil Ozair ,

Adams Yu ,

Christof Angermueller ,

Xiaowei Li ,

Weiren Wang ,

Julia Wiesinger ,

Emmanouil Koukoumidis ,

Yuan Tian ,

Anand Iyer ,

Madhu Gurumurthy ,

Mark Goldenson ,

Parashar Shah ,

MK Blake ,

Hongkun Yu ,

Anthony Urbanowicz ,

Jennimaria Palomaki ,

Chrisantha Fernando ,

Kevin Brooks ,

Ken Durden ,

Harsh Mehta ,

Nikola Momchev ,

Elahe Rahimtoroghi ,

Maria Georgaki ,

Amit Raul ,

Sebastian Ruder ,

Morgan Redshaw ,

Jinhyuk Lee ,

Komal Jalan ,

Dinghua Li ,

Ginger Perng ,

Blake Hechtman ,

Parker Schuh ,

Milad Nasr ,

Mia Chen ,

Kieran Milan ,

Vladimir Mikulik ,

Trevor Strohman ,

Juliana Franco ,

Tim Green ,

Demis Hassabis ,

Koray Kavukcuoglu ,

Jeffrey Dean ,

Oriol Vinyals

热度 46

2023年12月19日

简介

本报告介绍了一种新的多模态模型家族Gemini，它在图像、音频、视频和文本理解方面展现出卓越的能力。Gemini家族包括Ultra、Pro和Nano三种规格，适用于从复杂推理任务到设备内存受限的应用场景。在广泛的基准测试中，我们最强大的Gemini Ultra模型在32个基准测试中有30个取得了最新进展，特别是在广受关注的考试基准测试MMLU上首次实现了人类专家的表现，并在我们检查的20个多模态基准测试中提高了现有技术的水平。我们相信，Gemini模型在跨模态推理和语言理解方面的新能力将使各种用例成为可能，我们讨论了我们部署它们以负责任的方式提供给用户的方法。
图表
解决问题

Gemini模型试图解决跨模态推理和语言理解的问题，以及在内存受限设备上实现高性能的多模态应用。这是一个新问题。
关键思路

Gemini模型家族包括三种规模的模型，利用Transformer架构实现跨模态推理和语言理解，在30个基准测试中取得了优异的成绩，其中在MMLU基准测试上首次达到了人类专家的水平。
其它亮点

Gemini模型在跨模态推理和语言理解方面具有出色的性能，可以应用于各种应用场景。实验设计充分，使用了20个多模态基准测试数据集，并在30个基准测试中取得了优异的成绩。论文还讨论了如何负责任地将Gemini模型部署到用户身上。
相关研究

最近的相关研究包括CLIP、DALL-E、ViLBERT等模型。

PDF

原文

点赞收藏评论分享到Link

沙发等你来抢

去评论