Galactica: A Large Language Model for Science

From the website:

Our first release is a powerful large language model (LLM) trained on over 48 million papers, textbooks, reference material, compounds, proteins and other sources of scientific knowledge. You can use it to explore the literature, ask scientific questions, write scientific code, and much more.

I’m prepping for an ask me anything session on Deep Reinforcement Learning, so I decided to ask it to…

Explain deep reinforcement learning to a two year old

And here was it’s response:

I’ll try to explain this to my son later and see what he says…

All jokes aside, this looks like a powerful tool.

I’m excited to play around with it more, and will use it as my go to for scientific queries to see what comes of it.

I think @shubham and @sGx_tweets would be interested in this!

You can play around with it here:


Absoluely amazing. While it definitely missed the mark, maybe there is some opportunity to tool-combine…

Reinforcement learning is a method of teaching a machine how to do something by having it try different things and rewarding it when it does something correctly. For example, if you wanted to teach a machine how to play chess, you would start by giving it a chess board and some pieces. The machine would then try different moves and be rewarded each time it made a move that led to a win. Over time, the machine would learn which moves are most likely to lead to a win, and eventually it would become quite good at playing chess.

Deep learning is a method of teaching a machine how to do something by using multiple layers of information. For example, if you wanted to teach a machine to recognize pictures of animals, you would start by showing it a lot of pictures of animals. The machine would then try to identify patterns in the pictures, and the more pictures it saw, the better it would become at identifying animals.

Thanks GPT-3!


Ok this is pretty dope, thanks for sharing. It’s interesting to see how these two will work together. Gonna try to write some posts in this manner and see what happens :rofl:

This is really interesting. Thanks for sharing @harpreet.sahota :slight_smile:

1 Like

2 things that stood out to me.

  1. You asked it to describe it to a TWO year old :rofl:
  2. And the last statement for Deep Learning reads: Neural Networks are.

I can agree with that! :sunglasses: :joy:

Cool stuff, @harpreet.sahota! Gonna be cool to have a personal scientific assistant in the future when doing research and working on specialized ML problems

1 Like