Recycling is Looping: From Protein Folding to LLMs
Published:
Deep learning runs on a handful of simple ideas that scale with data and compute. And because these methods share a common language of networks, ideas that work for board games or proteins can often be carried over to text. Reasoning models are one example. They borrow from AlphaZero’s recipe, pairing reinforcement learning with more computation at inference time to explore possible solutions.
