All terms
Foundations
Emergent Abilities
Capabilities that appear only once a model reaches sufficient scale.
Definition
Emergent abilities are capabilities that show up only once a model is large enough, seemingly absent in smaller versions. Examples discussed in research include multi-step reasoning and in-context learning. How sharp these jumps really are is debated, since some apparent leaps may be artifacts of how performance is measured.