Meta’s ‘pruning’ of Llama 2 model shows path to slimmer AI
The “lottery ticket hypothesis,” introduced in a 2019 paper by Jonathan Frankle and Michael Carbin, suggests that large AI programs can contain smaller sections capable of similar performance with less memory and fewer operations. A recent study by Andrey Gromov and colleagues explores this idea further, demonstrating that removing deep layers from models like Meta’s […]