Author: The Horizon

Eight Things to Know about Large Language Models

The widespread public deployment of large language models (LLMs) in recent months has prompted a wave of new attention and engagement from advocates, policymakers, and scholars from many fields. This attention is a timely response to the many urgent questions that this technology raises, but it can sometimes miss important considerations. This paper surveys the […]

Humans will attain immortality with the help of ‘nanobots’ by 2030, claims former Google scientist

Ray Kurzweil, a former Google engineer and futurist, has predicted that humans will achieve immortality within seven years, primarily through advancements in technology such as genetics, nanotechnology, and robotics.   Kurzweil’s prediction is based on the concept of “singularity,” a hypothetical future point where technological advancements, particularly in AI, lead to machines surpassing human intelligence. […]

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention

We present LLaMA-Adapter, a lightweight adaption method to efficiently fine-tune LLaMA into an instruction-following model. Using 52K self-instruct demonstrations, LLaMA-Adapter only introduces 1.2M learnable parameters upon the frozen LLaMA 7B model, and costs less than one hour for fine-tuning on 8 A100 GPUs. Specifically, we adopt a set of learnable adaption prompts, and prepend them […]