In 1-bit LLMs, only 1 bit (i.e. 0 or 1) is used to store the weight parameters compared to 32/16 bits in traditional LLM . This reduces the overall size by a big percentage hence enabling even smaller devices to use LLM. This is huge and eventually eliminates several devices that can’t use it including mobile phones .
#SCIENCE #English #AU
Read more at Medium