Apple and Microsoft Are Working on "Small" Language Models

• You may read the whitepaper HERE.

• These language models have approximately 1 billion parameters.

• I can think of many use cases for smaller language models deployed on phones that assist with discrete tasks: placing calls, writing emails and texts, opening apps, running queries - everything that Google Assistant does not do so well and that Siri fails at miserably.

---