"Tiiny AI, a US-based deep-tech startup, has unveiled the Pocket Lab, officially verified as the "world's smallest personal AI supercomputer." This palm-sized device, no larger than a typical power bank, is capable of running large language models (LLMs) with up to 120 billion parameters entirely on-device, without relying on cloud servers or external GPUs. Designer: Tiiny AI At its core, the Pocket Lab aims to make advanced artificial intelligence both personal and private."
"Despite its compact size, measuring 14.2 × 8 × 2.53 centimeters and weighing roughly 300 grams, this mini supercomputer delivers noteworthy computing power. The system operates within a typical 65-watt energy envelope, comparable to a conventional desktop PC, yet manages to support extensive AI workloads. The hardware architecture combines a 12-core ARMv9.2 CPU with a custom heterogeneous module that includes a dedicated Neural Processing Unit (NPU),"
Pocket Lab is a palm-sized AI supercomputer capable of running large language models up to 120 billion parameters entirely on-device. The device enables fully offline AI computation to enhance data privacy, reduce latency, and lower carbon emissions by avoiding cloud servers. The system measures 14.2 × 8 × 2.53 centimeters, weighs roughly 300 grams, and operates within a typical 65-watt energy envelope. Hardware components include a 12-core ARMv9.2 CPU, a custom heterogeneous module with a dedicated Neural Processing Unit delivering approximately 190 TOPS, 80 GB of LPDDR5X memory, and a 1 TB solid-state drive.
Read at Yanko Design - Modern Industrial Design News
Unable to calculate read time
Collection
[
|
...
]