First on-device Vector database for mobile devices

by awaliason 5/16/24, 12:18 PMwith 1 comments
by greenroboton 5/16/24, 12:29 PM

ObjectBox CTO here...

Note that this is not just running a lib like HNSWlib or FAISS on top of database persistence. It's deeply integrated with database internals, which is also why in runs nicely with low-memory devices. The entire binary is like 3 MB, so leaves lots of resources to actual vector data and LLMs.

AMA...