Tried running compact models via WASM. The result: surprisingly usable latency for note-taking and keyword jogs.
Lesson: if it can run client-side, let it.
AI / Edge
Edge inference experiments in the browser
Andrew Bartlett · 18 July 2020 · 1 min read
Originally published 18 July 2020. Historical posts reflect the tools and project plans at the time of writing.
Original WordPress post