Show HN: Panza: A personal email assistant, trained and running on-device(github.com)
github.com
Show HN: Panza: A personal email assistant, trained and running on-device
https://github.com/IST-DASLab/PanzaMail
3 comments
I will try this on my M2 with 24gb. Got all my email since the 1998.
Edit: oof spoke to soon. Need to spend some time with this to adapt it for the M2. Only linux+nvidia out of the box
Edit: oof spoke to soon. Need to spend some time with this to adapt it for the M2. Only linux+nvidia out of the box
you might want to open an issue in our git repo, and if there is interest we would be more than happy to add a solution for Apple silicon
This is so cool!
Some technical details about Panza:
- Panza is an automated email assistant customized to your writing style and past email history.
- Panza produces a fine-tuned LLM that matches your writing style, pairing it with a Retrieval-Augmented Generation (RAG) component which helps it produce relevant emails.
- Panza *can be trained and run entirely locally*. Currently, it requires a single GPU with 16-24 GiB of memory, but we also plan to release a CPU-only version.
- Training and execution are also quick - for a dataset on the order of 1000 emails, training Panza takes well under an hour, and generating a new email takes a few seconds at most.