AI Tools
-
These are some tools I'm using for lower usage and better accuracy:
- rtk-ai : Filters and compresses command-outputs AI have to go through. https://github.com/rtk-ai/rtk
- codegraph : Traces function-to-function calls in codebase, reduces exploration. https://github.com/colbymchenry/codegraph
- RAG : Retrieval Augmented Generation, used in documentation for chunk-based text-recognition, reduces exploration. https://www.ibm.com/think/topics/retrieval-augmented-generation
- headroom - Haven't tried yet : Middleware compression-layer, compacts prompts before arriving at LLM. https://github.com/headroomlabs-ai/headroom
- ggrun - Haven't tried yet: llama.cpp model optimization. https://github.com/raketenkater/ggrun
-
- Quantprobe - llama.cpp model quant optimization. https://github.com/FedericoTs/quantprobe
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login