stfn <img src="https://cdn.fosstodon.org/custom_emojis/images/000/015/409/original/raspberry-pi.png" alt=":raspberrypi:" class="inline h-5 w-5"> <img src="https://cdn.fosstodon.org/custom_emojis/images/000/025/124/original/7e1fe81995650028.png" alt=":python:" class="inline h-5 w-5">

2mo ·
Public

·
fosstodon.org

All in all, I am impressed at what it can do, using less than 5GB of VRAM, and providing long answers (several paragraphs) in a few seconds, all that on my rather old RTX2060.