Discover the power of local open source AI with our latest video! In this third installment of our series, we install and demo Jan.ai, …
[ad_2]
source
Discover the power of local open source AI with our latest video! In this third installment of our series, we install and demo Jan.ai, …
[ad_2]
source
Lorem ipsum dolor sit amet, consectetur.
Do you prefer the privacy of local LLMs?
Great set of videos, working my way though them at the moment, once small thing that would save you loads of work, you don't need to write the scripts or make the .desktop fine under mint, just go to the install directory, hold Ctrl+Shift and drag it to the desktop
Thanks, Love the step by step process so far for the AI series!!! [from the 3rd video so far.]
I have installed it on PC, with one problem. I am not getting any responses with both models been indicated to install in guide. [That is for Llama 8B Q4 & Mistral Instruct 7B Q4]
I went from Assistant to Model and then select each one of them on a PC with 16Gb RAM.
The thread was a short " What is the meaning of the name Hildegard" –
It failed and came up with the following message – Apologies, something’s amiss!
Jan’s in beta. Access troubleshooting assistance now.
I will try to follow the trouble shooting Assistance document.
Step 1
Follow our troubleshooting guide for step-by-step solutions.
You forgot to mention, how those models can give uncensored answers
Will you be looking at TensorFlow?
Would love to see a part of the series where you expand upon the speed and capabilities of these platforms by leveraging GPU acceleration.
Thank you for this series. It is nice to see you troubleshoot and explain why/how you get an open source project to work.
Hmmm. Followed the guide and everything appears to work ok but I just dont get any responses back for trom my inputs. Any ideas?
Looks impressive…i installed just now
Great series for beginners. Love the detail step-by-step setup. I use Ollama but not Jan AI.
One other project that i recently 'discovered' that has high potential is llamafile (by Mozilla) (opensource). I think it is by far the easiest to run as they pre-package models inside and run like windows portable programs. I like this specially in future where i can have my own model fine-tuned to what i want and have them "frozen" with all the dependencies baked inside. The base app can also run gguf files from hugging face if those with the extension "llamafile" was not pre-packaged. The coolest thing is i am able to run a 1.1b model on a mid-tier Android phone ! (but painfully slow, something like 1.5 tok/s) but with future small capable models it is very promising indeed. Worth keeping an eye on the project. Not as mature as Ollama and JanAI but getting there (also uses OpenAI API format and can be used as backend). !