Originally I was more interested in ML/DL theory and mech interp, so you can see I was more into theory. Recently, I am also curious and leaning towards learning more about how to build products with foundational models, such as LLM; for instance, recently I got the "LLM's Engineer Handbook [1]".
> If you want to work with ML you likely need the PhD + get lucky.
I do am interested in doing PhD in theoretical computer science, but I'm not too sure about AI PhD as I heard many (not-so-good) things about it.
> If you are interested on it because of AI, it's better to focus on LLMs and more NLP related fields.
Do you have any recomenndations that you have gone through that you think are helpful?
Out of curiosity, for people who have do projects in both Django and Ruby on Rails, which one would you prefer and why?
I learned Python more than 10 years ago, but later chose Rails to be my first web framework to learn, as I also wanted to learn more about Ruby, hence the question.
Thank you for your reply. In your other comment, you mention that you know Ruby relatively well. Would you recommend learning Ruby along side with Rails (i.e., learning Ruby in/with Rails), if I have some experience with other languages, such as Java, Python, C/C++, Lisp, and so on?
Also are there any Ruby AI libraries that you would recommend? Thanks!
> If you're doing AI stuff, any Python framework will be best.
I understand that AI stuff now is mainly Python. But is it possible to connect Rails with some Python program/service, is this one of the purpose of microservices?
Congrats OP and it looks really nice! Out of curiosity, may I ask what’s ur tech stack for developing this software? I’m also an aspiring app developer :) Thank you!
May I ask how small? From what I see on r/localllama, it seems that at least 3B and 7B ones are starting to be useful? Also I cannot use CUDA or modern AMD cards..
> About that, I am waiting for the quad core version to arrive. I liked it so much I bought another unit that I will use just for Nextcloud in RAID.
>
> I am amazed by the zimablade performance especially as it is a very low specs machine theoretically. Never tried the zimaboard but I have no reasons to do it.
Thanks! Then I will consider buying one for myself!
> Yes, we were moving these hosting services to a mid-tower "server" (actually a normal PC with linux). Thermals surely were better handled due to the size of the build but from my personal experience you can add some thermal solutions to NUCs and get the same / better results. Note that the mid-tower build I am talking about would be considered low spec nowadays (I don't remember exactly the specs but it was surely pre-2019).
No problem, thank you for the clarifications!
> To give you a practical example, you can try
>
> https://view.tcsenpai.com/feed/popular (invidious instance hosted on the Jetson Xavier)
>
> https://swing.tunnelsenpai.win/#/ (hosted on the ZimaBlade)
>
> In my opinion, while being way cheaper, the ZimaBlade obliterates the Jetson Xavier (which btw is forced to run at 20w vs 6w and must use Ubuntu 18.04 with a 5. something kernel)
> Why would you use home-grade "servers" when a startup has access to a variety of cheap cloud solutions? What business market segment in a server space would these mini PCs occupy?
This is more of a hypothetical question. From simple use, the Beelink SER5 I have seems to have better performance than my 13-year-old Macbook Pro, so I was curious about the upper bound / limits of little machines like it.
May I ask what you mean by "a variety of cheap cloud solutions", do you refer to services such as DigitalOcean's Droplet and/or similar products?