"The recent change also means you can run multiple LLaMA ./main processes at the same time, and they'll all share the same memory resources."
So this could have a main and multiple sub-worker llm processes possibly collaborating while sharing same memory footprint?
This sounds like a great advice! Will pickup a domain and get started.
Would probably look around for hardware/robotics and machine learning domain specific projects to get started and learn :)
Over last 10 years have used Freemind & (last few years) Xmind to kind of make superfast flow charts in the tools dressed as mindmap tools. So i can see the appeal of knoted here for quick jotting down of thought flows.
But have also enjoyed making nice diagrams in mermaidjs especially the sequence diagrams. Prefer markdown to digram for code maintainability. Was recently seeing a youtube talk from C4 author on composable diagrams and agree to a lot of what was said in the talk. Src: https://www.youtube.com/watch?v=Za1-v4Zkq5E
Keyboard to diagram is much faster than mouse based diagram tools and have found them better for long term use cases. Quick diagraming in excalidraw or figjam doesn't hurt though when brainstorming especially with not very technical folks as they can easily contribute.
Have used sequence diagrams for interactions & state diagram for state machines from mermaid for this. https://mermaid-js.github.io/mermaid/#/
System architecture is probably best in PlantUML as already pointed out in other comments. https://real-world-plantuml.com/ is helpful.
But mostly it's a lot of manual effort to keep it updated, but the markdown (in git repo) makes it easier I guess...
=> One thing that worked at times was to have new joinees in team update the docs and the diagram based on their understanding + having this system architecture as part of onboarding sort of ensures it is updated on most occasions. :)
It was delightful to watch him create a Wordle clone with a simple html file coupled with one js file in plain sublime text editor and chrome debugger hacking :D
No complex modules installation or initialisation setup.
After having seen the JS complexity grow to from simple jquery stuff to download a whole lot of stuff to just get started creating a simple webpage, I personally found this simplicity absolutely delightful and inspiring. Ended up creating a simple world clone in a couple of hours and quite enjoyed the whole simplicity of it all :D
While I would agree with this to get started, but it's always a good idea to be aware of possibilities beforehand and skim though them once so one knows that the solution exists for the problem being faced, what the solution looks like and where to look for it the quickest. So while i know I will forget the exact implementations of 90% all the cool stuff I can do with vim, but I know the possibilities when I have seen them once somewhere.
I remember feeling combinations of motions with edit commands were like the superpowers when I first saw them. I had to look them up again several times whenever I needed them to get it right. But once I got it, suddenly predicting them to edit text on vim transcended into fun territory for me personally.
Though for vim, I have found to adopt only one or two new things a week at max to improve productivity. Anything more and it used to get overwhelming, or i forgot about it anyways...
Yep. It's almost there.
Used to use excel a lot earlier (on Windows) in data science job.
Now have excel on Mac, but google spreadsheets mostly gets the job done on most occasions. (Now I am mostly a programmer/product guy)
A few problems I have encountered with google spreadsheet:
1. Sharing some stuff with third parties who exclusively use Windows and just want an excel.
2. Speed of working with all the keyboard shortcuts still seems better in desktop excel as compared to google spreadsheet (but I am happy with the progress of how many of those same shortcuts now work on google spreadsheets).
And also some Kubernetes, Docker in more detail, explore rkt and CoreOS, perhaps also get into details of linux kernel and finish a custom build from http://www.linuxfromscratch.org/
Get more depth into system security
If time permits, would love to learn more about Quantum Computing and explore if I can contribute in any way.
He chooses a topic and does a snapstorm (a bunch of continuous 10 second videos) on those topics. Quite nice focused advice and personal observations on a daily basis.
Topics range from how to raise money and reaching out to angels/VCs to other things relevant to everyday business processes like marketing, building teams, metrics to focus on, common mistakes, etc.
Justin recommended to follow him once earlier this year I think. Checking out their stories almost daily is one of my prime use cases for Snapchat since then. (I am in India and in late 20's so have very few folks around me on Snapchat to do anything else really...)
Also starting the day seeing Justin following up with example on his advice of "Fitness is the first step to greatness" has personally helped me get a lot more motivated towards a better lifestyle :)