Looking forward to giving this a try. I have tried MLX using Rapid MLX however the LLM (Qwen) would always have hiccups and get stuck repeating itself.
Moving onto llama.cpp I was able to get faster tokens with MTP and a more reliable llm.
I wonder what other people's experiences are using MLX vs llama.cpp
I think one difference is that it also provides the service of being a production environment you can serve from at the same time as development. There's more information about this thought in the fly io blog post.
Definitely. Shout out to the effort they've put into their api's as well. I've integrated them into a product and raise awareness of sustainable fishing for several major retail outlets.
I really resonate with this post after working with Jenkins for ages. In my experience I wasn't very happy with Bash in the end either and moved to Javascript for reliability, performance and tighter integration with the Cloud were deploying to. It also allowed us to run locally and avoid having to deploy to Jenkins to test.
The discoverability issue is also a massive issue, declarative pipelines massively over promise its capability. Pipeline configuration was mostly still done in the UI because extensions had 0 documentation about how to declaratively define its configuration. Searching on the internet for the magic incantations as the author puts it is such a waste of time and I just compromised to get it running.
I'm glad this post is out there to articulate these common challenges when you invest so much into Jenkins.
I use drone self hosted (which is what Woodpecker CI was forked from in one of the other replies). It's an alright system and it works with my Gitea instance to build executables and docker images.
I think though ironically my take away after setting everything up, was that I didn't really need to spend a lot of time to get it perfect, rather just getting it working was enough for me.
Yeah I definitely agree, wasting time figuring out how to get to the save and apply your changes is the worst obstacle there, in most cases the saves are encrypted and have a check sum applied. Although I've found some games that allow you access the save data without messing around with this stuff, mainly the Shin Megami Tensei line of JRPG games in my experience.
Granted, the saves are binary blobs but once you find the value you want you can find an entire struct of data along side it. There are tools like imHex which help the process and help you define the structure of the save file. It's become a common project of mine to save hack and then build a save editor when I'm confident my changes work.
They failed to architect the project properly by trying to run everything on the blockchain smart contracts instead of leveraging something off chain. Similarly there was mismanagement from DA (the developers) and ASX with no clear goal of what the end product looked like or how progress was being made.
Accenture even call out that a blockchain solution might not have been the best one considering the ASX centrally settles trades anyway.
The pdf is a good read into the technical and management failings of the project
University was my playground for this sort of this sort of thing (because my high school was all paper). One subject used an Online Platform called Wiley which stored the answer in the page, a weekend writing up the script to solve it, fake a realistic completed percentage and take a realistic amount of time to solve. I used a greasemonkey script, just like this post as well!
Countless subjects also distributed questions and answers from Textbooks in a PDF format. One OCR run later and a script to clean text I had a database of questions and answers I could share with my friends to practice for the exam (which helpfully used the exact same questions). https://www.rytek.me/archive/projects/epmquiz-webapp/
I never did flex my cheating like you did haha for fear of the repercussions.
A lot of people these days reccomend Parsec. However bear in mind that it is closed source. Personally I was using it to play it takes two with friends and it worked pretty well.
Moving onto llama.cpp I was able to get faster tokens with MTP and a more reliable llm.
I wonder what other people's experiences are using MLX vs llama.cpp