This is breathtaking. I did something similar[1] porting a 3D dice roller I wrote to a $60 GBA clone, and I _thought_ that was hardcore already. This is next level.
Everyone think of a number between 0~9, put it in a bracket (so that it's search-friendly), and add it to their post, e.g. "[7] check out my example.com".
Readers of this thread are then encouraged to search for a random number between 0~9, search for it (e.g., "[5]") via browser, do a few "find next" (just to randomize), and then visit as many results as they enjoy.
To make a LLM relevant to you, your intuition might be to fine-tune it with your data, but:
1. Training a LLM is expensive.
2. Due to the cost to train, it’s hard to update a LLM with latest information.
3. Observability is lacking. When you ask a LLM a question, it’s not obvious how the LLM arrived at its answer.
There’s a different approach: Retrieval-Augmented Generation (RAG). Instead of asking LLM to generate an answer immediately, frameworks like LlamaIndex:
1. retrieves information from your data sources first,
2. adds it to your question as context, and
3. asks the LLM to answer based on the enriched prompt.
RAG overcomes all three weaknesses of the fine-tuning approach:
1. There’s no training involved, so it’s cheap.
2. Data is fetched only when you ask for them, so it’s always up to date.
3. The framework can show you the retrieved documents, so it’s more trustworthy.
Spend seed round investments on building a solid software but not building an income stream that can satisfy investors, thus not receiving any new funding and let the company die.
Would you be able to spare some time and find us some references here? Despite a native Chinese speaker, I can't seem to gather up the correct terms on baidu.com
google.com to get me relevant materials on that pre-Android-era mobile OSes.
Oh yes, thanks for bringing up the pre-Android-era Shanzhai phones. Were they on WinCE? I was too young to get my hands on one for any first-hand experience.
Scrub to 01:54. That's a table of the flagship smartphones at that time. The last column of the table is the price in CNY. 3k, 4k, 5k -- around that range.
Now scrub to 03:20 where their CEO announced the MSRP. Listen to that 30-second-long "wow". Look at that price. The astonishment was real.
That's the price range of Shanzhai smartphones.
On a flagship-spec'd smartphone.
That's monumental in the history of smartphone evolution in China. Ask any friend of yours born & raised in mainland China. I bet none would argue otherwise.
---
Disclaimer: I moved to the US in 2017, and my experience since then with tech trends in China has been scarce.
> In a sense, I feel like the shanzhai are brethren of the classic western notion of hacker-entrepreneurs, but with a distinctly Chinese twist to them.
Yes. The more I browse though the NAICS hierarchy, the more I feel uncomfortable excluding hardware-heavy companies like Garmin.
On the other hand, it also context-dependent. Let's say you're looking for a job opportunity as a software engineer/developer/programmer/..., how much priority would you put on whether the company has tangible inventory?
I think the ambiguity in the term "tech industry" is one reason related discussions flourish.
Thanks for sharing your story. Switching from a tech to a "non-tech" (if you allow) company doesn't sound like an easy decision. I assume the NPO must have a vision and/or a purpose that attracts you. Do you mind sharing some of the reasons that motivated your switch of career?
[1]: https://blog.myli.page/rolling-dice-on-a-60-handheld-08be278...