acutesoftware

mês passadodiscuss

> and maintain

This right here is the key difference! Yes anyone can vibe code a replacement for many apps - but will it still run 2 years later (assuming they get it 'running' in an prod environment at all

acutesoftware

há 4 mesesdiscuss

This highlights that all RAG systems should be using metadata embedded into each of the vectorstores. Any result from the LLM needs to have a link to a document / chunk - which is turn links to a 'source file' which (should) have the file system owners id or another method of linking to a person.

If the 'source information' cannot be linked to a person in the organisation, then it doesnt really belong in the RAG document store as authorative information.

acutesoftware

há 6 mesesdiscuss

Nice to see old tech revitalised - I had fun with the Australian version of a Z80 single board computer - https://en.wikipedia.org/wiki/TEC-1

acutesoftware

há 6 mesesdiscuss

I am using LangChain with a SQLite database - it works pretty well on a 16G GPU, but I started running it on a crappy NUC, which also worked with lesser results.

The real lightbulb moment is when you realise the ONLY thing a RAG passes to the LLM is a short string of search results with small chunks of text. This changes it from 'magic' to 'ahh, ok - I need better search results'. With small models you cannot pass a lot of search results ( TOP_K=5 is probably the limit ), otherwise the small models 'forget context'.

It is fun trying to get decent results - and it is a rabbithole, next step I am going into is pre-summarising files and folders.

I open sourced the code I was using - https://github.com/acutesoftware/lifepim-ai-core

acutesoftware

há 6 mesesdiscuss

I am working on a local RAG LLM designed for lower end PC's - ability for people to try out searching their own documents, seeing it was such a learning curve to get to this stage - hoping others can learn from my mistakes.

https://github.com/acutesoftware/lifepim-ai-core

Only been public a few days, so please let me know if there are glaring issues.

acutesoftware

há 9 mesesdiscuss

Switching models when running locally is fairly easy - as long as you have them downloaded you can switch them in and out with a just a config setting - cant quite remember, but you may need to rebuild the vectorstore when switching though.

LangChain has the embeddings for major providers:

  def build_vectorstore(docs):
    """
    Create vectorstore from documents using configured embedding model.
    """
    # Choose embedding model
    if cfg.EMBED_MODEL.lower() == "openai":
        embeddings = OpenAIEmbeddings(model="text-embedding-3-small")
    elif cfg.EMBED_MODEL.lower() == "huggingface":
        from langchain_community.embeddings import HuggingFaceEmbeddings
        embeddings = HuggingFaceEmbeddings(model_name="sentence-transformers/all-MiniLM-L6-v2")
    elif cfg.EMBED_MODEL.lower() == "nomic-embed-text":
        from langchain_ollama import OllamaEmbeddings
        embeddings = OllamaEmbeddings(model=cfg.EMBED_MODEL)

acutesoftware

ano passadodiscuss

I think it was the modal dialog box that forced you to stop what you were doing and click 'piss off clippy', rather than being able to ignore it.

acutesoftware

ano passadodiscuss

> Some people love programming, for the sake of programming itself.

And this is what is causing the friction against LLM's (which are quite useful for getting up to speed with a new concept / language ), the programming itself is the fun bit - I still want to do that bit!

acutesoftware

há 2 anosdiscuss

Very well done - it took me several attempts to get the hang of Blender and I still only know / used half those shortcuts. Thanks for the easy to use tips!

acutesoftware

há 2 anosdiscuss

I think Google has lost all faith in terms of keeping projects around - especially when they involve data locked into a mildly complex system without a complete migration path out.

I would be wary investing time in learning / using any new products from them.

acutesoftware

há 2 anosdiscuss

Cyc seemed to be the best application for proper AI in my opinion - all the ML and LLM tricks are statistically really good, but you need to parse it through Cyc to check for common sense.

I am really pleased they continue to work on this - it is a lot of work, but it needs to be done and checked manually, once done the base stuff shouldn't change much and it will be a great common sense check for generated content.

acutesoftware

há 2 anosdiscuss

Our ETL process is heavily monitored so we never miss a days data, but we got a surprising error "cant build aggregates - missing data, aborting MV refresh, data will be a day old". It was the year to date (YTD) calculation - no data for 29/2/2023 to compare to today.

acutesoftware

há 3 anosdiscuss

> "You can't just take the CSS stylesheets and references and store them."

Yes you can - just save them locally?

acutesoftware

há 3 anosdiscuss

Well, you can - you can have a policy that forces payments from a select group. Some users will complain when "No, you cant pay with 2 chickens every 3rd full moon", but that is too bad.

acutesoftware

há 3 anosdiscuss

Oracle requires you to login to get access to most support documents now.

acutesoftware

há 3 anosdiscuss

https://www.lifepim.com/blog

Very low frequency updates mainly about information management and data.

Most popular article was "What software will you trust when you get senile?" - https://www.lifepim.com/blog/5856_What_software_will_you_tru...

acutesoftware

há 3 anosdiscuss

This is really impressive, even the trees look pretty good which appears to be tricky to do with procgen stuff.

A nice next step or addition would be to take the results and remesh them to lower poly models so it can be used in a game engine to walk around in.

acutesoftware

há 3 anosdiscuss

In terms of Unreal blueprints they may be low syntax but they are not low code - you still need to know software development techniques or you will end up in a pile of garbage very quickly (which you can also do with any other language).

acutesoftware

há 4 anosdiscuss

1. Lots of additional data breaches will make more users wary of using cloud apps for personal data. This will cause more power users to move to desktop / local first apps.

2. AI will improve and showcase several new cool 'tricks' but commercially it will continue to focus on guiding users to watch more ads.

3. An increase in the number of streaming media services will make the average user realize they need to pay quite a lot money to 'watch stuff' - either a new unified package will appear for a reasonable price, or piracy will increase.

acutesoftware

há 4 anosdiscuss

This is very cool, though as others have said it is fairly resource intensive.

I'd love to see a schematic exported or even shown as you press simulate (you clearly have it the components and links in memory somewhere to do the simulation). This would be great for debugging.

acutesoftware

Submissions

What software will you trust when you get senile?

LifePIM – a fast and secure place to store the Metadata of your life

Ask HN: What you think about encrypting users data at the database level?

Ask HN: How do you monitor usage of your websites?

Show HN: PreAlpha – AI knowledge information framework

comments