Spark 4.2 has a feature that could retire your vector database(thenewstack.io)
thenewstack.io
Spark 4.2 has a feature that could retire your vector database
https://thenewstack.io/spark-4-2-ai-workloads/
https://thenewstack.io/spark-4-2-ai-workloads/