Find 'Abbey Road when type 'Beatles abbey rd': Fuzzy/Semantic search in Postgres

(rendiment.io)

Comments

fsckboy 19 hours ago
these days i find myself yearning to type "Beatles abbey rd" and find only "Beatles abbey rd"
gingerlime 19 hours ago
Great post. Explains the concepts just enough that they click without going too deep, shows practical implementation examples, how it fits together. Simple, clear and ultimately useful. (to me at least)
pinkmuffinere 19 hours ago
The rewritten title is confusing imo. Can I propose:

“Finding ‘Abbey Road’ given ‘beatles abbey rd’ search with Postgres”

augusteo 12 hours ago
On the API vs local model question:

We went with API embeddings for a similar use case. The cold-start latency of local models across multiple workers ate more money in compute than just paying per-token. Plus you avoid the operational overhead of model updates.

The hybrid approach in this article is smart. Fuzzy matching catches 80% of cases instantly, embeddings handle the rest. No need to run expensive vector search on every query.

timlod 16 hours ago
FWIW, the performance considerations section is a little simplistic, and probably assumes that exact dataset/problem.

For GIN for example, perfomance depends a lot on the size of the search input (the fewer characters, the more rows to compare) as well as the number of rows/size of the index.

It also mentions GiST (another type of index which isn't mentioned anywhere else in the article)..

lbrito 19 hours ago
I was just starting to learn about embeddings for a very similar use on my project. Newbie question: what are pros/cons of using an API like gpt Ada to calculate the embeddings, compared to importing some model on Python and running it locally like in this article?
TeamDman 18 hours ago
for 50,000 rows I'd much rather just use fzf/nucleo/tv against json files instead of dealing with database schemas. When it comes to dealing with embedding vectors rather than plaintext then it gets slightly more annoying but still feels like such an pain in the ass to go full database when really it could still be a bunch of flat open files.

More of a perspective from just trying to index crap on my own machine vs building a SaaS

danielfalbo 18 hours ago
> Abbey Road

> The Dark Side of the Moon

> OK Computer

Those are my 3 personal records ever. I feel so average now...

cess11 19 hours ago
I found fuzzy search in Manticore to be straightforward and pretty good. Might be a decent alternative if one perceives the ceremony in TFA as a bit much.
esafak 18 hours ago
tl,dr: A demo of pg_trgm (fuzzy matcher) + pgvector (vector search).