How does search work?

I tried to search for a recent post of mine and I couldn't find it.

Do you periodically build a search index of some sort that serves as the basis for the search?

Or does a search request go against the raw post data?

If the former, it looks like maybe the search index hasn't been rebuilt in some time.

If the latter, then I'm confused why my search is not working.

Indexing is run overnight around 3am-4am - it's really taxing on the server.  I think it's running every other day or 3 nights.  I may try and rund it  nightly - need to check the cron.

For many years - we've used sphinx for this - if anyone knows of a better alternative- let me know.  Also, one that is free. 

I'm not familiar with sphinx or similar products.

I guess the indexing process re-indexes the entire database (or whatever tables are involved). Is there any way to fine tune it so that it only indexes data based on a date, simply adding to the search index, rather than rebuilding from scratch?

Poking around, I came across something called elasticsearch. Have you looked into that?

drummerboy said:

Poking around, I came across something called elasticsearch. Have you looked into that?

I haven't - looks like it starts around $95 a month.  And primarily uses cloud data storage.   Also, we're using mysql - for that it mainly handles logs and metrics.

Okay this thread title is funny given today’s news. 

Search seems to be down?

just wondering what the current schedule is for rebuilding the search index. was looking for a recent post (maybe from yesterday?) but can't find it.

I noticed some weirdness with it just now -- did a search for a single word and got back the earliest post in 2023, but I knew had an an earlier post than that. Did it with two words, and found the post I was looking for, from 2022.

drummerboy said:

just wondering what the current schedule is for rebuilding the search index. was looking for a recent post (maybe from yesterday?) but can't find it.

I have to check the cron - search gets indexed at night.  It may have skipped a night.  Another item that's very taxing on the current server.  My guys should be getting back on schedule tomorrow with the upgrade - it has taking much longer than anticipated.

ok. I was wondering about the upgrade. Didn't realize it hadn't been completed.