Page 1 of 1

Elasticsearch - search results at Google speed

Posted: Tue Jul 07, 2020 9:29 am
by Rik Brown
For those of us running Joomla websites with over a million pages, MySQL can return fairly quick search results on a dedicated server with a lot of RAM.

But what I would suggest here is that people start looking at integrating a faster backend search indexer and what we've been using for the past 7 months is Elasticsearch. This free (open source) indexer gives nearly instantaneous search results, like Google. It's my understanding that Wikipedia uses it as their indexer.

The reason I mention it here is that I noticed I had participated in a thread in 2013 and, wouldn't you know it, here it is 2020 and I'm finally using it.

Check out the Joomla component in the extension directories. I'm hoping Elasticsearch becomes more and more mainstream in the Joomla community. It leaves MySQL searches in the dust.

Re: Elasticsearch - search results at Google speed

Posted: Tue Jul 07, 2020 10:25 am
by toivo
The Apache Solr and Lucene platform was ultra fast with large document repositories already several years ago when I last used it with Joomla.

If the data has to be hosted inhouse, rather than in AWS or other third party service, install Solr on Tomcat. A bit of development would be required to integrate the API of the PHP client Solarium into a custom component and smart search plugins to access the Solr engine:
Ref. 1 http://www.solarium-project.org
Ref. 2 https://github.com/solariumphp

Re: Elasticsearch - search results at Google speed

Posted: Tue Jul 07, 2020 5:42 pm
by Rik Brown
Those might be good options too.

I'm loving running Elasticsearch on a dedicated server (no additional cost since we already have the server) and Elasticsearch installs in just a few steps (about 5 minutes on Linux).

It's been 100% bulletproof in operation. I haven't had to do one single thing to it since installation over 7 months ago.

Re: Elasticsearch - search results at Google speed

Posted: Thu Jul 09, 2020 9:07 am
by DistanceRoyal
Can u expend a little bit more about how to install it? I'm using a shared hosting server, do I need to have a dedicated server / vps in order to use it?

Re: Elasticsearch - search results at Google speed

Posted: Thu Jul 09, 2020 4:01 pm
by Rik Brown
I've never used a VPS so I can't help you there. I've only installed it once myself on a dedicated server.

All I can say is that I followed the instructions which you can easily find on Elastic.co. I just cut and pasted the commands I found there.

Google is your friend.

Re: Elasticsearch - search results at Google speed

Posted: Thu Jul 09, 2020 8:37 pm
by Rik Brown
I might add that before setting up Elasticsearch, you will likely first want to find a way to incorporate it into Joomla.

We are currently doing that using the Geek Elasticsearch component which you can find on the Joomla extensions directory. You can look at their documentation to see if that will work for you.

Re: Elasticsearch - search results at Google speed

Posted: Fri Jul 10, 2020 8:42 am
by DistanceRoyal
thanks I'll google it