
This article offers a list of top search engines for Competitive Intelligence, Competitor Analysis research. In no particular order, and if you have any suggestions or additions, then please let us know on hello@octopusintelligence.com.
Why use more than one search engine?
We have selected a couple of search engines which focus on privacy. However, in our view, the trick when searching for secondary information is to use niche search engines to really target your search. But also, searching for the same subject will reveal very different results. Sometimes you find nuggets of gold.
List of top search engines for Competitive Intelligence
In this article, we present the following search engines our researchers use to varying degrees.
- Yippy
- Dogpile
- Board Reader
- Dark Search
- WolframAlpha
- Million Short
- Peekier
- Mojeek
- Reelgood
- Carrott2
- Yandex
- isearchfrom
- instya
- Pimeyes
- Answer the public
- Deep
We all know how to use a search engine, but do you know how do search engines actually work?
How do search engines work?
Search engines crawl billions of pages using their own web crawlers. They are often called bots or spiders. Search engines navigate the web, download web pages and follow links within these pages to discover new pages.
They add the isolated web pages into a data structure index. This index includes the URLs and other relevant data, including:
- Keywords found within the page
- Using microdata called Schemes the content of the page
- The age of the website
- The popularity of the page
Ok, but what’s a metasearch engine?
Using an algorithm, a metasearch engine is a web portal aggregator of many results for a keyword or a phrase of a number of different search engines. A metasearch engine removes the need to use many individual search engines separately. Examples of metasearch engines include Metacrawler, Dogpile, lxquick, Metager, Yabado, and Zoo.
Yippy
Yippy is a metasearch engine which groups search results into clusters. This search engine was created by Vivísimo in 2004 under the name Clusty. Vivisimo was acquired by IBM in 2010 and incorporated the power of IBM Watson.
Dogpile
Dogpile is a metasearch engine. It fetches results from Yandex, Google, Bing Yahoo!, and other popular search engines. Including audio and video content.
Boardreader
Boardreader is a niche search engine which focuses searching on groups and message boards. Most search engines overlook these often vibrant communities, and you can get significant insight into your business, brand and the answers to the questions you need to ask.
Dark Search
Darksearch claims to be the worlds first real Dark Web search engine, which of course it isn’t. The search engine allows you research and directly access sites onion (via Tor2Web) by simplifying access, monitoring the dark web, and cybersecurity. Darksearch indexes all .onion site and will soon allow you to search other restricted forums. Ahmia’s is a more established premier search engine for the Tor network. A more conventional search engine for the deep web. Ahmia allows access to onion services to anyone.
WolframAlpha
Released in May 2009 WolframAlpha is a computational knowledge search engine or answer engine. Rather than providing a list of web pages that may answer your questions, this online service answers factual questions by calculating external data.
Million Short
Toronto based search engine Million Short brands itself as “more of a discovery engine’. Million Short allows you to filter out of your search results the top million websites on the internet. A unique group of search results based on content, not just who’s got the best SEO budget.
Peekier
Search engine Peekier has doesn’t add cookies, and or save your IP address or any other information; they don’t keep your search keywords or aggregated your history. Results mainly sourced from Bing, but as discussed in the opening paragraph alternative search results will be revealed.
Mojeek
Launched in 2004, Mojeek is a UK based search engine based. Search results come from its index of web pages using its spiders.
Reelgood
Reelgood is a 100% free streaming service search engine that offers a wide range of documentaries, movies, and TV shows. We also give users a personalized view where they can see all of the shows available to them from different streaming services in one place.
Carrot2
Carrot2 is an open-source search clustering engine and instantly places search results into topics. Results are clustered into thematic categories, meaning they are group into themes. So search dog you will get groupings including collar and bone, rather than cats and pet rabbits.
Yandex
Yandex is a Russian search engine and is the biggest search engine in Russia, with over 50% of the search engine market. But Yandex operates like any other leading search engines but will offer different results to other search engines.
isearchfrom
isearchfrom emulates Google search location tool. You enter the language or the country where you want to search in. Your search results reflect the same search results if you are in that country. Of course, the alternative way to do this is to use a VPN to mask your location or use a server from the country you wish to find information in.
ICIJ Offshore Leaks
ICIJ is an independent and nonprofit news organisation. Offshore leaks brings journalists together to help collaboration on in-depth global investigations. The ICIJ Offshore Leaks search engines allow you to search 100,000 plus discrete companies, funds and trusts created in offshore locales like the Cayman Islands, British Virgin Islands, Singapore, and the Cook Islands.
This article offered a list of top search engines for Competitive Intelligence, Competitor Analysis research. The list is in no particular order, and if you have any suggestions or additions, please let us know on hello@octopusintelligence.com.
Checkusernames
Social networking like Twitter, Facebook, Instagram contains a lot of information, but it can take time to search for usernames. It’s often a tedious exercise too. Checkusernames will search for usernames on 150 plus websites. Knowem is a similar search engine but claims to have over 500 websites. https://knowem.com
100searchengines.com
100 Search Engines was created by Advanced Search Technologies, Inc. 100 Search Engines is designed to find the current and relevant information, news, images and videos. Why have one search engine when you can have 100?
Instya.com
A single destination and shopping engine focusing on products and associated and similar websites for comparison.
Pimeyes Facial Recognition Search
PimEyes is a search engine for face recognition Integrated facial recognition with a search engine. Developing into a self-monitoring, self-protection, and self-image management tool.
Answer the public
AnswerThePublic listens into autocomplete data from Google and other search engines then produces useful phrases and questions people are asking around your keyword. A direct line to your customers’ thoughts.
DEEP
DEEP is a platform offering collaborative tools tailored toward humanitarian crisis responses. It includes analysis workflows and frameworks for thinking using structured and unstructured quantitative and qualitative data. By using a customisable analysis framework, you can catalogue information contained in documents and and data.