Skip to main content

2 posts tagged with "fulltext"

View All Tags

FullText Search Engine Componenets

· 2 min read
forfd8960
forfd8960
Author

What's the Core Components in a Full Text Search Engine​

Look into Bleve Modern Search Lib Code, and Found that it has the following core components：

componentfunction of the component
analysismainly contains analyzer(char filters, token filters, tokenizer)
cmdcommand line client
documentdefine Document and Related Doc Fields(Text Field, Datetime Field, etc)
geoImplement geo point and geo shape query
indexAnalyze and read, write indexed fields to under key-value store
mappingimplment DocumentMapping: How the Document should be indexed.
searchImplment search functionality

How a Full Text Search engine works - Index

· 11 min read
forfd8960
forfd8960
Author

Recently I am start working on build a Full Text Search engine with rust. But I don't know how to get started. And have many questions:

  • What is the basic concept in the full-text search Engine.
  • What are the core conponents in the Engine.
  • And how they works together.
  • How the document/text is analyzed and filtered,
  • How the analyzed indexed is stored on the disk.
  • How the engine searchs the results according user's query.

After Read about Elastic Search Docuemnts, Melisearch blogs, Couchbase blog, and read some source code from Bleve.