Tengence Intelligent Search: An AI-Driven On-Site Search Solution
Summary: Tengence Search is an AI retrieval solution built for enterprise on-site search. Keyword recall, semantic vector recall and hybrid fused ranking fix "nothing found" and "wrong results", while standardized ingestion and search analytics fix "cannot connect" and "cannot see".
Investment in on-site retrieval is often concealed by the lowest bar of all, namely "something comes back". Four failure modes are the most common: a high zero-result rate, top hits that miss the intent, data scattered across systems that cannot be searched together, and query logs that are stored but never analyzed. They sit at four different layers, recall, relevance, data ingestion and measurement, so neither swapping the tokenizer nor redesigning the front end will fix them. This article explains what Tengence Search is made of, how it is integrated, when it fits and how it differs, then gives a rollout cadence and the metrics to watch.
Key Takeaways
- Enterprise on-site search fails in four ways: a high zero-result rate, poor relevance, multi-source data that cannot be ingested, and a lack of search analytics.
- A usable retrieval capability needs four layers: query understanding, multi-path recall with fused ranking, intervention rules, and measurement.
- Keyword recall guarantees precision and explainability, semantic vector recall crosses the vocabulary gap, and hybrid fused ranking delivers both.
- Query understanding, meaning segmentation, correction, synonyms and intent, sets the ceiling on recall quality and is the prerequisite for any relevance work.
- The intervention-rule layer cannot be replaced by algorithms: pinning, blocking and synonyms are still the main levers of daily operations.
- Measure by establishing a baseline first and iterating afterwards, tracking the zero-result rate, top-result click-through rate and search exit rate.
1. Four real pain points in enterprise on-site search
Nothing found: a high zero-result rate. A reasonable query returns an empty results page, and the direct consequence is an abandoned session. The causes are usually a segmentation granularity that does not match business vocabulary, missing synonyms, and new products or documents that have not been indexed in time. Zero-result queries are the most valuable signal of demand gaps; the full breakdown is in How to Cut the Zero-Result Rate in On-Site Search: 8 Practical Tactics.
Wrong results: poor relevance. Results come back, but the ones on top are not what the user wanted. The root cause is usually a single ranking signal: text similarity alone, with no sales volume, stock, freshness or click feedback folded in. This problem never shows up in the zero-result rate; only the click distribution exposes it.
Cannot connect: isolated multi-source data. Products live in the transaction platform, documents in the knowledge base, tickets in the support system, each with its own entry point. Elastic defines enterprise search as covering structured and unstructured data across an organization, for sites, e-commerce, knowledge bases and support desks; ingesting many sources at once is the first hurdle.
Cannot see: no search analytics. Without an aggregated view of the query log, you cannot know what users are searching for or which terms have returned nothing for months, so optimization is reduced to guesswork.
2. Capability structure: four layers
Tengence Search organizes its capabilities into four layers so that you can locate the layer a problem comes from.
| Layer | Main responsibility | Key output |
|---|---|---|
| Query understanding | Segmentation, correction, synonym expansion, intent recognition, rewriting | Query string, intent label, rewrite candidates |
| Recall and ranking | Keyword and vector recall, fused ranking, precise reranking | Candidate set and ranking score |
| Intervention rules | Pinning, blocking, down-weighting, synonyms, freshness weighting | Ranking override rules |
| Measurement | Query analytics, zero-result reports, click attribution | Dashboards and tuning evidence |
Query understanding sets the ceiling on recall quality. Elastic suggesters return near-miss and candidate terms through the suggest parameter, a common implementation pattern for correction and suggestion; the research community is exploring large language models for query rewriting and intent completion.
Recall and ranking run on two parallel paths, the keyword path protecting precision and the vector path protecting semantics. Hybrid retrieval merges the two result sets before output, commonly through reciprocal rank fusion (RRF), which merges by rank position rather than raw score and sidesteps inconsistent score scales. The boundary between the two recall paths is drawn in What Is Semantic Search? Vector Retrieval vs Keyword Retrieval, Compared.
Intervention rules are the business-side fallback: pinning a product, blocking content and treating brand aliases as equivalent are rule problems, and folding them into the model only makes troubleshooting harder.
3. Data flow and integration: from source to feedback loop
The whole pipeline has four stages: data source ingestion -> index construction -> query service -> feedback collection.
Data source ingestion. Three methods are common: incremental database synchronization (listening to the binlog or polling by update time), active push from a business system API, and batch import of files from object storage. When ingesting, settle the field mapping first: title, body, category, tags, time, status and permission flags.
Index construction. This covers tokenizer configuration, vector encoding, indexing of structured fields, and incremental versus full rebuild strategies. Run one index validation before launch, sampling coverage and field completeness, to avoid the trap of "connected, but half the fields are missing".
Query service. Provided as an HTTP API, a request passes through query understanding into multi-path recall and fused ranking, and returns the hit list, facet aggregation and debug information; permissions are filtered at this layer before scoring. Site front ends and mobile apps, back-office systems, and support consoles are the three integration patterns: the first care about latency and suggestion, back-office systems care more about filtering and permission isolation. Interface parameters are listed in Tengence Search API documentation.
Feedback collection. Capture impressions, clicks, pagination, leaving without a click, and order or self-service resolution events; the log feeds both analytics reports and the mining input for ranking and synonyms.
4. Where it fits: five business types, different priorities
Data shape and success criteria differ sharply across businesses.
| Scenario | Retrieval object | Configuration focus | Main risk |
|---|---|---|---|
| E-commerce | Products, SKUs, attribute specifications | Precise attribute filtering, stock and sellable status, brand alias synonyms | Over-semantic retrieval breaking model-number matching |
| Content platforms | Articles, videos, topics | Freshness weighting, differentiated title and body weights, topic aggregation | Semantic generalization causing topic drift |
| Enterprise knowledge bases | Documents, spreadsheets, scans | Permission filtering, document parsing, paragraph-level retrieval | Permission misconfiguration exposing content |
| Support help centers | FAQs, tickets, scripts | Natural-language question handling, direct answers, self-service resolution rate | Falling out of sync with the ticketing system |
| In-product search for SaaS | Customer data, feature entry points, help documents | Multi-tenant isolation, latency control, mixed content types | Cross-tenant leakage and stale index updates |
To judge where the emphasis belongs, look at the query-string shape first: businesses dominated by model numbers, codes and order numbers weight keyword recall and structured filtering higher, while businesses dominated by full sentences gain more directly from semantic recall and query understanding.
5. How it differs from in-house, open-source and generic SaaS search
Four routes each carry their own conditions, and the choice depends on data complexity and the engineering capacity of the team.
| Dimension | In-house retrieval | Open-source (Elasticsearch and others) | Generic SaaS search | Tengence Search |
|---|---|---|---|---|
| Initial investment | High, needs a dedicated team | Medium, needs self-tuning | Low, register and connect | Low, connect by data source |
| Time to launch | Long, built item by item | Medium, semantics added yourself | Short | Short, includes query understanding and hybrid recall |
| Controllability | Highest, algorithms can be changed | High, source is open | Lower, bounded by the product | Medium, algorithms and rules configurable |
| Ops burden | Fully self-managed | Self-managed cluster and versions | Vendor-managed | Vendor-managed |
| Semantics and fused ranking | Models and fusion built in-house | Requires a vector store and models | Depends on the product | Built-in dual-path recall and fusion |
| Business intervention | Operations console built in-house | Rule UI built in-house | Basic rules provided | Pinning, blocking, synonyms |
| Search analytics | Instrumentation and dashboards built in-house | Reports built in-house | Basic reports provided | Built-in query analytics reports |
| Best fit | Retrieval is the core moat | Team available, autonomy wanted | Generic needs, fast launch | Fast launch while keeping intervention |
Teams that already run a stable open-source stack do not need a full replacement; the common approach is to keep the existing index and incrementally add semantic recall and fused ranking.
6. Rollout steps and launch cadence
Phase one: integration and baseline. Finish the data inventory and field mapping, settle the permission flags, build the index and get the query API working, while collecting production logs to establish a baseline with at least the zero-result rate, top-result click-through rate and search exit rate. Without a baseline there is no way to judge which direction to tune.
Phase two: tuning. Work in priority order: fix zero results first (segmentation, synonyms, field completion), then relevance (hybrid weights, ranking features), and finally interaction (suggestions, correction, filtering). Evaluation must be segmented by query type, because aggregate metrics hide the pattern of "fuzzy queries improved while exact queries collapsed"; the method is in How to Optimize Search Relevance Ranking: A Recall + Ranking Two-Stage Method.
Phase three: canary and A/B. Split traffic by proportion, keep the original strategy in the control group, and roll out fully only after the difference reaches statistical significance.
Phase four: continuous operations. Run weekly query analytics: add synonyms for new zero-result terms, review ranking for high-impression low-click results, and keep index updates in sync with content going on and off the shelf. Retrieval quality is not a one-off project.
7. How to measure results: the core metric list
Offline test sets tell you whether an algorithm change moves in the right direction; you can follow a benchmark such as BEIR and build your own query set with human labels. Online metrics tell you the real gain.
| Metric | Definition | What it shows | Common improvement action |
|---|---|---|---|
| Zero-result rate | Queries with no results / total queries | Demand gaps and index coverage | Add segmentation, synonyms, fields |
| Search exit rate | Share of sessions with no click after search | Whether the results page satisfies intent | Tune ranking features and display density |
| Top-result click-through rate | Clicks on the first result / queries | Relevance of the top hit | Tune fusion weights and reranking |
| Top-three click share | Clicks in the top three / total clicks | Whether good results rank high | Ranking weights and intervention rules |
| Query rewrite rate | Share of queries triggering correction or rewriting | Coverage of query understanding | Refresh correction and synonym tables |
| Search conversion rate | Share of search sessions completing the goal action | Business contribution of retrieval | Improve result content and landing pages |
| Response latency p95 | Return time of 95% of queries | Experience and stability | Index optimization, caching and scaling |
Lock the zero-result rate, search exit rate and top-result click-through rate as primary metrics first. The full framework is in What Is On-Site Search? Principles, Core Metrics and the Capability Framework.
FAQ
Q: What is the difference between Tengence Search and the fuzzy query built into a database?
A: A fuzzy query only performs substring containment matching, with no segmentation, synonyms, correction or relevance ranking, and it degrades noticeably once content volume grows past tens of thousands of records. Tengence Search adds query understanding, dual-path recall, fused ranking and search analytics.
Q: We already use Elasticsearch. Do we still need Tengence Search?
A: Not necessarily as a full replacement. The common approach is to keep the existing index and let Tengence Search add query understanding, semantic recall, fused ranking and a rule configuration UI, cutting the work of building that capability in-house.
Q: Once semantic vector recall is live, do synonym tables still need maintenance?
A: Yes, but the job changes. Semantic models cover most general synonymous expressions, while business-specific equivalents such as brand aliases and internal abbreviations cannot be learned by the model, so the table becomes a supplement for precise correction.
Q: Does integration require reworking existing business systems?
A: In most cases no. On the data side you connect through incremental synchronization or API push, on the query side you switch to calling the retrieval API, and the front end keeps its existing display structure; the rework concentrates on field mapping and permission cleanup.
Q: How is data permission guaranteed against overreach?
A: Permission flags are written into the index as an independent field during ingestion, and queries filter by permission before scoring and ranking, so invisible content never enters the candidate set; run one round of overreach testing before launch.
Q: How do I know whether search optimization actually worked?
A: Look at three things: whether there is a baseline from before tuning, whether evaluation is segmented by query type, and whether an A/B test reached statistical significance. Watching the overall click-through rate alone tends to average the effect away.
About Tengence
Tengence Search targets enterprise on-site retrieval with query understanding, dual-path keyword and semantic vector recall, hybrid fused ranking, intervention rules and search analytics, and can be connected from sites, apps and back-office systems. Tengence (TENGENCE) is the enterprise growth engine of the AI era, focused on public-traffic acquisition and private-domain conversion; its core products are Tengence GEO (dual-engine GEO + SEO) and Tengence Search.
Related Reading
- What Is Site Search? How It Works, Core Metrics and Capability Framework
- Semantic Search vs. Keyword Search: A Full Comparison
- How to Optimize Search Relevance Ranking? A Two-Stage Recall + Ranking Method
- How to Lower Your Site-Search Zero-Results Rate: 8 Actionable Strategies
Data Sources
- Elastic, "What is enterprise search?": enterprise search covers structured and unstructured data across an organization, for sites, e-commerce, knowledge bases and support desks; supports the section on isolated multi-source data.
- Elastic, "What is hybrid search?": hybrid retrieval merges keyword matching and vector similarity into one output; supports dual-path recall and fused ranking.
- Elasticsearch guide, "Reciprocal rank fusion": merges by rank position rather than raw score; supports the claim that fusion avoids inconsistent score scales across the two paths.
- Elasticsearch reference, "Suggester examples": the suggest parameter returns near-miss suggestions from input text; supports correction and suggestion in the query understanding layer.
- arXiv, "Query Understanding in the Age of Large Language Models" (Anand et al., 2023): query rewriting and intent completion with large language models; supports the claim that query understanding sets the ceiling on recall quality.
- arXiv, "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models" (Thakur et al., 2021): a heterogeneous zero-shot retrieval benchmark; supports building an offline baseline from your own query set.