Skip to main content

Agent-CoreX Architecture

Agent-CoreX is built on three core pillars: Tool Retrieval, MCP Management, and Intelligent Execution. Let’s break down how everything works together.

System Architecture

Core Components

1. Tool Retrieval Engine

The heart of Agent-CoreX. Converts natural language queries into ranked tool recommendations. How it works:
  1. User/Agent queries: "I need to deploy to AWS and notify Slack"
  2. Query is vectorized using embeddings
  3. Matched against tool index (100+ MCP servers)
  4. LLM-based ranker scores tools by relevance
  5. Returns top-k tools sorted by relevance score
Key Features:
  • Fast semantic search (sub-50ms)
  • Context-aware ranking
  • Token-optimized responses
  • Caching for frequently queried patterns

2. MCP Manager

Routes tool execution requests to the appropriate MCP server and handles communication. Responsibilities:
  • Server discovery and health checks
  • Load balancing across MCP instances
  • Authentication & credential management
  • Error handling & retries
  • Response formatting
Supported Protocols:
  • JSON-RPC 2.0 (MCP standard)
  • REST with MCP gateway
  • WebSocket for real-time tools

3. Tool Index

A vector database that catalogs all available tools and their metadata. Contains:
  • Tool name, description, parameters
  • Input/output schemas
  • Authentication requirements
  • Performance metadata
  • Usage frequency & popularity
Updated:
  • Real-time when new MCP servers connect
  • Nightly indexing of tool changes
  • On-demand reindexing via API

4. Ranking & Optimization Engine

Uses LLM-based intelligence to rank tools and optimize token usage. Ranking Factors:
  1. Semantic relevance (0.4 weight)
  2. Tool popularity (0.25 weight)
  3. User history (0.2 weight)
  4. Performance metrics (0.15 weight)
Optimization:
  • Minimizes context window usage
  • Batches similar tools
  • Prunes low-confidence results
  • Caches hot tools

5. Query Events & Observability

Comprehensive logging and monitoring of tool retrieval patterns. Capabilities:
  • Logs all queries with rankings and selections
  • Tracks request source (CLI/MCP, API, Dashboard)
  • Records tool metadata and score details
  • Enables analytics and debugging via dashboard
  • Fire-and-forget logging (non-blocking)
Uses:
  • Monitor which tools agents select
  • Debug ranking issues
  • Analyze usage patterns
  • Track performance metrics
  • Audit trail for compliance
Learn more in Query Events & Observability

Data Flow: From Query to Execution

Let’s trace a real request:

Scenario: “Create a GitHub PR, update Jira, and notify Slack”

MCP Servers for Developers: Integration

Agent-CoreX provides first-class support for MCP servers across developer ecosystems:

MCP Servers in AI Applications

Security & Authentication

Each MCP server connection is secured:

Performance Characteristics

Deployment Topology

Agent-CoreX can be deployed in multiple configurations:

1. Cloud Managed (Default)

Pros: Zero maintenance, automatic scaling Cons: External dependency

2. Self-Hosted

Pros: Full control, private deployment Cons: You manage infrastructure

3. Hybrid

Pros: Best of both worlds Cons: More complex setup

Comparison: MCP Servers for Developers

Agent-CoreX simplifies working with MCP servers across different environments:

Next Steps

Core Concepts

Learn about tool lifecycle and dynamic retrieval in detail.

MCP Setup

Connect your first MCP server and start building.

API Reference

Detailed endpoint documentation with examples.

Use Cases

See real-world examples of Agent-CoreX in action.

Want to understand the technical details? Check out our GitHub repository for source code and architecture discussions.