Guide · Research library
Agentic performance source library
A curated reading map for understanding how models, guidance, data, tools, software, runtimes, architecture, evaluation, and governance combine to shape professional agentic outcomes.
How to use this library
This is not a list of “best agent platforms.” It is a source map for the seven performance levers in Skills in the agentic performance system:
- Purpose — what good looks like;
- Intelligence — which model configuration can do the work;
- Guidance — what method it should follow;
- Grounding — what it should know now;
- Action — what it can see, use, or change;
- Execution — how the work runs;
- Assurance — how people know, diagnose, and improve.
Security, privacy, identity, governance, accessibility, and human authority form a trust boundary around all seven.
The sources are deliberately labeled by evidence type:
| Source type | Best use | Important limitation |
|---|---|---|
| Open standard, specification, or foundation resource | Definitions, interoperability, governance, ecosystem structure | A standard does not prove that an implementation performs well |
| Official architecture or product documentation | Current capabilities, implementation patterns, operational details | Describes the publisher's stack and may change quickly |
| Vendor engineering or research article | Lessons learned from real systems and experiments | Results may not generalize to other models, harnesses, or environments |
| Peer-reviewed paper | Methods and findings that have passed scholarly review | Benchmarks can still be narrow or age quickly |
| arXiv preprint | Early evidence and emerging questions | arXiv is a repository, not peer review; findings remain provisional |
| O'Reilly Radar article | Practitioner synthesis, vocabulary, and provocative framing | Commentary is not a standard or independent validation of product claims |
For presentation citations, prefer the first four categories for factual claims. Use O'Reilly to make the ideas approachable and to surface tensions worth discussing.
A twelve-resource starting shelf
For an audience that should not have to absorb the full bibliography, begin here:
- Building effective agents — Anthropic for the difference between fixed workflows and agents, and for the “augmented LLM” mental model.
- A practical guide to building agents — OpenAI for a beginner-friendly progression through models, tools, instructions, orchestration, and guardrails.
- Agentic AI patterns and workflows — AWS Prescriptive Guidance for reusable architecture patterns and the perception–reason–action loop.
- Agentic AI architecture guides — Google Cloud for a browsable map from single-agent systems to multi-agent, enterprise data, and security scenarios.
- AI agent orchestration patterns — Microsoft for explicit tradeoffs among sequential, concurrent, group-chat, handoff, and manager-led patterns.
- Agentic AI Foundation — current projects and working groups for the vendor-neutral open infrastructure landscape.
- Agent Skills specification for the portable structure of procedural guidance.
- Model Context Protocol architecture for the distinction between hosts, clients, servers, tools, resources, prompts, consent, and security boundaries.
- Effective context engineering for AI agents — Anthropic for treating context as a finite system resource rather than an ever-growing prompt.
- Demystifying evals for AI agents — Anthropic for tasks, trials, graders, traces, outcome state, and the model–harness pairing.
- Evaluate agent workflows — OpenAI for trace-based evaluation and regression workflows.
- What We Learned from a Year of Building with LLMs, Part I — O'Reilly Radar for an accessible practitioner bridge from prompting to retrieval, workflows, evaluation, and monitoring.
Agentic AI Foundation and the Linux Foundation
The Agentic AI Foundation (AAIF) is useful here for a specific reason: it provides a neutral home for open projects and working groups at the interfaces between agentic systems. It should not be presented as a complete reference architecture, certification authority, or guarantee of quality.
The Linux Foundation launch announcement identifies MCP, goose, and AGENTS.md as the three founding project contributions in December 2025. The current AAIF organization page now also lists agentgateway and Agent2Agent (A2A). That distinction matters: “founding projects” and “current hosted projects” are not the same claim.
Projects and open infrastructure
| Resource | What it contributes | Performance levers |
|---|---|---|
| AAIF home and current project map | A high-level entry point to AAIF projects, participation, and events | Action, Execution, Trust boundary |
| AAIF GitHub organization | The most useful current index of hosted projects, working groups, governance, proposals, and the taxonomy workstream | All levers; especially Execution and Assurance |
| Model Context Protocol and its architecture specification | A standard interface for connecting agent hosts to tools, resources, and prompts while keeping host responsibilities visible | Grounding, Action, Execution, Trust boundary |
| AGENTS.md | A predictable repository location for instructions that coding agents should follow | Guidance |
| goose | A local-first, model-flexible agent harness and practical proving ground for MCP-enabled workflows | Guidance, Action, Execution |
| agentgateway | A gateway layer for service, model, and MCP traffic; relevant to policy enforcement and observability at the action boundary | Action, Execution, Assurance, Trust boundary |
| Agent2Agent project | An open protocol for discovery and communication between independently implemented agents | Action, Execution, Trust boundary |
MCP, A2A, and Skills solve different problems. MCP standardizes access to context and capabilities. A2A standardizes inter-agent communication. Skills package procedural guidance. None of them, by itself, supplies clean data, correct permissions, a good professional method, or evidence that the workflow succeeds.
Working groups worth watching
AAIF's working groups are especially relevant because their scopes closely match the outer trust and assurance layers of the proposed visual:
| AAIF group | Why it matters to this framework |
|---|---|
| Accuracy and Reliability | System-level quality, repeatability, failure characterization, and reliability practices |
| Observability and Traceability | Shared vocabulary and instrumentation for understanding agent behavior |
| Identity and Trust | Agent identity, delegated authority, trust relationships, and accountable autonomy |
| Security and Privacy | Threats introduced by tools, protocols, external data, memory, and side effects |
| Governance, Risk, and Regulatory | Lifecycle governance and alignment with organizational and regulatory obligations |
| Workflows and Process Integration | How agents participate in real business processes rather than isolated demonstrations |
| Taxonomy and Landscape workstream | Shared language for a fragmented ecosystem and stewardship of the landscape |
These repositories are active community work, not finished standards. Cite them as places where the relevant problems are being defined and coordinated.
Ecosystem research and discovery
| Resource | Useful takeaway | Caveat |
|---|---|---|
| AAIF Landscape | A broad catalog for discovering projects across the agentic stack | Inclusion is not an endorsement or performance certification |
| Agentic AI Momentum and its AAIF report narrative | An ecosystem view of activity, contributor health, project concentration, and security debt across five layers | Repository activity and estimated software value are not measures of workflow quality |
| Open Source and the Future of AI — Linux Foundation Research | Leadership questions around identity, privacy, regulated use, accountability, vocabulary, and security scaffolding | A forum summary and analysis, not a technical standard |
| AAIF Technical Committee and project proposals | Visible governance and a way to inspect how projects enter the foundation | Governance health still needs to be judged project by project |
Amazon Web Services
AWS has unusually broad material spanning design patterns, security architecture, runtime services, evaluation, and production operations. The general architecture guidance is portable; the AgentCore implementation details are AWS-specific.
| Resource | Why it is useful | Performance levers |
|---|---|---|
| Agentic AI patterns and workflows on AWS | A reusable pattern language grounded in perception, reasoning, and action; useful for comparing deterministic and agentic structures | Purpose, Action, Execution |
| System design and security recommendations for agentic AI | Explicitly recommends deterministic logic where AI is unnecessary, careful agent scoping, shared-memory management, and session isolation | Purpose, Grounding, Execution, Trust boundary |
| Secure access, usage, and implementation of generative AI agents | Connects autonomous tool use to identity, access, and security architecture | Action, Execution, Trust boundary |
| Amazon Bedrock AgentCore Runtime | Concrete runtime responsibilities: identity, sessions, tool access, tracing, scaling, and deployment | Action, Execution, Assurance |
| AgentCore harness | A current example of a declarative harness in which model, tools, Skills, and instructions are configured while the runtime supplies compute, memory, identity, networking, and observability | Intelligence, Guidance, Grounding, Action, Execution |
| AgentOps: Operationalize agentic AI at scale | A lifecycle view organized around governance and security, build and operations, evaluation, and observability; also separates release-time evaluation from continuous monitoring | Execution, Assurance, Trust boundary |
| Evaluating AI agents: real-world lessons from Amazon | Makes the case for measuring the whole system: tool choice, multi-step reasoning, memory retrieval, task completion, responsibility, and cost | Assurance across every lever |
| Debugging production agents with AgentCore Observability | Shows why standard service health is insufficient when an agent can loop, choose the wrong tool, or produce plausible failure | Execution, Assurance |
Anthropic
Anthropic's engineering writing is strongest when used as a set of design and evaluation lessons, not as universal laws. Several articles make the model–harness–environment coupling unusually explicit.
| Resource | Why it is useful | Performance levers |
|---|---|---|
| Building effective agents | A clear introduction to augmented LLMs, fixed workflows, autonomous agents, routing, parallelization, orchestrator–worker patterns, and evaluator–optimizer loops | Purpose, Guidance, Action, Execution |
| Effective context engineering for AI agents | Treats system instructions, tools, MCP, external data, history, retrieval, and compaction as one finite context-design problem | Guidance, Grounding, Execution |
| Writing effective tools for agents | Shows that tool names, descriptions, parameters, return shapes, and evaluation directly affect agent performance | Action, Assurance |
| Effective harnesses for long-running agents | Explores incremental progress, structured handoffs, artifacts, and context resets across long tasks | Guidance, Grounding, Execution |
| Harness design for long-running application development | A newer multi-agent planner–generator–evaluator architecture and a concrete discussion of when naive long-running loops lose coherence | Purpose, Guidance, Execution, Assurance |
| Demystifying evals for AI agents | Defines task, trial, grader, transcript, outcome, eval harness, agent harness, capability suite, and regression suite; recommends repeated trials and transcript review | Assurance |
| Quantifying infrastructure noise in agentic coding evals | Evidence that CPU, memory, disk, networking, and evaluation setup can change benchmark results enough to distort model comparisons | Intelligence, Execution, Assurance |
| Trustworthy agents in practice | Frames trust across model, harness, tools, and environment, including permissions and human control | All levers; especially Trust boundary |
OpenAI
OpenAI's current developer documentation is most useful when read as a connected set: model selection, orchestration, Skills, context management, traces, datasets, and graders are parts of one optimization loop.
| Resource | Why it is useful | Performance levers |
|---|---|---|
| A practical guide to building agents | The most accessible OpenAI overview of models, tools, instructions, single- versus multi-agent orchestration, layered guardrails, and human intervention | Purpose, Intelligence, Guidance, Action, Execution, Trust boundary |
| Model guidance | Current model-family guidance and an important optimization rule: lower resource use is an improvement only when the result continues to pass the workflow's evals | Intelligence, Assurance |
| Skills | Defines a Skill as a versioned bundle with a SKILL.md manifest, files, and compatibility with the open Agent Skills standard | Guidance |
| Orchestration | Current implementation guidance for agents as tools, handoffs, manager patterns, and orchestration tradeoffs | Execution |
| Compaction | Current context-management guidance for long-running Responses workflows | Grounding, Execution |
| Evaluate agent workflows | Connects full traces, graders, datasets, and eval runs to workflow debugging and regression detection | Assurance |
| Evals | A general path from test data and criteria to repeatable evaluation runs | Purpose, Assurance |
| Evaluation best practices | Guidance on task-relevant datasets, graders, human calibration, and avoiding misleading evaluation designs | Purpose, Assurance |
Google's sources are valuable at three levels: open framework and protocol documentation, managed runtime architecture, and controlled research on multi-agent scaling and memory.
| Resource | Why it is useful | Performance levers |
|---|---|---|
| Agentic AI architecture guides | A current index of design guides and reference architectures across single-agent, multi-agent, multi-tenant, data, analytics, and security use cases | Purpose, Grounding, Action, Execution, Trust boundary |
| Agent Development Kit documentation | Open framework documentation for agents, tools, orchestration, sessions, memory, evaluation, deployment, and observability | Guidance, Grounding, Action, Execution, Assurance |
| Gemini Enterprise Agent Platform: Scale your agents | A concrete production stack joining runtime, sessions, memory, example retrieval, evaluation, optimization, IAM, and observability | Grounding, Action, Execution, Assurance |
| Agents CLI evaluation guide | A practical eval–fix loop with datasets, trace generation, grading, comparison, failure analysis, and prompt optimization | Assurance |
| Announcing the Agent2Agent Protocol | The originating design rationale for A2A and its focus on communication across different frameworks and vendors | Action, Execution |
| Towards a science of scaling agent systems | Controlled evidence that multi-agent coordination helps parallelizable tasks but can materially hurt sequential work and amplify errors | Purpose, Execution, Assurance |
| ReasoningBank: enabling agents to learn from experience | A recent memory architecture that distills experience and retrieves task-relevant reasoning memories; useful as an emerging pattern, not a settled default | Grounding, Execution, Assurance |
| Monitor an agent | Concrete runtime metrics, custom metrics, and alerting for deployed agents | Execution, Assurance |
Microsoft
Microsoft's architecture material is helpful because it repeatedly distinguishes model behavior from workload design and treats nondeterminism as an operational concern.
| Resource | Why it is useful | Performance levers |
|---|---|---|
| Agents hub | A current map of Microsoft's agent concepts, adoption guidance, architecture, products, and developer paths | Orientation across all levers |
| Agent archetype framework | A beginner-friendly shared language of categories, capabilities, and components for discussing agent scenarios without immediately choosing products | Purpose, Guidance, Execution |
| AI agent orchestration patterns | Technology-agnostic comparison of sequential, concurrent, group-chat, handoff, and manager-led patterns, including failure and state concerns | Purpose, Execution, Assurance |
| Microsoft Agent Framework overview | A current implementation model spanning agents, an opinionated harness, graph workflows, sessions, memory providers, middleware, MCP, telemetry, and human checkpoints | Guidance, Grounding, Action, Execution, Assurance |
| Search and tool-use architectures | Separates agents, tools, and Skills and explains model-agnostic patterns for search and action | Guidance, Grounding, Action |
| RAG solution design and evaluation guide | Connects business requirements, representative queries and documents, parsing, chunking, enrichment, embeddings, retrieval, and evaluation | Purpose, Grounding, Assurance |
| AI workload documentation | Places application design, training and grounding data, platform, operations, evaluation, and responsible AI inside one workload architecture | All levers |
| Test and evaluate AI workloads | Explicitly distinguishes model evaluation from whole-system testing and includes agentic workflow and grounding-data validation | Assurance |
| Responsible AI in Azure workloads | Applies auditability, role-based access, circuit breakers, data ingress and egress control, integrity, and human checkpoints to agentic systems | Trust boundary, Action, Assurance |
| Run agent evaluations with the Azure Developer CLI | A practical measured-quality loop with versioned agents, datasets, evaluators, thresholds, reruns, and trace evaluation for long-running or A2A agents | Assurance |
Research papers and benchmarks
A note about arXiv
arXiv is an indispensable public repository, but appearance on arXiv does not mean a paper has been peer reviewed. The table therefore identifies publication status only where the paper's own record makes it clear. Even peer-reviewed benchmarks should be treated as diagnostic instruments rather than universal rankings: agent performance depends on the task distribution, tools, harness, runtime, budgets, and graders.
| Paper | Status | What it contributes | Performance levers |
|---|---|---|---|
| Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks | NeurIPS 2020 | The foundational formulation combining parametric generation with retrieved non-parametric memory | Grounding |
| ReAct: Synergizing Reasoning and Acting in Language Models | ICLR 2023 | Interleaves reasoning traces with actions and observations from an external environment | Action, Execution |
| Lost in the Middle | TACL 2023 | Shows that long context is not uniformly usable and that the position of relevant information can materially affect performance | Grounding, Assurance |
| AgentBench: Evaluating LLMs as Agents | ICLR 2024 | Evaluates agents across multiple interactive environments and analyzes long-horizon reasoning, decisions, and instruction-following failures | Intelligence, Execution, Assurance |
| SWE-bench | ICLR 2024 | Uses real repositories, issues, execution environments, and end-state tests to evaluate software-engineering agents | Action, Execution, Assurance |
| OSWorld | arXiv record | A reproducible real-computer environment with execution-based grading across web and desktop applications | Action, Execution, Assurance |
| $\tau$-bench | arXiv preprint | Evaluates user interaction, domain policies, API tools, database end state, and reliability across repeated trials with pass^k | Purpose, Guidance, Action, Assurance |
| MemGPT | arXiv preprint | An operating-system-inspired approach to hierarchical memory and context management across long interactions | Grounding, Execution |
| Toolformer | arXiv record | Investigates when and how a language model can learn to call external APIs | Intelligence, Action |
| Harness-Bench | 2026 arXiv preprint | Directly studies model–harness configurations under shared tasks and reports completion, process quality, efficiency, and failure behavior | Intelligence, Execution, Assurance |
| The Scaffold Effect in Coding Agents | Preliminary 2026 work; under review when verified | Treats harness choice as a hidden variable and reports different failure fingerprints and resource use across model–harness pairs | Intelligence, Execution, Assurance |
The last two papers are unusually relevant to this framework because they test its central claim: the useful comparison unit is often the configured agent system, not the model name alone. They are also recent preprints, so they should inspire evaluation design rather than settle the question.
O'Reilly Radar
O'Reilly Radar is most valuable here as a bridge between technical evidence and an audience learning how to think about agentic systems. Use these articles for narrative, questions, and practitioner heuristics; use the primary sources above for specifications and strong factual claims.
Durable foundations
| Article | Why reference it | Performance levers |
|---|---|---|
| What We Learned from a Year of Building with LLMs, Part I | A dense but practical guide to prompting, structured outputs, retrieval, multi-step flows, evaluation, monitoring, and guardrails | Guidance, Grounding, Execution, Assurance |
| Part II: Operations | Treats operational practices, data, feedback, experimentation, and team design as part of product performance | Purpose, Execution, Assurance |
| Part III: Strategy | Argues that the model is not the product, recommends starting simple, and connects evals and data collection to a compounding improvement loop | Purpose, Intelligence, Assurance |
| Software Architecture in an AI World | An approachable discussion of retrieval, judges, tool use, planning, reflection, and multi-agent collaboration as architectural patterns | Grounding, Action, Execution |
| Beyond Prompt-and-Pray | A useful counterweight to autonomy hype: put deterministic, testable business logic around probabilistic language understanding when reliability requires it | Purpose, Guidance, Execution, Trust boundary |
| Escaping POC Purgatory | Frames evaluation and error analysis as the development loop rather than a final gate | Assurance across all levers |
Newer agent-specific perspectives
| Article | Why reference it | How to frame it |
|---|---|---|
| Stop Overengineering Your Agent Harness | Defines the harness through loop, tool execution, context, state, and safety, then relates needed complexity to action and context complexity | A practitioner heuristic, useful for explaining why more architecture is not automatically more performance |
| The AI Agents Stack: 2026 Edition | A current market-oriented stack view that includes evals, observability, guardrails, memory, and runtime | A landscape snapshot, not a neutral product benchmark |
| The New Software Lifecycle | Directly connects static versus dynamic context, rule files, Skills, RAG, permissions, trajectory evaluation, and deployment | A timely narrative companion to the rotating performance visual |
| Agent Memory | An accessible taxonomy of semantic, episodic, procedural, entity, working, and summary memory, plus the problems of scope, correction, retrieval, and drift | An explanatory taxonomy; implementation examples are vendor-shaped |
| Long-Running Agents | Explores pause and resume, execution state, memory layers, artifacts, identities, gateways, and audit over extended work | A broad practitioner vision; pair it with harness and evaluation research |
| The Missing Layer in Agentic AI | Proposes a deterministic execution boundary between probabilistic reasoning and privileged side effects | A design argument for high-consequence workflows, not a universal architecture |
| The Agent Stack Bet | Connects identity, universal context, persistent state, observability, and governance to the production gap | A provocative systems perspective and discussion starter |
Independent trust and lifecycle baselines
Vendor documentation explains how to build on a platform; independent frameworks help keep the conversation anchored in organizational responsibility.
| Resource | Why it belongs | Performance levers |
|---|---|---|
| NIST AI Risk Management Framework Core | Organizes continuous work around Govern, Map, Measure, and Manage across the lifecycle | Purpose, Assurance, Trust boundary |
| NIST Generative AI Profile | Extends the AI RMF to generative-AI-specific risks, contexts, measurement, and management | All levers; especially Trust boundary |
| OpenTelemetry semantic conventions | A vendor-neutral foundation for consistent traces, metrics, logs, events, and resource attributes | Execution, Assurance |
What the sources collectively support
Across foundations, cloud providers, model providers, research papers, and practitioner writing, several themes recur strongly enough to anchor the presentation:
- The model is a component, not the outcome. The harness, instructions, context, tools, environment, and graders change what the model can accomplish.
- Start with the work, not the architecture. Define the user, end state, acceptable variation, authority, and review path before selecting an agent pattern.
- Prefer the least complicated structure that passes the evals. A deterministic function, fixed workflow, or single agent is often better than a multi-agent system when the task does not benefit from added autonomy or parallelism.
- Context is selected, not merely accumulated. Better performance depends on relevance, authority, freshness, placement, compaction, and memory policy—not just context-window size.
- Tools and software interfaces are part of intelligence in practice. A model cannot reliably overcome ambiguous schemas, overlapping tool descriptions, weak errors, unsafe permissions, or an unstable interface.
- Protocols improve interoperability, not correctness. MCP, A2A, and similar standards reduce bespoke integration, while data quality, method quality, authorization, and evaluation remain separate responsibilities.
- Evaluate outcomes and trajectories. End-state checks answer whether the job was completed; traces reveal where selection, retrieval, reasoning, tool use, state, or recovery failed.
- Variation is a system property. Multiple trials, representative environments, pinned configurations, and runtime controls are necessary for meaningful comparisons.
- Trust belongs around the system. Identity, least privilege, confirmation, audit, reversibility, privacy, and human authority shape every lever rather than appearing as a final gate.
- Cost should be optimized against a passing quality bar. Tokens, latency, retries, infrastructure, and human review are valuable metrics only in relation to a correct and useful outcome.
Reading paths for different audiences
New to agentic workflows — approximately 60 minutes
- Building effective agents
- A practical guide to building agents
- AAIF current projects
- AI agent orchestration patterns
- The first half of Demystifying evals for AI agents
The inspirational message is: you do not need the entire stack to begin; you need one valuable outcome and enough structure to learn whether it worked.
Designing Skills and reusable guidance
- Agent Skills specification
- OpenAI Skills documentation
- AGENTS.md
- Effective context engineering
- Writing effective tools
Architecture and production operations
- AWS agentic patterns
- Google agentic architecture guides
- Microsoft AI workload documentation
- Anthropic long-running harness guidance
- OpenAI orchestration
Evaluation and consistency
Citation hygiene for the final guide and presentation
- Link to the exact page that supports the claim, not a search result or company home page.
- Add the publisher and, for time-sensitive product documentation, the access or verification date.
- Distinguish a founding project from a project currently hosted by the same foundation.
- Do not call an arXiv preprint “peer reviewed” unless a venue is explicitly confirmed.
- Describe a landscape as a discovery tool, not an endorsement list.
- Treat vendor benchmark findings as evidence about the tested configuration, not every model or workflow.
- Prefer measured statements such as “in this evaluation” over universal statements such as “multi-agent systems are better.”
- Recheck current product, protocol, and working-group pages before publication; this ecosystem changes quickly.