Agent Skills Library

Guide · Research library

Agentic performance source library

A curated reading map for understanding how models, guidance, data, tools, software, runtimes, architecture, evaluation, and governance combine to shape professional agentic outcomes.

How to use this library

This is not a list of “best agent platforms.” It is a source map for the seven performance levers in Skills in the agentic performance system:

  1. Purpose — what good looks like;
  2. Intelligence — which model configuration can do the work;
  3. Guidance — what method it should follow;
  4. Grounding — what it should know now;
  5. Action — what it can see, use, or change;
  6. Execution — how the work runs;
  7. Assurance — how people know, diagnose, and improve.

Security, privacy, identity, governance, accessibility, and human authority form a trust boundary around all seven.

The sources are deliberately labeled by evidence type:

Source typeBest useImportant limitation
Open standard, specification, or foundation resourceDefinitions, interoperability, governance, ecosystem structureA standard does not prove that an implementation performs well
Official architecture or product documentationCurrent capabilities, implementation patterns, operational detailsDescribes the publisher's stack and may change quickly
Vendor engineering or research articleLessons learned from real systems and experimentsResults may not generalize to other models, harnesses, or environments
Peer-reviewed paperMethods and findings that have passed scholarly reviewBenchmarks can still be narrow or age quickly
arXiv preprintEarly evidence and emerging questionsarXiv is a repository, not peer review; findings remain provisional
O'Reilly Radar articlePractitioner synthesis, vocabulary, and provocative framingCommentary is not a standard or independent validation of product claims

For presentation citations, prefer the first four categories for factual claims. Use O'Reilly to make the ideas approachable and to surface tensions worth discussing.

A twelve-resource starting shelf

For an audience that should not have to absorb the full bibliography, begin here:

  1. Building effective agents — Anthropic for the difference between fixed workflows and agents, and for the “augmented LLM” mental model.
  2. A practical guide to building agents — OpenAI for a beginner-friendly progression through models, tools, instructions, orchestration, and guardrails.
  3. Agentic AI patterns and workflows — AWS Prescriptive Guidance for reusable architecture patterns and the perception–reason–action loop.
  4. Agentic AI architecture guides — Google Cloud for a browsable map from single-agent systems to multi-agent, enterprise data, and security scenarios.
  5. AI agent orchestration patterns — Microsoft for explicit tradeoffs among sequential, concurrent, group-chat, handoff, and manager-led patterns.
  6. Agentic AI Foundation — current projects and working groups for the vendor-neutral open infrastructure landscape.
  7. Agent Skills specification for the portable structure of procedural guidance.
  8. Model Context Protocol architecture for the distinction between hosts, clients, servers, tools, resources, prompts, consent, and security boundaries.
  9. Effective context engineering for AI agents — Anthropic for treating context as a finite system resource rather than an ever-growing prompt.
  10. Demystifying evals for AI agents — Anthropic for tasks, trials, graders, traces, outcome state, and the model–harness pairing.
  11. Evaluate agent workflows — OpenAI for trace-based evaluation and regression workflows.
  12. What We Learned from a Year of Building with LLMs, Part I — O'Reilly Radar for an accessible practitioner bridge from prompting to retrieval, workflows, evaluation, and monitoring.

Agentic AI Foundation and the Linux Foundation

The Agentic AI Foundation (AAIF) is useful here for a specific reason: it provides a neutral home for open projects and working groups at the interfaces between agentic systems. It should not be presented as a complete reference architecture, certification authority, or guarantee of quality.

The Linux Foundation launch announcement identifies MCP, goose, and AGENTS.md as the three founding project contributions in December 2025. The current AAIF organization page now also lists agentgateway and Agent2Agent (A2A). That distinction matters: “founding projects” and “current hosted projects” are not the same claim.

Projects and open infrastructure

ResourceWhat it contributesPerformance levers
AAIF home and current project mapA high-level entry point to AAIF projects, participation, and eventsAction, Execution, Trust boundary
AAIF GitHub organizationThe most useful current index of hosted projects, working groups, governance, proposals, and the taxonomy workstreamAll levers; especially Execution and Assurance
Model Context Protocol and its architecture specificationA standard interface for connecting agent hosts to tools, resources, and prompts while keeping host responsibilities visibleGrounding, Action, Execution, Trust boundary
AGENTS.mdA predictable repository location for instructions that coding agents should followGuidance
gooseA local-first, model-flexible agent harness and practical proving ground for MCP-enabled workflowsGuidance, Action, Execution
agentgatewayA gateway layer for service, model, and MCP traffic; relevant to policy enforcement and observability at the action boundaryAction, Execution, Assurance, Trust boundary
Agent2Agent projectAn open protocol for discovery and communication between independently implemented agentsAction, Execution, Trust boundary

MCP, A2A, and Skills solve different problems. MCP standardizes access to context and capabilities. A2A standardizes inter-agent communication. Skills package procedural guidance. None of them, by itself, supplies clean data, correct permissions, a good professional method, or evidence that the workflow succeeds.

Working groups worth watching

AAIF's working groups are especially relevant because their scopes closely match the outer trust and assurance layers of the proposed visual:

AAIF groupWhy it matters to this framework
Accuracy and ReliabilitySystem-level quality, repeatability, failure characterization, and reliability practices
Observability and TraceabilityShared vocabulary and instrumentation for understanding agent behavior
Identity and TrustAgent identity, delegated authority, trust relationships, and accountable autonomy
Security and PrivacyThreats introduced by tools, protocols, external data, memory, and side effects
Governance, Risk, and RegulatoryLifecycle governance and alignment with organizational and regulatory obligations
Workflows and Process IntegrationHow agents participate in real business processes rather than isolated demonstrations
Taxonomy and Landscape workstreamShared language for a fragmented ecosystem and stewardship of the landscape

These repositories are active community work, not finished standards. Cite them as places where the relevant problems are being defined and coordinated.

Ecosystem research and discovery

ResourceUseful takeawayCaveat
AAIF LandscapeA broad catalog for discovering projects across the agentic stackInclusion is not an endorsement or performance certification
Agentic AI Momentum and its AAIF report narrativeAn ecosystem view of activity, contributor health, project concentration, and security debt across five layersRepository activity and estimated software value are not measures of workflow quality
Open Source and the Future of AI — Linux Foundation ResearchLeadership questions around identity, privacy, regulated use, accountability, vocabulary, and security scaffoldingA forum summary and analysis, not a technical standard
AAIF Technical Committee and project proposalsVisible governance and a way to inspect how projects enter the foundationGovernance health still needs to be judged project by project

Amazon Web Services

AWS has unusually broad material spanning design patterns, security architecture, runtime services, evaluation, and production operations. The general architecture guidance is portable; the AgentCore implementation details are AWS-specific.

ResourceWhy it is usefulPerformance levers
Agentic AI patterns and workflows on AWSA reusable pattern language grounded in perception, reasoning, and action; useful for comparing deterministic and agentic structuresPurpose, Action, Execution
System design and security recommendations for agentic AIExplicitly recommends deterministic logic where AI is unnecessary, careful agent scoping, shared-memory management, and session isolationPurpose, Grounding, Execution, Trust boundary
Secure access, usage, and implementation of generative AI agentsConnects autonomous tool use to identity, access, and security architectureAction, Execution, Trust boundary
Amazon Bedrock AgentCore RuntimeConcrete runtime responsibilities: identity, sessions, tool access, tracing, scaling, and deploymentAction, Execution, Assurance
AgentCore harnessA current example of a declarative harness in which model, tools, Skills, and instructions are configured while the runtime supplies compute, memory, identity, networking, and observabilityIntelligence, Guidance, Grounding, Action, Execution
AgentOps: Operationalize agentic AI at scaleA lifecycle view organized around governance and security, build and operations, evaluation, and observability; also separates release-time evaluation from continuous monitoringExecution, Assurance, Trust boundary
Evaluating AI agents: real-world lessons from AmazonMakes the case for measuring the whole system: tool choice, multi-step reasoning, memory retrieval, task completion, responsibility, and costAssurance across every lever
Debugging production agents with AgentCore ObservabilityShows why standard service health is insufficient when an agent can loop, choose the wrong tool, or produce plausible failureExecution, Assurance

Anthropic

Anthropic's engineering writing is strongest when used as a set of design and evaluation lessons, not as universal laws. Several articles make the model–harness–environment coupling unusually explicit.

ResourceWhy it is usefulPerformance levers
Building effective agentsA clear introduction to augmented LLMs, fixed workflows, autonomous agents, routing, parallelization, orchestrator–worker patterns, and evaluator–optimizer loopsPurpose, Guidance, Action, Execution
Effective context engineering for AI agentsTreats system instructions, tools, MCP, external data, history, retrieval, and compaction as one finite context-design problemGuidance, Grounding, Execution
Writing effective tools for agentsShows that tool names, descriptions, parameters, return shapes, and evaluation directly affect agent performanceAction, Assurance
Effective harnesses for long-running agentsExplores incremental progress, structured handoffs, artifacts, and context resets across long tasksGuidance, Grounding, Execution
Harness design for long-running application developmentA newer multi-agent planner–generator–evaluator architecture and a concrete discussion of when naive long-running loops lose coherencePurpose, Guidance, Execution, Assurance
Demystifying evals for AI agentsDefines task, trial, grader, transcript, outcome, eval harness, agent harness, capability suite, and regression suite; recommends repeated trials and transcript reviewAssurance
Quantifying infrastructure noise in agentic coding evalsEvidence that CPU, memory, disk, networking, and evaluation setup can change benchmark results enough to distort model comparisonsIntelligence, Execution, Assurance
Trustworthy agents in practiceFrames trust across model, harness, tools, and environment, including permissions and human controlAll levers; especially Trust boundary

OpenAI

OpenAI's current developer documentation is most useful when read as a connected set: model selection, orchestration, Skills, context management, traces, datasets, and graders are parts of one optimization loop.

ResourceWhy it is usefulPerformance levers
A practical guide to building agentsThe most accessible OpenAI overview of models, tools, instructions, single- versus multi-agent orchestration, layered guardrails, and human interventionPurpose, Intelligence, Guidance, Action, Execution, Trust boundary
Model guidanceCurrent model-family guidance and an important optimization rule: lower resource use is an improvement only when the result continues to pass the workflow's evalsIntelligence, Assurance
SkillsDefines a Skill as a versioned bundle with a SKILL.md manifest, files, and compatibility with the open Agent Skills standardGuidance
OrchestrationCurrent implementation guidance for agents as tools, handoffs, manager patterns, and orchestration tradeoffsExecution
CompactionCurrent context-management guidance for long-running Responses workflowsGrounding, Execution
Evaluate agent workflowsConnects full traces, graders, datasets, and eval runs to workflow debugging and regression detectionAssurance
EvalsA general path from test data and criteria to repeatable evaluation runsPurpose, Assurance
Evaluation best practicesGuidance on task-relevant datasets, graders, human calibration, and avoiding misleading evaluation designsPurpose, Assurance

Google

Google's sources are valuable at three levels: open framework and protocol documentation, managed runtime architecture, and controlled research on multi-agent scaling and memory.

ResourceWhy it is usefulPerformance levers
Agentic AI architecture guidesA current index of design guides and reference architectures across single-agent, multi-agent, multi-tenant, data, analytics, and security use casesPurpose, Grounding, Action, Execution, Trust boundary
Agent Development Kit documentationOpen framework documentation for agents, tools, orchestration, sessions, memory, evaluation, deployment, and observabilityGuidance, Grounding, Action, Execution, Assurance
Gemini Enterprise Agent Platform: Scale your agentsA concrete production stack joining runtime, sessions, memory, example retrieval, evaluation, optimization, IAM, and observabilityGrounding, Action, Execution, Assurance
Agents CLI evaluation guideA practical eval–fix loop with datasets, trace generation, grading, comparison, failure analysis, and prompt optimizationAssurance
Announcing the Agent2Agent ProtocolThe originating design rationale for A2A and its focus on communication across different frameworks and vendorsAction, Execution
Towards a science of scaling agent systemsControlled evidence that multi-agent coordination helps parallelizable tasks but can materially hurt sequential work and amplify errorsPurpose, Execution, Assurance
ReasoningBank: enabling agents to learn from experienceA recent memory architecture that distills experience and retrieves task-relevant reasoning memories; useful as an emerging pattern, not a settled defaultGrounding, Execution, Assurance
Monitor an agentConcrete runtime metrics, custom metrics, and alerting for deployed agentsExecution, Assurance

Microsoft

Microsoft's architecture material is helpful because it repeatedly distinguishes model behavior from workload design and treats nondeterminism as an operational concern.

ResourceWhy it is usefulPerformance levers
Agents hubA current map of Microsoft's agent concepts, adoption guidance, architecture, products, and developer pathsOrientation across all levers
Agent archetype frameworkA beginner-friendly shared language of categories, capabilities, and components for discussing agent scenarios without immediately choosing productsPurpose, Guidance, Execution
AI agent orchestration patternsTechnology-agnostic comparison of sequential, concurrent, group-chat, handoff, and manager-led patterns, including failure and state concernsPurpose, Execution, Assurance
Microsoft Agent Framework overviewA current implementation model spanning agents, an opinionated harness, graph workflows, sessions, memory providers, middleware, MCP, telemetry, and human checkpointsGuidance, Grounding, Action, Execution, Assurance
Search and tool-use architecturesSeparates agents, tools, and Skills and explains model-agnostic patterns for search and actionGuidance, Grounding, Action
RAG solution design and evaluation guideConnects business requirements, representative queries and documents, parsing, chunking, enrichment, embeddings, retrieval, and evaluationPurpose, Grounding, Assurance
AI workload documentationPlaces application design, training and grounding data, platform, operations, evaluation, and responsible AI inside one workload architectureAll levers
Test and evaluate AI workloadsExplicitly distinguishes model evaluation from whole-system testing and includes agentic workflow and grounding-data validationAssurance
Responsible AI in Azure workloadsApplies auditability, role-based access, circuit breakers, data ingress and egress control, integrity, and human checkpoints to agentic systemsTrust boundary, Action, Assurance
Run agent evaluations with the Azure Developer CLIA practical measured-quality loop with versioned agents, datasets, evaluators, thresholds, reruns, and trace evaluation for long-running or A2A agentsAssurance

Research papers and benchmarks

A note about arXiv

arXiv is an indispensable public repository, but appearance on arXiv does not mean a paper has been peer reviewed. The table therefore identifies publication status only where the paper's own record makes it clear. Even peer-reviewed benchmarks should be treated as diagnostic instruments rather than universal rankings: agent performance depends on the task distribution, tools, harness, runtime, budgets, and graders.

PaperStatusWhat it contributesPerformance levers
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksNeurIPS 2020The foundational formulation combining parametric generation with retrieved non-parametric memoryGrounding
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023Interleaves reasoning traces with actions and observations from an external environmentAction, Execution
Lost in the MiddleTACL 2023Shows that long context is not uniformly usable and that the position of relevant information can materially affect performanceGrounding, Assurance
AgentBench: Evaluating LLMs as AgentsICLR 2024Evaluates agents across multiple interactive environments and analyzes long-horizon reasoning, decisions, and instruction-following failuresIntelligence, Execution, Assurance
SWE-benchICLR 2024Uses real repositories, issues, execution environments, and end-state tests to evaluate software-engineering agentsAction, Execution, Assurance
OSWorldarXiv recordA reproducible real-computer environment with execution-based grading across web and desktop applicationsAction, Execution, Assurance
$\tau$-bencharXiv preprintEvaluates user interaction, domain policies, API tools, database end state, and reliability across repeated trials with pass^kPurpose, Guidance, Action, Assurance
MemGPTarXiv preprintAn operating-system-inspired approach to hierarchical memory and context management across long interactionsGrounding, Execution
ToolformerarXiv recordInvestigates when and how a language model can learn to call external APIsIntelligence, Action
Harness-Bench2026 arXiv preprintDirectly studies model–harness configurations under shared tasks and reports completion, process quality, efficiency, and failure behaviorIntelligence, Execution, Assurance
The Scaffold Effect in Coding AgentsPreliminary 2026 work; under review when verifiedTreats harness choice as a hidden variable and reports different failure fingerprints and resource use across model–harness pairsIntelligence, Execution, Assurance

The last two papers are unusually relevant to this framework because they test its central claim: the useful comparison unit is often the configured agent system, not the model name alone. They are also recent preprints, so they should inspire evaluation design rather than settle the question.

O'Reilly Radar

O'Reilly Radar is most valuable here as a bridge between technical evidence and an audience learning how to think about agentic systems. Use these articles for narrative, questions, and practitioner heuristics; use the primary sources above for specifications and strong factual claims.

Durable foundations

ArticleWhy reference itPerformance levers
What We Learned from a Year of Building with LLMs, Part IA dense but practical guide to prompting, structured outputs, retrieval, multi-step flows, evaluation, monitoring, and guardrailsGuidance, Grounding, Execution, Assurance
Part II: OperationsTreats operational practices, data, feedback, experimentation, and team design as part of product performancePurpose, Execution, Assurance
Part III: StrategyArgues that the model is not the product, recommends starting simple, and connects evals and data collection to a compounding improvement loopPurpose, Intelligence, Assurance
Software Architecture in an AI WorldAn approachable discussion of retrieval, judges, tool use, planning, reflection, and multi-agent collaboration as architectural patternsGrounding, Action, Execution
Beyond Prompt-and-PrayA useful counterweight to autonomy hype: put deterministic, testable business logic around probabilistic language understanding when reliability requires itPurpose, Guidance, Execution, Trust boundary
Escaping POC PurgatoryFrames evaluation and error analysis as the development loop rather than a final gateAssurance across all levers

Newer agent-specific perspectives

ArticleWhy reference itHow to frame it
Stop Overengineering Your Agent HarnessDefines the harness through loop, tool execution, context, state, and safety, then relates needed complexity to action and context complexityA practitioner heuristic, useful for explaining why more architecture is not automatically more performance
The AI Agents Stack: 2026 EditionA current market-oriented stack view that includes evals, observability, guardrails, memory, and runtimeA landscape snapshot, not a neutral product benchmark
The New Software LifecycleDirectly connects static versus dynamic context, rule files, Skills, RAG, permissions, trajectory evaluation, and deploymentA timely narrative companion to the rotating performance visual
Agent MemoryAn accessible taxonomy of semantic, episodic, procedural, entity, working, and summary memory, plus the problems of scope, correction, retrieval, and driftAn explanatory taxonomy; implementation examples are vendor-shaped
Long-Running AgentsExplores pause and resume, execution state, memory layers, artifacts, identities, gateways, and audit over extended workA broad practitioner vision; pair it with harness and evaluation research
The Missing Layer in Agentic AIProposes a deterministic execution boundary between probabilistic reasoning and privileged side effectsA design argument for high-consequence workflows, not a universal architecture
The Agent Stack BetConnects identity, universal context, persistent state, observability, and governance to the production gapA provocative systems perspective and discussion starter

Independent trust and lifecycle baselines

Vendor documentation explains how to build on a platform; independent frameworks help keep the conversation anchored in organizational responsibility.

ResourceWhy it belongsPerformance levers
NIST AI Risk Management Framework CoreOrganizes continuous work around Govern, Map, Measure, and Manage across the lifecyclePurpose, Assurance, Trust boundary
NIST Generative AI ProfileExtends the AI RMF to generative-AI-specific risks, contexts, measurement, and managementAll levers; especially Trust boundary
OpenTelemetry semantic conventionsA vendor-neutral foundation for consistent traces, metrics, logs, events, and resource attributesExecution, Assurance

What the sources collectively support

Across foundations, cloud providers, model providers, research papers, and practitioner writing, several themes recur strongly enough to anchor the presentation:

  1. The model is a component, not the outcome. The harness, instructions, context, tools, environment, and graders change what the model can accomplish.
  2. Start with the work, not the architecture. Define the user, end state, acceptable variation, authority, and review path before selecting an agent pattern.
  3. Prefer the least complicated structure that passes the evals. A deterministic function, fixed workflow, or single agent is often better than a multi-agent system when the task does not benefit from added autonomy or parallelism.
  4. Context is selected, not merely accumulated. Better performance depends on relevance, authority, freshness, placement, compaction, and memory policy—not just context-window size.
  5. Tools and software interfaces are part of intelligence in practice. A model cannot reliably overcome ambiguous schemas, overlapping tool descriptions, weak errors, unsafe permissions, or an unstable interface.
  6. Protocols improve interoperability, not correctness. MCP, A2A, and similar standards reduce bespoke integration, while data quality, method quality, authorization, and evaluation remain separate responsibilities.
  7. Evaluate outcomes and trajectories. End-state checks answer whether the job was completed; traces reveal where selection, retrieval, reasoning, tool use, state, or recovery failed.
  8. Variation is a system property. Multiple trials, representative environments, pinned configurations, and runtime controls are necessary for meaningful comparisons.
  9. Trust belongs around the system. Identity, least privilege, confirmation, audit, reversibility, privacy, and human authority shape every lever rather than appearing as a final gate.
  10. Cost should be optimized against a passing quality bar. Tokens, latency, retries, infrastructure, and human review are valuable metrics only in relation to a correct and useful outcome.

Reading paths for different audiences

New to agentic workflows — approximately 60 minutes

  1. Building effective agents
  2. A practical guide to building agents
  3. AAIF current projects
  4. AI agent orchestration patterns
  5. The first half of Demystifying evals for AI agents

The inspirational message is: you do not need the entire stack to begin; you need one valuable outcome and enough structure to learn whether it worked.

Designing Skills and reusable guidance

  1. Agent Skills specification
  2. OpenAI Skills documentation
  3. AGENTS.md
  4. Effective context engineering
  5. Writing effective tools

Architecture and production operations

  1. AWS agentic patterns
  2. Google agentic architecture guides
  3. Microsoft AI workload documentation
  4. Anthropic long-running harness guidance
  5. OpenAI orchestration

Evaluation and consistency

  1. Anthropic agent evals
  2. OpenAI agent evals
  3. Amazon's evaluation lessons
  4. Google Agents CLI evaluation guide
  5. $\tau$-bench, SWE-bench, and Harness-Bench

Citation hygiene for the final guide and presentation

  • Link to the exact page that supports the claim, not a search result or company home page.
  • Add the publisher and, for time-sensitive product documentation, the access or verification date.
  • Distinguish a founding project from a project currently hosted by the same foundation.
  • Do not call an arXiv preprint “peer reviewed” unless a venue is explicitly confirmed.
  • Describe a landscape as a discovery tool, not an endorsement list.
  • Treat vendor benchmark findings as evidence about the tested configuration, not every model or workflow.
  • Prefer measured statements such as “in this evaluation” over universal statements such as “multi-agent systems are better.”
  • Recheck current product, protocol, and working-group pages before publication; this ecosystem changes quickly.
← Back to guides