Skip to content

Techniques

Methods for getting the most out of models

44 articles · 3 sous-catégories
Subcategory
Content type
analyse Alignment

Agentic red teaming — when the LLM is no longer the main target

Why auditing an agentic system means widening the perimeter beyond the LLM: the Dreadnode taxonomy of 5 fronts, the OWASP ASI framework, an audit methodology and actionable mitigations.

agenticsecurityred-teamingauditowasp-asidreadnodesupply-chainmcp
analyse Multi-Agent Orchestration

The web getting ready for AI agents — where the transition is actually happening

An empirical 2026 survey of the web facing AI agents: outbound-click disintermediation, headless bimodality between enterprise and consumer, agents ready only for bounded use cases, and fragmented bidirectional standards (MCP, NLWeb, Cloudflare Pay Per Crawl, llms.txt).

webagents-iamcpheadlesssearchtransition2026
analyse RAG & document retrieval

RAG Panorama April 2026 — Vector, Vectorless and Emerging Approaches

State of the art of Retrieval-Augmented Generation in April 2026: dense vector, vectorless/sparse/hybrid, and emerging (GraphRAG, Self-RAG, Agentic) families, plus the long-context debate. Pedagogical version.

ragretrievalembeddingsbm25colbertgraphragself-ragagentic-ragvector-databasehybrid-searchlong-context
concept Multi-Agent Orchestration

Agentic AI — LLMs that take action

Definition, principles, and state of the art of agentic AI: when language models become autonomous through tool use, orchestration, and planning.

agentsagentic aiorchestrationtool usemulti-agentreactplanningmcp
concept Reasoning & inference

Multi-answer RLVR — training a model to explore

Binary correct/incorrect rewards cause diversity collapse in LLMs. Multi-answer training (RLVR multi-answer) achieves +69% accuracy on MBPP and near-perfect calibration. Why asking for multiple responses is superior.

rlvrreinforcement-learningmulti-answercalibrationdiversitygrpodeepseektraining
concept Multi-Agent Orchestration

Agent0 — learning to improve without any human data

Agent0 is a framework that co-evolves two agents from a base LLM, without annotated data: one generates increasingly difficult tasks, the other learns to solve them. All through reinforcement learning and a code interpreter.

agentsself-improvementreinforcement-learningzero-datatool-integrated-reasoningcurriculum-learninggrpoco-evolution
analyse Multi-Agent Orchestration

AI research automation — how far does it actually work?

The AI Scientist (Nature, 2026) is a pipeline that fully automates the machine learning research cycle: ideation, code, experiments, writing, evaluation. One generated paper passed the first round of peer review at ICLR 2025.

automationscientific researchagentspeer reviewexperimentationfoundation modelsevaluationmachine learning
concept Agent memory

Context graphs — the next infrastructure for AI agents?

Foundation Capital sees context graphs as a trillion-dollar opportunity. But the Logic Gap and critics show the road is long.

context-graphknowledge-graphdecision-tracesfoundation-capitalagentsarchitectureorchestrationenterprise
concept Multi-Agent Orchestration

Agent harnesses — the architecture that wraps the LLM

A harness is the control layer that transforms an LLM into an executable agent: reasoning loop, state management, tools, roles, and validation gates. A tour of components and architectural patterns.

agentharnessarchitectureorchestrationcontext-engineeringstate-managementcontrolmulti-agentReActtools
concept Agent memory

MemEvolve — when agent memory self-optimizes

A system that co-evolves memory architecture and agent knowledge. +17% performance through bi-level optimization.

memorymeta-learningagentsoptimizationbi-levelarchitectureevolutionbenchmark
concept Multi-Agent Orchestration

Meta-Harness — automatically optimizing the code around the LLM

A system that discovers the best harnesses for LLMs by exploring the complete history of past attempts. +7.7 points with 4× fewer tokens.

harnessmeta-learningoptimizationcontext-engineeringagentsclaude-codeparetoorchestration
analyse Multi-Agent Orchestration

Asynchronous coding agents — effective coordination strategies

How multiple AI agents can collaborate in parallel on the same repository without blocking each other. Analysis of the CAID system and branch-and-merge patterns.

agentssoftware engineeringmulti-agentcoordinationgitparallelismasynchronousbenchmark
decouverte Optimization

HACRL — when LLMs of different sizes train together

HACRL proposes collaborative learning between models of varying capabilities through verified rollout sharing. Result: +3.3% over GSPO at half the cost.

reinforcement-learningmulti-agentcollaborationoptimizationhacrlhacpotraining
decouverte Reasoning & inference

λ-RLM — lambda calculus to make LLM reasoning more reliable

λ-RLM replaces free code generation with a typed functional runtime. Result: +21.9 points of accuracy and up to 4.1× latency reduction across 9 models.

reasoninglambda-calculuslong-contextcontext-rotverificationinferencearchitecture
concept Multi-Agent Orchestration

Automated multi-agent auditing — when agents verify their own system

Delegating the audit of an agent system to specialized agents reduces self-evaluation bias and enables continuous verification at scale. This pattern rests on separating producer agents from auditor agents.

multi-agentsevaluationauditLLM-as-a-Judgeorchestrationqualitymonitoringtrajectory
concept Reasoning & inference

Chain-of-Debate — when agents argue to make better decisions

Chain-of-Debate and Graph-of-Debate are multi-agent frameworks where multiple LLMs debate, cross-criticize each other, and converge on a collective answer more reliable than any individual model.

multi-agentreasoningdebatechain-of-thoughtconsensusbiasCoDGoD
concept Evaluation

Evaluating an LLM Agent — methods and pitfalls

Testing an LLM agent is nothing like classical software testing. Trajectory metrics, LLM-as-a-Judge, continuous monitoring: an overview of available approaches and their blind spots.

evaluationagentsllm-as-a-judgetrajectorymonitoringdriftcontractormulti-agents
concept Multi-Agent Orchestration

Multi-agent exception handling — when agents manage the unexpected

How multi-agent systems detect, handle, and recover from errors in production. Three layers: detection, tactical treatment, stabilization.

exception handlingmulti-agentsresiliencefallbackgraceful degradationorchestrationreliabilityrecovery
concept Multi-Agent Orchestration

Multi-agent systems — when collaboration amplifies (or not)

Six interrelation models define how AI agents interact. The value of a multi-agent system depends less on the number of agents than on the quality of coordination protocols and a shared ontology.

multi-agentorchestrationsupervisorprotocolcoordinationdistributed systemsarchitectureLLM
concept Multi-Agent Orchestration

Agentic AI planning — formulate, execute, adapt

Agentic planning enables an AI system to decompose a complex objective into structured actions, then adapt its plan during execution as obstacles arise. Distinct from fixed workflows, it applies when the path to the objective must be discovered.

planningagentsorchestrationplan-execute-adaptreplanningworkflowdeep-researchautonomous-agents
comparatif Multi-Agent Orchestration

Prompt chaining vs autonomous agent — which one to choose?

Prompt chaining and autonomous agents occupy two positions on the same agenticity spectrum. The former decomposes a task into predefined sequential LLM calls; the latter maintains an autonomous loop. The choice is a trade-off between control and flexibility.

prompt-chainingagentsorchestrationreactworkflowautonomyroutingbounded-agency
concept Multi-Agent Orchestration

Reflection and self-critique — when agents correct themselves

The Producer-Critic pattern allows an AI agent to separate generation and evaluation in order to iteratively refine its outputs. How it works, stopping criteria, self-revision bias, and production limitations.

reflectionproducer-criticself-correctionorchestrationagentsfeedbackiterative-loop
pattern Multi-Agent Orchestration

Routing in agentic AI — how agents choose their path

Routing is the mechanism by which an agentic system dynamically decides which action, tool, or sub-agent to activate based on context. Four mechanisms coexist, each with distinct performance and flexibility trade-offs.

routingagentsorchestrationllmclassificationembeddingslanggrapharchitecture
concept Prompting & Context Engineering

Self-Consistency — running the same prompt 3 times

Self-consistency generates N independent reasoning paths via temperature sampling then selects the majority answer. Documented gains of +6 to +18 points on reasoning benchmarks, but computational cost remains the main barrier.

self-consistencypromptingchain-of-thoughtreasoningsamplingmajority-voteinferencetest-time-compute
concept Multi-Agent Orchestration

LLM Agents — how a language model moves from response to action

An LLM agent does not simply answer: it plans, uses tools, and self-corrects. An explanation of the architectures that make this possible, and the limits that benchmarks reveal.

agentstool-useplanningmulti-agentsreactmcp
guide Prompting & Context Engineering

Context prompting — a practical guide by usage level

How to structure what an LLM receives to maximize response quality. Actionable techniques for the solo operator, single agent, and multi-agent systems, with nuances from the literature.

context-promptingprompt-engineeringcontext-engineeringfew-shotchain-of-thoughtmulti-agentcontext-windowllmguide
guide Multi-Agent Orchestration

35 LLM agents in parallel — anatomy and positioning

A documented field report on orchestrating 35 tooled LLM agents in parallel. Architecture, positioning vs academic literature, emergent behavior, and control mechanisms.

orchestrationmulti-agentsfire-and-consolidatescalabilitytooled-agentsparallelismemergent-behaviorbounded-autonomy
concept Optimization

Model distillation — transferring knowledge from large to small

How a small model can learn from a large one without copying its parameters. Principles, methods, and the difference with quantization and pruning.

distillationcompressionmodelstrainingefficiency
concept Specialization

LLMs and code generation — what benchmarks don't tell you

Language models reach 90% on reference tests yet generate vulnerable code. A survey of what research actually knows about code assistants.

codebenchmarkcopilotswe-benchsecurityagents
concept Specialization

Voice models — the AI that speaks and listens

From automatic transcription to real-time voice conversation, an overview of STT, TTS and speech-to-speech technologies — with their limitations and ethical stakes.

speechvoicewhisperttsaudiovoice-models
concept Optimization

LLM inference optimization — how the industry cuts the bill

Serving a large language model is expensive and hardware-constrained. Quantization, FlashAttention, vLLM, speculative decoding, distillation: five techniques each attacking a different bottleneck.

optimizationinferencekv-cachebatchingspeculative-decoding
concept Optimization

Quantization — shrinking an LLM without breaking it

A 70B model weighs 140 GB in FP16. Quantization cuts that weight by 4× by truncating numerical precision. How it works, which methods exist, and where it breaks down.

quantizationggufllama-cppcompressioninferenceefficiency
concept Alignment

Adversarial security of LLMs — attacks and defenses

How large language models can be subverted by malicious inputs, and what defenses research has developed in response.

securityadversarialjailbreakinjectionred-teamingdefense
concept Prompting & Context Engineering

Context engineering — beyond prompt engineering

Context engineering is the discipline of managing what the model sees at inference time. Understanding why the position and quality of information in the window change the results.

context-engineeringprompt-engineeringcontext-windowkarpathycontext-rotllmragagents
decouverte Multi-Agent Orchestration

Agents in production — what 1,200 real cases reveal

What does the analysis of 1,200 enterprise LLM agent deployments reveal? Divergent figures, success patterns, documented failures, and the Gartner prediction on upcoming cancellations.

agents-productiondeploymententerpriseroifailuressuccess-patternsllmopsgovernance
guide Multi-Agent Orchestration

Cognitive dispatch — assigning the right model to the right task

In a multi-agent system, using the same model for every task is costly and degrades quality. Cognitive dispatch means aligning model capability with task nature.

cognitive-dispatchmulti-agentshaikusonnetopuscost-qualityorchestrationsub-agents
concept Multi-Agent Orchestration

Human escalation vs. auto-recovery — who corrects the agent?

When an LLM agent fails, two options compete: automatic recovery or human intervention. Taxonomy of errors, HITL patterns, and documented limits.

human-escalationauto-recoveryhuman-in-the-loopreliabilityllm-agentssrecascading-failurescorrigibility
decouverte Multi-Agent Orchestration

174 agents, 0 failures: real reliability or measurement bias?

Multi-agent orchestration tests show 99.4% success across 174 runs. This figure deserves scrutiny before being cited.

orchestrationmulti-agentsreliabilityerror-ratebiasllm-agents
concept Multi-Agent Orchestration

Fire-and-consolidate — a multi-agent orchestration pattern

Fire-and-consolidate is an orchestration pattern that launches N agents in parallel, then consolidates their results in a single pass. Analysis of the mechanics, strengths, and limits.

orchestrationmulti-agentsfire-and-consolidateparallelismconsolidationllm-agents
decouverte Prompting & Context Engineering

The LLM/language paradox — why machines prefer machine language

LLMs were trained on human text, yet the highest-performing systems drive them with structured language. This apparent paradox reveals something fundamental about how they work.

promptingxmlstructured-languageskillscontext-engineeringprompt-formatmarkdown
concept Multi-Agent Orchestration

The Wave pattern — orchestrating in two waves

The Wave pattern splits a multi-agent orchestration into sequential waves. Wave 1 collects, wave 2 produces. Between the two, an adjustment step decides what to keep, complete, or drop.

orchestrationmulti-agentswave-patternmulti-wavepipelinellm-agents
decouverte Multi-Agent Orchestration

More agents ≠ better results — the multi-agent scaling paradox

Adding agents to an AI system does not guarantee better performance. Several empirical studies document the exact conditions where this strategy fails — and the rare cases where it succeeds.

multi-agentsbaseline-paradoxscalingoverheadsingle-agentbenchmarksorchestrationtoken-cost
concept Multi-Agent Orchestration

Step 0bis — challenging your own architecture before acting

Before dispatching to parallel agents, a self-critical verification step detects structural conflicts that would cause cascading errors. Analysis of the mechanism and its four control points.

step-0bisorchestrationmulti-agentspre-flight-checkself-critiquellm-agentsrobustness
concept Multi-Agent Orchestration

The decision triangle — governing an agentic AI system

Distributing roles between a human, an AI copilot, and a technical executor enables governing an agentic system without losing independent validation capability.

ai-governanceorchestrationmulti-agentsconvergencehuman-in-the-looparchitectureagentic