Home
Portfolio
Professor Review
Download Deck

Last-Mile Delivery Exception Agents

A LangGraph multi-agent system that reads messy delivery logs, picks a playbook-grounded action, escalates by policy and writes the customer message.

Download final submission
Enter the access code to download the submission PDF.
Task completion
100.0%
10 shipments
Escalation accuracy
100.0%
8 exception shipments
Tool call accuracy
100.0%
all paths
Coherence
4.90/5.0
gpt-4o judge
Latency
7.85s
mean per shipment
ShipmentActionEscalatedToneTaskEscalationToolsCoherenceLatencyPages
SHP-001N/ANON/APASSN/APASS5/50.0snoise
SHP-002RESCHEDULEYESFORMALPASSPASSPASS4/58.4sp5, p5, p9, p2
SHP-003RESCHEDULENOCASUALPASSPASSPASS5/58.4sp3, p3, p3, p2
SHP-004REPLACEYESFORMALPASSPASSPASS5/58.9sp4, p4, p4, p6
SHP-005REROUTE_TO_LOCKERYESCASUALPASSPASSPASS5/510.0sp2, p2, p3, p10
SHP-006RETURN_TO_SENDERNOCASUALPASSPASSPASS5/512.4sp5, p5, p5, p2
SHP-007REPLACEYESFORMALPASSPASSPASS5/510.3sp6, p6, p6, p6
SHP-008RESCHEDULEYESCASUALPASSPASSPASS5/510.9sp2, p3, p3, p5
SHP-009REPLACEYESFORMALPASSPASSPASS5/59.3sp6, p4, p4, p3
SHP-010N/ANON/APASSN/APASS5/50.0snoise

Proof-of-concept results on 10 curated shipments; not a production accuracy estimate.

Data loading and model initialization

SQLite (12 customers, 6 lockers), 2 CSVs, 10-page playbook in 36 chunks; gpt-4o-mini agents, gpt-4o critic.

Defining tools

Log reader, customer lookup (PII-gated), locker eligibility, playbook RAG search, deterministic escalation rules.

Multi-agent architecture

Preprocessor, orchestrator, Resolution, Critic (x2), Communication, Finalize; prompts, routing and 4-layer escalation.

Test cases, evaluation and observability

All 10 shipments with traces, page citations and the five metrics, plus 3-run tuning history.

Conclusions and business recommendations

Shadow-mode pilot, rule engine as escalation authority, larger held-out test set.

Presentation quality

34-slide deck in the course template; every rubric section covered, appendix with prompts, limits and cropped notebook screenshots.

Evaluator review workflow
Enter the review access code to capture evaluator notes and store them as a numbered version alongside this submission.