Post-Hoc Recovery Evaluation: Measuring Agent Recovery After Unsafe Tool Execution
A research project that makes recovery a first-class evaluation object: injecting controlled, sandboxed unsafe-execution events into agent benchmarks and measuring...
Build a consumer route planner that compares walking routes by pollution exposure and shade — routing data, open environmental feeds, and transparent scoring, with honest limits about estimates and coverage.

A consumer web app that compares walking routes between two points and scores them for comfort — lower pollution exposure and more shade — using open map data and public environmental feeds. Enter an origin and destination; the app fetches candidate walking routes, overlays air-quality measurements and tree-canopy information along each route geometry, and ranks the alternatives with a transparent, adjustable score. It is an informational route-preference tool: it helps a walker choose between options, and it is explicit that its environmental numbers are estimates from public data, not health guidance.
>Route preference, not health advice. The scores describe general environmental conditions along routes using public data of varying freshness and coverage. This tool does not diagnose, protect, or promise anything about health: it does not claim a route is medically safer, does not assess personal health risk, and cannot guarantee current air quality or shade anywhere. What it offers is a clearer picture of the choices a map app normally hides.
Walking is the healthiest, cheapest way through a city — but not all walking routes are equal. One street may be a shaded, tree-lined corridor; a parallel one may hug a busy arterial with measurably worse air. Standard map apps optimize for distance and time and are silent on everything else, so the walker never sees the choice they are making. Meanwhile, cities publish open environmental data — air-quality measurements, tree-canopy layers, urban-heat studies — and volunteer projects maintain a free, complete map of the world’s walkable streets. The pieces all exist. What’s missing is the consumer-grade connection: a small product that reads open routing data, layers public environmental signals on top, and shows a walker their options ranked by comfort instead of only by speed.
The product is an orchestration of open data services with a scoring layer in the middle. Each stage is beginner-buildable with well-documented free APIs.
When a user enters an origin and destination, call a routing engine — OSRM (Open Source Routing Machine) is the standard choice, running as a free public demo API or self-hosted from OpenStreetMap data — and request several alternative walking routes, not just the fastest one. Each route comes back as a geometry (an ordered list of coordinates) plus distance and duration. The alternatives are the whole point: scoring one route is information, scoring two or three is a decision.
Along each route’s geometry, fetch environmental signals:
The overlay is a spatial-join exercise: for each segment of the route, find the environmental readings whose coverage area contains it. Keep it simple at first — buffer the route line, join intersecting zones — and accept that precision improves with geometry discipline later.
Reduce each route’s environmental profile to two interpretable components:
Combine them with a distance/time penalty into a single transparent score — transparent meaning the formula is shown in the UI, the weights are user-adjustable, and nobody has to reverse-engineer why route B won.
Show the ranked routes on a map with their environmental profiles: distance, time, exposure, shade, and the composite score. Let users drag weight sliders (“I care most about shade”) and watch the ranking re-sort — which is both the best UX feature and the most honest one, because it makes the subjectivity of the weighting visible and theirs.
Environmental feeds and routing APIs have rate limits and update cycles. Cache route geometry and scoring results keyed by origin/destination/parameters, record the data timestamps alongside cached scores, and re-fetch environmental layers on a sensible schedule rather than per request. Staleness is a fact of public data: show when the air-quality readings were taken, and never pretend a cached value is a live measurement.
A minimal but complete MVP:
Explicitly out of MVP: user accounts, saved routes, live sensor integration, elevation/heat modeling, and mobile apps. All are natural extensions.
This project consumes environmental data; it does not produce forecasts. The Air Quality Prediction & Pollution Hotspot Mapper is an analysis project: it predicts air-quality values and maps pollution hotspots for monitoring audiences. #060 is a consumer decision product: it takes available air-quality readings as one input, adds shade and distance, and ranks walking routes for an individual choosing a path today. Different output (ranked route options vs pollution maps), different audience (pedestrians vs environmental-data builders), different stack (routing and geodata overlay in JavaScript vs ML time-series work in Python). It shares the location-intelligence spirit of the Location-Based Reminder App with Geofencing — practical consumer geography — but answers a different question: not “remind me when I arrive,” but “which way should I walk?” Both, notably, are built on the same open OSM foundation.
| Tool type | Approach | Limitation |
|———–|———-|————|
| Mainstream map apps | Fastest/shortest routing | Silent on pollution and shade; no comfort trade-offs visible |
| Cycling route planners with pollution layers | Exposure-aware bike routing | Bike-focused; walking networks and speeds differ |
| City open-data dashboards | Environmental layers on maps | Exploratory maps, not decision tools tied to a specific trip |
| Air-quality alert apps | Location-based pollution notifications | Notify about conditions; do not compare route alternatives |
This project’s differentiators: a walking-specific, decision-oriented product on fully open data, transparent adjustable scoring, honest staleness and “no data” handling, and a privacy-minimal design.
Browse more Product Ideas · Beginner Ideas
A research project that makes recovery a first-class evaluation object: injecting controlled, sandboxed unsafe-execution events into agent benchmarks and measuring...
A research project that answers the question every failed agent run raises: which step broke it? Building an attributed corpus...
A research project that audits the measurement instruments themselves: applying the ABC validity-checklist methodology to agent-security benchmarks to find task-validity...
Published on September 12, 2026
A team of developers, researchers, and innovators who review and publish practical ideas for builders and creators.
Published on September 12, 2026
A team of developers, researchers, and innovators who review and publish practical ideas for builders and creators.