Independent engineering lab · Oct 2026
Vehicle Assistant Validation Lab
- problem
- How can assistant tools, stored preferences, and scenario checks be tested against explicit contracts before connecting them to real systems?
- built
- Implemented a Python lab combining budget-aware test selection, a simulated vehicle backend with token, scope, and ownership checks, idempotent writes, and SQLite memory with provenance and per-user isolation. Added structural and semantic checks for a defined OpenSCENARIO 1.2 XML subset, an official-SDK MCP stdio tool adapter, 29 automated tests, and reproducible JSON/XML benchmark reports.
Local proof of concept using synthetic fixtures and a simulated backend. Scenario checks cover a restricted subset; production OAuth, live-model evaluation, and simulator execution remain future work.
- Python
- MCP SDK
- HTTP / JSON
- Authorization
- SQLite
- OpenSCENARIO
- Test Selection