Version 3.4 • 2026-08-13 • Living Document – Subject to refinement
| Version | Milestone | Theme | Status |
|---|---|---|---|
| 0.9.0 | 1 | Dataset management, password policy, admin features | Released |
| 0.10.0 | 2 | Statistical Foundation — core stats, DuckDB, recipes, sharing | Released |
| 0.11.0 | 3 | AI Agents & Collaboration — chat agents, notebook import, mobile, audio I/O | Released |
| 0.12.0 | 4 | Recipe Redesign & Platform Polish — master-detail, transforms, SQL engine, sharing, translations | In Progress |
| 0.13.0 | 5 | Production Readiness — audit, performance, documentation, testing | Planned |
Delivered in: Version 0.10.0
| Feature | Status |
|---|---|
| DuckDB Storage Engine (Quack protocol) | Complete |
| Dataset Management (Upload, Define, Browse) | Complete |
| Recipe Framework (CRUD, execution pipeline, wizard UI) | Complete |
| Statistics Engine (Descriptive, correlation, t-test, ANOVA, regression, chi-square) | Complete |
| Visualisation (Bar, pie, line, scatter, histogram) | Complete |
| User Groups (100 groups, sharing, admin management) | Complete |
| Resource Sharing (AI, DB, Datasets, Recipes via group) | Complete |
| Multilingual Support (Backend + Frontend i18n framework) | Complete |
| Database Connections (PostgreSQL, MySQL via UI) | Complete |
| Data Preparation Rules (per-dataset transforms, preview) | Complete |
| Golden Screwdriver — MS Access via jet-server | Complete |
Delivered in: Version 0.11.0
| Feature | Status |
|---|---|
| Chat Agent — general chat with session management, CRUD, streaming | Complete |
| AI Providers — Anthropic, Ollama, OpenAI-compatible (DeepSeek, etc.) | Complete |
| AI Agents — Dataset Cleaner, Database Designer, Recipe Assistant | Complete |
| AI-Augmented Database Design — Schema AI, Semantic AI (ISIC domains, code systems, column meanings), Integration AI (relationships, research capabilities, DDL proposals) | Complete |
| Notebook Import — .ipynb parsing, DuckDB/PostgreSQL/MySQL storage | Complete |
| Group Administration — group descriptions, admin UI, user group assignment | Complete |
| Example User — demo account with read-only guardrails | Complete |
| Audio I/O — speech-to-text + text-to-speech, per-user settings | Complete |
| MS SQL Server — connection, schema browsing, dataset import | Complete |
| Mobile Support — hamburger drawer, responsive sidebars, touch targets | Complete |
| Copy-to-Clipboard, Demo Indicators, Feature Gates | Complete |
Theme: A complete rebuild of the recipe system with pipeline editor, dataset-level transforms, SQL execution pushdown, and platform-wide translation compliance.
| Feature | Status | Notes |
|---|---|---|
| Recipe Master-Detail Layout | Complete | Two-panel layout: scrollable list (left) + editor (right). Removed old wizard. Deep linking via /recipes/[id]. |
| Three-Component Pipeline Editor | Complete | Dataset/Transform, Algorithm, Output components with collapsible cards, bidirectional constraint propagation. |
| Dataset-Level Transform Management | Complete | Transforms editor (two-panel), 8 operation types, live preview, CRUD with recipe reference integrity. |
| SQL Execution Engine | Complete | Universal ops compiler (451 lines), 5 backends (DuckDB, PostgreSQL, MySQL, MSSQL, Access), capability matrix, partial pushdown with pandas fallback. 84 tests. |
| Recipe Sharing & Cloning | Complete | Group-based share toggle, "Shared by" badge, read-only mode for non-owners, recipe forking. |
| DuckDB-Native Statistics | Complete | Descriptive, correlation, t-tests, ANOVA, chi-square, linear regression via DuckDB aggregates. Non-DuckDB uses scipy. 135 tests. |
| Preview SQL Pushdown | Complete | Preview endpoint wired for both direct ops and rule-based modes. SQL compiled, split, executed natively. |
| New Settings Design | Complete | Admin → Setup (Limits, Options, Internal, Licence). Removed Settings → Global. |
| Licence Management in Setup | Complete | Licence page repositioned under Admin → Setup. |
| Auto-Create Datasets on Connection Save | Complete | PostgreSQL, MySQL, MSSQL, Access. Idempotent. |
| Translation Compliance Audit | Complete | Audited entire codebase (~80 violations). Fixed all backend and frontend violations. En.yaml regenerated (1723 keys frontend, 366 keys backend). Full translation deferred to release. |
| AI Recipe Restructure | Complete | Replace current single-turn chat (clone of AIDataClean) with multi-turn educational concierge. 6 phases, 23 tasks. Backend endpoints implemented and working. Full verification deferred to End-to-End Verification item. |
| Remove Old Preparation Pages | Complete | Deleted standalone /datasets/[id]/preparation routes. Redirects to /recipes. Transforms editor is the replacement. |
| Consolidate Duplicate Validation | Complete | Extracted 130-line validate_operations() and 4 constants into shared backend/src/routers/datasets/validation.py. Both files now call shared logic with their respective translation dicts. |
| Dead Code Removal | Complete | Removed 6 dead Next.js /api/recipes route handlers (594 lines). All requests rewritten to Python backend via next.config.mjs. |
| Dynamic Algorithm/Output Discovery | Complete | Recipe editor now fetches algorithm types and visualization types from backend API instead of hardcoded frontend lists. New GET /api/recipes/recipe-algorithms endpoint. |
| End-to-End Verification | Pending | Full workflow walkthrough: upload → transform → recipe → execute → visualise. |
| Virtual Datasets | Planned | DuckDB federated SQL joins across uploaded CSVs, PostgreSQL, MySQL tables. AI-guided creation. |
| More Chart Types | Complete | Scatter, area, horizontal bar, donut, histogram, distribution (sandbox + recipe pipeline). |
| Translation: 8-Language Pass | Complete | Frontend + backend translated to 8 languages via delta mode (129–341 new keys each). Imported into DB. |
Theme: Making the Workbench enterprise-ready.
| Feature | Notes |
|---|---|
| Code Audit | Security audit, performance review, dead code removal, dependency audit. Pre-release gate. (moved from 4) |
| Performance Optimisation | Query optimisation, caching strategies |
| Activity Logs & Audit Trail | User activity tracking + system-wide audit logging (moved from 3) |
| Comprehensive Testing | Unit tests, integration tests, E2E tests |
| User & Developer Documentation | API docs, architecture guides, user manuals |
| Backup & Recovery | Automated backups, restore procedures |
| Monitoring & Alerting | Metrics, dashboards, alerts |
Features deferred indefinitely. May be re-prioritised in a future roadmap revision.
| Feature | Reason |
|---|---|
| AI Recipe Assistant (Phase 7 — old single-turn) | Replaced by AI Recipe Restructure (now in 4). Old stateless agent deprecated. Deferred 2026-07-28, superseded 2026-07-29. |
| Advanced Statistical Techniques | Bayesian methods, time series, clustering — not required for current user base. (moved from 4) |
| Recipe Export/Import | Move from milestone 4 — not required for current user base. |
| Export Visualisations | Move from milestone 4 — not required for current user base. |
| Interactive Visualisations | User interaction with charts — requires Plotly upgrade. (moved from 4) |
| More Database Types | SQLite, Snowflake, BigQuery — no current user demand. (moved from 5) |
| Recipe Templates | Pre-built recipe templates — low priority without community growth. (moved from 5) |
| Agent Sharing & Marketplace | Ecosystem features — requires user base growth first |