Roadmap¶
Three questions: what is done, what is being worked on, and what comes next. Spectio stays below 1.0 until it has been checked with several use cases and several groups; the conditions are written down in the release stages.
Specifications, screen designs, test pipelines on both engines, reviews before any code.
One run crosses every part once: launch, watch, stop at a gate, resume, hand off to depictio.
Installed from the docs in under 30 minutes, real pipelines every night, backups tested.
Open to everyone, demo instance on EMBL's Kubernetes, upgrades tested release after release.
Several groups using it daily, both engines on SLURM and Kubernetes, frozen API.
Done¶
- The design, reviewed before code: 13 specifications, about 60 screen designs, a decision log.
- Test pipelines written for both engines, with 11 scenarios (stops at gates, failures, retries, resumes) passing on Nextflow 26.10 and 25.10 and on Snakemake 9.27, on every change.
- A test corpus of 14 nf-core pipelines and 9 Snakemake catalog workflows on their own test data.
- This documentation, written and reviewed at every step.
Now¶
The design phase runs in waves. Each wave is a set of steps, done by agents and checked before the next wave starts.
W07/7Foundations, done interactively with Thomas (2026-10-24 to 26)W10/9Independent reviews and the first spike (read-only, parallel)W20/6Triage and apply W1 findings, then the reviews that need cleaned specsW30/14Development layer and test infrastructure (parallel worktrees)W40/3Synthesis, plan and the one human decisionW50/2Implementation of the walking skeleton
Each step has its own page under Progress.
Next¶
- Reviews before code (waves W1 and W2): consistency, facts, constraints, security, screens, depictio.
- Development setup and test clusters (wave W3): local SLURM and Kubernetes for tests, dev previews, end-to-end tests.
- The go decision (wave W4), then the walking skeleton.
Ideas, not scheduled¶
- CWL and WDL engines.
- Other schedulers: LSF, PBS, SGE.
- GA4GH WES and TES interfaces.