/distill Workflow
๐งช /distill Workflow
Standard workflow for extracting structured knowledge from long-form content
๐ฏ Purpose
Long-form content (ChatGPT journals, Notion pages, exported conversations) can't be directly ingested โ they need to be distilled into structured outputs first.
Core idea: Agent reads the full document, extracts categorized outputs, generates a structured change proposal, Adrian reviews and merges. Like a PR for knowledge.
๐ Flow
๐ Step-by-Step Design
Step 1: Input
Agent receives a file path to any long-form content
Step 2: Read & Analyze
Agent reads the full document, identifies themes, and scans for extractable items
Step 3: Extract & Classify CORE
Categorize extracted items into 5 MECE output types
Step 4: Generate Proposal
Structured change proposal โ like a PR for knowledge
Step 5: Adrian Review
Human-in-the-loop governance
Step 6: Merge & Mark
Apply approved changes, mark source as processed
๐ Output Type Routing
Output Type | Route To | Review Required? |
|---|---|---|
๐ฃ Principles | kb/adrian/Principles.md | ALWAYS |
๐ต Facts |
| USUALLY |
๐ข Actions | D1 Task or Smart Todo | OPTIONAL |
๐ก Insights | KB article or | USUALLY |
๐ Observations |
| ALWAYS |
Governance rule: High-layer changes (Principles, Identity, Observations) always require human review. Lower-layer changes (Facts, Actions) can be auto-applied if confidence is high.
๐งช Prototype Evidence
This workflow was prototyped (manually) in the current session:
Source | Outputs Generated | Time |
|---|---|---|
ChatGPT ้ซๆฏ็ฝๅช้ณ่งฃ้.md | 5 new Principles | ~2 hours (manual) |
Target with automated /distill: 30 minutes per document.
โ Open Design Questions
Question | Options | Status |
|---|---|---|
How does agent determine nexus node for routing? | Query nexus API / match by keywords / ask Adrian | OPEN |
Where to store distill proposals temporarily? | Task folder / temp file / inline in chat | OPEN |
How to handle documents too long for one context window? | Chunked processing / summary-then-detail / multi-pass | OPEN |
Should distill create a formal report? | Yes (portal report) / No (just proposal) / Optional | LEANING: optional |
Dependency: Nexus needs to exist first? | Yes (Phase 0 first) / No (use workspace as proxy) | DECIDED: Can use workspace as proxy initially |