Documentation
Cursor
VS Code
Preventing Costly Data Errors with a Transparency First Framework
Problem
As AI becomes more involved in data workflows, mistakes become harder to trace. Without full visibility into assumptions, queries, intermediate data, and decisions, teams lose control and risk costly data errors.
Solution
Adopt a transparency first framework across the entire analytics workflow. By documenting the business question, execution steps, queries, intermediate datasets, and final outputs, teams gain full traceability and validation at every stage. This mindset, independent of tools, reduces risk, increases trust, and keeps analysts in control of AI driven processes.
Prompt
# Analysis Workflow
## Purpose
Defines the standard workflow for data analyses including folder structure, templates, and conversational checkpoints.
## Folder Structure
Create this structure for new analyses:
```
analyses/{YYYY-MM-DD}_{analysis-slug}/
├── README.md
├── analysis_flow.md
├── deliverables/
│ ├── report_summary.pdf
│ ├── report_interactive.html
│ └── report.html
├── queries/
│ ├── 01_{query-name}.sql
│ └── ...
├── eda/
│ └── eda_report.md
├── conclusions/
│ └── conclusions.md
└── data/
├── 01_query-results.json
└── ...
```
**Naming conventions:**
- Folders: `YYYY-MM-DD_descriptive-slug` (e.g., `2024-12-15_churn-analysis`)Walkthrough
