Key Points
Before We Use AI: What Are We Practising?
- This lesson teaches you to inspect, question, constrain, and validate AI output, not to delegate your thinking.
- Generation, understanding, and validation are different skills. Generation is the easy one.
- For a novice, verifying generated code can cost more effort than writing it.
- Working code is not the same as trustworthy code. Use the run / revise / reject checkpoint every time.
CLI-Based AI
- Different AI tools see and change different things; always ask what a tool can see and do before trusting it.
- A CLI agent can read, run, and edit your real files, which makes verifying what it changed part of the workflow.
- Run
/initinside Claude Code to create aCLAUDE.mdLiving Spec that reduces context drift. - A portable
AGENTS.mdlets the same spec travel across different AI tools, but auto-loading it isn’t universal; check per tool (Claude Code needs an explicit@AGENTS.mdimport). - The shift is from writing syntax to actively reviewing intent, assumptions, and evidence; it does not remove your responsibility.
Best Practices for Prompting
- Be specific and provide context.
- Plan before you act: use plan mode so the agent can’t write files until you approve its approach, not just a prompt asking it to wait.
- Prefer prompts that preserve learning: ask for plans, hints, and the simplest version, not the finished answer.
- Always validate AI outputs, and never ship a line you cannot explain.
- Introspection can surface issues the first draft missed, but it is not a guarantee of correctness; treat what it finds as something to verify, not proof.
Data Cleaning with AI
- Predict the inconsistencies yourself before prompting, so you can judge the AI’s plan.
- Ask for a plan first, put constraints in the spec, then generate code.
- Explain the script before you run it; you cannot validate what you cannot explain.
- Validate with concrete checks (row count, missing values, date format), not because it ran.
Validation Strategies: The Approval Gate
- The approval gate separates experimental prototypes from validated research.
- Rewrite time is a local, formative signal about your workflow, not a productivity score.
- Immutable requirements prevent the AI from drifting away from research specs.
- A multi-model critique, run in a fresh session, is a reviewer, not an authority.
- You cannot validate what you cannot explain.
Limitations and Cautions
- Avoid AI for security-critical tasks, sensitive data, and basic syntax practice.
- Know when AI supports learning and when it gets in the way.
- You are responsible for the final output.
- Open-weight models offer better reproducibility (a pinned revision); the right choice for a task still depends on data sensitivity, auditability, and cost, not a default.
From AI Output to a Review-Ready Bundle
- Review-ready means spec, plan, code, validation, a result, provenance, and a decision, not just a script that runs — a descriptive plot is not itself a statistical finding.
- The same checkpoint pattern scales from one script to a whole small project.
- A plot can render cleanly and still be wrong; domain plausibility is your job.
- “Revise” is a valid, honest outcome when the evidence does not yet cover the claim.
Resources and Next Steps
- The workflow transfers across tools; match the tool and backend to the task and data sensitivity.
- Attribute AI use transparently; it cannot be an author.
- Leave with a concrete plan for your own data, including the one check that would catch a silent error.
- Before adopting a new tool, check its scope claims, transparency, citations, and data-privacy terms; new tools appear daily, and many are more marketing than substance.