Skip to content

Commit 2b22896

Browse files
committed
docs: update
1 parent 180260c commit 2b22896

File tree

9 files changed

+4366
-45
lines changed

9 files changed

+4366
-45
lines changed

.codex/skills/content-research-writer/SKILL.md

Lines changed: 595 additions & 0 deletions
Large diffs are not rendered by default.

.codex/skills/scientific-critical-thinking/SKILL.md

Lines changed: 585 additions & 0 deletions
Large diffs are not rendered by default.

.codex/skills/scientific-critical-thinking/references/common_biases.md

Lines changed: 440 additions & 0 deletions
Large diffs are not rendered by default.

.codex/skills/scientific-critical-thinking/references/evidence_hierarchy.md

Lines changed: 570 additions & 0 deletions
Large diffs are not rendered by default.

.codex/skills/scientific-critical-thinking/references/experimental_design.md

Lines changed: 551 additions & 0 deletions
Large diffs are not rendered by default.

.codex/skills/scientific-critical-thinking/references/logical_fallacies.md

Lines changed: 562 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 193 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,193 @@
1+
# Scientific Method Core Principles
2+
3+
## Fundamental Principles
4+
5+
### 1. Empiricism
6+
7+
- Knowledge derives from observable, measurable evidence
8+
- Claims must be testable through observation or experiment
9+
- Subjective experience alone is insufficient for scientific conclusions
10+
11+
### 2. Falsifiability (Popper's Criterion)
12+
13+
- A hypothesis must be capable of being proven false
14+
- Unfalsifiable claims are not scientific (e.g., "invisible, undetectable forces")
15+
- Good hypotheses make specific, testable predictions
16+
17+
### 3. Reproducibility
18+
19+
- Results must be replicable by independent researchers
20+
- Methods must be described with sufficient detail for replication
21+
- Single studies are rarely definitive; replication strengthens confidence
22+
23+
### 4. Parsimony (Occam's Razor)
24+
25+
- Prefer simpler explanations over complex ones when both fit the data
26+
- Don't multiply entities unnecessarily
27+
- Extraordinary claims require extraordinary evidence
28+
29+
### 5. Systematic Observation
30+
31+
- Use standardized, rigorous methods
32+
- Control for confounding variables
33+
- Minimize observer bias through blinding and protocols
34+
35+
## The Scientific Process
36+
37+
### 1. Question Formation
38+
39+
- Identify a specific, answerable question
40+
- Ensure the question is within the scope of scientific inquiry
41+
- Consider whether current methods can address the question
42+
43+
### 2. Literature Review
44+
45+
- Survey existing knowledge
46+
- Identify gaps and contradictions
47+
- Build on previous work rather than reinventing
48+
49+
### 3. Hypothesis Development
50+
51+
- State a clear, testable prediction
52+
- Define variables operationally
53+
- Specify the expected relationship between variables
54+
55+
### 4. Experimental Design
56+
57+
- Choose appropriate methodology
58+
- Identify independent and dependent variables
59+
- Control confounding variables
60+
- Select appropriate sample size and population
61+
- Plan statistical analyses in advance
62+
63+
### 5. Data Collection
64+
65+
- Follow protocols consistently
66+
- Record all observations, including unexpected results
67+
- Maintain detailed lab notebooks or data logs
68+
- Use validated measurement instruments
69+
70+
### 6. Analysis
71+
72+
- Apply appropriate statistical methods
73+
- Test assumptions of statistical tests
74+
- Consider effect size, not just significance
75+
- Look for alternative explanations
76+
77+
### 7. Interpretation
78+
79+
- Distinguish between correlation and causation
80+
- Acknowledge limitations
81+
- Consider alternative interpretations
82+
- Avoid overgeneralizing beyond the data
83+
84+
### 8. Communication
85+
86+
- Report methods transparently
87+
- Include negative results
88+
- Acknowledge conflicts of interest
89+
- Make data and code available when possible
90+
91+
## Critical Evaluation Criteria
92+
93+
### When Reviewing Scientific Work, Ask:
94+
95+
**Validity Questions:**
96+
97+
- Does the study measure what it claims to measure?
98+
- Are the methods appropriate for the research question?
99+
- Were controls adequate?
100+
- Could confounding variables explain the results?
101+
102+
**Reliability Questions:**
103+
104+
- Are measurements consistent?
105+
- Would the study produce similar results if repeated?
106+
- Are inter-rater reliability and measurement precision reported?
107+
108+
**Generalizability Questions:**
109+
110+
- Is the sample representative of the target population?
111+
- Are the conditions realistic or artificial?
112+
- Do the results apply beyond the specific context?
113+
114+
**Statistical Questions:**
115+
116+
- Is the sample size adequate for the analysis?
117+
- Are the statistical tests appropriate?
118+
- Are effect sizes reported alongside p-values?
119+
- Were multiple comparisons corrected?
120+
121+
**Logical Questions:**
122+
123+
- Do the conclusions follow from the data?
124+
- Are alternative explanations considered?
125+
- Are causal claims supported by the study design?
126+
- Are limitations acknowledged?
127+
128+
## Red Flags in Scientific Claims
129+
130+
1. **Cherry-picking data** - Highlighting only supporting evidence
131+
2. **Moving goalposts** - Changing predictions after seeing results
132+
3. **Ad hoc hypotheses** - Adding explanations to rescue a failed prediction
133+
4. **Appeal to authority** - "Expert X says" without evidence
134+
5. **Anecdotal evidence** - Relying on personal stories over systematic data
135+
6. **Correlation implies causation** - Confusing association with causality
136+
7. **Post hoc rationalization** - Explaining results after the fact without prediction
137+
8. **Ignoring base rates** - Not considering prior probability
138+
9. **Confirmation bias** - Seeking only evidence that supports beliefs
139+
10. **Publication bias** - Only positive results get published
140+
141+
## Standards for Causal Inference
142+
143+
### Bradford Hill Criteria (adapted)
144+
145+
1. **Strength** - Strong associations are more likely causal
146+
2. **Consistency** - Repeated observations by different researchers
147+
3. **Specificity** - Specific outcomes from specific causes
148+
4. **Temporality** - Cause precedes effect (essential)
149+
5. **Biological gradient** - Dose-response relationship
150+
6. **Plausibility** - Coherent with existing knowledge
151+
7. **Coherence** - Consistent with other evidence
152+
8. **Experiment** - Experimental evidence supports causation
153+
9. **Analogy** - Similar cause-effect relationships exist
154+
155+
### Establishing Causation Requires:
156+
157+
- Temporal precedence (cause before effect)
158+
- Covariation (cause and effect correlate)
159+
- Elimination of alternative explanations
160+
- Ideally: experimental manipulation showing cause produces effect
161+
162+
## Peer Review and Scientific Consensus
163+
164+
### Understanding Peer Review
165+
166+
- Filters obvious errors but isn't perfect
167+
- Reviewers can miss problems or have biases
168+
- Published ≠ proven; it means "passed initial scrutiny"
169+
- Retraction mechanisms exist for flawed papers
170+
171+
### Scientific Consensus
172+
173+
- Emerges from convergence of multiple independent lines of evidence
174+
- Consensus can change with new evidence
175+
- Individual studies rarely overturn consensus
176+
- Consider the weight of evidence, not individual papers
177+
178+
## Open Science Principles
179+
180+
### Transparency Practices
181+
182+
- Preregistration of hypotheses and methods
183+
- Open data sharing
184+
- Open-source code
185+
- Preprints for rapid dissemination
186+
- Registered reports (peer review before data collection)
187+
188+
### Why Transparency Matters
189+
190+
- Reduces publication bias
191+
- Enables verification
192+
- Prevents p-hacking and HARKing (Hypothesizing After Results are Known)
193+
- Accelerates scientific progress

0 commit comments

Comments
 (0)