-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathMIDAS.Rmd
More file actions
289 lines (134 loc) · 8.88 KB
/
MIDAS.Rmd
File metadata and controls
289 lines (134 loc) · 8.88 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
---
title: "Data Analysis Reporting Template using MIDAS authoring tool"
output:
html_document: default
pdf_document: default
word_document: default
always_allow_html: yes
---
```{r}
```
```{r setup, include=FALSE}
knitr::opts_chunk$set(echo = TRUE)
```
##Pretreatment of data:
<!-- What are the dimensions of the dataset entering this phase of analysis?-->
<!-- What percentage of the data is Missing Values?-->
<!-- Is imputation (I) performed?-->
<!-- If yes describe method-->
<!-- Is normalisation (N) performed?-->
<!-- If yes describe method-->
<!-- Is transformation (T) performed?-->
<!-- If yes describe method-->
<!-- Is scaling (S)performed?-->
<!-- If yes describe method-->
<!-- Is filtering (F) applied to the dataset at this point?-->
<!-- If yes describe method-->
<!-- Is a QC (QC) method employed on the dataset-->
<!-- Please describe-->
<!-- Outline the order of the steps performed on the dataset: E.g. I-> T-> S->N->F->QC-->
<!--Have the dimensions of the dataset changed? If yes how and why?-->
<!--Provide the dimensions of the dataset at the end of the pretreatment phase.-->
<!--Provide details on the package or program used for this phase of the analysis-->
<!--If in house code is used provide it or a link to it and also the language the code is written in.-->
##Univariate Data Analysis
<!--What are the dimensions of the dataset entering this phase of analysis?-->
<!--Is univariate testing performed?-->
<!--If yes describe method-->
<!--Is multiple testing correction employed with this method?-->
<!--If yes describe method-->
<!--Are other methods of univariate testing performed?-->
<!--If yes describe methods
<!--Are multiple testing correction employed with these methods?
<!--If yes describe method-->
<!--Pleasre report p-values and adjusted p-values.-->
<!--Please report test statistics and confidence intervals.-->
<!--Have the dimensions of the dataset changed? If yes how and why?-->
<!--Provide the dimensions of the dataset at the end of univariate analysis.-->
<!--Provide details on the package or program used for this phase of the analysis-->
<!--If in house code is used provide it or a link to it and also the language the code is written in.-->
<!--If a list of potential biomarkers is produced at this point please state this explicitly.-->
##Unsupervised Analysis
<!--What are the dimensions of the dataset entering this phase of the analysis?-->
<!--Are unsupervised methods employed for visualisation and/ or data reduction and/or correlation analysis?-->
<!--If yes describe method.-->
<!--Are unsupervised analysis methods used for clustering.-->
<!--If yes describe and provide distance metric.-->
<!--Have the dimensions of the dataset changed at the end of this step? If yes, how and why?-->
<!--Provide the dimensions of the dataset at the end of unsupervised analysis.-->
<!--Provide details on the package or program used for this phase of the analysis-->
<!--If in house code is used provide it or a link to it and also the language it is written in.-->
<!--If a list of potential biomarkers is produced at this point please state this explicitly.-->
##Supervised Analysis
<!--What are the dimensions of the dataset at this point?-->
<!--Are supervised methods employed?.-->
<!--If yes describe the supervised analysis described fully enough to allow imitation of the exact procedure. This would require reporting all the following information: all parameters; details of how data is split; details of how internal validation is conducted (i.e. Cross Validation); details of how meta-parameter optimization is performed; details about the chosen metric for assessing the predictive ability of the model and finally the overall description of the workflow.-->
<!--Is more than one supervised method employed?-->
<!--If yes describe the implemention of the other alorithm(s) fully enough to allow imitation of the exact procedure. This would require reporting all the following information: all parameters; details of how data is split; details of how internal validation is conducted (i.e. Cross Validation); details of how meta-parameter optimization is performed; details about the chosen metric for assessing the predictive ability of the model and finally the overall description of the workflow-->
<!--Is external validation employed?.-->
<!--If yes describe source of external data. Is the data from the same location/ lab/timeline?.-->
<!--Provide a confusion matrix of results..-->
<!--Are potential biomarkers identified? If yes, list them.-->
<!--Have the dimensions of the dataset changed? If yes how and why?-->
<!--Provide the dimensions of the dataset at the end of supervised analysis.-->
<!--Provide details on the package or program used for this phase of the analysis-->
<!--If in house code is used provide it or a link to it and also the language the code is written in.-->
<!--If a list of potential biomarkers is produced at this point please state this explicitly.-->
##ROC Analysis
<!--Is ROC analysis performed on the identified putative biomarkers?-->
<!--If yes please report on AUC sensitivity and specificity-->
<!--Provide details on the package or program used for this phase of the analysis-->
<!--If in house code is used provide it or a link to it and also the language the code is written in.-->
```{r include=FALSE}
library("DiagrammeR")
```
###Workflow Diagram of Pretreatment Phase of Data Analysis
<!--Below you will be instructed to enter the steps of the pretreatment phase of analysis so that they will become nodes of your workflow diagram. You will also be asked to differentiate between the different datasets at each point -->
```{r pressure, echo=FALSE}
grViz("
digraph boxes_and_circles{
node [shape = box]
###Instruction 1: write out all steps of pretreatment in your analysis as below separated by semicolon, delete or add to this list as appropriate
Imputation; Normalisation; Scaling; Filtering; QC_Treatment;
node [shape = circle]
### Instruction 2: Write out all datasets inputs and outputs and all biomarker lists created at the pretreatment stage, include the dimensions of the input and output datasets in the name, in the following format...dataset#_NxM, where # is the unique identifier of the dataset which is the input or output at that point in the analysis, where N is the number of samples (rows) in the dataset and where m is the number of variables or peaks (columns) in the dataset at that point in the analysis. Delete or add to this list as appropriate
Dataset1_15x4000; Dataset2_100x3500; BiomarkerList1;
### Connect all nodes of the workflow diagram including the dataset inputs and outputs as steps in the diagram, as below
Dataset1_15x4000->QC_Treatment;
QC_Treatment-> Dataset2_100x3500;
Dataset2_100x3500->Imputation;
Imputation->Normalisation;
Normalisation->Scaling;
Scaling->Filtering;
Filtering-> Dataset3_100x1500;
Filtering->BiomarkerList1;
}
")
```
###Workflow Diagram of all major steps of the Data Analysis
```{r echo=FALSE}
grViz("
digraph boxes_and_circles{
### This will give all the steps of the analysis a box shape in your diagram
node [shape = box]
### Instruction 3: Write out all steps of the analysis as below separated by semicolon
Pretreatment; Univariate_Analysis; Supervised_Analysis; Unsupervised_Analysis;ROC_Analysis;
### This will give all the datasets and biomarker lists entering and resulting from the analysis a circle shape in your diagram
node [shape = circle]
### Instruction 4: Write out all datasets inputs and outputs and all biomarker lists created at the pretreatment stage, include the dimensions of the input and output datasets in the name, in the following format...dataset#_NxM, where # is the unique identifier of the dataset which is the input or output at that point in the analysis, where N is the number of samples (rows) in the dataset and where m is the number of variables or peaks (columns) in the dataset at that point in the analysis. Delete or add to this list as appropriateDataset1_100x4000; BiomarkerList1; Dataset3_100x1500; BiomarkerList2; BiomarkerList3; Dataset4;Dataset2_100x3500;
###Instruction 5: Connect the nodes with edges by using an arrow in the following way
Dataset1_100x4000 ->QC_Treatment;
QC_Treatment-> Dataset2_100x3500;
Dataset2_100x3500 -> Pretreatment;
Pretreatment ->BiomarkerList1;
Pretreatment ->Dataset3_100x1500;
Dataset3_100x1500-> Univariate_Analysis;
Univariate_Analysis-> BiomarkerList2;
Univariate_Analysis-> Dataset4;
Dataset4->Unsupervised_Analysis;
Dataset4->Supervised_Analysis;
Supervised_Analysis-> BiomarkerList3;
BiomarkerList3-> ROC_Analysis;
}
")
```