annotate filtering.xml @ 1:8d212f15666b draft

Uploaded
author greg
date Wed, 09 May 2012 20:21:15 -0400
parents f28d5018f9cb
children 48edb538c102
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
1
8d212f15666b Uploaded
greg
parents: 0
diff changeset
1 <tool id="Filter1" name="Filter (new behavior)" version="1.0.2">
0
f28d5018f9cb Uploaded
greg
parents:
diff changeset
2 <description>data on any column using simple expressions</description>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
3 <command interpreter="python">
f28d5018f9cb Uploaded
greg
parents:
diff changeset
4 filtering.py $input $out_file1 "$cond" ${input.metadata.columns} "${input.metadata.column_types}"
f28d5018f9cb Uploaded
greg
parents:
diff changeset
5 </command>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
6 <inputs>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
7 <param format="tabular" name="input" type="data" label="Filter" help="Query missing? See TIP below."/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
8 <param name="cond" size="40" type="text" value="c1=='chr22'" label="With following condition" help="Double equal signs, ==, must be used as shown above. To filter for an arbitrary string, use the Select tool.">
f28d5018f9cb Uploaded
greg
parents:
diff changeset
9 <validator type="empty_field" message="Enter a valid filtering condition, see syntax and examples below."/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
10 </param>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
11 </inputs>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
12 <outputs>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
13 <data format="input" name="out_file1" metadata_source="input"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
14 </outputs>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
15 <tests>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
16 <test>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
17 <param name="input" value="1.bed"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
18 <param name="cond" value="c1=='chr22'"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
19 <output name="out_file1" file="filter1_test1.bed"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
20 </test>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
21 <test>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
22 <param name="input" value="7.bed"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
23 <param name="cond" value="c1=='chr1' and c3-c2>=2000 and c6=='+'"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
24 <output name="out_file1" file="filter1_test2.bed"/>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
25 </test>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
26 </tests>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
27 <help>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
28
f28d5018f9cb Uploaded
greg
parents:
diff changeset
29 .. class:: warningmark
f28d5018f9cb Uploaded
greg
parents:
diff changeset
30
f28d5018f9cb Uploaded
greg
parents:
diff changeset
31 Double equal signs, ==, must be used as *"equal to"* (e.g., **c1 == 'chr22'**)
f28d5018f9cb Uploaded
greg
parents:
diff changeset
32
f28d5018f9cb Uploaded
greg
parents:
diff changeset
33 .. class:: infomark
f28d5018f9cb Uploaded
greg
parents:
diff changeset
34
f28d5018f9cb Uploaded
greg
parents:
diff changeset
35 **TIP:** Attempting to apply a filtering condition may throw exceptions if the data type (e.g., string, integer) in every line of the columns being filtered is not appropriate for the condition (e.g., attempting certain numerical calculations on strings). If an exception is thrown when applying the condition to a line, that line is skipped as invalid for the filter condition. The number of invalid skipped lines is documented in the resulting history item as a "Condition/data issue".
f28d5018f9cb Uploaded
greg
parents:
diff changeset
36
f28d5018f9cb Uploaded
greg
parents:
diff changeset
37 .. class:: infomark
f28d5018f9cb Uploaded
greg
parents:
diff changeset
38
f28d5018f9cb Uploaded
greg
parents:
diff changeset
39 **TIP:** If your data is not TAB delimited, use *Text Manipulation-&gt;Convert*
f28d5018f9cb Uploaded
greg
parents:
diff changeset
40
f28d5018f9cb Uploaded
greg
parents:
diff changeset
41 -----
f28d5018f9cb Uploaded
greg
parents:
diff changeset
42
f28d5018f9cb Uploaded
greg
parents:
diff changeset
43 **Syntax**
f28d5018f9cb Uploaded
greg
parents:
diff changeset
44
f28d5018f9cb Uploaded
greg
parents:
diff changeset
45 The filter tool allows you to restrict the dataset using simple conditional statements.
f28d5018f9cb Uploaded
greg
parents:
diff changeset
46
f28d5018f9cb Uploaded
greg
parents:
diff changeset
47 - Columns are referenced with **c** and a **number**. For example, **c1** refers to the first column of a tab-delimited file
f28d5018f9cb Uploaded
greg
parents:
diff changeset
48 - Make sure that multi-character operators contain no white space ( e.g., **&lt;=** is valid while **&lt; =** is not valid )
f28d5018f9cb Uploaded
greg
parents:
diff changeset
49 - When using 'equal-to' operator **double equal sign '==' must be used** ( e.g., **c1=='chr1'** )
f28d5018f9cb Uploaded
greg
parents:
diff changeset
50 - Non-numerical values must be included in single or double quotes ( e.g., **c6=='+'** )
f28d5018f9cb Uploaded
greg
parents:
diff changeset
51 - Filtering condition can include logical operators, but **make sure operators are all lower case** ( e.g., **(c1!='chrX' and c1!='chrY') or not c6=='+'** )
f28d5018f9cb Uploaded
greg
parents:
diff changeset
52
f28d5018f9cb Uploaded
greg
parents:
diff changeset
53 -----
f28d5018f9cb Uploaded
greg
parents:
diff changeset
54
f28d5018f9cb Uploaded
greg
parents:
diff changeset
55 **Example**
f28d5018f9cb Uploaded
greg
parents:
diff changeset
56
f28d5018f9cb Uploaded
greg
parents:
diff changeset
57 - **c1=='chr1'** selects lines in which the first column is chr1
f28d5018f9cb Uploaded
greg
parents:
diff changeset
58 - **c3-c2&lt;100*c4** selects lines where subtracting column 3 from column 2 is less than the value of column 4 times 100
f28d5018f9cb Uploaded
greg
parents:
diff changeset
59 - **len(c2.split(',')) &lt; 4** will select lines where the second column has less than four comma separated elements
f28d5018f9cb Uploaded
greg
parents:
diff changeset
60 - **c2>=1** selects lines in which the value of column 2 is greater than or equal to 1
f28d5018f9cb Uploaded
greg
parents:
diff changeset
61 - Numbers should not contain commas - **c2&lt;=44,554,350** will not work, but **c2&lt;=44554350** will
f28d5018f9cb Uploaded
greg
parents:
diff changeset
62 - Some words in the data can be used, but must be single or double quoted ( e.g., **c3=='exon'** )
f28d5018f9cb Uploaded
greg
parents:
diff changeset
63
f28d5018f9cb Uploaded
greg
parents:
diff changeset
64 </help>
f28d5018f9cb Uploaded
greg
parents:
diff changeset
65 </tool>