Mercurial > repos > pjbriggs > amplicon_analysis_pipeline

annotate updating-to-pipeline-1.3-DADA2.txt @ 52:6c15d2223e46 draft default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 7be61b7ed35ca3deaad68d2eae384c8cd365bcb8
author pjbriggs
date Fri, 20 Dec 2019 11:59:21 +0000
parents 098ad1dd7760
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
42
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
1 Notes on updating Galaxy tool to pipeline 1.3 (DADA2)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
2 =====================================================
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
3
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
4 Where stuff is:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
5
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
6 * projects/Amplicon_analysis-galaxy: git repo for Galaxy tool (these
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
7 developments are in the 'update-to-Amplicon_analysis_pipeline-1.3'
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
8 branch, PR #50:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
9 https://github.com/pjbriggs/Amplicon_analysis-galaxy/pull/50)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
10
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
11 * scratchpad/test_Amplicon_analysis_pipeline_DADA2: directory for
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
12 running/testing the updates
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
13
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
14 So far:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
15
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
16 * Updated the installer for pipeline version 1.3.2
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
17
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
18 * Have been trying to run the pipeline manually outside of Galaxy
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
19 on popov & CSF3:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
20 -- DADA2 works on popov (can't remember if it works on CSF3)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
21 -- Vsearch pipeline fails on popov and CSF3 (but errors are
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
22 different)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
23
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
24 * Mauro is looking at fixing the errors while I carry on trying
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
25 to update the Galaxy tool
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
26
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
27 Random notes from my notebook:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
28
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
29 p44:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
30
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
31 * DADA2 uses NSLOTS environment variable from the local environment
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
32 (so can get number of cores on cluster; if NSLOTS not set then
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
33 gets number of cores on local machine)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
34
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
35 * DADA2 has new outputs:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
36 -- DADA2_OTU_tables/Error_rate_plots/ <-- need to capture all
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
37 PDFs from this folder
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
38
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
39 pp78-79:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
40
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
41 * Galaxy wrapper could check that 'Run' column is in supplied
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
42 metatable file (if it's not present then pipeline will fail
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
43 now)
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
44
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
45 * DADA2 has its own reference database
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
46
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
47 * DADA2 produces same outputs as Vsearch (with name changed from
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
48 "Vsearch_*" to "DADA2_*", plus extras:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
49 -- Vsearch_OTUs.tre -> otus.tre
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
50 -- Vsearch_multiplexed_linearised_dereplicated_mc2_repset_nonchimeras_OTUS.fasta -> seqs.fa
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
51 -- There might be issues with the heatmap
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
52
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
53 p83: notes on progress...
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
54
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
55 p95:
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
56
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
57 * Confirms heatmap is now e.g. RESULTS/Vsearch_silva/Heatmap.pdf
098ad1dd7760 planemo upload for repository https://github.com/pjbriggs/Amplicon_analysis-galaxy commit 10be6f00106e853a6720e4052871d9d84e027137
pjbriggs
parents:
diff changeset
58 (instead of HTML output)