Mercurial > repos > jjohnson > query_tabular

annotate query_tabular.py @ 10:98bd1e29d669 draft default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
author jjohnson
date Wed, 20 Apr 2016 15:44:33 -0400
parents 6d9c91071884
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
1 #!/usr/bin/env python
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
2 """
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
3 """
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
4 import sys
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
5 import re
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
6 import os.path
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
7 import json
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
8 import sqlite3 as sqlite
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
9 import optparse
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
10 from optparse import OptionParser
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
11
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
12 """
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
13 TODO:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
14 - could read column names from comment lines, but issues with legal names
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
15 - could add some transformations on tabular columns,
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
16 e.g. a regex to format date/time strings
8
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
17 format: {
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
18 c2 : re.sub('pat', 'sub', c2)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
19 c3 : len(c3)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
20 }
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
21 def format(colname,val, expr):
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
22 - column_defs dict of columns to create from tabular input
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
23 column_defs : { 'name1' : 'expr', 'name2' : 'expr'}
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
24 - allow multiple queries and outputs
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
25 - add a --json input for table definitions (or yaml)
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
26 JSON config:
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
27 { tables : [
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
28 { file_path : '/home/galaxy/dataset_101.dat',
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
29 table_name : 't1',
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
30 column_names : ['c1', 'c2', 'c3'],
10
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
31 pkey_autoincr : 'id'
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
32 comment_lines : 1
10
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
33 unique: ['c1'],
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
34 index: ['c2','c3']
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
35 },
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
36 { file_path : '/home/galaxy/dataset_102.dat',
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
37 table_name : 'gff',
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
38 column_names : ['seqname',,,'start','end']
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
39 comment_lines : 1
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
40 load_named_columns : True
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
41 },
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
42 { file_path : '/home/galaxy/dataset_103.dat',
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
43 table_name : 'test',
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
44 column_names : ['c1', 'c2', 'c3']
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
45 }
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
46 ]
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
47 }
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
48 """
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
49
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
50 tables_query = \
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
51 "SELECT name, sql FROM sqlite_master WHERE type='table' ORDER BY name"
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
52
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
53
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
54 def getValueType(val):
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
55 if val or 0. == val:
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
56 try:
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
57 int(val)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
58 return 'INTEGER'
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
59 except:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
60 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
61 float(val)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
62 return 'REAL'
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
63 except:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
64 return 'TEXT'
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
65 return None
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
66
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
67
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
68 def get_column_def(file_path, table_name, skip=0, comment_char='#',
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
69 column_names=None, max_lines=100,load_named_columns=False):
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
70 col_pref = ['TEXT', 'REAL', 'INTEGER', None]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
71 col_types = []
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
72 col_idx = None
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
73 data_lines = 0
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
74
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
75 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
76 with open(file_path, "r") as fh:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
77 for linenum, line in enumerate(fh):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
78 if linenum < skip:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
79 continue
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
80 if line.startswith(comment_char):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
81 continue
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
82 data_lines += 1
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
83 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
84 fields = line.split('\t')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
85 while len(col_types) < len(fields):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
86 col_types.append(None)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
87 for i, val in enumerate(fields):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
88 colType = getValueType(val)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
89 if col_pref.index(colType) < col_pref.index(col_types[i]):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
90 col_types[i] = colType
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
91 except Exception, e:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
92 print >> sys.stderr, 'Failed at line: %d err: %s' % (linenum, e)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
93 except Exception, e:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
94 print >> sys.stderr, 'Failed: %s' % (e)
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
95 for i,col_type in enumerate(col_types):
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
96 if not col_type:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
97 col_types[i] = 'TEXT'
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
98 if column_names:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
99 col_names = []
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
100 if load_named_columns:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
101 col_idx = []
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
102 for i, cname in enumerate([cn.strip() for cn in column_names.split(',')]):
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
103 if cname != '':
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
104 col_idx.append(i)
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
105 col_names.append(cname)
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
106 col_types = [col_types[i] for i in col_idx]
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
107 else:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
108 col_names = ['c%d' % i for i in range(1, len(col_types) + 1)]
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
109 for i, cname in enumerate([cn.strip() for cn in column_names.split(',')]):
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
110 if cname and i < len(col_names):
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
111 col_names[i] = cname
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
112 else:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
113 col_names = ['c%d' % i for i in range(1, len(col_types) + 1)]
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
114 col_def = []
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
115 for i, col_name in enumerate(col_names):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
116 col_def.append('%s %s' % (col_names[i], col_types[i]))
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
117 return col_names, col_types, col_def, col_idx
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
118
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
119
10
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
120 def create_table(conn, file_path, table_name, skip=0, comment_char='#', pkey_autoincr=None, column_names=None,load_named_columns=False,unique_indexes=[],indexes=[]):
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
121 col_names, col_types, col_def, col_idx = get_column_def(file_path, table_name, skip=skip, comment_char=comment_char, column_names=column_names,load_named_columns=load_named_columns)
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
122 col_func = [float if t == 'REAL' else int if t == 'INTEGER' else str for t in col_types]
10
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
123 table_def = 'CREATE TABLE %s (\n %s%s\n);' % (
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
124 table_name,
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
125 '%s INTEGER PRIMARY KEY AUTOINCREMENT,' % pkey_autoincr if pkey_autoincr else '',
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
126 ', \n '.join(col_def))
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
127 # print >> sys.stdout, table_def
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
128 insert_stmt = 'INSERT INTO %s(%s) VALUES(%s)' % (table_name, ','.join(col_names), ','.join(["?" for x in col_names]))
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
129 # print >> sys.stdout, insert_stmt
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
130 data_lines = 0
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
131 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
132 c = conn.cursor()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
133 c.execute(table_def)
8
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
134 conn.commit()
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
135 c.close()
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
136 for i,index in enumerate(unique_indexes):
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
137 index_name='idx_uniq_%s_%d' % (table_name,i)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
138 index_columns = index.split(',')
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
139 create_index(conn, table_name, index_name, index_columns,unique=True)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
140 for i,index in enumerate(indexes):
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
141 index_name='idx_%s_%d' % (table_name,i)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
142 index_columns = index.split(',')
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
143 create_index(conn, table_name, index_name, index_columns)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
144 c = conn.cursor()
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
145 with open(file_path, "r") as fh:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
146 for linenum, line in enumerate(fh):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
147 if linenum < skip or line.startswith(comment_char):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
148 continue
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
149 data_lines += 1
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
150 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
151 fields = line.rstrip('\r\n').split('\t')
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
152 if col_idx:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
153 fields = [fields[i] for i in col_idx]
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
154 vals = [col_func[i](x) if x else None for i, x in enumerate(fields)]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
155 c.execute(insert_stmt, vals)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
156 except Exception, e:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
157 print >> sys.stderr, 'Failed at line: %d err: %s' % (linenum, e)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
158 conn.commit()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
159 c.close()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
160 except Exception, e:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
161 print >> sys.stderr, 'Failed: %s' % (e)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
162 exit(1)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
163
8
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
164 def create_index(conn, table_name, index_name, index_columns, unique=False):
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
165 index_def = "CREATE %s INDEX %s on %s(%s)" % ('UNIQUE' if unique else '', index_name, table_name, ','.join(index_columns))
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
166 c = conn.cursor()
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
167 c.execute(index_def)
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
168 conn.commit()
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
169 c.close()
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
170
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
171 def regex_match(expr, item):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
172 return re.match(expr, item) is not None
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
173
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
174
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
175 def regex_search(expr, item):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
176 return re.search(expr, item) is not None
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
177
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
178
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
179 def regex_sub(expr, replace, item):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
180 return re.sub(expr, replace, item)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
181
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
182
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
183 def get_connection(sqlitedb_path, addfunctions=False):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
184 conn = sqlite.connect(sqlitedb_path)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
185 if addfunctions:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
186 conn.create_function("re_match", 2, regex_match)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
187 conn.create_function("re_search", 2, regex_search)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
188 conn.create_function("re_sub", 3, regex_sub)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
189 return conn
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
190
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
191
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
192 def __main__():
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
193 # Parse Command Line
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
194 parser = optparse.OptionParser()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
195 parser.add_option('-s', '--sqlitedb', dest='sqlitedb', default=None, help='The SQLite Database')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
196 parser.add_option('-t', '--table', dest='tables', action="append", default=[], help='Tabular file: file_path[=table_name[:column_name, ...]')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
197 parser.add_option('-j', '--jsonfile', dest='jsonfile', default=None, help='Tabular file: file_path[=table_name[:column_name, ...]')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
198 parser.add_option('-q', '--query', dest='query', default=None, help='SQL query')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
199 parser.add_option('-Q', '--query_file', dest='query_file', default=None, help='SQL query file')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
200 parser.add_option('-n', '--no_header', dest='no_header', action='store_true', default=False, help='Include a column headers line')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
201 parser.add_option('-o', '--output', dest='output', default=None, help='Output file for query results')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
202 (options, args) = parser.parse_args()
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
203
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
204 # open sqlite connection
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
205 conn = get_connection(options.sqlitedb)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
206 # determine output destination
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
207 if options.output is not None:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
208 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
209 outputPath = os.path.abspath(options.output)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
210 outputFile = open(outputPath, 'w')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
211 except Exception, e:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
212 print >> sys.stderr, "failed: %s" % e
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
213 exit(3)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
214 else:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
215 outputFile = sys.stdout
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
216
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
217 # get table defs
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
218 if options.tables:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
219 for ti, table in enumerate(options.tables):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
220 table_name = 't%d' % (ti + 1)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
221 column_names = None
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
222 fields = table.split('=')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
223 path = fields[0]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
224 if len(fields) > 1:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
225 names = fields[1].split(':')
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
226 table_name = names[0] if names[0] else table_name
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
227 if len(names) > 1:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
228 column_names = names[1]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
229 # print >> sys.stdout, '%s %s' % (table_name, path)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
230 create_table(conn, path, table_name, column_names=column_names)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
231 if options.jsonfile:
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
232 try:
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
233 fh = open(options.jsonfile)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
234 tdef = json.load(fh)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
235 if 'tables' in tdef:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
236 for ti, table in enumerate(tdef['tables']):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
237 path = table['file_path']
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
238 table_name = table['table_name'] if 'table_name' in table else 't%d' % (ti + 1)
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
239 comment_lines = table['comment_lines'] if 'comment_lines' in table else 0
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
240 column_names = table['column_names'] if 'column_names' in table else None
7
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
241 if column_names:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
242 load_named_columns = table['load_named_columns'] if 'load_named_columns' in table else False
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
243 else:
aa2409ae9dc0 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 4
diff changeset
244 load_named_columns = False
8
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
245 unique_indexes = table['unique'] if 'unique' in table else []
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
246 indexes = table['index'] if 'index' in table else []
10
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
247 pkey_autoincr = table['pkey_autoincr'] if 'pkey_autoincr' in table else None
98bd1e29d669 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 29288f94a382686e263623cf6ddcd235ed5f2310-dirty
jjohnson
parents: 8
diff changeset
248 create_table(conn, path, table_name, pkey_autoincr=pkey_autoincr, column_names=column_names,
8
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
249 skip=comment_lines, load_named_columns=load_named_columns,
6d9c91071884 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 60d1a49c09f87c1c1ec6fecbe54aa226bdc695a7-dirty
jjohnson
parents: 7
diff changeset
250 unique_indexes=unique_indexes, indexes=indexes)
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
251 except Exception, exc:
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
252 print >> sys.stderr, "Error: %s" % exc
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
253 conn.close()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
254
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
255 query = None
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
256 if (options.query_file is not None):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
257 with open(options.query_file, 'r') as fh:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
258 query = ''
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
259 for line in fh:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
260 query += line
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
261 elif (options.query is not None):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
262 query = options.query
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
263
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
264 if (query is None):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
265 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
266 conn = get_connection(options.sqlitedb)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
267 c = conn.cursor()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
268 rslt = c.execute(tables_query).fetchall()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
269 for table, sql in rslt:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
270 print >> sys.stderr, "Table %s:" % table
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
271 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
272 col_query = 'SELECT * FROM %s LIMIT 0' % table
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
273 cur = conn.cursor().execute(col_query)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
274 cols = [col[0] for col in cur.description]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
275 print >> sys.stderr, " Columns: %s" % cols
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
276 except Exception, exc:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
277 print >> sys.stderr, "Error: %s" % exc
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
278 except Exception, exc:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
279 print >> sys.stderr, "Error: %s" % exc
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
280 exit(0)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
281 # if not sqlite.is_read_only_query(query):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
282 # print >> sys.stderr, "Error: Must be a read only query"
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
283 # exit(2)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
284 try:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
285 conn = get_connection(options.sqlitedb, addfunctions=True)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
286 cur = conn.cursor()
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
287 results = cur.execute(query)
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
288 if not options.no_header:
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
289 outputFile.write("#%s\n" % '\t'.join([str(col[0]) for col in cur.description]))
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
290 # yield [col[0] for col in cur.description]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
291 for i, row in enumerate(results):
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
292 # yield [val for val in row]
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
293 outputFile.write("%s\n" % '\t'.join([str(val) for val in row]))
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
294 except Exception, exc:
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
295 print >> sys.stderr, "Error: %s" % exc
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
296 exit(1)
0
763c4f968dc6 Uploaded
jjohnson
parents:
diff changeset
297
4
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
298 if __name__ == "__main__":
afdbc7198353 planemo upload for repository https://github.com/jj-umn/galaxytools/tree/master/query_tabular commit 9ae87502ea7c3da33ecc453872c4eb2f41ecea4a-dirty
jjohnson
parents: 2
diff changeset
299 __main__()