Mercurial > repos > bgruening > sklearn_stacking_ensemble_models

annotate model_prediction.py @ 14:2fc88dc854ee draft default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit f031d8ddfb73cec24572648666ac44ee47f08aad
author bgruening
date Thu, 11 Aug 2022 07:49:08 +0000
parents 0380f10c4e04
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
1 import argparse
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
2 import json
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
3 import warnings
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
4
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
5 import numpy as np
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
6 import pandas as pd
10
2d890789ac48 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 208a8d348e7c7a182cfbe1b6f17868146428a7e2"
bgruening
parents: 9
diff changeset
7 from galaxy_ml.utils import get_module, load_model, read_columns, try_get_attr
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
8 from scipy.io import mmread
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
9 from sklearn.pipeline import Pipeline
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
10
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
11 N_JOBS = int(__import__("os").environ.get("GALAXY_SLOTS", 1))
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
12
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
13
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
14 def main(
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
15 inputs,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
16 infile_estimator,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
17 outfile_predict,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
18 infile_weights=None,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
19 infile1=None,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
20 fasta_path=None,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
21 ref_seq=None,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
22 vcf_path=None,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
23 ):
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
24 """
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
25 Parameter
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
26 ---------
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
27 inputs : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
28 File path to galaxy tool parameter
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
29
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
30 infile_estimator : strgit
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
31 File path to trained estimator input
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
32
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
33 outfile_predict : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
34 File path to save the prediction results, tabular
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
35
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
36 infile_weights : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
37 File path to weights input
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
38
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
39 infile1 : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
40 File path to dataset containing features
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
41
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
42 fasta_path : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
43 File path to dataset containing fasta file
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
44
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
45 ref_seq : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
46 File path to dataset containing the reference genome sequence.
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
47
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
48 vcf_path : str
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
49 File path to dataset containing variants info.
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
50 """
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
51 warnings.filterwarnings("ignore")
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
52
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
53 with open(inputs, "r") as param_handler:
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
54 params = json.load(param_handler)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
55
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
56 # load model
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
57 with open(infile_estimator, "rb") as est_handler:
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
58 estimator = load_model(est_handler)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
59
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
60 main_est = estimator
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
61 if isinstance(estimator, Pipeline):
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
62 main_est = estimator.steps[-1][-1]
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
63 if hasattr(main_est, "config") and hasattr(main_est, "load_weights"):
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
64 if not infile_weights or infile_weights == "None":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
65 raise ValueError(
11
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
66 "The selected model skeleton asks for weights, "
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
67 "but dataset for weights wan not selected!"
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
68 )
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
69 main_est.load_weights(infile_weights)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
70
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
71 # handle data input
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
72 input_type = params["input_options"]["selected_input"]
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
73 # tabular input
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
74 if input_type == "tabular":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
75 header = "infer" if params["input_options"]["header1"] else None
11
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
76 column_option = params["input_options"]["column_selector_options_1"][
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
77 "selected_column_selector_option"
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
78 ]
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
79 if column_option in [
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
80 "by_index_number",
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
81 "all_but_by_index_number",
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
82 "by_header_name",
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
83 "all_but_by_header_name",
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
84 ]:
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
85 c = params["input_options"]["column_selector_options_1"]["col1"]
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
86 else:
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
87 c = None
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
88
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
89 df = pd.read_csv(infile1, sep="\t", header=header, parse_dates=True)
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
90
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
91 X = read_columns(df, c=c, c_option=column_option).astype(float)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
92
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
93 if params["method"] == "predict":
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
94 preds = estimator.predict(X)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
95 else:
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
96 preds = estimator.predict_proba(X)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
97
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
98 # sparse input
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
99 elif input_type == "sparse":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
100 X = mmread(open(infile1, "r"))
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
101 if params["method"] == "predict":
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
102 preds = estimator.predict(X)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
103 else:
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
104 preds = estimator.predict_proba(X)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
105
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
106 # fasta input
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
107 elif input_type == "seq_fasta":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
108 if not hasattr(estimator, "data_batch_generator"):
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
109 raise ValueError(
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
110 "To do prediction on sequences in fasta input, "
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
111 "the estimator must be a `KerasGBatchClassifier`"
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
112 "equipped with data_batch_generator!"
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
113 )
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
114 pyfaidx = get_module("pyfaidx")
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
115 sequences = pyfaidx.Fasta(fasta_path)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
116 n_seqs = len(sequences.keys())
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
117 X = np.arange(n_seqs)[:, np.newaxis]
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
118 seq_length = estimator.data_batch_generator.seq_length
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
119 batch_size = getattr(estimator, "batch_size", 32)
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
120 steps = (n_seqs + batch_size - 1) // batch_size
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
121
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
122 seq_type = params["input_options"]["seq_type"]
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
123 klass = try_get_attr("galaxy_ml.preprocessors", seq_type)
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
124
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
125 pred_data_generator = klass(fasta_path, seq_length=seq_length)
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
126
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
127 if params["method"] == "predict":
11
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
128 preds = estimator.predict(
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
129 X, data_generator=pred_data_generator, steps=steps
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
130 )
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
131 else:
11
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
132 preds = estimator.predict_proba(
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
133 X, data_generator=pred_data_generator, steps=steps
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
134 )
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
135
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
136 # vcf input
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
137 elif input_type == "variant_effect":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
138 klass = try_get_attr("galaxy_ml.preprocessors", "GenomicVariantBatchGenerator")
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
139
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
140 options = params["input_options"]
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
141 options.pop("selected_input")
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
142 if options["blacklist_regions"] == "none":
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
143 options["blacklist_regions"] = None
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
144
11
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
145 pred_data_generator = klass(
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
146 ref_genome_path=ref_seq, vcf_path=vcf_path, **options
0380f10c4e04 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ea12f973df4b97a2691d9e4ce6bf6fae59d57717"
bgruening
parents: 10
diff changeset
147 )
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
148
7
00819b7f2f55 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 756f8be9c3cd437e131e6410cd625c24fe078e8c"
bgruening
parents: 3
diff changeset
149 pred_data_generator.set_processing_attrs()
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
150
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
151 variants = pred_data_generator.variants
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
152
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
153 # predict 1600 sample at once then write to file
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
154 gen_flow = pred_data_generator.flow(batch_size=1600)
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
155
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
156 file_writer = open(outfile_predict, "w")
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
157 header_row = "\t".join(["chrom", "pos", "name", "ref", "alt", "strand"])
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
158 file_writer.write(header_row)
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
159 header_done = False
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
160
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
161 steps_done = 0
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
162
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
163 # TODO: multiple threading
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
164 try:
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
165 while steps_done < len(gen_flow):
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
166 index_array = next(gen_flow.index_generator)
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
167 batch_X = gen_flow._get_batches_of_transformed_samples(index_array)
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
168
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
169 if params["method"] == "predict":
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
170 batch_preds = estimator.predict(
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
171 batch_X,
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
172 # The presence of `pred_data_generator` below is to
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
173 # override model carrying data_generator if there
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
174 # is any.
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
175 data_generator=pred_data_generator,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
176 )
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
177 else:
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
178 batch_preds = estimator.predict_proba(
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
179 batch_X,
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
180 # The presence of `pred_data_generator` below is to
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
181 # override model carrying data_generator if there
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
182 # is any.
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
183 data_generator=pred_data_generator,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
184 )
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
185
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
186 if batch_preds.ndim == 1:
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
187 batch_preds = batch_preds[:, np.newaxis]
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
188
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
189 batch_meta = variants[index_array]
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
190 batch_out = np.column_stack([batch_meta, batch_preds])
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
191
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
192 if not header_done:
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
193 heads = np.arange(batch_preds.shape[-1]).astype(str)
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
194 heads_str = "\t".join(heads)
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
195 file_writer.write("\t%s\n" % heads_str)
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
196 header_done = True
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
197
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
198 for row in batch_out:
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
199 row_str = "\t".join(row)
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
200 file_writer.write("%s\n" % row_str)
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
201
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
202 steps_done += 1
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
203
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
204 finally:
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
205 file_writer.close()
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
206 # TODO: make api `pred_data_generator.close()`
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
207 pred_data_generator.close()
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
208 return 0
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
209 # end input
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
210
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
211 # output
3
963e449636d3 "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ba6a47bdf76bbf4cb276206ac1a8cbf61332fd16"
bgruening
parents: 2
diff changeset
212 if len(preds.shape) == 1:
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
213 rval = pd.DataFrame(preds, columns=["Predicted"])
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
214 else:
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
215 rval = pd.DataFrame(preds)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
216
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
217 rval.to_csv(outfile_predict, sep="\t", header=True, index=False)
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
218
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
219
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
220 if __name__ == "__main__":
2
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
221 aparser = argparse.ArgumentParser()
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
222 aparser.add_argument("-i", "--inputs", dest="inputs", required=True)
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
223 aparser.add_argument("-e", "--infile_estimator", dest="infile_estimator")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
224 aparser.add_argument("-w", "--infile_weights", dest="infile_weights")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
225 aparser.add_argument("-X", "--infile1", dest="infile1")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
226 aparser.add_argument("-O", "--outfile_predict", dest="outfile_predict")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
227 aparser.add_argument("-f", "--fasta_path", dest="fasta_path")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
228 aparser.add_argument("-r", "--ref_seq", dest="ref_seq")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
229 aparser.add_argument("-v", "--vcf_path", dest="vcf_path")
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
230 args = aparser.parse_args()
e18d9b17c322 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit c035d399196b3bef9982db4f8e47331411dbb20e
bgruening
parents:
diff changeset
231
9
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
232 main(
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
233 args.inputs,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
234 args.infile_estimator,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
235 args.outfile_predict,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
236 infile_weights=args.infile_weights,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
237 infile1=args.infile1,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
238 fasta_path=args.fasta_path,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
239 ref_seq=args.ref_seq,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
240 vcf_path=args.vcf_path,
b8c92e94ac1d "planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit e2a5eade6d0e5ddf3a47630381a0ad90d80e8a04"
bgruening
parents: 7
diff changeset
241 )