-
Notifications
You must be signed in to change notification settings - Fork 27
/
Copy pathresults.txt
92 lines (81 loc) · 7.2 KB
/
results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
+-------------------+-----------------+---------------+-----------------+---------------+
| Method/Model | SSD | MAD | PRD | COS_SIM |
+-------------------+-----------------+---------------+-----------------+---------------+
| FIR Filter | 47.464 (88.496) | 0.676 (0.572) | 66.158 (22.104) | 0.692 (0.216) |
| IIR Filter | 35.645 (70.189) | 0.594 (0.532) | 61.125 (23.220) | 0.736 (0.208) |
| DRNN | 6.702 (11.316) | 0.480 (0.340) | 50.035 (24.802) | 0.878 (0.126) |
| FCN-DAE | 10.633 (14.417) | 0.598 (0.381) | 94.504 (70.717) | 0.770 (0.171) |
| Vanilla L | 13.623 (16.365) | 0.538 (0.298) | 83.997 (29.832) | 0.728 (0.137) |
| Vanilla NL | 7.810 (11.795) | 0.431 (0.303) | 63.294 (35.386) | 0.845 (0.121) |
| Multibranch LANL | 6.772 (10.553) | 0.403 (0.291) | 58.389 (30.311) | 0.864 (0.114) |
| Multibranch LANLD | 5.203 (7.915) | 0.386 (0.283) | 50.445 (29.598) | 0.897 (0.097) |
+-------------------+-----------------+---------------+-----------------+---------------+
+-------------------+------------------------+--------------------+
| Method/Model | training(GPU) h:m:s:ms | test(GPU) h:m:s:ms |
+-------------------+------------------------+--------------------+
| FIR Filter | 0 | 2:38:08.188255 |
| IIR Filter | 0 | 0:00:26.014481 |
| DRNN | 1:42:35.872811 | 0:03:34.495191 |
| FCN-DAE | 0:29:49.862431 | 0:00:10.196534 |
| Vanilla L | 0:18:56.154461 | 0:00:04.462464 |
| Vanilla NL | 0:26:10.944233 | 0:00:04.523844 |
| Multibranch LANL | 1:58:31.669586 | 0:00:18.913845 |
| Multibranch LANLD | 1:55:29.519425 | 0:00:19.145996 |
+-------------------+------------------------+--------------------+
* For FIR and IIR Filters is CPU since scipy filters are CPU based implementations
###########################################################
Printing Table for different noise values on the SSD metric
+-------------------+-------------------+-------------------+-------------------+-------------------+
| Method/Model | 0.2 < noise < 0.6 | 0.6 < noise < 1.0 | 1.0 < noise < 1.5 | 1.5 < noise < 2.0 |
+-------------------+-------------------+-------------------+-------------------+-------------------+
| FIR Filter | 7.162 (9.485) | 22.542 (30.795) | 51.381 (72.620) | 95.983 (134.621) |
| IIR Filter | 5.615 (7.508) | 17.262 (25.049) | 38.334 (58.050) | 71.980 (107.880) |
| DRNN | 4.000 (7.437) | 4.932 (6.652) | 7.016 (10.971) | 10.031 (15.665) |
| FCN-DAE | 7.396 (8.032) | 8.638 (8.247) | 10.929 (12.883) | 14.586 (21.429) |
| Vanilla L | 8.346 (8.954) | 10.183 (8.220) | 14.083 (14.400) | 20.185 (23.905) |
| Vanilla NL | 4.356 (7.463) | 6.140 (7.126) | 8.489 (11.492) | 11.267 (16.273) |
| Multibranch LANL | 3.282 (5.020) | 5.002 (5.686) | 7.325 (9.769) | 10.476 (15.421) |
| Multibranch LANLD | 2.401 (3.419) | 3.816 (4.771) | 5.717 (7.781) | 8.078 (11.104) |
+-------------------+-------------------+-------------------+-------------------+-------------------+
###########################################################
Printing Table for different noise values on the MAD metric
+-------------------+-------------------+-------------------+-------------------+-------------------+
| Method/Model | 0.2 < noise < 0.6 | 0.6 < noise < 1.0 | 1.0 < noise < 1.5 | 1.5 < noise < 2.0 |
+-------------------+-------------------+-------------------+-------------------+-------------------+
| FIR Filter | 0.280 (0.183) | 0.510 (0.337) | 0.759 (0.513) | 1.045 (0.713) |
| IIR Filter | 0.248 (0.171) | 0.449 (0.322) | 0.666 (0.487) | 0.918 (0.676) |
| DRNN | 0.390 (0.286) | 0.432 (0.273) | 0.496 (0.330) | 0.576 (0.409) |
| FCN-DAE | 0.480 (0.278) | 0.532 (0.301) | 0.617 (0.369) | 0.727 (0.474) |
| Vanilla L | 0.476 (0.240) | 0.499 (0.245) | 0.544 (0.279) | 0.616 (0.371) |
| Vanilla NL | 0.319 (0.220) | 0.377 (0.224) | 0.453 (0.289) | 0.544 (0.381) |
| Multibranch LANL | 0.291 (0.196) | 0.346 (0.207) | 0.423 (0.274) | 0.521 (0.376) |
| Multibranch LANLD | 0.293 (0.214) | 0.341 (0.222) | 0.401 (0.270) | 0.483 (0.351) |
+-------------------+-------------------+-------------------+-------------------+-------------------+
###########################################################
Printing Table for different noise values on the PRD metric
+-------------------+-------------------+-------------------+-------------------+-------------------+
| Method/Model | 0.2 < noise < 0.6 | 0.6 < noise < 1.0 | 1.0 < noise < 1.5 | 1.5 < noise < 2.0 |
+-------------------+-------------------+-------------------+-------------------+-------------------+
| FIR Filter | 42.673 (15.504) | 61.370 (18.213) | 73.491 (17.577) | 81.627 (15.250) |
| IIR Filter | 38.653 (15.668) | 55.867 (19.482) | 67.972 (19.714) | 76.644 (18.290) |
| DRNN | 40.298 (19.983) | 45.582 (21.936) | 52.317 (24.336) | 59.312 (27.389) |
| FCN-DAE | 76.445 (41.696) | 86.350 (56.163) | 98.331 (68.010) | 112.012 (94.656) |
| Vanilla L | 78.794 (34.009) | 81.750 (31.087) | 85.538 (28.114) | 88.451 (25.793) |
| Vanilla NL | 46.274 (25.272) | 56.990 (29.432) | 67.685 (34.481) | 77.698 (40.459) |
| Multibranch LANL | 40.644 (16.625) | 51.148 (21.605) | 62.443 (28.551) | 74.496 (36.636) |
| Multibranch LANLD | 34.026 (14.234) | 43.346 (19.925) | 53.777 (27.189) | 66.167 (38.040) |
+-------------------+-------------------+-------------------+-------------------+-------------------+
###########################################################
Printing Table for different noise values on the COS SIM metric
+-------------------+-------------------+-------------------+-------------------+-------------------+
| Method/Model | 0.2 < noise < 0.6 | 0.6 < noise < 1.0 | 1.0 < noise < 1.5 | 1.5 < noise < 2.0 |
+-------------------+-------------------+-------------------+-------------------+-------------------+
| FIR Filter | 0.891 (0.082) | 0.760 (0.149) | 0.637 (0.192) | 0.532 (0.209) |
| IIR Filter | 0.910 (0.074) | 0.800 (0.143) | 0.690 (0.191) | 0.589 (0.217) |
| DRNN | 0.926 (0.070) | 0.906 (0.084) | 0.871 (0.122) | 0.824 (0.167) |
| FCN-DAE | 0.844 (0.110) | 0.807 (0.136) | 0.757 (0.167) | 0.692 (0.205) |
| Vanilla L | 0.802 (0.108) | 0.764 (0.113) | 0.711 (0.128) | 0.654 (0.145) |
| Vanilla NL | 0.916 (0.062) | 0.875 (0.086) | 0.829 (0.115) | 0.778 (0.146) |
| Multibranch LANL | 0.931 (0.048) | 0.896 (0.072) | 0.852 (0.105) | 0.796 (0.145) |
| Multibranch LANLD | 0.948 (0.042) | 0.921 (0.064) | 0.888 (0.093) | 0.844 (0.124) |
+-------------------+-------------------+-------------------+-------------------+-------------------+