This is a sortable version of Table2 from The timing mega-study: comparing a range of experiment generators, both lab-based and online
Timing summaries of lab-based software by package and platform. The Var(iability) measures are the inter-trial standard deviations of the various latencies for that configuration. The table is sorted by the mean of those variabilities (Mean Var). The Lag/Bias measures are the mean latency values, for that configuration. In the case of audiovisual sync, a negative bias indicates the audio lead the visual stimulus, a positive bias means the visual lead the audio. Each of the values with a hyperlink will lead to a plot of the distribution of values leading to that summary value.
Click the headers to sort the table.
The first time you click, the sorting direction is ascending (A to Z).
Click again, and the sorting direction will be descending (Z to A):
| Package | Platform | Mean Precision | RT var | RT lag | Visual duration var | Visual duration bias | Visual onset var | Visual onset bias | Audio var | Audio lag | Audiovisual var | Audiovisual bias |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PsychToolBox | Ubuntu | 0.18 | 0.31 | 12.30 | 0.15 | 2.05 | 0.18 | 4.53 | 0.17 | -0.74 | 0.11 | -5.27 |
| Presentation | Win10 | 0.29 | 0.35 | 11.48 | 0.23 | -1.83 | 0.34 | 7.07 | 0.31 | 0.56 | 0.19 | -6.51 |
| PsychToolBox | MacOS | 0.39 | 0.44 | 22.27 | 0.12 | -2.15 | 0.41 | 21.52 | 0.53 | 0.09 | 0.43 | -21.43 |
| PsychoPy | Ubuntu | 0.46 | 0.31 | 8.43 | 1.19 | 3.49 | 0.34 | 4.71 | 0.31 | -0.71 | 0.16 | -5.43 |
| E-Prime | Win10 | 0.57 | 0.53 | 9.27 | 0.18 | 2.51 | 0.18 | 4.41 | 0.98 | 5.08 | 0.97 | 0.67 |
| PsychToolBox | Win10 | 0.67 | 0.42 | 10.49 | 0.75 | 2.24 | 0.19 | 4.56 | 0.99 | 0.77 | 0.98 | -3.79 |
| PsychoPy | Win10 | 1.00 | 0.35 | 12.05 | 2.42 | -1.97 | 0.35 | 7.10 | 0.96 | 0.85 | 0.93 | -6.25 |
| PsychoPy | MacOS | 2.75 | 0.40 | 22.02 | 11.56 | 1.00 | 0.55 | 18.24 | 0.70 | 0.54 | 0.52 | -17.70 |
| Open Sesame | MacOS | 3.14 | 0.54 | 21.21 | 1.65 | 18.94 | 0.79 | 18.10 | 6.40 | 9.46 | 6.30 | -8.64 |
| Open Sesame | Ubuntu | 3.41 | 0.45 | 9.68 | 9.16 | 32.29 | 0.50 | 2.35 | 3.45 | 2.05 | 3.48 | -0.30 |
| Open Sesame | Win10 | 4.02 | 1.22 | 8.27 | 1.12 | 17.04 | 0.72 | 3.85 | 8.56 | 47.24 | 8.50 | 43.39 |
| Expyriment | Win10 | 6.22 | 2.90 | 10.76 | 0.55 | -0.08 | 0.19 | 5.98 | 13.72 | 106.83 | 13.72 | 100.85 |
| Expyriment | Ubuntu | 7.75 | 2.73 | 23.45 | 8.31 | 12.08 | 0.73 | 16.75 | 13.49 | 118.67 | 13.50 | 101.92 |
| Expyriment | MacOS | 9.05 | 4.84 | 33.83 | 7.04 | -1.13 | 4.82 | 29.02 | 13.84 | 42.81 | 14.72 | 13.79 |
