Conclusion¶
RQ1: What is the history of the ELIXIR evaluation questions?¶
The ELIXIR student evaluation is based on two evaluations. Neither evaluation describes (1) how its questions were developed, (2) by which criteria the best questions were selected.
From these two questionnaires, some (but not all) questions were selected to be put in the ELIXIR evaluation. Additionally, ELIXIR added new questions, regarding student satisfactions. The criteria for neither not copying questions for the earlier questionnaires, not for adding adding questions were not written down.
As none of these evaluations describe the process on how questions were developed, it comes as no surprise that neither evaluation refers to evidence-based best practices in the literature.
RQ2: How does the academic literature relate to the ELIXIR evaluation questions?¶
The mandatory ELIXIR evaluation questions with the goal of evaluating course quality have the following relation to the academic literature
| Question | Relation to the literature |
|---|---|
| 5 | None found |
| 6 | None found |
| 7 | One paper which states that this question is suitable to assess course quality |
| 8 | Many papers, including a meta-analysis that this question is unsuitable to assess course quality |
| 9 | None found |
RQ3: Which ELIXIR evaluation questions are concluded from a fully transparent process?¶
TODO
RQ4: How different are the newly suggested questions from the current ones?¶
TODO