5. Conclusion¶
5.1. RQ1: What is the history of the ELIXIR evaluation questions?¶
The ELIXIR student evaluation is based on two evaluations. Neither evaluation describes (1) how its questions were developed, (2) by which criteria the best questions were selected.
From these two questionnaires, some (but not all) questions were selected to be put in the ELIXIR evaluation. Additionally, ELIXIR added new questions, regarding student satisfactions. The criteria for neither not copying questions for the earlier questionnaires, not for adding adding questions were not written down.
As none of these evaluations describe the process on how questions were developed, it comes as no surprise that neither evaluation refers to evidence-based best practices in the literature.
5.2. RQ2: How does the academic literature relate to the ELIXIR evaluation questions?¶
The mandatory ELIXIR evaluation questions with the goal of evaluating course quality have the following relation to the academic literature
| Index | Question | Connection to the academic literature |
|---|---|---|
| 5 | Have you used the tools/resource(s) covered in the course before? | None found |
| 6 | Will you use the tools/resource(s) covered in the course again? | None found |
| 7 | Would you recommend the course? | One paper which states that this question is suitable to assess course quality |
| 8 | What is your overall rating for the course? | Many papers, including a meta-analysis that this question is unsuitable to assess course quality |
| 9 | May we contact you by email in the future for more feedback? | None found |
5.3. RQ3: Which ELIXIR evaluation questions are concluded from a fully transparent process?¶
TODO
5.4. RQ4: How different are the newly suggested questions from the current ones?¶
TODO