Judging Criteria: Points Rubric
We’re not expecting a full blown solution to any aspect of the challenge (though high marks if you can do it!). Here’s what our judges will be looking for on a scale of 1-5, with 5 being the highest score:
Criteria | Level 1 | Level 2 | Level 3 | Level 4 | Level 5 | Team Score |
Comprehensiveness (How many of the challenges the solution addresses) | The solution addresses one of the challenges | The solution addresses two of the challenges | The solution addresses three of the challenges | The solution addresses four of the challenges | The solution addresses all challenges comprehensively |
|
Context and Relevance (How well the solution demonstrates an understanding of the use case, the context of the use case | The context and relevance of the solution is not clearly presented or demonstrates a lack of understanding.
| The context and relevance of the solution is somewhat clear.
| The solution demonstrates an adequate level of understanding about the context(s) of the use case and the relevance of the solution as a response the to the use case challenge.
| The context and relevance of the solution is clearly presented, and demonstrates a good understanding of the technical, data/records, and social contexts of the solution. References to appropriate background documents relevant to the contexts of the solution are cited in the submission.
| The context and relevance of the solution is clearly presented, and demonstrates an excellent and sophisticated understanding of the technical, data/records, and social contexts in which the solution must be implemented. It is evident that background research on the contexts of the solution has been undertaken by the team. |
|
Economic & Social Benefit (How well the solution demonstrates economic and social benefit) | Proposed solution does not address its economic and social benefits. | Proposed solution somewhat addresses its economic and social benefits. | Proposed solution adequately addresses its economic and social benefits. | Proposed solution elegantly addresses its economic and social benefits, making a solid case for the solution design in relation to these benefits. | Proposed solution elegantly addresses economic and social benefits, making a very strong case for the solution design in relation to these benefits. |
|
Security & Privacy | The solution overlooks security & privacy considerations. | The team solution somewhat considers security & privacy considerations. Privacy & security appear to be afterthoughts. | The team solution clearly and effectively incorporates security & privacy considerations. | The team solution clearly and effectively incorporates security & privacy considerations to a high standard. | The team solution clearly and effectively incorporates security & privacy considerations to a very high standard. |
|
Usability & Convenience (How usable the solution is in relation to standard software usability criteria, such as intuitive design, ease of learning, efficiency of use, memorability, error frequency and severity, subjective satisfaction etc.) | The solution does not address usability & convenience. | The solution gives only a passing nod to usability and convenience. Usability & convenience appear to be afterthoughts. | The solution demonstrates a reasonable level of thought about usability & convenience. The discussion of these elements is convincing. | The solution demonstrates careful attention to usability & convenience. | The solution demonstrates careful and sophisticated attention to usability & convenience, and references authoritative supporting or background documents. |
|
Feasibility (How relatively easy the solution would be to implement from an operational, technical, legal, social and economic perspective) | The solution is impractical. | The solution is not feasible in the current context, but could be with some changes. | The solution is feasible in relation to one aspect of the operational, technical, legal, social or economic context, but would require adjustment to be feasible along the other dimensions. | The solution is feasibility in relation to more than one aspect of the operational, technical, legal, social or economic context, but would require adjustment to be feasible along the other dimensions. | The solution is feasible in along all dimensions. |
|
Creativity & Presentation (How creative the solution is, and how engaging the final presentation on the solution is, including how clearly and succinctly it conveys the highlights of the use case(s) and how the design addresses the above criteria as a solution to the use case problems) | The design solution does not demonstrate a significantly new approach.
The team presentation does not effectively tell the story about how their solution will solve pain points. | The design solution demonstrates an incrementally new approach.
The team presentation somewhat tells the story about how their solution will solve pain points. | The design solution is somewhat novel and demonstrates creative thinking.
The team presentation clearly and effectively tells the story about how their solution will solve pain points. The presentation is needs a little more polish but is otherwise very good. | The design solution is novel and demonstrates creative thinking.
The team presentation clearly and effectively tells the story about how their solution will solve pain points. The presentation is polished. | The design solution is very innovative and demonstrates a high degree of creativity.
The team presentation clearly and effectively tells the story about how their solution will solve pain points. The presentation is very professionally presented. |
|