A structured method for evaluating visualisation designs
The Critical Design Strategy (CDS) comprises three sequential stages: Overview, Detail, and Review. Each stage guides the appraiser through a structured critique of a visualisation artefact, helping them think critically, reflect deeply, and identify opportunities for design improvement.
The person conducting the critique is the appraiser—often the designer or developer of the visualisation. The subject of critique is the artefact, which might be a sketch, dashboard, interactive tool, physicalisation, or poster. It presents data, is designed for a user, and may involve contributions from multiple roles such as designer and developer.
Sometimes, a single individual performs all these roles—for example, a student may design, implement, and appraise their own visualisation using the CDS.
The first stage helps the appraiser build a deep understanding of the challenge and context, preparing for critique by reviewing the artefact, data, and task. The appraiser then assigns a short name and summarizes the essence of the design. Finally, they select five words from a set of twenty to capture their initial holistic impression.
This stage involves a comprehensive critique across 30 heuristic questions, structured into six key perspectives: User, Environment, Interface, Components, Design, and Visual Marks.
Each question is scored on a Likert scale (from -2 to +2) to represent quality or suitability, and serves as both a reflection guide and evaluation tool. Responses can be compiled into a report or summary of findings.
The final stage focuses on synthesis and reflection. The appraiser calculates an overall score (e.g., average of Likert scores), revisits initial impressions, and evaluates strengths and weaknesses across the six perspectives.
Based on this reflection, the appraiser identifies next steps – such as redesigning, refining layout or interface, or planning usability testing or user feedback. This stage ensures insights are actionable and valuable for improving the artefact.
Instructors can integrate CDS into lectures, workshops, and peer review sessions, using it to guide discussion and encourage constructive critique. Over time, students develop a more nuanced understanding of design trade-offs, gain confidence in articulating feedback, and learn to make more deliberate design decisions.
The Critical Design Strategy (CDS) is more than a critique checklist – it is a structured thinking aid designed to help learners engage deeply with their own and others’ visualisation work. In teaching, it can be used both as a formative exercise during project development and as a summative reflection at the end of a task.
In the first stage, students select their own dataset, analyse it, and conduct a design study (for example, using the Five Design Sheets method – cf. FdS website, Book, Paper). They then apply the CDS to their initial designs to evaluate their suitability, identify strengths, and highlight potential weaknesses.
In the second stage, students develop and implement an appropriate visualisation solution for their data. They perform a self-evaluation of their final output using the CDS, and present their findings as a technical report. This report should include the CDS results, organised into the three main stages, with detailed discussion across the six perspectives of the second stage.
Students can also use the CDS as a structured framework within larger project work, particularly when developing a new visualisation tool or artefact.
In a project-based context, the CDS can be applied throughout the design and development process — from the initial concept through to the final evaluation. A typical workflow might proceed as follows:
Using the CDS in this way embeds critical thinking throughout the project lifecycle. Rather than serving as a one-off evaluation tool, it becomes a mechanism for continuous design reflection — helping students identify strengths, uncover weaknesses, and make informed decisions that lead to more effective, user-focused visualisations.
In industry, the CDS can be used as part of a professional design and development workflow to evaluate visualisation products before deployment. This is especially valuable in settings where the visualisation is a core component of a business tool — for example, dashboards for business intelligence, interactive analytics platforms, or data-driven client presentations.
A commercial project might proceed as follows:
By integrating the CDS into commercial workflows, organisations can ensure that their visualisation products are not only technically functional but also strategically aligned with business goals, easy to interpret, and engaging for their intended audience.