The SEQUAL framework is systems modellingreference model for evaluating the quality of models. The SEQUAL framework, which stands for "semiotic quality framework" is developed by John Krogstie and others since the 1990s. The SEQUAL framework is a so-called "top-down quality framework", which is based on semiotic theory, such as the works of Charles W. Morris. Building on these theory it "defines several quality aspects based on relationships between a model, a body of knowledge, a domain, a modeling language, and the activities of learning, taking action, and modeling". Its usefulness, according to Mendling et al., was confirmed in a 2002 experiment by Moody et al.
History
The basic idea behind the SEQUAL framework is, that "conceptual models can be considered as sets of statements in a language, and therefore can be evaluated in semiotic/linguistic terms". A first semiotic framework for evaluating conceptual models was originally proposed by Lindland et al. in the 1994 article "Understanding quality in conceptual modeling". In its initial version, it considered three quality levels:
syntactic,
semantic, and
pragmatic quality
The framework was later extended, and called the SEQUAL framework by Krogstie et al. in the 1995 article "Defining quality aspects for conceptual models". in the 2002 article "Quality of interactive models" Krogstie & Jørgensen extended the initial framework adding more levels of Stamper's semiotic ladder.
Model activation, according to John Krogstie, is the process by which a model affects reality. Model activation involves actors interpreting the model and to some extent adjusting their behaviour accordingly. This process can be:
I: What the persons in the audience interpret the model to say
T: What relevant tools interpret the model to say
G: The goals of the modeling
Physical quality
The three main aspects of physical quality are:
Externalization or the question "Is it possible to externalize knowledge by using the model language?",
Internalizability about model persistence and availability, and
Basically or the question "Is the model language able to express the model domain?"
Externalization is presenting the modeller's concept in some model form for others to make sense of it. Other people can have look on it and can discuss. How other people perceives the model is a matter of internalization. After perceiving the model in their own way they can discuss and change their mind accordingly. To make sense others, it is better to have some model language in common. Physical quality refers to the possibility of externalizing models by using model language that should be available and of course in persistence manner to be internalized by audiences. How available is the model to audience? Availability depends on distributability, especially when members of the audience are geographically dispersed. Then, a model which is an electronically distributable format will be more easily distributed than one which must be printed on paper and sent by ordinary mail or fax. It may also matter exactly what is distributed, e.g. the model in an editable form or merely in an output format. How persistent is the model, how protected is it against loss or damage? This also includes previous versions of the model, if these are relevant. E.g. for a model on disk, the physical quality will be higher if there is a backup copy, or even higher if this backup is on another disk whose failure is independent of the originals. Similarly, for models on paper, the amount and security of backup copies will be essential.
Empirical quality
To evaluate empirical quality, the model should be well externalized. Main aspects are:
Ergonomics,
readability,
layout, and
information theory.
Basically empirical quality is about the question "Is the model easily readable?". Empirical quality deals with the variety of elements distinguished, error frequencies when being written or read, coding and ergonomics for Computer-Human Interaction for documentation and modeling-tools. Ergonomics is the study of workplace design and the physical and psychological impact it has on workers. This quality is related to readability and layout. There are different factors that have an important impact on visual emphasis like size, solidity, foreground/background differences, colour,change, position and so on. For graph aesthetics there may be different consideration like angles between edges not be too small, minimize the number of bends along edges, minimize the number of crossings between edges, place nodes with high degree in the centre of the drawing, have symmetry of sons in hierarchies, have uniform density of nodes in the drawing, have verticality of hierarchical structures and so on.
Syntactical quality
Syntactic quality is the correspondence between the model M and the language extension L of the language in which the model is written. Three aspects here are:
Error detection: During a modeling session, some syntactical errors--- syntactic incompleteness --- should be allowed on a temporary basis. For instance, although the DFD language requires that all processes are linked to a flow, it is difficult to draw a process and a flow simultaneously. Syntactical completeness has to be checked upon user's request. So, in contrast to implicit checks where the tool is ``forcing the user to follow the language syntax, explicit check can only detect and report on existing errors. The user has to make the corrections.
Error correction'': to replace a detected error with a correct statement
Semantic quality
What is expressed in the model? The semantic goals of this framework are:
Validity; if all the statements in the model are correct and related to the problem. M\D = Ø
Completeness; if the model contains all relevant and correct statements to solve this problem. D\M = Ø
Perceived semantic quality
Perceived semantic quality is the relation between an actor's interpretation of a model and his/her knowledge of the domain.
Perceived validity I\K = Ø
Perceived completeness K\I = Ø
Pragmatic quality
Pragmatic quality is the correspondence between the model and people's interpretation of it. Comprehension is the only pragmatic goal in the framework. It is very important that people that read the model, understand it. No solution is good if no-one understands it. Pragmatic quality relates to the effect the model have on the participants and the world. Four aspects is treated specifically, that:
the human interpretation of the model is correct relative to what is meant.
the tool interpretation is correct relative to what is meant to be expressed in the model.
the participants learn based on the model.
the domain is changed.
Social quality
The goal for the social quality is agreement. Agreement about knowledge, interpretation and model. Agreement is achieved if perceived semantic quality and comprehension are achieved. There is relative agreement and absolute agreement. For the three agreement parts we can define:
Relative agreement in the three above agreement types; all Knowledge, Interpretation and Model are consistent.
Absolute agreement in the three above agreement types; all Knowledge, Interpretation and Model are equal.
Knowledge quality
Degree of internalization of existing organizational reality.
The language is appropriate to the participants' knowledge of modeling languages
The language appropriate to express the knowledge of the participants
If the language quality is good, it will improve the participants' interpretation and other technical actors' interpretation. For additional detail, see the quality of modelling languages
Organizational quality
The organizational quality of the model relates to:
That all statements in the model contribute to fulfilling the goals of modeling, or Organizational goal validity.
That all the goals of modeling are addressed through the model, or Organizational goal completeness.
Alternative quality framework
An alternative quality framework is the Guidelines of Modeling based on general accounting principles. The framework "include the six principles of correctness, clarity, relevance, comparability, economic efficiency, and systematic design". It was operationalized for Event-driven Process Chains and also tested in experiments Another alternative modelling process quality framework actually based on SEQUAL is the "Quality of Modelling" framework. QoMo is still a "preliminary modelling process oriented, based on knowledge state transitions, cost of the activities bringing such transitions about, and a goal structure for activities-for-modelling. Such goals are directly linked to concepts of SEQUAL".
