Next Article in Journal
Effect of Landscape Elements on the Symmetry and Variance of the Spatial Distribution of Individual Birds within Foraging Flocks of Geese
Next Article in Special Issue
A Rough Hybrid Multicriteria Decision-Making Model for Improving the Quality of a Research Information System
Previous Article in Journal
Calculation of Limit Support Pressure for EPB Shield Tunnel Face in Water-Rich Sand
Previous Article in Special Issue
An Adaptive Routing-Forwarding Control Scheme Based on an Intelligent Fuzzy Decision-Making System for Opportunistic Social Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of the Orientation of the Ordered Fuzzy Assessment on the Simple Additive Weighted Method

1
Department of Investment and Real Estate, Poznań University of Economics and Business, 61-875 Poznań, Poland
2
Faculty of Economy and Management, University of Bialystok, 15-062 Bialystok, Poland
3
Institute of Finance, WSB University in Poznań, 61-895 Poznań, Poland
*
Author to whom correspondence should be addressed.
Submission received: 28 July 2019 / Revised: 17 August 2019 / Accepted: 21 August 2019 / Published: 2 September 2019
(This article belongs to the Special Issue Multi-Criteria Decision Aid methods in fuzzy decision problems)

Abstract

:
We examine some aspects of the use of Simple Additive Weighting method to evaluate decision alternatives. Decision alternative attributes may be evaluated by verbal assessments which by their nature are imprecise. This means that for the purposes of Simple Additive Weighting method, any verbal assessment is represented by a fuzzy number being an imprecise approximation of a number. In this paper, all verbal assessments are represented by ordered fuzzy numbers. This approach is justified in the way that any ordered fuzzy number is additionally equipped with orientation, i.e., information about the location of the approximated number. The family of all ordered fuzzy numbers is divided into centrally symmetric families of positively oriented fuzzy numbers and of negatively oriented fuzzy numbers. The main purpose of this paper is to examine the consequences of omitting orientation of criterion ratings. We restrict all considerations to the case of trapezoidal oriented fuzzy numbers. We prove the mathematical theorem that an orientation omission can result in an increase in risk when choosing the right decision alternative. We study an empirical example of the Simple Additive Weighting method application to rank some negotiation offers. From the discussion, it follows that an orientation omission results in an increase in risk.

Graphical Abstract

1. Introduction

Arrangement of decision alternatives is necessary for any rational decision-making process. Therefore, decision alternatives are ordered before making the actual decision. Because decision alternatives are characterized by various attributes, multi-criteria techniques are useful for ordering these alternatives [1]. The decision alternatives are ordered with the use of a chosen multi-criteria technique which takes into account the decision-maker’s preferences with respect to all given issues as well as their relative importance. Among the different multi-criteria techniques, we have some scoring techniques which determine a ranking of decision alternatives as order of assigned scoring values. The most popular scoring techniques are:
  • The Simple Additive Weighting method (SAW) [2,3];
  • Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) [4].
The SAW method is also known as the Simple Multi Attribute Rating Technique [2,3].
In real decision-making problems, the criteria are usually assessed in a qualitative form. This implies the linguistic approach for decision assessing. Then, any criterion is evaluated by linguistic values which are words or sentences in a natural language. Therefore, the meaning of any linguistic value is imprecise. For these reason, linguistic values may be represented with use of fuzzy set theory [5,6,7]. In line with suggestions given in [8], any criterion evaluation is approximated by some kind of imprecise number.
A commonly used model of an imprecise number is fuzzy number (FN) [9]. An important disadvantage of FN theory is that subtraction of FNs is the inverse operator to addition of FNs. The notion of OFN is proposed by Kosiński et al [10] as a model of such an imprecise number that subtraction of OFNs is the inverse operator to addition of OFNs. Therefore, OFNs can help with the interpretation of specific improper fuzzy arithmetic results. The major drawback of Kosiński’s theory is the existence of OFNs which are not linked to any membership function [11]. Therefore, the Kosiński’s theory is revised in [12]. From the point-view of symmetry theory, the space of all OFNs may be considered as centrally symmetric closure of an isomorphic image of the space of all FNs.
Any criteria may be valued by OFNs. The main goal of our article is to examine the impact of criteria ranking orientation on a decision-making process. Thus we focus on such scoring techniques which use scoring function with arguments’ values given by OFNs.
To our best knowledge, OFNs are so far only used in the scoring functions describing the SAW method or TOPSIS [13]. In TOPSIS, we always used a scoring function valued with crisp real numbers. For this reason, the values of the TOPSIS scoring function always are ordered in a natural way like real numbers. Thanks to this, if we order decision alternatives with the use of TOPSIS then the obtained arrangement is independent of the orientation of values of scoring function arguments. On the other hand, the SAW scoring method uses a weighted average of criterion ratings. Therefore, if arguments of SAW scoring function are valued by OFNs then any SAW scoring function is also valued by OFNs. Only then we can obtain a decision alternatives arrangement which may be dependent on an orientation of values of scoring function arguments. Thus, our focus should be restricted to effects of applications of the SAW method equipped with scoring function determined for argument valued by OFN.
The basic SAW method is related to scoring function with arguments evaluated by real numbers. The fuzzy SAW method is introduced by Chou and Chang [8] in such way that each argument of scoring function is valued by Trapezoidal FN (TrFN). This proposition is justified in this way that TrOFNs are more realistic representation of linguistic assessments. For the needs of the scoring negotiation offers, Roszkowska and Kacprzak [13] tentatively introduced the Oriented Fuzzy SAW (OF-SAW) with arguments of scoring function valued by trapezoidal OFN (TrOFN). The replacement of TrFN by TrOFN is justified by the fact that TrOFNs contain more information than TrFN. In [14], the OF-SAW method is modified in a way that is compatible with revised theory of OFNs [12]. In [15] it is justified that the OF-SAW method equipped with the fuzzy initial preorder is significantly better than the OF-SAW methods equipped with any crisp initial preorder outlined with the use of any defuzzification method. There it is shown that the use of defuzzification procedures can totally blur the true picture of a real order of decision alternatives. So, we should avoid the defuzzification stage in ordering decision alternatives.
Summing up, since the main goal of our paper is to examine the impact of criteria ranking orientation on a decision-making process, our focus will be on the OF-SAW equipped with fuzzy initial preorder. In this way, we can compare linguistically evaluated decision alternatives without losing information about the imprecision and orientation of linguistic evaluation. This approach is more realistic.
This paper is organized as follows. Section 2 describes the elements of fuzzy sets theory. We restrict our considerations to the case of TrOFNs. There, FNs, TrFNs, OFNs, TrOFNs, disorientation map, and fuzzy order relations between TrFNs or between TrOFNs are discussed. Moreover, the central symmetry phenomenon of the space of all TrOFNs is explained there. The OF-SAW method equipped with fuzzy initial preorder is presented in Section 3. In Section 4, we discuss disorientation impact on ordering of decision alternatives. Original mathematical theorems show that an orientation omission can result in increase in risk of choosing the right decision alternative. Section 5 presents here some new results obtained for the example of the OF-SAW empirical application for ranking negotiation offers. Here we study the effects of replacing the oriented criteria raking with a disoriented one. In with way we show that an orientation omitting causes noticeable increase in risk burdening the decision making process. Section 6 contains final conclusions. For the convenience of readers, all acronyms used are defined in Nomenclature section. Appendix A and Appendix B contain full proofs of applied original mathematical theorems. Appendix C presents membership functions of initial preorders considered in Section 5.

2. Elements of Fuzzy Sets Theory

Let X be given space of all considered states. The symbol ( X ) denotes the family of all crisp sets in the space X . Any precise information about considered states may be described by crisp set A ( X ) .
A fuzzy subset A X is determined as the set of ordered pairs
A = { ( x , μ A ( x ) ) : x X }
where μ A [ 0 , 1 ] X is its membership function. Multi-valued logic interprets the membership function in this way that each value μ A ( x ) is equal to the ‘truth value’ of the sentence x A . The symbol ( X ) denotes the family of all fuzzy subsets of the space X . Any imprecise information about considered states may be described by fuzzy set A ( X ) .
Basic set theory operations and relations are defined in the usual way, suggested by Zadeh [16]. Among other things, we have here the inclusion relation
{ x X :   μ A ( x ) μ B ( x ) } A B
After Klir [17] we understand ambiguity as a lack of an explicit recommendation between one alternative amongst various others. Therefore, if condition (2) is met then we say that the fuzzy set B is more ambiguous than the fuzzy set A .
For any fuzzy set A ( X ) we can distinguish its support S ( A ) ( X ) , determined as follows:
S ( A ) = { x X :   μ A ( x ) > 0 } .

2.1. Fuzzy Numbers

An usually applied model of imprecise number is a fuzzy number (FN) which is most generally defined as a some kind of a fuzzy set in the real line [9]. In the fuzzy SAW method [8], the FN applications are restricted to following their kind.
Definition 1.
For any non-decreasing sequence   ( a , b , c , d ) , the trapezoidal FN (TrFN) is the fuzzy set T = T r ( a , b , c , d ) ( ) determined by its membership functions μ T [ 0 , 1 ] as follows:
μ T ( x ) = μ T r ( x | a , b , c , d ) = {   0 ,                       x [ a , d ] , x a b a ,                     x [ a , b [ , 1 ,                         x [ b , c ] , x d c d ,                     x ] c , d ] .
We denote the space of all TrFNs by the symbol F T r . The TrFN T r ( a , a , a , a ) = represents the crisp number a . In this way we get F T r . For any z [ b , c ] , TrFN T r ( a , b , c , d ) is a formal model of linguistic variable “about z ”.
Let us take into account any arithmetic operation defined on . By we denote an extension of arithmetic operation to F T r . In [9], arithmetic operations on FN are introduced with use of the Zadeh’s Extension Principle. In line with it, for any pair ( K , ) F T r 2 represented by their membership functions μ K , μ L [ 0 , 1 ] , the FN = K is described by its membership function μ M [ 0 , 1 ] determined by means of the identity:
μ M ( z ) = sup { min { μ K ( x ) , μ L ( y ) } :   z = x y , ( x , y ) } .
In line with above, the dot product and the sum determined on F T r are given as follows
β T r ( a , b , c , d ) = { T r ( β · a , β · b , β · c , β · d )           β 0 , T r ( β · d , β · c , β · b , β · a )           β < 0 .
T r ( a , b , c , d ) T r ( e , f , g , h ) = T r ( a + e , b + f , c + g , d + h )
All above arithmetic operations are executed in the standard order. Moreover, let us note that
T r ( a , b , c , d ) T r ( e , f , g , h ) e a f b c g d h
We can argue about these TrFNs, that T r ( e , f , g , h ) is more ambiguous than T r ( a , b , c , d ) .

2.2. Ordered Fuzzy Numbers

The notion of OFN is intuitively introduced by Kosiński [10] as a model of such an imprecise number that the subtraction of OFNs is the inverse operator to the addition of OFNs. Therefore, OFNs can contribute to specific problems concerning the solution of fuzzy linear equations of the form or help with the interpretation of specific improper fuzzy arithmetic results. The main disadvantage of Kosiński’s theory is the existence of OFNs which cannot be linked to any membership function [11]. For this reason, the Kosiński’s theory is revised in [12]. Due to high complexity of arithmetic operations, an application of OF-SAW method [13] restricts the use of OFNs only to their kind distinguished below.
Definition 2
[12]. For any monotonic sequence   ( a , b , c , d ) , the trapezoidal ordered fuzzy number (TrOFN) T r ( a , b , c , d ) = T is the pair of the orientation a , d = ( a , d ) and fuzzy subset T ( ) determined explicitly by its membership functions μ T [ 0 , 1 ] as follows
μ T ( x ) = μ T r ( x | a , b , c , d ) = {   0 ,                       x [ a , d ] [ d , a ] , x a b a ,                 x [ a ,   b [ ] b , a ] 1 ,                         x [ b , c ] [ c , b ] x d c d ,                 x ] c , d ] [ d , c [ .
The identity (9) additionally describes numerical intervals in way which is applied in this paper.
The symbol K T r denotes the space of all TrOFNs. Any TrOFN describes an imprecise number with additional information about the location of the approximated number. This information is given as orientation of TrOFN. If a < d then TrOFN T r ( a , b , c , d ) has the positive orientation a , d . For any z [ b , c ] , the positively oriented TrOFN T r ( a , b , c , d ) is a formal model of linguistic variable “about or slightly above z ”. The symbol K T r + denotes the space of all positively oriented TrOFN. If a > d , then TrOFN T r ( a , b , c , d ) has the negative orientation a , d . For any z [ c , b ] , the negatively oriented TrOFN T r ( a , b , c , d ) is a formal model of linguistic variable “about or slightly below z ”. The symbol K T r denotes the space of all negatively oriented TrOFN. If a = d , OFN TrOFN T r ( a , a , a , a ) describes an unoriented number a . Summing up, we see that
K T r = K T r +     K T r .
The arithmetic operations on K T r are not consistent with Zadeh’s Extension Principle. Kosiński [1] formulated the postulate that the subtraction of OFNs is the inverse operator to the addition of OFNs. For this reason, Kosiński [10] introduces the arithmetic operators of dot product for TrOFNs by the identity
β T r ( a , b , c , d ) = T r ( β · a , β · b , β · c , β · d ) .
Then, the unary minus operator on is extended to the minus operator on K T r in the following way
Ψ ( T r ( a , b , c , d ) ) = T r ( a , b , c , d ) = ( 1 ) T r ( a , b , c , d ) = T r ( a , b , c , d ) .
Kosiński defines OFNs addition with use of formulas proven by Goetschel and Voxman [18] for FNs addition. Furthermore, Kosiński [11] have shown that there exists such pair of OFNs that their sum does not exist. Therefore, Kosiński’s addition is replaced by addition defined on K T r by the identity [12]
T r ( a , b ,   c , d ) T r ( p a , q b ,   r c , s d ) = = { T r ( min { p , q } , q ,   r , max { r , s } )                 ( q < r ) ( q = r p s ) T r ( max { p , q } , q ,   r , min { r , s } )                   ( q > r ) ( q = r p > s ) .
In [12], the definition of addition operator is justified in detail. The difference between OFNs is defined in usual way
T r ( a , b , c , d ) T r ( e , f , g , h ) = T r ( a , b , c , d ) ( T r ( e , f , g , h ) ) .
Using (13), we get
T r ( a , b ,   c , d ) T r ( a p , b q , c r , d s ) = = { T r ( min { p , q } , q ,   r , max { r , s } ) ,                 ( q < r ) ( q = r p s ) , T r ( max { p , q } , q ,   r , min { r , s } ) ,                   ( q > r ) ( q = r p > s ) .
All above arithmetic operations are executed in the standard order. In [19] it is proven that the subtraction is the inverse operator for the addition operators . Therefore, we can say that revised theory of OFNs meet the intuitive postulate put forward by Kosiński.
On the other hand, the additive semigroup F T r ,   and the additive semigroup K T r ,   cannot be considered as homomorphic algebraic structures [19]. Therefore, any theorems on FNs cannot automatically extended to the case of OFNs.

2.3. Disorientation Map

For the case a d the membership function of TrFN T r ( a , b , c , d ) is equal to the membership function of TrOFN T r ( a , b , c , d ) . This fact implies the existence of isomorphism Ψ : ( K T r +   ) F T r given for any nondecreasing sequence ( a , b , c , d ) by the identity
T r ( a , b , c , d ) = Ψ ( T r ( a , b , c , d ) ) .
This isomorphism may be extended to the space K T r by disorientation map Ψ = : K T r F T r given by the identity
Ψ = ( K ) = { Ψ ( K )                   K K T r +   R , Ψ ( K )               K K T r .
The disorientation map Ψ = : K T r F T r may be equivalently determined by the identity
Ψ = ( T r ( a , b , c , d ) ) = T r ( min { a , d } , min { b , c } , max { b , c } , max { a , d } ) .
Moreover, it is very easy to check that for any pair ( K , α ) K T r × we have
Ψ = ( α K ) = α Ψ = ( K ) .
Let us examine the disorientation map property that interests us. At the beginning, let’s follow the example below.
Example 1.
We compare the effect of “disorientation before addition” and the effect of “disorientation after addition”. Let us look on the following numerical case
Ψ = ( T r ( 1 , 2 , 3 , 4 ) T r ( 12 , 10 , 8 , 6 ) ) = Ψ = ( T r ( 13 , 12 , 11 , 10 ) ) = T r ( 10 , 11 , 12 , 13 )
Ψ = ( T r ( 1 , 2 , 3 , 4 ) ) Ψ = ( T r ( 12 , 10 , 8 , 6 ) ) = T r ( 1 , 2 , 3 , 4 ) T r ( 6 , 8 , 10 , 12 ) = T r ( 7 , 10 , 13 , 16 )
Figure 1 presents the diagram of the membership functions of above results. We see that we have
Ψ = ( T r ( 1 , 2 ,   3 , 4 ) T r ( 12 , 10 ,   8 , 6 ) )   Ψ = ( T r ( 1 , 2 ,   3 , 4 ) ) Ψ = ( T r ( 12 , 10 ,   8 , 6 ) ) .
In this case, the the sum of disoriented OFNs is more ambigous than disoriented sum of the same OFNs. It implies that the actions of disorientating and additing are not permutable.
The above conclusions can be generalized to the following theorem proven in Appendix A.
Theorem 1.
For any sequences ( K 1 ,   K 2 , , K n ) K T r and ( α 1 ,   α 2 , , α n ) we have
Ψ = ( α 1 K 1 α 2 K 2 α n K n ) α 1 Ψ = ( K 1 ) α 2 Ψ = ( K 2 ) α n Ψ = ( K n ) .
We see that the disorientation map is subadditive.
The space of all TrOFNs may be equivalently defined with use of basic notions of the symmetry theory. We take into account the space F T r of all TrFNs and isomorphism Ψ 1 : F T r L determined by (16). The central symmetric relation is determined by the unary minus operator Φ defined on L by (12). Then space K T r is the centrally symmetric closure of the set Ψ 1 ( F T r ) . This fact may be useful in proving some mathematical theorems about TrOFNs.

2.4. Relation “Greater than or Equal to” for Trapezoidal Fuzzy Numbers

We consider the pair ( K , ) F T r × F T r of TrFNs described by their membership functions μ K , μ L [ 0 , 1 ] . On the set F T r , we determine the relation K . G E .   read as follows:
TrFN   K   is greater than or equal to TrFN  
In agreement with the Zadeh’s Extension Principle, the relation (24) is a fuzzy preorder [ G E ] ( ( F T r ) 2 ) described by its membership function ν [ G E ] [ 0 , 1 ] F T r × F T r given as follows [20]:
ν [ G E ] ( K , ) = sup { min { μ K ( u ) , μ L ( v ) } : u v } .
Theorem 2
[19]. For any TrFNs T r ( a , b , c , d ) ,   T r ( e , f , g , h ) F T r we have
ν [ G E ] ( T r ( a , b , c , d ) ,   T r ( e , f , g , h ) ) = { 0 ,                               0 < a h , a h a + g b h ,             a h 0 < b g , 1 ,                         b g 0 .
The following theorem is proven in Appendix B.
Theorem 3.
( K , , , N ) F T r 4 :   { K   &   N } ν [ G E ] ( K , ) ν [ G E ] ( , N )

2.5. Relation “Greater than or Equal to” for Trapezoidal Oriented Fuzzy Numbers

For any pair ( K , ) ( K T r ) 2 , the symbol K . G E ˜ .   denotes the relation
T r O F N   K   i s   g r e a t e r   t h a n   o r   e q u a l   t o   T r O F N   .
which is introduced in [19]. This relation is a fuzzy preorder G E ˜ ( ( K T r ) 2 ) defined by its membership function ν G E [ 0 , 1 ] ( K T r ) 2 . In [19], it is additionally assumed that any membership function ν G E [ 0 , 1 ] ( K T r ) 2 meets the following well-known conditions:
  • for any pair ( K , ) ( K T r +   ) 2 , the extension principle
    ν G E ( K , ) = ν [ G E ] ( Ψ ( K ) , Ψ ( ) ) ,
  • for any pair ( K , ) ( K T r   ) 2 , the sign exchange law
    ν G E ( K , ) = ν G E ( , K   ) ,
  • for any pair ( K , ) ( K T r +   ) × ( K T r   ) , the law of subtraction of parties of inequality
    ν G E ( K , ) = ν G E ( K , 0 ) .
Theorem 4
[19]. For any pair ( K , ) ( K T r ) 2 we have
ν G E ( K , ) = ν [ G E ] ( Ψ = ( K ) , Ψ = ( ) ) .
Finally, when taken together, we get the dependency
ν [ G E ] ( T r ( a , b , c , d ) ,   T r ( e , f , g , h ) ) = = { 0 ,                                                       0 < min { a , d } max { e , h } , min { a , d } max { e , h } min { a , d } + max { f , g } max { e , h } min { b , c } ,             min { a , d } max { e , h } 0 , < min { b , c } max { f , g } 1 ,                                                         min { b , c } max { f , g } 0 .

3. Oriented Fuzzy SAW vs. Disoriented Fuzzy SAW

In decision-making, we meet situations dealing with imprecision resulting from linguistic assessment of decision alternatives. This assessment is made with use fixed Linguistic Order Scale (LOS) which contains ordered words of natural language. In information science, natural language words are considered as values of related linguistic variable. From the perspective of decision-making processes, the linguistic variable evaluation methodologies are reviewed in [1,21,22,23].
Understanding linguistic variables depends on the applied pragmatics of the natural language. Due this, the semantic meaning of linguistic values may be imprecise. Thus, any linguistic variable can be described by fuzzy sets [5,6,7,8]. In line with suggestions given in [8], any linguistic value is represented by some type of FN. Then, each decision alternative is evaluated with the use of the Numerical Order Scale (NOS) given as a sequence of some type of FNs.
In this paper, we will consider any NOS given as a sequence of TrOFNs. Such NOS is denoted by o-NOS. An example of o-NOS is constructed and justified in [13].
Originally, the SAW method uses a NOS given as a finite subset of positive real numbers. The SAW method was first associated with o-NOS in [13]. In this way, we obtain Oriented Fuzzy SAW (OF-SAW). Then in [14], the OF-SAW method has been adapted to the requirements of the revised OFNs’ theory.
On the other hand, all elements of o-NOS may be disoriented by means of the disorientation map (17). In this way we can obtain disoriented NOS (d-NOS). If we replace o-NOS by d-NOS then by reducing the whole of our analysis to FN. The SAW method associated with d-NOS is denoted by the acronym d-SAW. Using d-SAW method, we evaluate a decision alternative with losing information about the orientation of criterion ratings.
We will compare results obtained by use of OF-SAW method with results obtained by use of d-SAW method. In this way, we will examine impact of NOS orientation on a decision making process.
We consider here a multi-criteria decision-making problem with n evaluation criteria C 1 , C 2 , , C n D and m decision alternatives A 1 ,   A 2 , ,   A m A Y , where Y is an assumed evaluation template. The OF-SAW and d-SAW methods are described by the following procedure:
Procedure 1:
Step 1: Define the set D = { C 1 , C 2 , , C n } of evaluation criteria;
Step 2: Define the weight vector ( w 1 , w 2 , , w n ) ( 0 + ) n fulfilling the condition
w 1 + w 2 + + w n = 1 ,
where weight w j describes the importance of this criterion C j in the evaluation of the alternatives.
Step 3: For each evaluation criterion C j   ( j = 1 , 2 , , n ) , determine its scope Y j ;
Step 4: Determine the evaluation template Y = Y 1 × Y 2 × . × Y n ;
Step 5: Define the o-NOS O K t r ;
Step 6: Define the evaluation function X : Y × D O K t r fulfilling for each ( j = 1 , 2 , , n ) the condition
X ( A , C j )   G E ˜   X ( , C j ) F r o m   t h e   p e r s p e c t i v e   o f   t h e   c r i t e r i o n   C j ,   t h e   d e c i s i o n   a l t e r n a t i v e   A   i s   n o t   w o r s e   t h a n   t h e   d e c i s i o n   a l t e r n a t i v e   . ;
Step 7: Determine the set A = { A 1 ,   A 2 , ,   A m } Y of evaluated decision alternatives;
Step 8: For the OF-SAW method, determine the scoring function s a w : O n K T r given for any as an aggregated evaluation index
s a w ( Z ) = w 1 Z 1 w 2 Z 2 w n Z n ,
where Z = ( Z 1 , Z 2 , , Z n ) O n ;
Step 9: Using OF-SAW method, evaluate each alternative A i A ( i = 1 , 2 , , m ) by a scoring value
S A W ( A i ) = s a w ( X ( A i ) ) ,
where
X ( A i ) = ( X ( A i , C 1 ) , X ( A i , C 2 ) , , X ( A i , C n )   ) O n ;
Step 10: For the d-SAW method, determine the scoring function s a w = : O n F T r given for any as an aggregated evaluation index
s a w = ( Z ) = w 1 Ψ = ( Z 1 ) w 2 Ψ = ( Z 2 ) w n Ψ = ( Z n ) ,
Step 11: Using d-SAW method, evaluate each alternative A i A ( i = 1 , 2 , , m ) by a scoring value
S A W = ( A i ) = s a w = ( X ( A i ) ) .
From Equations (23), (36), and (39), we immediately obtain that
A i A :       Ψ = ( S A W ( A i ) ) S A W = ( A i ) .
It proves that if we omit the information about the orientation of criterion rating then it can increase in the ambiguity of the calculated scoring value.
We understand the term risk as a possibility of negative consequences of performed actions [24,25]. The increase in the scoring value ambiguity suggests a higher number of decision alternatives to choose from. This leads to an increase in the risk of choosing an incorrect alternative from recommended ones. This may result in making a decision, which will be ex post associated with a profit lower than maximal one, that is with a loss of chance. Described risk is called the ambiguity risk. In conclusion, omitting information about criterion rating orientation can result in increase in ambiguity risk when choosing the right alternative.
In the next sections, we will examine in more detail the impact of omission of NOS orientation on a decision-making process.

4. Disorientation Impact on Decisions Ordering

Decision-making consists of choosing exactly one decision alternative. Therefore, every decision made is precise. For this reason, the main goal of the application of any SAW method is to determine crisp partial order A . B E ¯ . , which reads as follows:
The   decision   alternative   A   is   not   worse   than   the   decision   alternative   B .
Let be given the set A = { A 1 ,   A 2 , ,   A m } of decision alternatives. To preserve the generality of our discussion, we will consider generalized SAW (g-SAW) method determined by fixed scoring function γ : A F T r . Each g-SAW method is pre-equipped with the initial preorder given for each pair ( A i , A k ) A 2 by the equivalency
A i . B E ( γ ) . A j γ ( A i ) . G E .   γ ( A k )
The preorder (43) is a fuzzy relation B E ( γ ) ( A 2 ) described by membership function ξ ( · | γ ) [ 0 , 1 ] A 2 given as follows
ξ ( A i , A k | γ ) = ν [ G E ] ( γ ( A i ) , γ ( A k ) ) .
For any nonempty set A ( A ) , we set the best alternative Best ( A | γ ) ( A ) given as follows:
Best ( A | γ ) = { A i A : A k A :   γ ( A i ) . G E . γ ( A k ) }
The best alternative Best ( A | γ ) is described by membership function μ Best ( A ) ( · | γ ) [ 0 , 1 ] A   , given by the identity
μ Best ( A ) ( A i | γ ) = min { ν [ G E ] ( γ ( A i ) , γ ( A k ) ) :   A k A } .
Identity (45) defines the best alternative as an alternative characterized by the maximal value of scoring function γ F T r A . For any A , the support S ( Best ( A | γ ) ) is always nonempty.
In this paper, we study the OF-SAW method pre-equipped with the initial preorder given for each pair ( A i , A k ) A 2 by the equivalency
A i . B E ˜ . A j S A W ( A i ) . G E ˜ .   S A W ( A k ) .
It, together with (32), implies that the preorder (46) is a fuzzy relation B E ˜ ( A 2 ) determined by membership function ϱ [ 0 , 1 ] A 2 given in the following way:
ϱ ( A i , A k ) = ν G E ( S A W ( A i ) , S A W ( A k ) ) = = ν [ G E ] ( Ψ = ( S A W ( A i ) ) , Ψ = ( S A W ( A k ) ) ) = ξ ( A i , A k | Ψ = S A W ) .
It means that the OF-SAW method may be equivalently described as g-SAW method determined by the scoring function ( Ψ = S A W ) F T r A . Then OF-SAW method is equivalently equipped with initial preorder B E ( Ψ = S A W ) . This preorder includes all the gathered information on the imprecision and orientation of linguistic evaluation. Thanks to that, it is the most faithful order of linguistic evaluated alternatives. The fuzzy subset Best ( A | Ψ = S A W ) ( A ) may be used as an imprecise recommendation of the best alternative.
We compare OF-SAW method with d-SAW method which equivalently defined as g-SAW method equipped with scoring function S A W = F T r A . The below theorem describes an important relationship between OF-SAW and d-SAW methods.
Theorem 5.
A ( A ) :   Best ( A | Ψ = S A W ) Best ( A | S A W = )   .
Proof. 
Let the fixed set be given as ( A ) A . For any A i A , the inequalities (27) and (41) imply that
μ Best ( A ) ( A i | Ψ = S A W ) = min { ν [ G E ] ( Ψ = ( S A W ( A i ) ) , Ψ = ( S A W ( A k ) ) ) :   A k A }   min { ν [ G E ] ( S A W = ( A i ) , S A W = ( A k ) ) :   A k A } = μ B e s t ( A ) ( A i | S A W = ) .  
The above theorem confirms our suspicions that omitting orientation of criterion ratings can result in increase in ambiguity risk when choosing the right alternative.
For any g-SAW method, the initial preorder B E ( γ ) ( A 2 ) is applied to determine an induced partial order B E I N D ( γ ) ( A 2 ) . Any induced preorder may be used as order (42). An example of induced partial order is faithful order B E ¯ I N D introduced in [15] for OF-SAW method.
In this section, the faithful order B E ¯ I N D will be generalized for the case of any g-SAW method equipped with a scoring function γ F T r A . Then the generalized faithful order B E ¯ I N D ( γ ) ( A 2 ) is determined with use the following procedure:
Procedure 2:
Step 1: Perform the substitutions k : = 0 , A ( 1 ) : = A ;
Step 2: Perform the substitutions k : = k + 1 ;
Step 3: Perform the substitutions
B ( k ) ( γ ) = S ( B e s t ( A ( k ) | γ ) ) ,
A ( k + 1 ) = A ( k ) \ B ( k ) ( γ ) ;
Step 4: If the condition
A ( k + 1 ) ,
is satisfied then go back to Step 2. Otherwise, go to Step 5.
Step 5: We have a sequence ( B ( k ) ( γ ) ) k = 1 m ( γ ) in which each recommendation A i A belongs only to one set B ( k ) ( γ ) . For any given numbers l > k , the value γ ( A i ) B ( k ) ( γ ) dominates the values γ ( A j ) B ( l ) ( γ ) Thanks to that, any pair ( A i ,   A j ) B ( k ) ( γ ) × B ( l ) ( γ ) is ordered as follows:
l > k   A i .   B E ¯ I N D ( γ ) .   A j ,
k l   A j .   B E ¯ I N D ( γ ) .   A i .
In this way, the partially ordered set ( A , B E ¯ I N D ( γ ) ) is uniquely determined.
Let us notice that for any pair ( A i ,   A j ) B ( k ) ( γ ) × B ( l ) ( γ ) we have
k = l   A i . B E ¯ I N D ( γ ) . A j   a n d   A j . B E ¯ I N D . A i ,
which is denoted as
k = l   A i . E Q ¯ I N D . A j .
For better help audience to understand the modelling this procedure, it is additionally described by flowchart given on Figure 2.
We see that any subset B ( k ) ( γ ) is an equivalence class determined by a partial order B E ¯ I N D ( γ ) . Summing up all the above considerations, the sequence ( B ( k ) ( γ ) ) k = 1 m ( γ ) of equivalence classes uniquely determines the partially ordered set ( A , B E ¯ I N D ( γ ) ) . This approach is especially useful in negotiating problems when each negotiating party uses an opposite order.
In this paper, an amount of information is expressed in bits. A more numerous sequence of equivalence classes sets a more detailed order on the set A of decision alternatives. This means that along with the increase in the number m ( γ ) of elements of the sequence ( B ( k ) ( γ ) ) k = 1 m ( γ ) , the amount of information described by the partially ordered set ( A , B E ¯ I N D ( γ ) ) grows. Therefore, the number m ( γ ) will be used in comparing the individual g-SAW methods equipped with different scoring function γ F T r A . In [15], the same approach was used for comparisons of individual OF-SAW methods with different initial preorder.
The main goal of this chapter is to study the effects of replacing the OF-SAW method by the d-SAW method. In this way, we examine the consequences of omitting information about orientation of criterion ratings. Above it is shown that the OF-SAW method is equivalently represented by the g-SAW method equipped with scoring function ( Ψ = S A W ) F T r A . The d-SAW method may be equivalently defined as g-SAW method with scoring function S A W = F T r A . Moreover, Theorem 5 implies that
m ( Ψ = S A W ) m ( S A W = ) .
It means that omitting orientation of criterion ratings can result in decrease in amount of information described by inducted partial order. This can indirectly impact on a risk burdening the decision-making process.
In the last two sections, we show the possibility that omitting orientation of criterion ratings can result in increase in risk when choosing the right alternative. For this reason, we recommend the partially ordered set ( A , B E ¯ I N D ( Ψ = S A W ) ) as a proper tool for analyzing decision-making alternatives. The order B E ¯ I N D ( Ψ = S A W ) includes all the gathered information on the imprecision and orientation of linguistic evaluation. Therefore, we can say that partial order B E ¯ I N D ( Ψ = S A W ) is the best crisp approximation of real order of considered decision alternatives. Thanks to that, it is the faithful order of linguistically evaluated decision alternatives. In the next section we intend to show the significance of the effects of omitting the orientation of criterion ratings.

5. Case Study

In this section, we consider an example of applications of OF-SAW methods for evaluation of negotiation offers. The considered negotiation problem is fully described by Roszkowska and Kacprzak [13] who tentatively introduced the OF-SAW in scoring negotiation offers. In this way, they determine NOS as a sequence of TrOFNs. In [14], the considered negotiation offers are evaluated by an OF-SAW method which is compatible with the revised theory of OFN [14]. In both papers, initial preorders are crisp partial orders between defuzzified values [26] of scoring function. In this way, we lose a lot of information about evaluated negotiation offers. Thus, in [15], considered negotiation offers are arranged by initial preorder obtained without a defuzzification procedure.
The discussed negotiation problem was determined independently of later studies. This fact raised the credibility of the subsequent case studies. Therefore, in this paper, we will apply a considered negotiation problem for investigating the significance of the effects of omitting the orientation of criterion ratings. In order to accomplish this task, we will evaluate all negotiation offers simultaneously using OF-SAW and d-SAW methods. Comparison of the results obtained by both methods will allow us to evaluate the effects of orientation omitting. To clarify our considerations, all calculations associated with the use of OF-SAW method will be indicated in red. For the same reason, all calculations related to the use of d-SAW method will be indicated in blue.
In this section, all negotiation offers are always evaluated using LOS and o-NOS introduced in [13]. Moreover, using the disorientation map (17), we designate d-NOS. All these ordered scales are presented in Table 1.
Let us consider the negotiation problem introduced in [13]. This negotiation problem is described by decision making task with decision alternatives A j   ( j = 1 , 2 , , m ) given as negotiation packages. There an evaluation criterion is called a negotiation issue.
The Seller takes into account 15 negotiation packages discussed in detail in [13]. All these packages are evaluated with the following negotiation issues:
  • C 1 —unit price expressed in €,
  • C 2 —complaint conditions described verbally,
  • C 3 —time of payment determined in days.
The Seller’s linguistic rating of all negotiations packages is given in Table 2.
Using the content of Table 1, we transform linguistic rating into numeric rating expressed in o-NOS and d-NOS. The results of this transformation are presented in Table 3.
Seller determines the validity of each of the negotiation issues using the following weight vector
w   =   ( 0.6 ,   0.2 ,   0.2 ) .
In the next step, we evaluate all negotiations packages with use OF-SAW and d-SAW methods. All obtained values of scoring function are presented in Table 4.
We observe that the condition (41) is met for any negotiation package A j   ( j = 1 , 2 , , 15 ) . Moreover, for negotiation packages A j   ( j = 1 ,   4 ,   6 ,   7 ,   8 ,   9 ,   10 ,   14 ) we have
Ψ = ( S A W ( A i ) ) S A W = ( A i ) .
It proves that the omitting information about criterion rating orientation noticeably increases ambiguity risk of choosing the right negotiation offer.
The identities (44), (32), and (26), determine the initial preorders B E ( Ψ = S A W ) and B E ( S A W = ) . The membership functions of these preorders are explicitly described in Appendix C. Then we distinguish the set Best ( A | Ψ = S A W ) of the best negotiation packages. In the considered case, this set is crisp one. We have
Best ( A | Ψ = S A W ) = { A 15 } .
In the face of a low number of the set Best ( A | Ψ = S A W ) , we proceed to the determination of induced partial order B E ¯ I N D ( Ψ = S A W ) of negotiation packages. To do so, we use Procedure 2 to determine the following equivalence classes:
{ B ( 1 ) ( Ψ = S A W ) = { A 15 } ,   B ( 2 ) ( Ψ = S A W ) = { A 13 } ,   B ( 3 ) ( Ψ = S A W ) = { A 7 ,   A 14 }     B ( 4 ) ( Ψ = S A W ) = { A 6 } , B ( 5 ) ( Ψ = S A W ) = { A 2 ,   A 8 , A 12 } ,   B ( 6 ) ( Ψ = S A W ) = { A 11 } B ( 7 ) ( Ψ = S A W ) = { A 5 } , B ( 8 ) ( Ψ = S A W ) = { A 3 ,   A 4 } ,   B ( 9 ) ( Ψ = S A W ) = { A 10 } B ( 10 ) ( Ψ = S A W ) = { A 9 } , B ( 11 ) ( Ψ = S A W ) = { A 1 } .  
The sequence ( B ( i ) ( Ψ = S A W ) ) i = 1 11 explicitly determines the partial order B E ¯ I N D ( Ψ = S A W ) which describes the negotiating Seller’s preferences. These preferences are presented in Table 4 by means of tired ranks [27]. In order to highlight the results of our considerations, the rows of Table 4 are ordered by determined partial order.
We will compare partial order B E ¯ I N D ( Ψ = S A W ) with induced partial order B E ¯ I N D ( S A W = ) . Using Procedure 2, we obtain the following equivalence classes:
{ B ( 1 ) ( S A W = ) = { A 15 } , B ( 2 ) ( S A W = ) = { A 6 ,   A 13 , A 14 } ,   B ( 3 ) ( S A W = ) = { A 7 ,   A 8 , A 11 ,   A 12 } B ( 4 ) ( S A W = ) = { A 2 , } , B ( 5 ) ( S A W = ) = { A 3 , A 5 } , B ( 6 ) ( S A W = ) = { A 4 ,   A 9 , A 10 } , B ( 7 ) ( S A W = ) = { A 1 } .
The sequence ( B ( i ) ( S A W = ) ) i = 1 7 explicitly determines the partial order B E ¯ I N D ( S A W = ) described in Table 4 by tired ranks [27]. We notice that for amounts of equivalence classes we get
m ( Ψ = S A W ) = 11 > m ( S A W = ) .
It means that in considered case orientation omitting noticeable decreases the amount of information about negotiating Seller’s preferences. It impacts on a risk burdening the negotiation process.
In considered case, applied tired ranks are not random. Therefore, we cannot use statistical tests for Spearman’s coefficient rho [27]. Nevertheless, we observe that the orders B E ¯ I N D ( Ψ = S A W ) and B E ¯ I N D ( S A W = ) noticeably differ from each other. Look, for example, on the positions of offers A 7 , A 2 and A 11 . We conclude that orientation omitting noticeably blurs the best approximation of a real order of negotiation packages. It significantly increases the hazard of accepting wrong negotiation offer.
Summing up, in the analyzed case, orientation omitting noticeable increases the risk of accepting wrong negotiation offer. In this way, we show that the OF-SAW method is more reliable than d-SAW method.

6. Final Conclusions

In our approach, each decision criterion is evaluated with the use of the predefined o-NOS given as a sequence of TrOFNs. In this paper we evaluate decision alternatives by the OF-SAW method associated with o-NOS. In line with results obtained in [15], our attention was paid to OF-SAW methods equipped with fuzzy initial preorder described by its membership function (48). In Section 3, we justified the view that this preorder is the most faithful order of linguistic evaluation alternatives.
We examined impact of criterion rating orientation on decision-making processes. For this reason, we also took into account d-NOS determined as the sequence of disoriented elements of o-NOS. If we associate a SAW method with d-NOS, then we obtain d-SAW method. Using d-SAW method, we evaluate a decision alternative with losing information about the orientation of criterion ratings. Therefore, comparison of results obtained with OF-SAW with the results obtained by means of d-SAW allowed us to examine the impact orientation omitting on ordering of decision alternatives.
In Section 3, using mathematical deduction we concluded that omitting information about criterion rating orientation can result in increase in risk when choosing the right alternative. This is just an application about the possibility of the impact of the orientation omission on the risk burdening a decision-making process. Nevertheless, this application proves that omitting information about criterion rating orientation does not decrease in decision-maker’s risk.
In Section 4, thanks to the use of mathematical deduction, we confirmed our suspicions that omitting orientation of criterion ratings can result in increase in ambiguity risk when choosing the right alternative. For analogous reasons, we concluded here that orientation omission may result in decrease in amount of information about partial order of decisions alternatives. Of course, it means that orientation omission does not increase in information about arrangement of decision alternatives. It impacts on a risk burdening the negotiation process.
Moreover, in Section 4 we proposed to accept Procedure 2 determining induced order of decision alternatives. This is the same order as the decision alternatives order proposed in [15]. We justified the view that if this induced order is determined with use of OF-SAW method then it is the best approximation of real order of considered decision alternatives. Thanks to that, it is the faithful order of linguistically evaluated decision alternatives.
In Section 5, we considered an example of applications of OF-SAW methods for evaluation of negotiation offers. We applied considered negotiation problem for investigation the significance of the effects of omitting the orientation of criterion ratings. In order to accomplish this task, we evaluated all negotiation offers simultaneously using OF-SAW and d-SAW methods. Comparison of the results obtained by both methods allowed us to evaluate the effects of orientation omitting. We noticed that:
  • omitting information about criterion rating orientation noticeable increases ambiguity risk of choosing the right negotiation offer;
  • the orientation omission noticeable decreases the amount of information about negotiating Seller’s preferences;
  • the orientation omission noticeably blurs the best approximation of a real order of negotiation packages.
So we found the case when the orientation omitting noticeable increases risk burdening decision making process.
Taking into account all the results of our research, we formulate the final conclusion:
  • If we use the OF-SAW method then omitting information about criterion rating orientation significantly increases in risk burdening decision making process.
For this reason, we can say that the OF-SAW associated with o-NOS is significantly better than d-SAW associated with d-NOS. Oriented Numerical Scale cannot be replaced by disoriented Numerical Order Scale.
Obtained in this paper results cannot be automatically generalized to other scoring techniques. It is necessary to undertake separate studies for each technique.
At present, the main disadvantage of OF-SAW method is the lack of well-justified o-NOS that would be empirically verified. Such empirical verification should be carried out for substantively different decision problems. We hope that further research progress on OF-SAW applications will solve this problem.
Further, we should generalize OF-SAW method for the case of imprecise weights which may be applicable in group decision making. We suppose that such imprecise weights will be represented by FN. Then we should to discuss the product TrFN by TrOFN. This is a new original mathematical problem. Its solution is a necessary condition for the correct generalization of the OF-SAW method for imprecise weighing instruments.
It is advisable to undertake research on various orders induced by the OF-SAW method equipped with fuzzy initial preorder. Then we should to propose different procedures determining induced order of decision alternatives. Obtained in this way, induced orders and the faithful order will have to be compared using the methodology used in this work.

Author Contributions

Conceptualization, K.P. and E.R.; methodology, K.P. and E.R.; validation, A.Ł-H.; formal analysis, A.Ł-H.; writing—original draft preparation, K.P.; writing—review and editing, K.P. and A.Ł-H.

Funding

This work was supported by the grant from Polish National Science Center 2016/21/B/HS4/01583.

Acknowledgments

Authors are very grateful to the editor and to the anonymous reviewers for their insightful and constructive comments and suggestions. Using these comments allowed me to improve this article.

Conflicts of Interest

The authors declare no conflict of interest.

Nomenclature

For the convenience of readers, all acronyms used are briefly explained below:
d-NOSdisoriented NOS introduced in Section 3
d-SAWdisoriented SAW method introduced in Section 3
FNFuzzy Number defined in [9]
g-SAWgeneralized SAW method introduced in Section 4
LOSLinguistic Order Scale mentioned in Section 3
NOSNumerical Order Scale mentioned in Section 3
OFNOrdered Fuzzy Number defined in [10]
o-NOSoriented NOS introduced in Section 3
OF-SAWOriented Fuzzy SAW method described in Section 3
SAWSimple Additive Weighting method [2,3]
TrFNTrapezoidal FN determined by its membership function (3)
TrOFNTrapezoidal OFN determined by its membership function (9)

Appendix A

Theorem A1.
For any sequences ( K 1 ,   K 2 , , K n ) K T r and ( α 1 ,   α 2 , , α n ) we have
Ψ = ( α 1 K 1 α 2 K 2 α n K n ) α 1 Ψ = ( K 1 ) α 2 Ψ = ( K 2 ) α n Ψ = ( K n )
Proof. 
Let us consider the sequence ( K 1 ,   K 2 ) = ( T r ( a , b ,   c , d ) , T r ( e , f ,   g , h ) ) K T r × K T r . We will take into account the following cases:
( K 1 ,   K 2 ) ( K T r +   ) × ( K T r +   ) ,
( K 1 ,   K 2 ) K T r × K T r ,
( K 1 ,   K 2 ) ( K T r +   ) × K T r K 1 K 2 K T r +   ,
( K 1 ,   K 2 ) ( K T r +   ) × K T r K 1 K 2 K T r ,
( K 1 ,   K 2 ) K T r × ( K T r +   ) K 1 K 2 K T r +   ,
( K 1 ,   K 2 ) K T r × ( K T r +   ) K 1 K 2 K T r .
In [12] it is shown that for the cases (A2) or (A3) we
K 1 K 2 = T r ( a + e , b + f ,   c + g , d + h ) .
Moreover, from (13) we get:
  • if (A4) or (A6) then
    K 1 K 2 = T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h ,   c + g } ) ,
  • if (A5) or (A7) then
    K 1 K 2 = T r ( max { a + e , b + f } , b + f ,   c + g , min { d + h ,   c + g } ) .
On the other hand, from (18) and (7) we have:
  • if (A2) then
    Ψ = ( K 1 ) Ψ = ( K 2 ) = T r ( a + e , b + f ,   c + g , d + h ) ,
  • if (A3) then
    Ψ = ( K 1 ) Ψ = ( K 2 ) = T r ( d + h , c + g ,   b + f , a + e ) ,
  • if (A4) or (A5) then
    Ψ = ( K 1 ) Ψ = ( K 2 ) = T r ( a + h , b + g ,   c + f , d + e ) ,
  • if (A6) or (A7) then
    Ψ = ( K 1 ) Ψ = ( K 2 ) = T r ( d + e , c + f ,   b + g , a + h ) .
For the case (A2), the identities (A8) and (A11) imply that
Ψ = ( K 1 K 2 ) = T r ( a + e , b + f ,   c + g , d + h ) = Ψ = ( K 1 ) Ψ = ( K 2 ) .
For the case (A3), the identities (A8) and (A12) imply that
Ψ = ( K 1 K 2 ) = T r ( d + h , c + g ,   b + f , a + e ) = Ψ = ( K 1 ) Ψ = ( K 2 ) .
For the case (A4) we get:
b + f c + g ,
b + g b + f ,
c + f c + g ,
a + h a + e ,
a + h b + f ,
d + e d + h ,
d + e c + g .
The inequalities (A20) and (A21) imply that
a + h min { a + e ,   b + f } .
The inequalities (A22) and (A23) imply that
d + e max { d + h ,   c + g } .
Inequalities (8), (A17)–(A19), (A24), and (A25) imply that
T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h } ) T r ( a + h ,   b + g ,   c + f ,   d + e ) .
Finally, from (A19), (18), (A26), and (A13) we have
Ψ = ( K 1 K 2 ) = Ψ = ( T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h } ) ) = = T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h ,   c + g } ) T r ( a + h ,   b + g ,   c + f ,   d + e ) = = Ψ = ( K 1 ) Ψ = ( K 2 ) .
For case (A5) we get
b + f c + g ,
c + g b + g ,
c + f b + f ,
a + h d + h ,
a + h c + g ,
d + e a + e ,
d + e b + f .
The inequalities (A31) and (A32) imply that
a + h min { d + h ,   c + g } .
The inequalities (A33) and (A34) imply that
d + e max { d + h ,   b + f } .
Inequalities (8), (A28)–(A30), (A35), and (A36) imply that
T r ( min { d + h , c + g } , c + g ,   b + f , max { a + e , b + f } ) T r ( a + h ,   b + g ,   c + f ,   d + e ) .
Finally, from (A19), (18), (A37), and (A13) we have
Ψ = ( K 1 K 2 ) = Ψ = ( T r ( max { a + e , b + f } , b + f ,   c + g , min { d + h , c + g } ) ) = = T r ( min { d + h , c + g } , c + g ,   b + f , max { a + e , b + f } ) T r ( a + h ,   b + g ,   c + f ,   d + e ) = = Ψ = ( K 1 ) Ψ = ( K 2 ) .
For the case (A6) we get (A17) and:
c + f b + f
b + g c + g
d + e a + e
d + e b + f
a + h d + h
a + h c + g
The inequalities (A39) and (A42) imply that
d + e min { a + e ,   b + f } .
The inequalities (A43) and (A44) imply that
a + h max { d + h ,   c + g } .
Inequalities (8), (A17), (A39), (A40) (A45), and (A46) imply that
T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h , c + g } ) T r ( d + e , c + f ,   b + g , a + h ) .
Finally, from (A18), (18), (A47), and (A14) we have
Ψ = ( K 1 K 2 ) = Ψ = ( T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h ,   c + g } ) ) = = T r ( min { a + e , b + f } , b + f ,   c + g , max { d + h , c + g } ) T r ( d + e , c + f ,   b + g , a + h ) = = Ψ = ( K 1 ) Ψ = ( K 2 ) .
For the case (A7) we have (A28) and
c + g c + f ,
b + g b + f ,
d + e c + g ,
d + e d + h ,
a + h a + e ,
a + h b + f .
The inequalities (A51) and (A52) imply that
d + e min { d + h ,   c + g } .
The inequalities (A53) and (A54) imply that
a + h max { a + e ,   b + f } .
Inequalities (8), (A28), (A49), (A50), (A55), and (A56) imply that
T r ( min { d + h ,   c + g } , c + g ,   b + f , max { a + e , b + f } ) T r ( d + e , c + f ,   b + g , a + h ) .
Finally, from (A19), (18), (A57), and (A14) we have
Ψ = ( K 1 K 2 ) = Ψ = ( T r ( max { a + e , b + f } , b + f ,   c + g , min { d + h ,   c + g } ) ) = = T r ( min { d + h ,   c + g } , c + g ,   b + f , max { a + e , b + f } ) T r ( d + e , c + f ,   b + g , a + h ) = = Ψ = ( K 1 ) Ψ = ( K 2 ) .
Taking together inequalities (A15), (A16), (A27), (A38), (A48), and (A58), we conclude that for any pair ( K 1 ,   K 2 ) K T r × K T r we have
Ψ = ( K 1 K 2 ) Ψ = ( K 1 ) Ψ = ( K 2 ) .
Applying mathematical induction now, we prove that for any sequence ( K 1 ,   K 2 , , K n ) K T r we have
Ψ = ( K 1 K 2 K n ) Ψ = ( K 1 ) Ψ = ( K 2 ) Ψ = ( K n ) .
It, together with (19), implies that inequality (a1) is met for any pair of sequences ( K 1 ,   K 2 , , K n ) K T r and ( α 1 ,   α 2 , , α n ) . □

Appendix B

Theorem A2.
( K , , , N ) F T r 4 :   { K   &   N } ν [ G E ] ( K , ) ν [ G E ] ( , N )
Proof: 
We substitute
K = T r ( a , b , c , d ) = T r ( a , b , c , d )   &   = T r ( e , f , g , h ) N = T r ( e , f , g , h )
Then from Definition 1 and identity (8), we obtain
a h a h b g ,
b g b g .
Therefore, we will only take into account the following cases:
0 a h ,
a h < 0 < b g ,
b g 0 .
For the case (A65), identity (26) implies
ν [ G E ] ( K , ) = 0 ν [ G E ] ( , N ) .
For the case (A66) we have
a h = α α a h = α < 0 < b g = β b g = β .
Let the function φ : × + be given by the identity
φ ( x , y ) = x x y .
It is very easy to check that this function is non-increasing one of both variables. It together with (26) and (A69) implies that for (A66) we get
ν [ G E ] ( K , ) = a h a + g b h = α α β α α β = a h a + g b h = ν [ G E ] ( , N )
For the case (A67), identity (26) implies
ν [ G E ] ( K , ) 1 = ν [ G E ] ( , N ) .
Taking together (A68), (A71), and (a72) we obtain (A61). □

Appendix C

Table A1. Membership function of initial preorder B E ( Ψ = S A W ) (Source: Own elaboration).
Table A1. Membership function of initial preorder B E ( Ψ = S A W ) (Source: Own elaboration).
A 1 A 2 A 3 A 4 A 5 A 6 A 7 A 8 A 9 A 10 A 11 A 12 A 13 A 14 A 15
A 1 100000000000000
A 2 111111011111000
A 3 101100001100000
A 4 101100001100000
A 5 101110001100000
A 6 111111011111000
A 7 111111111111010
A 8 111110011111000
A 9 101100001000000
A 10 101000001100000
A 11 111110001111000
A 12 111110.670.5011111000
A 13 111111111111110
A 14 111111111111010
A 15 111111111111111
Table A2. Membership function of initial preorder B E ( S A W = ) (Source: Own elaboration).
Table A2. Membership function of initial preorder B E ( S A W = ) (Source: Own elaboration).
A 1 A 2 A 3 A 4 A 5 A 6 A 7 A 8 A 9 A 10 A 11 A 12 A 13 A 14 A 15
A 1 1000.5000001000000
A 2 111111011111000
A 3 10110.500.3300.40110.500.50000
A 4 1011000010.6700000
A 5 101110.6701110.671000
A 6 1111111111110.5010
A 7 111111111111010
A 8 111111111111010
A 9 101100001100000
A 10 101100001100000
A 11 1111110.501111100.800
A 12 1111110.800.891111010
A 13 111111111111110
A 14 111111111111110
A 15 111111111111111

References

  1. Herrera, F.; Alonso, S.; Chiclana, F.; Herrera-Viedma, E. Computing with words in decision making: Foundations, trends and prospects. Fuzzy Optim. Decis. Mak. 2009, 8, 337–364. [Google Scholar] [CrossRef]
  2. Schoop, M.; Jertila, A.; List, T. Egoisst: A negotiation support system for electronic business-to-business negotiations in e-commerce. Data Knowl. Eng. 2003, 47, 371–401. [Google Scholar] [CrossRef]
  3. Kersten, G.E.; Noronha, S.J. WWW-based negotiation support: Design, implementation, and use. Decis. Support Syst. 1999, 25, 135–154. [Google Scholar] [CrossRef]
  4. Wachowicz, T.; Błaszczyk, P. TOPSIS based approach to scoring negotiating offers in negotiation support systems. Group. Decis. Negotiat. 2013, 22, 1021–1050. [Google Scholar] [CrossRef]
  5. Zadeh, L. The concept of a linguistic variable and its application to approximate reasoning—I. Inf. Sci. 1975, 8, 199–249. [Google Scholar] [CrossRef]
  6. Zadeh, L. The concept of a linguistic variable and its application to approximate reasoning—II. Inf. Sci. 1975, 8, 301–357. [Google Scholar] [CrossRef]
  7. Zadeh, L. The concept of a linguistic variable and its application to approximate reasoning—III. Inf. Sci. 1975, 9, 43–80. [Google Scholar] [CrossRef]
  8. Chou, S.; Chang, Y. A decision support system for supplier selection based on a strategy-aligned fuzzy SMART approach. Expert Syst. Appl. 2008, 34, 2241–2253. [Google Scholar] [CrossRef]
  9. Dubois, D.; Prade, H. Fuzzy real algebra: Some results. Fuzzy Sets Syst. 1979, 2, 327–348. [Google Scholar] [CrossRef]
  10. Kosiński, W.; Prokopowicz, P.; Ślęzak, D. Drawback of Fuzzy Arithmetics—New Intuitions and Propositions. In Methods of Artificial Intelligence; Burczyński, T., Cholewa, W., Moczulski, W., Eds.; PACM: Gliwice, Poland, 2002; pp. 231–237. [Google Scholar]
  11. Kosiński, W. On fuzzy number calculus. Int. J. Appl. Math. Comput. Sci. 2006, 16, 51–57. [Google Scholar]
  12. Piasecki, K. Revision of the Kosiński’s Theory of Ordered Fuzzy Numbers. Axioms 2018, 7, 16. [Google Scholar] [CrossRef]
  13. Roszkowska, E.; Kacprzak, D. The fuzzy saw and fuzzy TOPSIS procedures based on ordered fuzzy numbers. Inf. Sci. 2016, 369, 564–584. [Google Scholar] [CrossRef]
  14. Piasecki, K.; Roszkowska, E. On Application of Ordered Fuzzy Numbers in Ranking Linguistically Evaluated Negotiation Offers. Adv. Fuzzy Syst. 2018, 2018, 1–12. [Google Scholar] [CrossRef]
  15. Piasecki, K.; Roszkowska, E.; Łyczkowska-Hanćkowiak, A. Simple Additive Weighting Method Equipped with Fuzzy Ranking of Evaluated Alternatives. Symmetry 2019, 11, 482. [Google Scholar] [CrossRef]
  16. Zadeh, L. Fuzzy sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef] [Green Version]
  17. Klir, G.J. Developments in uncertainty-based information. Adv. Comp. 1993, 36, 255–332. [Google Scholar] [CrossRef]
  18. Goetschel, R.; Voxman, W. Elementary fuzzy calculus. Fuzzy Set. Syst. 1986, 18, 31–43. [Google Scholar] [CrossRef]
  19. Piasecki, K. Relation “Greater than or Equal to” between Ordered Fuzzy Numbers. Appl. Syst. Innov. 2019, 2, 26. [Google Scholar] [CrossRef]
  20. Orlovsky, S. Decision-making with a fuzzy preference relation. Fuzzy Sets Syst. 1978, 1, 155–167. [Google Scholar] [CrossRef]
  21. Herrera, F.; Herrera-Viedma, E. Linguistic decision analysis: Steps for solving decision problems under linguistic information. Fuzzy Sets Syst. 2000, 115, 67–82. [Google Scholar] [CrossRef]
  22. Martínez, L.; Ruan, D.; Herrera, F. Computing with Words in Decision support Systems: An overview on Models and Applications. Int. J. Comput. Intell. Syst. 2010, 3, 382–395. [Google Scholar] [CrossRef]
  23. Brzostowski, J.; Wachowicz, T.; Roszkowska, E. Reference points-based methods in supporting the evaluation of negotiation offers. Oper. Res. Decis. 2012, 22, 21–40. [Google Scholar] [CrossRef]
  24. Oxford Dictionaries, British and World English Dictionary. Available online: http://www.oxforddictionaries.com/definition/english/ (accessed on 26 July 2019).
  25. Oxford Dictionaries, US English Dictionary. Available online: http://www.oxforddictionaries.com/definition/american_english/ (accessed on 26 July 2019).
  26. Kosiński, W.; Wilczyńska-Sztyma, D. Defuzzification and Implication within Ordered Fuzzy Numbers. In Proceedings of the International Conference on Fuzzy Systems, Barcelona, Spain, 18–23 July 2010; pp. 1073–1079. [Google Scholar]
  27. Kendall, M.G. Rank Correlation Methods; Charles Griffin & Company Limited: London, UK, 1955. [Google Scholar]
Figure 1. The membership functions of Ψ = ( T r ( 1 , 2 ,   3 , 4 ) T r ( 12 , 10 ,   8 , 6 ) ) and Ψ = ( T r ( 1 , 2 ,   3 , 4 ) ) Ψ = ( T r ( 12 , 10 ,   8 , 6 ) ) .
Figure 1. The membership functions of Ψ = ( T r ( 1 , 2 ,   3 , 4 ) T r ( 12 , 10 ,   8 , 6 ) ) and Ψ = ( T r ( 1 , 2 ,   3 , 4 ) ) Ψ = ( T r ( 12 , 10 ,   8 , 6 ) ) .
Symmetry 11 01104 g001
Figure 2. The flowchart describing Procedure 2.
Figure 2. The flowchart describing Procedure 2.
Symmetry 11 01104 g002
Table 1. Applied order scales (Source: [13] and own elaboration).
Table 1. Applied order scales (Source: [13] and own elaboration).
Linguistic VariableLOSo-NOSd-NOS
Very Bad V B T r ( 1 , 1 , 1 , 1 ) T r ( 1 , 1 , 1 , 1 )
at least Very Bad . V B T r ( 1 , 1 , 1.5 , 2 ) T r ( 1 , 1 , 1.5 , 2 )
at most Bad . B T r ( 2 , 2 , 1.5 , 1 ) T r ( 1 , 1.5 , 2 , 2 )
Bad B T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 )
at least Bad . B T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2.5 , 3 )
at most Average . A V T r ( 3 , 3 , 2.5 , 2 ) T r ( 2 , 2.5 , 3 , 3 )
Average A V T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 )
at least Average . A V T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 )
at most Good . G T r ( 4 , 4 , 3.5 , 3 ) T r ( 3 , 3.5 , 4 , 4 )
Good G T r ( 4 , 4 , 4 , 4 ) T r ( 4 , 4 , 4 , 4 )
at least Good . G T r ( 4 , 4 , 4.5 , 5 ) T r ( 4 , 4 , 4.5 , 5 )
at most Very Good . V G T r ( 5 , 5 , 4.5 , 4 ) T r ( 4 , 4.5 , 5 , 5 )
Very Good V G T r ( 5 , 5 , 5 , 5 ) T r ( 5 , 5 , 5 , 5 )
Table 2. Linguistic rating of negotiations packages (Source; [12]).
Table 2. Linguistic rating of negotiations packages (Source; [12]).
PackageNegotiation Issues
C 1 C 2 C 3
A 1 V B . B . G
A 2 B . V G G
A 3 . V B G . A V
A 4 . B A V . A V
A 5 B . A V G
A 6 . B . G . V G
A 7 A V . G . A V
A 8 . B A V . V G
A 9 . A V . V B V B
A 10 A V . B . V B
A 11 . A V B
A 12 . A V . B B
A 13 G A V . A V
A 14 . A V . G . A V
A 15 V G B . A V
Table 3. Numeric rating of negotiations packages (Source: [13] and own elaboration).
Table 3. Numeric rating of negotiations packages (Source: [13] and own elaboration).
PackagesNegotiation Issues
C 1 C 2 C 3
o-NOSd-NOSo-NOSd-NOSo-NOSd-NOS
A 1 T r ( 1 , 1 , 1 , 1 ) T r ( 1 , 1 , 1 , 1 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 4 , 4 , 3.5 , 3 ) T r ( 3 , 3.5 , 4 , 4 )
A 2 T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 ) T r ( 5 , 5 , 4.5 , 4 ) T r ( 4 , 4.5 , 5 , 5 ) T r ( 4 , 4 , 4 , 4 ) T r ( 4 , 4 , 4 , 4 )
A 3 T r ( 1 , 1 , 1.5 , 2 ) T r ( 1 , 1 , 1.5 , 2 ) T r ( 4 , 4 , 4 , 4 ) T r ( 4 , 4 , 4 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 )
A 4 T r ( 2 , 2 , 1.5 , 1 ) T r ( 1 , 1.5 , 2 , 2 ) T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 )
A 5 T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 4 , 4 , 4 , 4 ) T r ( 4 , 4 , 4 , 4 )
A 6 T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 4 , 4 , 3.5 , 3 ) T r ( 3 , 3.5 , 4 , 4 ) T r ( 5 , 5 , 4.5 , 4 ) T r ( 4 , 4.5 , 5 , 5 )
A 7 T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 4 , 4 , 3.5 , 3 ) T r ( 3 , 3.5 , 4 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 )
A 8 T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 5 , 5 , 4.5 , 4 ) T r ( 4 , 4.5 , 5 , 5 )
A 9 T r ( 3 , 3 , 2.5 , 2 ) T r ( 2 , 2.5 , 3 , 3 ) T r ( 1 , 1 , 1.5 , 2 ) T r ( 1 , 1 , 1.5 , 2 ) T r ( 1 , 1 , 1 , 1 ) T r ( 1 , 1 , 1 , 1 )
A 10 T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 2 , 2 , 1.5 , 1 ) T r ( 1 , 1.5 , 2 , 2 ) T r ( 1 , 1 , 1.5 , 2 ) T r ( 1 , 1 , 1.5 , 2 )
A 11 T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 )
A 12 T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2.5 , 3 ) T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 )
A 13 T r ( 4 , 4 , 4 , 4 ) T r ( 4 , 4 , 4 , 4 ) T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 3 , 3 ) T r ( 3 , 3 , 2.5 , 2 ) T r ( 2 , 2.5 , 3 , 3 )
A 14 T r ( 3 , 3 , 3.5 , 4 ) T r ( 3 , 3 , 3.5 , 4 ) T r ( 4 , 4 , 3.5 , 3 ) T r ( 3 , 3.5 , 4 , 4 ) T r ( 3 , 3 , 2.5 , 2 ) T r ( 2 , 2.5 , 3 , 3 )
A 15 T r ( 5 , 5 , 5 , 5 ) T r ( 5 , 5 , 5 , 5 ) T r ( 2 , 2 , 2 , 2 ) T r ( 2 , 2 , 2 , 2 ) T r ( 3 , 3 , 2.5 , 2 ) T r ( 2 , 2.5 , 3 , 3 )
Table 4. Evaluations of negotiations packages (Source: own elaboration).
Table 4. Evaluations of negotiations packages (Source: own elaboration).
Scoring EvaluationsInduced Partial Orders
Packages S A W ( A i ) Ψ = ( S A W ( A i ) ) S A W = ( A i ) B E ¯ I N D
( Ψ = S A W )  
B E ¯ I N D ( S A W = )  
A 15 T r ( 4.0 , 4.0 , 3.9 , 3.8 ) T r ( 3.8 , 3.9 , 4.0 , 4.0 ) T r ( 3.8 , 3.9 , 4.0 , 4.0 ) 11
A 13 T r ( 3.6 , 3.6 , 3.5 , 3.4 ) T r ( 3.4 , 3.5 , 3.6 , 3.6 ) T r ( 3.4 , 3.5 , 3.6 , 3.6 ) 23
A 7 T r ( 3.2 , 3.2 , 3.2 , 3.2 ) T r ( 3.2 , 3.2 , 3.2 , 3.2 ) T r ( 3.0 , 3.1 , 3.3 , 3.4 ) 3.56.5
A 14 T r ( 3.2 , 3.2 , 3.3 , 3.4 ) T r ( 3.2 , 3.2 , 3.3 , 3.4 ) T r ( 2.8 , 3.0 , 3.5 , 3.8 ) 3.53
A 6 T r ( 3.0 , 3.0 , 3.1 , 3.2 ) T r ( 3.0 , 3.0 , 3.1 , 3.2 ) T r ( 2.6 , 2.8 , 3.3 , 3.6 ) 53
A 2 T r ( 3.0 , 3.0 , 2.9 , 2.8 ) T r ( 2.8 , 2.9 , 3.0 , 3.0 ) T r ( 2.8 , 2.9 , 3.0 , 3.0 ) 79
A 8 T r ( 2.8 , 2.8 , 3.0 , 3.2 ) T r ( 2.8 , 2.8 , 3.0 , 3.2 ) T r ( 2.6 , 2.7 , 3.1 , 3.4 ) 76.5
A 12 T r ( 2.6 , 2.6 , 3.0 , 3.4 ) T r ( 2.6 , 2.6 , 3.0 , 3.4 ) T r ( 2.6 , 2.6 , 3.0 , 3.4 ) 76.5
A 11 T r ( 2.6 , 2.6 , 2.9 , 3.2 ) T r ( 2.6 , 2.6 , 2.9 , 3.2 ) T r ( 2.6 , 2.6 , 2.9 , 3.2 ) 96.5
A 5 T r ( 2.6 , 2.6 , 2.7 , 2.8 ) T r ( 2.6 , 2.6 , 2.7 , 2.8 ) T r ( 2.6 , 2.6 , 2.7 , 2.8 ) 1010.5
A 3 T r ( 2.0 , 2.0 , 2.4 , 2.8 ) T r ( 2.0 , 2.0 , 2.4 , 2.8 ) 11.510.5
A 4 T r ( 2.4 , 2.4 , 2.2 , 2.0 ) T r ( 2.0 , 2.2 , 2.4 , 2.4 ) T r ( 1.8 , 2.1 , 2.5 , 2.6 ) 11.513
A 10 T r ( 2.4 , 2.4 , 2.4 , 2.4 ) T r ( 2.2 , 2.3 , 2.5 , 2.6 ) 1313
A 9 T r ( 2.2 , 2.2 , 2.0 , 1.8 ) T r ( 1.8 , 2.0 , 2.2 , 2.2 ) T r ( 1.6 , 1.9 , 2.3 , 2.4 ) 1413
A 1 T r ( 1.8 , 1.8 , 1.8 , 1.8 ) T r ( 1.8 , 1.8 , 1.8 , 1.8 ) T r ( 1.6 , 1.7 , 1.9 , 2.0 ) 1515
Amount of equivalence classes117

Share and Cite

MDPI and ACS Style

Piasecki, K.; Roszkowska, E.; Łyczkowska-Hanćkowiak, A. Impact of the Orientation of the Ordered Fuzzy Assessment on the Simple Additive Weighted Method. Symmetry 2019, 11, 1104. https://0-doi-org.brum.beds.ac.uk/10.3390/sym11091104

AMA Style

Piasecki K, Roszkowska E, Łyczkowska-Hanćkowiak A. Impact of the Orientation of the Ordered Fuzzy Assessment on the Simple Additive Weighted Method. Symmetry. 2019; 11(9):1104. https://0-doi-org.brum.beds.ac.uk/10.3390/sym11091104

Chicago/Turabian Style

Piasecki, Krzysztof, Ewa Roszkowska, and Anna Łyczkowska-Hanćkowiak. 2019. "Impact of the Orientation of the Ordered Fuzzy Assessment on the Simple Additive Weighted Method" Symmetry 11, no. 9: 1104. https://0-doi-org.brum.beds.ac.uk/10.3390/sym11091104

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop