29
REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED GOAL MODELING NOR ASHILA ABDUL RAHMAN UNIVERSITI TEKNOLOGI MALAYSIA

REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

Embed Size (px)

Citation preview

Page 1: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED GOAL

MODELING

NOR ASHILA ABDUL RAHMAN

UNIVERSITI TEKNOLOGI MALAYSIA

Page 2: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED GOAL

MODELING

NOR ASHILA BINTI ABDUL RAHMAN

A thesis submitted in fulfilment of the

requirements for the award of the degree of

Master of Science (Computer Science)

Faculty of Computing

Universiti Teknologi Malaysia

APRIL 2017

Page 3: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

ACKNOWLEDGEMENT

“In the name of Allah, the most Gracious and the most Merciful”

This thesis would have not been completed without the help and splendid

support from many individuals and teams. Firstly, my sincere gratitude goes to the

backbone of my research, my supervisors, Dr. Rohayanti Hassan and Dr. Muhamad

Razib Othman for their excellent supervision, knowledge, belief, patience and

interest in the work and for pushing me farther than I thought I could go. To my

beloved parents, thank you for always being there and never fail to give me words of

encouragement. Your endless support is making me for who I am today. To my

dearest colleagues and research-mates, I am thankful for the friendship, supportive

comments and ideas in reviewing each other’s works and also fun times throughout

last one and half year of this study. To my husband and family, thank you for helping

me surviving all the stress and not letting me giving up. To everyone who has

consistently giving support and advice directly or the other way round, including the

team of Software Engineering Research Group (SERG) and GATES IT Solutions

Sdn. Bhd., I refer my appreciation. My greatest thanks should also credit to all

lecturers at the Faculty of Computing, Universiti Teknologi Malaysia (UTM) for

their understanding and support. Last but not least, I appreciate the financial support

from the GATES IT Solutions Sdn. Bhd. under GATES Scholar Foundation (GSF)

and Malaysian Ministry of Higher Education under MyMaster funds.

Page 4: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

ABSTRACT

Requirements analysis is the process of analyzing the requirements of various

stakeholders that represent the specification of system behavior. This must be stated

precisely in order to proceed to the design phase. It is noted that the current process

of requirements analysis is not sufficient for identifying and representing the

existence of multiple stakeholders, which could lead to various conflicts and

overlapping requirements. Furthermore, the involvement of various stakeholders

normally leads to inconsistencies and misinterpretation of requirements. Therefore,

this study is conducted to enhance goal modeling representation, namely role-based

goal modeling. Role-based goal modeling highlights each stakeholder’s role

identification in discovering the intentions and requirements of various stakeholders

including the integration of data elements in order to determine the dependency of

data when dealing with multiple stakeholders. An Integrated Plantation System was

selected as a case study for this research with participation from different

stakeholders. Besides that, the Integrated Learning Management System and

NIMSAD approaches were used to evaluate the proposed method. From the result, it

is found that role-based goal modeling showed improvement in deriving high

feasibility (five goals) and high adequacy (one goal) requirements for

implementation. The integration of data elements indicates high complexity when

multiple stakeholders interact with the same data element. In sum, role-based goal

modeling can facilitate the process of analyzing and prioritizing requirements from

multiple stakeholders in the early stages of the development process.

Page 5: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

v

ABSTRAK

Analisis keperluan adalah proses menganalisis keperluan pelbagai pihak

berkepentingan yang menunjukkan spesifikasi sebuah sistem. Hal ini perlu

dinyatakan dengan tepat supaya fasa reka bentuk boleh dimulakan. Proses analisis

keperluan yang sedia ada didapati tidak cukup untuk mengenal pasti dan mewakili

kewujudan pelbagai pihak berkepentingan dan seterusnya boleh menimbulkan

pelbagai konflik dan pertindihan keperluan. Tambahan pula, penglibatan pelbagai

pihak berkepentingan lazimnya akan menyebabkan percanggahan dan salah tafsir

keperluan. Oleh itu, kajian ini dijalankan untuk menambah baik perwakilan

pemodelan matlamat iaitu pemodelan matlamat berasaskan peranan. Pemodelan

matlamat berasaskan peranan menekankan pengenalpastian peranan pihak

berkepentingan dalam mengesan kehendak dan keperluan pelbagai pihak

berkepentingan termasuk integrasi elemen data untuk menentukan kebergantungan

data apabila melibatkan pelbagai pihak berkepentingan. Sistem Sawit Bersepadu

dipilih sebagai kajian kes untuk penyelidikan ini dengan penglibatan daripada pihak

berkepentingan yang berbeza. Selain itu, pendekatan Sistem Pengurusan

Pembelajaran Bersepadu dan NIMSAD digunakan untuk penilaian model yang

dicadangkan. Daripada keputusan kajian, didapati bahawa pemodelan matlamat

berasaskan peranan menunjukkan kemajuan dalam memperoleh keperluan dengan

kebolehlaksanaan (5 matlamat) dan kecukupan (1 matlamat) yang tinggi untuk

tujuan pelaksanaan. Integrasi elemen data menunjukkan kerumitan pada tahap tinggi

apabila pelbagai pihak berkepentingan berinteraksi dengan elemen data yang sama.

Kesimpulannya, pemodelan matlamat berasaskan peranan boleh memudahkan proses

menganalisis dan mengutamakan keperluan pelbagai pihak berkepentingan dalam

peringkat awal proses pembangunan.

Page 6: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

vi

CHAPTER

1

TABLE OF CONTENTS

TITLE

DECLARATION

ACKNOWLEDGEMENT

ABSTRACT

ABSTRAK

TABLE OF CONTENTS

LIST OF TABLES

LIST OF FIGURES

LIST OF SYMBOLS

LIST OF ABBREVIATIONS

INTRODUCTION

1.1 Overview

1.2 Problem Background

1.2.1 Challenges in Multi-stakeholder

Requirement

1.2.2 Challenges in Integration with Data

Element

1.3 Problem Statement

1.4 Objectives of the Study

1.5 Scope of the Study

1.6 Significance of the Study

1.7 Organization of the Thesis

PAGE

ii

iii

iv

v

vi

x

xii

xiv

xv

1

3

3

5

6

7

8

8

9

Page 7: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

vii

2 LITERATURE REVIEW

2.1 Introduction 11

2.2 Goal Modeling 12

2.2.1 Requirements Completeness in Goal 12

Modeling

2.2.2 Traceability Links in Goal Modeling 13

2.2.3 Structuring Requirements Document in 14

Goal Modeling

2.2.4 Conflict Detecting in Goal Modeling 15

2.3 Formation of Goal Modeling 17

2.3.1 Assumption Based Goal Modeling 17

2.3.2 Dependency Based Goal Modeling 19

2.4 The Assessment of Goal Modeling 22

2.4.1 Risk Analysis Assessment 23

2.4.2 Complexity Assessment 25

2.5 Trends and Direction 29

2.6 Summary 30

3 RESEARCH METHODOLOGY

3.1 Introduction 31

3.2 Research Framework 32

3.3 The Operational Framework 33

3.3.1 Feasibility Study and Collection of Data 34

3.3.2 Literature Revie w 34

3.3.3 Formation of Role-Based Goal Modeling 35

3.3.4 Data Dependency in Role-Based Goal 36

Modeling

3.3.5 The Result Analysis 37

3.3.6 Documentation 37

3.4 Case Study Selection and Data Sources 37

3.4.1 Pilot Case Study 38

3.4.2 Implementation Case Study 40

3.5 Evaluation Metrics 41

Page 8: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

viii

3.6 Summary 42

4 ROLE-BASED GOAL MODELING WITH

REQUIREMENTS CLASSIFICATION MATRIX

4.1 Introduction 43

4.2 Related Works 44

4.3 Development of Role-based Goal Realization 45

Graph

4.3.1 Identifying Role and Goal 45

4.3.2 Formation of Goal Realization Graph 47

4.4 Assessment of Role-based Goal Realization 49

Graph Discussion

4.4.1 Confidence Factors Assessment 49

4.4.2 Determination of Feasibility and 50

Adequacy

4.5 Extending Role-based Goal Modeling for 53

Requirements Classification Summary

4.6 Implementation to the Case Study 54

4.7 Discussion 59

4.8 Summary 61

5 INTEGRATING DATA ELEMENT INTO ROLE-

BASED GOAL MODELING

5.1 Introduction 62

5.2 Related Works 63

5.3 Integrate Data Element into Goal Realization 64

Graph

5.4 The Assessment of Data-dependent Role-based 66

Goal Realization Graph

5.4.1 Complexity Assessment of Data Element 67

5.5 Case Study Implementation 70

5.6 Discussion 73

5.7 Summary 75

Page 9: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

ix

6 IMPLEMENTATION OF ROLE-BASED GOAL

MODELING WITH DATA ELEMENT

6.1 Introduction 76

6.2 Role-Based Applied in Learning Management 77

System

6.2.1 Assessment on FEASIBLE, 80

ADEQUATE, RISK and COMPLEX

6.2.2 Analysis with Change Request 83

6.3 Comparative Analysis with Previous Work 84

6.3.1 Comparative Analysis on FEASIBE, 84

ADEQUATE, RISK and DATA

6.4 Normative Information Model-based Systems 90

Analysis and Design Evaluation

6.5 Discussion 92

6.6 Summary 94

7 CONCLUSION

7.1 Concluding Remarks 95

7.2 Contributions 97

7.3 Future Works 98

REFERENCES

APPENDIX

99

103

Page 10: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

14

16

22

23

24

25

26

28

29

35

38

41

48

50

50

52

53

58

59

60

LIST OF TABLES

TITLE

Advantages and disadvantages of goal oriented

implementation

Summary of goal modeling attributes

Summary of goal modeling formation

Definition of confidence factors

4-point ordinal scale rating

Goal complexity evaluation

Metric to satisfy goal complexity

Fuzzy values for goals and soft goal correlation

Summary of assessment in goal modeling

SPEM notations

Summary of case study

Summary of goal graph metrics

Notation of goal realization graph

Definition of confidence factor

4-point ordinal scale rating

REFINE and MANDATE profile matrix

The risk identification based on the FEASIBLE

and ADEQUATE of goal realization graph

The confidence factor rating

The goal count for Figure 4.9

Requirements classification from the aspect of

feasibility, adequacy and risk for manage labor

Page 11: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

requisition

5.1 Additional notation of dependent-data Role-based 66

goal realization graph

5.2 Type of DATA inflow and outflow 68

5.3 CONF and PRIOR profile matrix 69

5.4 The role-based driven from the aspect of 69

complexity and risk

5.5 The role-based driven requirements classification 74

from the aspect of complexity and risk for Figure

5.5

6.1 The assessment of FEASIBLE, ADEQUATE, 82

risk, COMPLEX and CR

6.2 FEASIBLE, ADEQUATE, risk and DATA 89

between Kenneth et al. (2011) and role-based

6.3 Comparative evaluation framework description 91

6.4 Comparative evaluation for general concepts 92

criteria

6.5 Comparative evaluation for modeling criteria 92

6.6 Comparative evaluation for analysis criteria 92

Page 12: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

11

19

20

24

27

32

33

38

40

45

46

46

47

48

49

51

52

55

LIST OF FIGURES

TITLE

Content structure of Chapter 2

Operationalizing element in goal graph

Dependency of goal graph formation

Confidence factors assigning and rating

Assessment of assumption and achievability

confidence factor

Research framework

Overview of the research process

Visualization of PIS

iLMS overall integration process

Summary of role-based goal realization graph

Relationship between stakeholder’s role and goal

Diagram of activities in identifying stakeholders’

roles and goals

Steps and notation in formation of goal realization

graph

A goal realization

Steps in assessment of goal realization graph

The determination of FEASIBLE of goal

realization graph

The determination of ADEQUATE of goal

realization graph

A segment of business workflow in PIS system

Page 13: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

56

57

62

64

65

65

67

70

71

72

73

78

79

79

81

86

87-88

90

The role-based goal realization graph of manage

labor requisition

The role-based goal realization graph with

confidence factor rating of manage labor

requisition

Input to interpretation process

Summary of integrating data element into goal

realization graph

Steps and notation in formation of goal realization

graph with data element

A goal realization graph with data

element Steps in assessment of goal realization

graph with data element

Interrelation between "Manage Labor Requisition"

and other function

Interrelation between "Manage Labor Status" and

"Manage Labor Requisition"

Interrelation between "Manage Labor Requisition"

and "Manage Labor Application"

Rating for interrelation between “Manage Labor

Requisition” and “Manage Labor Application”

Segmentation of iLMS business workflow

The goal realization graph for managing exam

registration

The goal realization graph rating for managing

exam registration

Interrelation between “Manage Exam

Registration” and “Manage Payment”

Goal graph representation

Assessment for random goal graph and role-based

Comparative Evaluation Framework

Page 14: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

xiv

LIST OF SYMBOLS

H - High

L - Low

M - Medium

N - None

Page 15: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

xv

ACHIEVE - Achievability

ADEQUATE - Adequacy

AGORA - Attributed Goal Oriented Requirements Analysis

AHP - Analytic Hierarchy Process

ASSUME - Assumptions

CGM - Constrained Goal Model

COMPLEX - Complexity

CONF - Conflict

CR - Change Request

CReML - Comprehensive Requirements Modeling

Language

DATA - Data Element

ENGAGE - Engagement

FEASIBLE - Feasibility

GORE - Goal-Oriented in Requirements Engineering

GQM - Goal-Question-Metric

HQ - Headquaters

iLMS - Integrated Learning Management System

KAOS - Knowledge Acquisition in Automated

Specification

MANDATE - Stakeholder's Mandate

NIMSAD - Normative Information Model-based Systems

Analysis and Design Evaluation

SPEM - Software Process Engineering Meta-model

LIST OF ABBREVIATIONS

Page 16: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

CHAPTER 1

INTRODUCTION

1.1 Overview

As a primary focus of a large and complex system development, one of the

greatest difficulties is in understanding what a "requirement" really is. Before

proceeding to the design stage, requirements can be categorized in many different

ways that must be stated clearly, consistently and unambiguously (Irit et al., 2013).

Requirements can be summarized into an illustrative representation that should be

useful for and understood by project manager and requirement engineer. In

requirement engineering (RE), requirement can be classified under different

perspectives; high level description, abstract statement and formal specification.

Since the RE process is known as a continuing process that involves discovering,

documenting and maintaining (Shams et al., 2010; Lemai and Graeme, 2009) a set of

requirements, requirements analysis therefore is one of the most important processes

that requires high-reliability procedures. Requirements analysis can be difficult

because the requirement engineer needs to come out with a set of requirements

(Kenneth et al., 2011; Yuanyuan et al., 2011) that could represent a specification of

the system (Michel dos et al., 2011). There are two fundamental issues to be

addressed in requirements analysis: (i) involvement of multi-stakeholders and (ii)

integration between data elements.

Page 17: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

2

Developing a large and complex system will require identification of the

different levels of stakeholders’ within an organization as well as their roles and

objectives (Yuanyuan et al., 2011) that need to be analyzed by the requirement

engineer. Considering that stakeholders have valid interests that may be affected

directly or indirectly by the system (Niels and Hans, 2013), it is important to analyze

multi-stakeholders’ requirements. Lack of understanding of the business

requirements and engaging key stakeholders could contribute to a project’s failure.

Lack of stakeholders’ role identification such as needs and expectations could

contribute to the failure rate of up to 60% in large and complex projects as described

by Jeffrey et al. (2013). Christopher (2013) stated that multi-stakeholders’ role

involvement has been seen as a risky factor of project success. With the increment in

the list of stakeholders, the requirements can be unmanageable which will lead to

increased risk of failure. For that reason, analyzing requirements that come from

multi-stakeholders is important in order to improve the selection requirements with

high feasibility and adequacy accordingly before proceeding to the system design

phase.

In addition, when dealing with a large and complex system development,

requirements might conflict and overlap which could lead to project failure.

Nikhilesh and Amitabh (2008) stated that when a project fails, there are three

possible problems that need to be figured out: (i) requirements are incorrect or

incomplete, (ii) requirements are interpreted wrongly and (iii) variation of

stakeholders’ goals and priorities. Stakeholders are required to carry out different

activities according to their roles and goals. A stakeholder’s role is considered as an

essential element that is associated with the software artifacts. Xu et al. (2010)

claimed that dependencies between stakeholder and other artifacts are poorly

executed in the industry nowadays. Throughout the system development life cycle,

stakeholders are certainly associated with the requirements source and other created

artifacts. As a result, analyzing requirement requires an extensive process in mapping

out the requirements and other software artifacts.

Page 18: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

3

Requirements are the cornerstone of any development. It is essential for the

requirement engineer to trace the dependency between requirements and other

artifacts. Considering the requirements can be described in various forms: (i) goals,

(ii) scenarios, (iii) user profile and (iv) use cases, it is therefore important for the

requirement engineer to analyze the number of dependencies that might occur in

system development. Because of the growing size, complexity and customization of

software systems, the dependencies between requirements and other artifacts should

be traced effectively. According to Arda et al. (2014), whenever changes are made to

the requirement, the requirement engineer needs to find out the affected parts on

other software artifacts, such as requirement, design elements and source code.

1.2 Problem Background

The process of requirements analysis is carried out not only to define

customers’ needs, objectives and functions, but also to synthesize solutions in order

to optimize of performance requirements. The process of analyzing requirement still

becomes the root cause of failures in development of software project (Shams et al.,

2010). There are two challenges that have been discovered accordingly in

requirements analysis: (i) multi-stakeholders’ requirements and (ii) integration with

data element.

1.2.1 Challenge in Multi-stakeholder Requirement

Multi-stakeholder requirement is one major theoretical issue that has become

a main concern in requirement analysis for many years. In developing a large and

complex system, the involvement of different level of stakeholders from several

Page 19: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

4

departments that share the same information and communicate with each other is

required. All stakeholders’ needs must be determined clearly from the very first

phase of the development process. It is difficult for the requirement engineer to deal

with all collections of need (Tom et al., 2013; Michel et al., 2011) that come from

different stakeholders with their own desires about the system being developed. Each

stakeholder plays an important role which reflects the success of the system

development. Under such circumstances, Christopher (2013), holds the view that the

increment of stakeholder list will lead to unmanageable requirements since each

requirement engages with different level of risk. Besides, the lack of identification of

stakeholder’s role is seriously taken in a large and complex system development.

Throughout the requirements analysis process, goal modeling represents the

relationships between roles in terms of specific goals that one role depends on the

other role to provide. Goal has been applied by Kenneth et al. (2011) who propose a

goal sketching technique that emphasizes the presence of assumptions and

distinguishes them from the various system elements to be constructed. However, the

goal sketching that is used does not describe the requirements from multiple

stakeholders. Vikas and Guillaume (2013) stated that assumptions are usually

implicit during requirement modeling. However this often leads to goals and

requirements that may cause potential traceability errors and reduce the quality

control of the system development. Other approaches used an obstacle analysis

(Antoine and Axel van, 2014) that is crucial as it should be more adequate and

complete requirements. Unfortunately, requirement analysis process is still the root

cause of software-project delays, overruns and failure in systems development.

Page 20: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

5

1.2.2 Challenge in Integration with Data Element

Other challenges in requirement analysis that often affect the development of

large and complex systems are requirement conflict and overlap. Stakeholders are

required to accomplish a lot of different activities during the development. The

variation of stakeholders’ goals and priorities is one of the factors that will lead to

requirement conflict and overlap. Often, during development, there will be

stakeholders who misinterpret the requirements and claim that the system is not

being developed accordingly. Besides, there are also stakeholders who do not express

all their needs and desires for the system that is to be developed. As a consequence,

the requirement engineer could not fully understand the requirements because the

design of a to-be system is reliant on requirements from stakeholders (Xu et al.,

2010).

Since each stakeholder’s requirement is attached with different level of risk, it

is important for requirement engineer to analyze and prioritize requirements from the

stakeholders. Previous studies such as Kenneth et al. (2011) indicate that dependency

could be expressed in goal graph using the operationalizing elements of the system-

to-be that might not be dependable to the goals. Dependency on the other hand used

to define relations between actors in goal modeling formation. Thi-Thuy-Hang and

Alain (2012) mentioned that a quality of requirements describes a constraint whose

satisfaction or fulfillment ranges on a scale of possibilities and that can constraint a

goal. Besides, Chitra et al. (2015) in their study implemented inter-actor

dependencies using the fuzzy concepts to capture requirements where an actor

depends on other actors for its goal accomplishment. However, although the above

method has been widely used, the process of analyzing the level of confidence

attached to a set of requirements is often poorly executed in the industry nowadays.

Page 21: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

6

1.3 Problem Statement

This study was conducted in the area of requirements analysis process and

driven by the problems arising from the process of analyzing requirements

specifically in developing large and complex systems. Problems such as lack of

representation of multi-stakeholders consequently affect the process of analyzing and

prioritizing requirements from multiple stakeholders before proceeding to the design

phase. Besides, the integration between requirement and other data elements need to

be identified discretely in order to minimize complexity of the requirements. In this

study, the problem of analyzing multi-stakeholders’ requirements is addressed,

during design time, in an attempt to facilitate the modeling expressiveness. To realize

the research goal, there are three research questions (RQ) that need to be answered.

a) RQ 1: What should be done to show the involvement of multi-stakeholders in

goal modeling when analyzing requirements?

The first factor that is considered is to manage a set of requirements that

come from multi-stakeholders. The importance of analyzing requirements is to

improve the selection of feasibility and adequacy of requirement at the earliest stage

that should be realized in a to-be system. Requirement analysis is one of the crucial

steps that need high-reliability process. Requirement analysis process can be difficult

because the requirement engineer needs to come out with a set of requirements that

could express all the various stakeholders’ needs. Therefore, the representation by

including stakeholder-oriented identification is important for classifying

requirements based on stakeholders’ roles and functions.

b) RQ 2: How to integrate and evaluate data element in goal modeling?

The second factor that has to be considered is the ease in determining the

complexity of dependency of data when dealing with multi-stakeholders to perform a

lot of different activities. Data dependency happens when the data can be an input or

output from one goal to another goal. Consequently, the data has been changed or

intervened from one goal to another goal.

Page 22: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

7

c) RQ 3: How to validate the improvement of multi-stakeholder representation

and the integration of data element?

The validation of the analyzing process is measured based on the applicability

of the improvement to the real-world requirement analysis. The improvement process

is practical to show the appearance of multi-stakeholders attached in a set of

requirements to show the complexity of data element integration. Therefore, the

process is particularly useful during requirements analysis and the early stages of

systems development.

1.4 Objectives of the Study

The goal of this research is to enhance the requirement analysis process by

improving the goal modeling representation that consists of two main components;

role-based goal model by highlighting the stakeholder role identification together

with integration with data element as a second component. In order to realize the

goal, several objectives need to be achieved:

a) To enhance the representation of goal modeling by including the stakeholder

role identification in order to demonstrate multi-stakeholder intentions and

requirements.

b) To propose and evaluate the integration of data element in role-based goal

modeling in order to determine the complexity of data dependency of

requirements.

c) To validate the role-based goal modeling using NIMSAD evaluation.

Page 23: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

8

1.5 Scope of the Study

In order to achieve the objectives stated in this study, the scopes of this study

are bounded under these limitations:

a) This study focuses on improving the requirement analysis process with

representation of stakeholder role identification plus integration with data

element.

b) Goal representation is applied in order to illustrate the requirements from

multi-stakeholders.

c) The integration with data element is used to show the complexity of data

dependency of data when dealing with multi-stakeholders.

d) Plantation Integrated System (PIS) that focuses on labor management is used

in this study in order to demonstrate the proposed model.

e) The integrated learning management system (iLMS) is used to assess the

applicability of the improvement process.

f) The numbers of change request (CR) from iLMS testing phases are taken into

consideration for the evaluation in this study.

g) The evaluations considered in this study are: (a) feasibility and adequacy of

multi-stakeholder requirement and (b) the complexity of the dependency in

data element.

1.6 Significance of the Study

The results from this study will assist the requirement engineer to derive a set

of requirements that represent a specification of system behavior. Since requirement

analysis is an essential activity in requirement engineering, this study aims to reduce

time consumption in requirement analysis and minimize project failure at an early

stage (Kenneth et al., 2011). This study observes the importance of analyzing

Page 24: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

9

requirements from two different perspectives: (i) development estimation and (ii)

managing requirement.

In development estimation, the lack of requirement analysis could increase the

project failure rate (Jeffrey et al., 2013) in large and complex system development.

Besides, whenever user makes changes in requirement, the requirement engineer will

have to systematically monitor and document each change. Moreover, if analysis of

requirements is not strictly taken into consideration in system developments, it can

cause project delays, overruns and will lead to high cost and budget development

(Jeffrey et al., 2013; Shams et al., 2010; Kenneth et al., 2011).

From the perspective of requirement management, insufficient analysis of

requirement will affect the consistency of the requirements that have been gathered

from stakeholders (Christopher, 2013). If the requirements are not analyzed

accordingly, the feasibility of requirement cannot be achieved and it is difficult for

the requirement engineer to prioritize the requirements based on the aspect of

adequacy and feasibility before proceeding to the design stage (Kenneth et al., 2011).

Therefore, this study intends to improve the requirement analysis process by

highlighting the multi-stakeholder requirements and minimizing requirement

conflicts and overlaps in system developments.

1.7 Organization of the Thesis

This thesis is organized into seven chapters. Chapter 1 defines the challenges,

current methods, problem, objectives, scopes and significance of the study. Chapter 2

reviews the main subjects of interest, which are the goal modeling domain, the

formation of goal modeling and the assessment of goal modeling. The last section of

this chapter will present the trend and tendencies related to this study. In Chapter 3, a

Page 25: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

10

brief review of the proposed role-based goal model development framework is

presented, followed by detailed descriptions of a pilot and implementation case study

and instrumentation used and result analysis.

Chapter 4 gives a brief overview on the enhancement of goal realization

technique that highlights the stakeholder role identification in discovering the

intentions and requirements of multi-stakeholders. This includes the assessment of

four risks factor in order to analyze the feasibility and adequacy of the requirement.

Next, Chapter 5 extends the role-based goal model by considering the integration

element in goal modeling. Integration of data element is intended to show the

complexity of dependency of data when dealing with multi-stakeholders to perform a

lot of different activities. Chapter 6 gives the overview of the whole achievement of

the research objectives. The role-based goal modeling is evaluated and compared

with the basic goal graph. Subsequently, the role-based goal modeling is then

implemented and analysed using a case study of exam registration module in the

integrated learning environment case study in order to assess the quality of the

proposed model. Finally, Chapter 7 the achievement results to date are presented.

The contributions and future works of the study are also described.

Page 26: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

99

REFERENCES

Agnar, A., Mads, N. (1995). Different Roles and Mutual Dependencies of Data,

Information, and Knowledge - an AI Perspective on Their Integration. Data

& Knowledge Engineering. 16, 191-222.

Anish, D. S., Xin, L. D., Alon, H. (2008). Data Integration with Dependent Sources.

Proceedings of the 14th International Conference on Extending Database

Technology. New York, USA. pp. 401-412.

Antoine, C., Axel van, L. (2014). Integrating Exception Handling in Goal Models.

2014 IEEE 22nd International Requirements Engineering Conference (RE).

22-29 August 2014. Karlskrona. pp. 43-52.

Arda, G., Ivan, K., Klaas van den B., Wietze, S. (2014). Change impact analysis for

requirements: A metamodeling approach. Information and Software

Technology. 56, 950-972.

Axel van, L., (2001). Goal-Oriented Requirements Engineering: A Guided Tour.

Proceedings of the 5th IEEE International Symposium on Requirements

Engineering. Toronto, Canada, pp. 249-262.

Carla, P., Ivan, G. (2012). A Systematic Literature Review of Stakeholder

Identification Methods in Requirements Elicitaion. The Journal of Systems

and Software. 85, 2171-2181.

Chitra, M. S., Aneesh, K., Arshinder, K. (2015). Reasoning about Goal Satisfaction

for Early Requirements Engineering in the i*Framework using Inter-Actor

Dependency. Proceedings of Pacific Asia Conference on Information Systems

(PACIS). pp. 89.

Faisal, A., Jeroen, K. (2010). Requirements Analysis: Evaluating KAOS Models.

SciRP, Journal Software Engineering & Applications. 3, 869-874.

Page 27: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

100

H.Christopher, P. (2013). Fundamental Principles of Managing Multi-Stakeholder

Engagement. International Food and Agribusiness Management Review. 16,

A, 11-22.

Haruhiko, K., Hisayuki, H., Motoshi. (2002). AGORA: Attributed Goal-Oriented

Requirements Analysis Method, Proceedings of IEEE Joint International

Conference on Requirements Engineering, pp. 13-22.

Haruhiko, K., Motoshi, S. (2004). Weaving Multiple Viewpoint Specifications in

Goal Oriented Requirements Analysis. Proceedings of 11th Asia-Pacific

Software Engineering Conference. 30 November - 3 December 2004. Busan,

Korea. pp. 418-427.

Helen, S., Anthony, F., Galal, G. (1999). Stakeholder Identification in the

Requirements Engineering Process. Proceedings of Tenth International

Workshop on Database and Expert Systems Applications. 1 - 3 September

1999. Florence. pp. 387-391.

Ibrahim, H., Weihang, W., Katrina, A., Tim, P. K. (2007). Extending Argumentation

to Goal-Oriented Requirements Engineering. In Proceedings Advances in

Conceptual Modeling - Foundations and Applications, ER 2007 Workshops

CMLSA, FP-UML, ONISW, QoIS, RIGiM, SeCoGIS. November 2007.

Auckland, New Zealand. pp. 5-9.

Irit, H., Iris, R.B., Tsvi, K., Anna, P., Filippo, R., Angelo, S. (2013). Comparing the

comprehensibility of requirements models expressed in Use Case and Tropos:

Results from a family of experiments. Information and Software Technology.

55, 1823-184.

Jeffrey, M., Gurpreet, D., Mario, C. (2013). Defining value-based objectives for ERP

systems planning. Decision Support Systems. 55, 98-109.

Jonathan, L., Nien-Lin, X., Jong-Yih, K. (2001). Structuring Requirement

Specifications with Goals. Journal of Information and Software Technology.

43, 121-135.

Kenneth, B., Anthony, F., Rachel, H. (2008). A lightweight technique for assessing

risks in requirements analysis. IET Software. 2, 46-57.

Kenneth, B., Anthony, F., Rachel, H. (2011). A method for assessing confidence in

requirements analysis. Information and Software Technology. 53, 1084-1096.

Page 28: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

101

Klaus, P., Peter, H., Klaus, W., Matthias, J. (1999). Improving Reviews by Extended

Traceability. Proceedings of the 32nd Annual Hawaii International Conference

on Systems Sciences. Maui, HI, USA. 5 Jan , ISSN: 0-7695-0001-3

Lemai, N., Graeme, S. (2009). A Framework for Understanding Creativity in

Requirements Engineering. Journal of Information and Software Technology.

51, 655-662.

Mai, C. N., Roberto, S., Paolo, G., John, M. (2016). Multi-Objective Reasoning with

Constrained Goal Models. Springer London.

Manzoor, A., Jean-Michel, B., Regine, L., Christophe, G. (2012). Using RELAX,

SysML and KAOS for Ambient Systems Requirements Modeling. Procedia

Computer Science. 10, 474-481.

Michel, D.D. S., Jos, V., Alexander, V. (2011). User requirements modeling and

analysis of software-intensive systems. The Journal of Systems and Software.

84, 328-339.

Naeem, U. R., Sarfraz, B., Sohail, A., Simon, F. (2010). Comparative Study of Goal-

Oriented Requirements Engineering. 4th International Conference on New

Trends in Information Science and Service Science (NISS). 11-13 May 2010.

Gyeongju. pp. 248-253.

Niels, K., Hans, M. (2013). Multi-stakeholder virtual dialogue: Introduction to the

special issue. Journal of Business Research. 66, 1460-1464.

Nikhilesh, K., Amitabh, S. (2008). Building Software: A Practitioner’s Guide. New

York: Taylor & Francis Group.

Par, C. (2002). Release Planning in Market-Driven Software Product Development:

Provoking an Understanding. Requirements Engineering, 7, 139-151.

Patricia, E., Miguel, G., Joao, A. (2013). A Framework to Evaluate Complexity and

Completeness of KAOS Goal Model. 25th International Conference on

Advanced Information Systems Engineering (CAiSE’13). 17 Jun 2013 - 21

Jun 2013. Valencia, Spain. pp. 562-577.

Shams-Ul, A., Qadeem, K., S.A.K.Gahyyur. (2010). Requirements Engineering

Processes, Tools/Technologies, & Methodologies, International Journal of

Reviews in Computing, 6, 2. ISSN: 2076-3328.

Shaokun, F., J.Leon, Z., Wanchun, D., Manlu, L. (2012). A framework for

transformation from conceptual to logical workflow models. Decision

Support Systems. 54, 781-794.

Page 29: REQUIREMENTS ANALYSIS PROCESS USING ROLE-BASED …eprints.utm.my/id/eprint/78905/1/NorAshilaAbdulMFC2017.pdf · me surviving all the stress and not letting me giving up. To everyone

102

Shareeful, I. (2009). Software Development Risk Management Model - A Goal

Driven Approach. Proceedings of the Doctoral Symposium for ESEC/FSE on

Doctoral Symposium. . 24-28 August 2009. Amsterdam, The Netherlands,

pp. 5-8.

Thi-Thuy-Hang, H., Alain, P. (2012). Distinguishing Soft-Goals and Quality

Requirements in Software Requirements Modeling. The Fourth International

Conference on Advances in Databases, Knowledge, and Data Applications.

29 February 2012. Saint Gilles, Reunion. pp. 9-14.

Thorsten, M., Daniela, J. and Alexander, D. (2011). Improved Representation of

Traceability Links in Requirements Engineering Knowledge using Sunburst

and Netmap Visualizations. In: Proceedings 4th International Workshop on

Managing Requirements Knowledge (MARK). Trento. pp. 17-21. Tom, H.,

Monique, S., Guido, D., Antoon, G., Frank, S. (2014). Visualizing Variability

Management in Requirements Engineering through Formal Concept Analysis.

Procedia Technology. 9, pp.189 - 199.

Vikas, S., Guillaume, A. (2013). Reinventing Goal-Based Requirements Modeling.

Proceeding of the Posters Workshop of Complex Systems Design &

Management Conference CSD&M 2013. 4 December 2013. Paris, France.

Vinay, S., Shridhar, A., Sudhakara, G. (2013). A Quantitative Approach Using Goal-

Oriented Requirements Engineering Methodology and Analytic Hierarchy

Process in Selecting the Best Alternative. Proceedings of International

Conference on Advances in Computing Advances in Intelligent Systems and

Computing. December 2012. pp. 441-454.

Xu, B., LiGuo, H. and He, Z. (2010). On Scoping Stakeholders and Artifacts in

Software Process. Proceedings of 2010 International Conference on Software

Process (ICSP 2010). Paderborn, Germany, pp. 39 - 51.

Yuanyuan, Z., Mark, H., Anthony, F., S.Afshin, M. (2011). Comparing the

performance of metaheuristics for the analysis of multi-stakeholder tradeoffs

in requirements optimisation, Information and Software Technology, 53,

761-773.