Upload
tanner-weatherby
View
230
Download
1
Tags:
Embed Size (px)
Citation preview
MSc Communications SoftwareDissertation Support
01 Research Process
MSc Communications SoftwareDissertation Support
01 Research Process
Mícheál Ó Foghlú[email protected]ícheál Ó Foghlú
Revised ScheduleRevised Schedule Mon 12th Jan Thomas Magedanz - Guest Lecture on IMS Wed 14th Jan Presentations Wed 21st Jan Presentations Wed 28th Jan IPv6 Summit (Dublin Castle) Wed 4th Feb EMPTY - to be scheduled? Wed 11th Feb Session 01 Wed 25th Feb EMPTY - CHANGED was Session 02 Wed 4th Mar Session 02 - CHANGED was EMPTY Wed 11th Mar Session 03 Wed 18th Mar EMPTY - to be scheduled? Wed 25th Mar EMPTY - to be scheduled? Wed 1st Apr Session 04 Wed 22nd Apr Session 05
Sessions 01-05 to be delivered by Mícheál Ó Foghlú
Mon 12th Jan Thomas Magedanz - Guest Lecture on IMS Wed 14th Jan Presentations Wed 21st Jan Presentations Wed 28th Jan IPv6 Summit (Dublin Castle) Wed 4th Feb EMPTY - to be scheduled? Wed 11th Feb Session 01 Wed 25th Feb EMPTY - CHANGED was Session 02 Wed 4th Mar Session 02 - CHANGED was EMPTY Wed 11th Mar Session 03 Wed 18th Mar EMPTY - to be scheduled? Wed 25th Mar EMPTY - to be scheduled? Wed 1st Apr Session 04 Wed 22nd Apr Session 05
Sessions 01-05 to be delivered by Mícheál Ó Foghlú
Schedule DetailSchedule Detail
01 What is research? Philosophy, Epistemology, Methodology and Method
02 How to write academically? Some simple language rules Some simple structure rules
03 What’s the big deal with plagiarism? Bibliographies, references and citations, … Doing it in Word Doing it with other tools like LaTeX/BibTeX
04 Results - how to do experiments Support tools: simulation, data analysis, …
05 Discussion
01 What is research? Philosophy, Epistemology, Methodology and Method
02 How to write academically? Some simple language rules Some simple structure rules
03 What’s the big deal with plagiarism? Bibliographies, references and citations, … Doing it in Word Doing it with other tools like LaTeX/BibTeX
04 Results - how to do experiments Support tools: simulation, data analysis, …
05 Discussion
About the PresenterAbout the Presenter Current Position
Research Director Telecommunications Software & Systems Group (WIT) –160 staff and students; 20 PostGrad students; 40 projects
Lecturer in department of Computing, Mathematics & Physics (a.k.a. P&Q)
Supervision and Research Procedural Related Experience Member of 2nd and 3rd WIT Academic Councils (Support
Subcommittee, Research Subcommittee) Involved in numerous HETAC evaluation panels, in particular for
delegation of authority to award at levels 8, 9 and 10. Supervised 3 MSc to completion as named primary, 11 MSc to
completion as named secondary, 27 MSc to completion as TSSG research co-ordinator. First 3 PhD graduated 2008.
External examiner for NUI Maynooth (1 MEng), Cork IT (2 MSc), Athlone IT (1 MSc)
Current Position Research Director Telecommunications Software & Systems Group
(WIT) –160 staff and students; 20 PostGrad students; 40 projects Lecturer in department of Computing, Mathematics & Physics
(a.k.a. P&Q) Supervision and Research Procedural Related Experience
Member of 2nd and 3rd WIT Academic Councils (Support Subcommittee, Research Subcommittee)
Involved in numerous HETAC evaluation panels, in particular for delegation of authority to award at levels 8, 9 and 10.
Supervised 3 MSc to completion as named primary, 11 MSc to completion as named secondary, 27 MSc to completion as TSSG research co-ordinator. First 3 PhD graduated 2008.
External examiner for NUI Maynooth (1 MEng), Cork IT (2 MSc), Athlone IT (1 MSc)
Presentation OutlinePresentation Outline
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
Presentation OutlinePresentation Outline
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
What is Science (Philosophically)?What is Science
(Philosophically)? The distinction drawn between science and philosophy
is of relatively recent origin. Prior to the nineteenth century, science was considered to be a part of philosophy and not an intellectual endeavor separate from it. What we know today as the scientific method began to take on its modern form in the period from the mid-1500s to the early 1700s, and what we now call science was known until into the nineteenth century as natural philosophy.
http://www.mrc.uidaho.edu/~rwells/Critical%20Philosophy%20and%20Mind/Chapter%2002.pdf
The distinction drawn between science and philosophy is of relatively recent origin. Prior to the nineteenth century, science was considered to be a part of philosophy and not an intellectual endeavor separate from it. What we know today as the scientific method began to take on its modern form in the period from the mid-1500s to the early 1700s, and what we now call science was known until into the nineteenth century as natural philosophy.
http://www.mrc.uidaho.edu/~rwells/Critical%20Philosophy%20and%20Mind/Chapter%2002.pdf
What is Science (Philosophically)?What is Science
(Philosophically)? So Science is “Natural Philosophy” – an attempt to understand the
rules of the natural world by observation and testing (experimentation)
In general the Scientific method was finalised by Karl Popper as the attempt to confirm a falsifiable hypothesis
e.g. Are the tides caused by water in the ocean expanding? Test by observing high tides at opposite sides of the ocean.
In logic (the philosophy of science) Pierce emphasised the requirement to combine inductive reasoning (to generate a hypothesis) with deductive reasoning (to test it)
Syllogisms were first formalised by Aristotle, e.g. deduction… Socrates is a man (assertion 1) an observable fact All men are mortal (assertion 2) a generalised rule Socrates is mortal (deduction) a new fact, harder to observe directly
Aside: a third form of syllogistic reasoning, abductive reasoning, was defined by Pierce and has since been very influential in attempts at artificial intelligence in the 20th Century
So Science is “Natural Philosophy” – an attempt to understand the rules of the natural world by observation and testing (experimentation)
In general the Scientific method was finalised by Karl Popper as the attempt to confirm a falsifiable hypothesis
e.g. Are the tides caused by water in the ocean expanding? Test by observing high tides at opposite sides of the ocean.
In logic (the philosophy of science) Pierce emphasised the requirement to combine inductive reasoning (to generate a hypothesis) with deductive reasoning (to test it)
Syllogisms were first formalised by Aristotle, e.g. deduction… Socrates is a man (assertion 1) an observable fact All men are mortal (assertion 2) a generalised rule Socrates is mortal (deduction) a new fact, harder to observe directly
Aside: a third form of syllogistic reasoning, abductive reasoning, was defined by Pierce and has since been very influential in attempts at artificial intelligence in the 20th Century
What is Engineering/Technology?
What is Engineering/Technology?
The typical natural scientist does not go to any great effort to conceal his belief that engineering is not a science. “You do not study science in order to add to our knowledge of nature,” he will say. “You only study science in order to exploit nature for commercial purposes.”
But, on the other hand, it is also true that some engineers (usually those with Ph.D. degrees) do engage in research and do carry out investigations on topics in a fashion that is practically indistinguishable from the working practices of the physicist.
The typical natural scientist does not go to any great effort to conceal his belief that engineering is not a science. “You do not study science in order to add to our knowledge of nature,” he will say. “You only study science in order to exploit nature for commercial purposes.”
But, on the other hand, it is also true that some engineers (usually those with Ph.D. degrees) do engage in research and do carry out investigations on topics in a fashion that is practically indistinguishable from the working practices of the physicist.
The Research ProcessThe Research Process Simple view:
Register for a postgraduate degree Automatic if registered on MSc (taught)
Read, write and work on “research” Produce thesis (mini-dissertation) Graduate with postgraduate degree
Simple view: Register for a postgraduate degree
Automatic if registered on MSc (taught) Read, write and work on “research” Produce thesis (mini-dissertation) Graduate with postgraduate degree
The Research ProcessThe Research Process Related skills:
Writing (final thesis, work along the way, academic papers)
Presenting (papers at conferences, internal seminars)
Understanding (development of expertise within the domain of the thesis)
Ownership/Management (charting a path through - creation and management of work programme)
Related skills: Writing (final thesis, work along the way,
academic papers) Presenting (papers at conferences, internal
seminars) Understanding (development of expertise
within the domain of the thesis) Ownership/Management (charting a path
through - creation and management of work programme)
“Research” Definitions (UK RAE)“Research” Definitions (UK RAE)“‘Research’ for the purpose of the RAE is to be understood as original
investigation undertaken in order to gain knowledge and understanding. It includes work of direct relevance to the needs of commerce, industry, and to the public and voluntary sectors; scholarship*; the invention and generation of ideas, images, performances, artefacts including design, where these lead to new or substantially improved insights; and the use of existing knowledge in experimental development to produce new or substantially improved materials, devices, products and processes, including design and construction. It excludes routine testing and routine analysis of materials, components and processes such as for the maintenance of national standards, as distinct from the development of new analytical techniques. It also excludes the development of teaching materials that do not embody original research.
* Scholarship for the RAE is defined as the creation, development and maintenance of the intellectual infrastructure of subjects and disciplines, in forms such as dictionaries, scholarly editions, catalogues and contributions to major research databases.”
(UK RAE 2006)
“‘Research’ for the purpose of the RAE is to be understood as original investigation undertaken in order to gain knowledge and understanding. It includes work of direct relevance to the needs of commerce, industry, and to the public and voluntary sectors; scholarship*; the invention and generation of ideas, images, performances, artefacts including design, where these lead to new or substantially improved insights; and the use of existing knowledge in experimental development to produce new or substantially improved materials, devices, products and processes, including design and construction. It excludes routine testing and routine analysis of materials, components and processes such as for the maintenance of national standards, as distinct from the development of new analytical techniques. It also excludes the development of teaching materials that do not embody original research.
* Scholarship for the RAE is defined as the creation, development and maintenance of the intellectual infrastructure of subjects and disciplines, in forms such as dictionaries, scholarly editions, catalogues and contributions to major research databases.”
(UK RAE 2006)
“Research” Pasteur’s Quadrant
“Research” Pasteur’s Quadrant
Yes
Pure basic research Bohr’s Quadrant
Use-inspired basic research Pasteur’s Quadrant
No
Pure applied research Edison’s Quadrant Quest for fundamental understanding?
No Yes
Considerations of use?
Yes
Pure basic research Bohr’s Quadrant
Use-inspired basic research Pasteur’s Quadrant
No
Pure applied research Edison’s Quadrant Quest for fundamental understanding?
No Yes
Considerations of use?
Stokes, DE (1997) Pasteur’s Quadrant: Basic Science and Technological Innovation Brookings Institution
Press: Washington DC
Models: HumanitiesModels: Humanities
Scholarship Produce an edition of a text (e.g. translate a
text and produce annotated edition) Criticism
Argue a case based on examples from literature
Artistic creation Create a portfolio of work
Scholarship Produce an edition of a text (e.g. translate a
text and produce annotated edition) Criticism
Argue a case based on examples from literature
Artistic creation Create a portfolio of work
Models: Social Sciences/Business
Models: Social Sciences/Business
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove
the hypotheses Ethnographic (qualitative)
Discuss a series of case studies in great detail abstracting general principles (though not strictly proven)
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove
the hypotheses Ethnographic (qualitative)
Discuss a series of case studies in great detail abstracting general principles (though not strictly proven)
Models: Science/MathematicsModels: Science/Mathematics
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove
the hypotheses Theoretical
Propound a new theory which it may not be possible to test at present
Mathematical Produce a proof in mathematics
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove
the hypotheses Theoretical
Propound a new theory which it may not be possible to test at present
Mathematical Produce a proof in mathematics
Models: Engineering/Technology
Models: Engineering/Technology
Developmental Develop a prototype using innovative technologies
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove the
hypotheses Ethnographic (qualitative)
Discuss a series of case studies in great detail abstracting general principles (though not strictly proven)
Developmental Develop a prototype using innovative technologies
Experimental (quantitative) Carry out experiments to test a series of hypotheses Show that the figures produced prove or disprove the
hypotheses Ethnographic (qualitative)
Discuss a series of case studies in great detail abstracting general principles (though not strictly proven)
Models of the Research Process
Models of the Research Process
Models: Managing the Research Process
Models: Managing the Research Process
Project management Traditional project management tries to
control as many of the variables as possible Each step is precisely estimated (time and
cost) Research is much more fluid, but can still
benefit from some of the rigour of project management
Usually deadlines are set
Project management Traditional project management tries to
control as many of the variables as possible Each step is precisely estimated (time and
cost) Research is much more fluid, but can still
benefit from some of the rigour of project management
Usually deadlines are set
Managing the Research Process (MSc taught)
Managing the Research Process (MSc taught)
Investigation phase (during 1st 2 semesters) Read and analyse the state of the art, produce a draft
literature review Place your work in the context of other academic work in
the domain Explore feasibility by doing what you intend to do so you
know if it is going to work out Activity phase(s) (start of summer Jun/Jul)
Using an appropriate methodology carry out the main body of the work
Translate and edit a book Carry out experiments Develop software prototypes
Write-up phase (end of summer Aug) Produce the thesis
Investigation phase (during 1st 2 semesters) Read and analyse the state of the art, produce a draft
literature review Place your work in the context of other academic work in
the domain Explore feasibility by doing what you intend to do so you
know if it is going to work out Activity phase(s) (start of summer Jun/Jul)
Using an appropriate methodology carry out the main body of the work
Translate and edit a book Carry out experiments Develop software prototypes
Write-up phase (end of summer Aug) Produce the thesis
Models: Managing the Research Process
Models: Managing the Research Process
Despite having a “write-up” phase, you should be writing all the way through your research, much of which can be reused in the final thesis, but much will need reworking
Despite having a “write-up” phase, you should be writing all the way through your research, much of which can be reused in the final thesis, but much will need reworking
Scientific MethodScientific Method Pose a research question in the form of a
testable hypothesis Define an experimental process to test this
hypothesis Carry out the experiments to these this
hypothesis Analyse the results and decide if the
hypothesis is proved (for now) or disproved Publish the results (and the process used to
generate them) Allow other to refute the results with counter
examples so that nothing is ever proved fully, but is always open to refutation later
Pose a research question in the form of a testable hypothesis
Define an experimental process to test this hypothesis
Carry out the experiments to these this hypothesis
Analyse the results and decide if the hypothesis is proved (for now) or disproved
Publish the results (and the process used to generate them)
Allow other to refute the results with counter examples so that nothing is ever proved fully, but is always open to refutation later
Summary: The Research ProcessSummary: The Research Process
The Research Process What is the research process?
It is different in different disciplines Within a discipline there may be a number of options There are a lot of similarities across disciplines
How can you manage it? As research students you should take control of the
process for yourselves Ideally this should happen within a structured
environment (and research ethos)
The Research Process What is the research process?
It is different in different disciplines Within a discipline there may be a number of options There are a lot of similarities across disciplines
How can you manage it? As research students you should take control of the
process for yourselves Ideally this should happen within a structured
environment (and research ethos)
Presentation OutlinePresentation Outline
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
MSc (research) versus MSc (taught)
MSc (research) versus MSc (taught)
No MSc has to produce new knowledge – that’s a PhD
An MSc (research) has much more emphasis on the full research process as defined here
An MSc (taught) has some emphasis on introducing you to the research process as defined here
No MSc has to produce new knowledge – that’s a PhD
An MSc (research) has much more emphasis on the full research process as defined here
An MSc (taught) has some emphasis on introducing you to the research process as defined here
So how does that effect my mini-dissertation?
So how does that effect my mini-dissertation?
You must be aware of the need to validate your work in a wider context
You cannot simply develop something and run it – that does not prove anything
You must, at the very least, test what you have built, and compare it with the state of the art showing how you have progressed things in some way
You must be aware of the need to validate your work in a wider context
You cannot simply develop something and run it – that does not prove anything
You must, at the very least, test what you have built, and compare it with the state of the art showing how you have progressed things in some way
So what can I do?So what can I do? Ideally: situate your work as a testable
hypothesis, and present your results in this context
Otherwise: at the very least situate your work firmly within an academic research field (for comparison), and demonstrate how you evaluated your work formally within this context.
Ideally: situate your work as a testable hypothesis, and present your results in this context
Otherwise: at the very least situate your work firmly within an academic research field (for comparison), and demonstrate how you evaluated your work formally within this context.
So what does that mean?So what does that mean?
If you want to develop some software, you must show that it is not simply doing the job inefficiently, that has been done elsewhere more efficiently already (though it is okay to be somewhat derivative in an MSc (taught).
If you want to develop some software, you must show that it is not simply doing the job inefficiently, that has been done elsewhere more efficiently already (though it is okay to be somewhat derivative in an MSc (taught).
Danger Signs of a Bad Research Mini-Dissertation
Danger Signs of a Bad Research Mini-Dissertation
All the references are websites and/or standards documents (no academic papers)
The work describes how a software prototype was built, does not discuss or test/evaluate whether the software is any use for anything
The literature review discusses an abstract set of papers without being critical of any of them, and without having an argument being made (literature reviews support the understanding of a research question – they do not exist for their own sake)
The mini-dissertation is not formatted or structured properly, and/or reads too informally or just uses bad English
All the references are websites and/or standards documents (no academic papers)
The work describes how a software prototype was built, does not discuss or test/evaluate whether the software is any use for anything
The literature review discusses an abstract set of papers without being critical of any of them, and without having an argument being made (literature reviews support the understanding of a research question – they do not exist for their own sake)
The mini-dissertation is not formatted or structured properly, and/or reads too informally or just uses bad English
Good Signals of Good ResearchGood Signals of Good Research
The mini-dissertation makes a clear argument all the way through from introduction to conclusion
The dissertation is clearly formatted, structured, and written
It is clear how an academic research paper could be written based on the research in the dissertation (not a requirement for an MSc (taught) but a clear indication of quality)
The dissertation is focused on the results, and not on stating the problem
The mini-dissertation makes a clear argument all the way through from introduction to conclusion
The dissertation is clearly formatted, structured, and written
It is clear how an academic research paper could be written based on the research in the dissertation (not a requirement for an MSc (taught) but a clear indication of quality)
The dissertation is focused on the results, and not on stating the problem
NomenclatureNomenclature Epistemology
A systematic structure for knowledge (what does knowledge mean to you)?
In scientific research this is not usually debated – it is assumed – there is an assumption that any solution to a problem can be modelled mathematically and then that such models can be tested
Methodology A systematic approach to carrying out research (e.g. use a
real testbed experimental-based approach to investigate new Quality of Service protocols, or use a simulation approach for the same purpose)
Method A particular mechanism for conducting some research (e.g.
carry out a particular experiment using a Latin Square design of control group and tested groups to measure QoS on a network using different QoS schemes)
Epistemology A systematic structure for knowledge (what does
knowledge mean to you)? In scientific research this is not usually debated – it is
assumed – there is an assumption that any solution to a problem can be modelled mathematically and then that such models can be tested
Methodology A systematic approach to carrying out research (e.g. use a
real testbed experimental-based approach to investigate new Quality of Service protocols, or use a simulation approach for the same purpose)
Method A particular mechanism for conducting some research (e.g.
carry out a particular experiment using a Latin Square design of control group and tested groups to measure QoS on a network using different QoS schemes)
MethodologyMethodology A software development methodology is about
developing good software code and is not the basis of any research process
A research methodology is about producing new knowledge in a way that can be validated
This does not mean you shouldn’t use software development methodologies, but simply that these are not the focus of your research
A software development methodology is about developing good software code and is not the basis of any research process
A research methodology is about producing new knowledge in a way that can be validated
This does not mean you shouldn’t use software development methodologies, but simply that these are not the focus of your research
Presentation OutlinePresentation Outline
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
A) Theory(What is the big deal about epistemology
and research methodology?) B) Practice
(What does it mean in practice for the MSc Communications Software dissertation?)
C) Conclusion
Common WeaknessesCommon Weaknesses How do/can you evaluate your research work?
(if you cannot – then refocus towards something you can evaluate)
Have you left at least 2 months to do this evaluation? The actual process of evaluation may involve running experiments to test the performance of your code, for example, this takes time.
Have you written your dissertation to allow for at least 1/3 of it being critical evaluation, supported by evidence?
How do/can you evaluate your research work? (if you cannot – then refocus towards something you can evaluate)
Have you left at least 2 months to do this evaluation? The actual process of evaluation may involve running experiments to test the performance of your code, for example, this takes time.
Have you written your dissertation to allow for at least 1/3 of it being critical evaluation, supported by evidence?
ConclusionConclusion You must step back from your research and put it in
some context You must consider the question: was your research any
good? And try and answer this in your mini-dissertation The requirement for an MSc (taught) is the lowest for
any such research, so merely attempting to do this should be enough
For a PhD the requirement is the highest, and you must prove that you have created new knowledge in your field and can defend this in your thesis and in an oral examination
You should understand this difference having done an MSc (taught) even though you are not under a requirement to produce new knowledge
You must step back from your research and put it in some context
You must consider the question: was your research any good? And try and answer this in your mini-dissertation
The requirement for an MSc (taught) is the lowest for any such research, so merely attempting to do this should be enough
For a PhD the requirement is the highest, and you must prove that you have created new knowledge in your field and can defend this in your thesis and in an oral examination
You should understand this difference having done an MSc (taught) even though you are not under a requirement to produce new knowledge
ASIDE: 10/20/30 RULEASIDE: 10/20/30 RULE Anything important should be able to
said in 20 minutes - shorter is better If using slides the maximum number
should be 10 (2 minutes per slide) If using slides the maximum point size
should be 30 points (otherwise the slide is too crowded)
All rules are made to be broken - but aim to follow these rules and justify any exceptions to yourself
Anything important should be able to said in 20 minutes - shorter is better
If using slides the maximum number should be 10 (2 minutes per slide)
If using slides the maximum point size should be 30 points (otherwise the slide is too crowded)
All rules are made to be broken - but aim to follow these rules and justify any exceptions to yourself