Upload
javadch
View
204
Download
0
Embed Size (px)
Citation preview
BEXIS Tech Talk Series
#1: The Big Picture
Javad ChamanaraDecember 2015
BEXIS Tech Talk #1: The Big Picture 2
BExIS++ Project
BEXIS 2 SOFTWARE DEVELOPMENT
SUSTAINABILITYOUTREACH
SUPPORT
TRAINING
BEXIS Tech Talk #1: The Big Picture 4
Software Development
Data Management Platform• (large) research projects • tabular data, but not limited to• data integration and re-use
BEXIS Tech Talk #1: The Big Picture 5
Community
GRK 1666
GRK 1086
BEXIS 2
BExIS 1
BExIS 2Biodiversity
Exploratories
JenaExperiment
MPI-BGCResearchDatabase
Kilimanjaro
EFForTS
GFBio
AquaDiva
BEFmate
iDiv
UFZ Halle
TerraSensE
BEXIS Tech Talk #1: The Big Picture 6
Project Partners
BEXIS Tech Talk #1: The Big Picture 7
Tech Talk Series
• A Series of talks on– Various parts of the software– Software development
• In order to:– Promote knowledge sharing– Encourage external contribution
This is the first one!
BEXIS Tech Talk #1: The Big Picture 8
Requirements
• Data Lifecycle Management• Generic• Extensible• Portable• Scalable
BEXIS Tech Talk #1: The Big Picture 9
Requirements -> DLM
• Flexible Data Structures• Data Submission• Validation• Preserving• Metadata Management• Versioning
BEXIS Tech Talk #1: The Big Picture 10
Requirements -> Generic
• Modular• Workflow based
BEXIS Tech Talk #1: The Big Picture 11
Requirements -> Extensible
• Built-in Modules– DLM related modules
• Third Party Modules– BExIS 1 modules– AquaDiva modules– iDiv modules– Open modules
• Interaction with external systems– Geographic Information Systems– Persistent Identifier Providers– Authentication Providers– Annotation Providers
BEXIS Tech Talk #1: The Big Picture 12
Requirements -> Portable
• Multi DBMS support– IBM DB2– PostgreSQL– MS SQL Server
• Various Installation Scenarios– Dedicated hosting– Shared hosting– Portable hosting– Multi-tier Deployment– Secure Access
BEXIS Tech Talk #1: The Big Picture 13
Requirements -> Scalable
• To be used in large projects with– Multitude of Users– Big Datasets– Frequent Access
BEXIS Tech Talk #1: The Big Picture 14
Out of Scope
• Sophisticated Data Analysis Tool• Long Term Public Repository
BEXIS Tech Talk #1: The Big Picture 15
Questions?
• Short break• Feedback…
BEXIS Tech Talk #1: The Big Picture 16
Conceptual Overview
DataMetadata
Data StructureMetadata Structure Semantics Geo
Administration Security
«use»
«use»
«use» «use»
«use»
BEXIS Tech Talk #1: The Big Picture 17
Conceptual->Data
• Dataset– Tabular– Matrix
• Dataset Version• Data Tuple• Customization
BEXIS Tech Talk #1: The Big Picture 18
Conceptual->Data Structure
• Data Structure• Data Attribute
– Unit of measurement– Constraints– Value Validation
• Reuse promotion
BEXIS Tech Talk #1: The Big Picture 19
Conceptual->Metadata
• Metadata• Various metadata standards• Metadata mapping
BEXIS Tech Talk #1: The Big Picture 20
Conceptual->Metadata Structure
• Metadata Structure• Metadata Attribute
– Simple Types: Name, email– Compound types: Geographical extent, Author
• Reuse promotion– Schema matching– Semantic comparison
BEXIS Tech Talk #1: The Big Picture 21
Conceptual->Administration
• Project• Organization• People• Location• Relationship among them
BEXIS Tech Talk #1: The Big Picture 22
Design Overview
• Data• Functionality• Architecture
BEXIS Tech Talk #1: The Big Picture 23
Design Overview -> Data
• Relational• XML• Files
– CSV, Excel, Images, etc.• Configuration• Seed• Geographical
BEXIS Tech Talk #1: The Big Picture 24
Design Overview -> Functionality
• Core Functionality– Data Lifecycle Management
• Dataset/ Data Structure• Metadata/ Structure• Versioning
– AAA• Authentication• Authorization• Auditing
BEXIS Tech Talk #1: The Big Picture 25
Design Overview -> Architecture
Components• DLM• AAA• Transformation
– XML <-> XML– CSV <-> Excel– …
BEXIS Tech Talk #1: The Big Picture 26
Design Overview -> Architecture
Modules• A set of user oriented/facing functions• Crossing multiple layers, including the UI• Examples:
– DCM: Data Collection Module– DDM: Data Discovery Module– DIM: Data Integration Module
BEXIS Tech Talk #1: The Big Picture 27
Design Overview -> Architecture
External Dependencies• Geo Server• Services
– Terminology– PID– Authentication
BEXIS Tech Talk #1: The Big Picture 28
Design Overview -> Architecture
Public Services (APIs)• Public REST Services
– Download a dataset– Metadata Harvesting
• R Interface
BEXIS Tech Talk #1: The Big Picture 29
Questions?
• Short break…
BEXIS Tech Talk #1: The Big Picture 30
Development Environment
Tools• Visual Studio• Team Foundation Server (task & source
management)• Github (Public Releases)
BEXIS Tech Talk #1: The Big Picture 31
Development Environment
Basics– .NET ecosystem– C#– MVC– ORM– jQuery
BEXIS Tech Talk #1: The Big Picture 32
Development Environment
DBMS• IBM DB2 version 9.x and upper• PostgreSQL version 8.x and upper• MS SQL Server 2008 and upper
BEXIS Tech Talk #1: The Big Picture 33
Deployment
• MS IIS• Dedicated Hosting• Virtual Machine Hosting• Portable Hosting• Multi-tier Deployment
BEXIS Tech Talk #1: The Big Picture 34
Outlook
Whats next in the talk series?
• The Conceptual Model in more detail• The database design
BEXIS Tech Talk #1: The Big Picture 3535
Thanks!Questions?
Contact:[email protected]://fusion.cs.uni-jena.de/bexis
Acknowledgment