34
BEXIS Tech Talk Series #1: The Big Picture Javad Chamanara December 2015

1 the big picture

  • Upload
    javadch

  • View
    204

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 1 the big picture

BEXIS Tech Talk Series

#1: The Big Picture

Javad ChamanaraDecember 2015

Page 2: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 2

BExIS++ Project

BEXIS 2 SOFTWARE DEVELOPMENT

SUSTAINABILITYOUTREACH

SUPPORT

TRAINING

Page 3: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 4

Software Development

Data Management Platform• (large) research projects • tabular data, but not limited to• data integration and re-use

Page 4: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 5

Community

GRK 1666

GRK 1086

BEXIS 2

BExIS 1

BExIS 2Biodiversity

Exploratories

JenaExperiment

MPI-BGCResearchDatabase

Kilimanjaro

EFForTS

GFBio

AquaDiva

BEFmate

iDiv

UFZ Halle

TerraSensE

Page 5: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 6

Project Partners

Page 6: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 7

Tech Talk Series

• A Series of talks on– Various parts of the software– Software development

• In order to:– Promote knowledge sharing– Encourage external contribution

This is the first one!

Page 7: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 8

Requirements

• Data Lifecycle Management• Generic• Extensible• Portable• Scalable

Page 8: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 9

Requirements -> DLM

• Flexible Data Structures• Data Submission• Validation• Preserving• Metadata Management• Versioning

Page 9: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 10

Requirements -> Generic

• Modular• Workflow based

Page 10: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 11

Requirements -> Extensible

• Built-in Modules– DLM related modules

• Third Party Modules– BExIS 1 modules– AquaDiva modules– iDiv modules– Open modules

• Interaction with external systems– Geographic Information Systems– Persistent Identifier Providers– Authentication Providers– Annotation Providers

Page 11: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 12

Requirements -> Portable

• Multi DBMS support– IBM DB2– PostgreSQL– MS SQL Server

• Various Installation Scenarios– Dedicated hosting– Shared hosting– Portable hosting– Multi-tier Deployment– Secure Access

Page 12: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 13

Requirements -> Scalable

• To be used in large projects with– Multitude of Users– Big Datasets– Frequent Access

Page 13: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 14

Out of Scope

• Sophisticated Data Analysis Tool• Long Term Public Repository

Page 14: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 15

Questions?

• Short break• Feedback…

Page 15: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 16

Conceptual Overview

DataMetadata

Data StructureMetadata Structure Semantics Geo

Administration Security

«use»

«use»

«use» «use»

«use»

Page 16: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 17

Conceptual->Data

• Dataset– Tabular– Matrix

• Dataset Version• Data Tuple• Customization

Page 17: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 18

Conceptual->Data Structure

• Data Structure• Data Attribute

– Unit of measurement– Constraints– Value Validation

• Reuse promotion

Page 18: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 19

Conceptual->Metadata

• Metadata• Various metadata standards• Metadata mapping

Page 19: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 20

Conceptual->Metadata Structure

• Metadata Structure• Metadata Attribute

– Simple Types: Name, email– Compound types: Geographical extent, Author

• Reuse promotion– Schema matching– Semantic comparison

Page 20: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 21

Conceptual->Administration

• Project• Organization• People• Location• Relationship among them

Page 21: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 22

Design Overview

• Data• Functionality• Architecture

Page 22: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 23

Design Overview -> Data

• Relational• XML• Files

– CSV, Excel, Images, etc.• Configuration• Seed• Geographical

Page 23: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 24

Design Overview -> Functionality

• Core Functionality– Data Lifecycle Management

• Dataset/ Data Structure• Metadata/ Structure• Versioning

– AAA• Authentication• Authorization• Auditing

Page 24: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 25

Design Overview -> Architecture

Components• DLM• AAA• Transformation

– XML <-> XML– CSV <-> Excel– …

Page 25: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 26

Design Overview -> Architecture

Modules• A set of user oriented/facing functions• Crossing multiple layers, including the UI• Examples:

– DCM: Data Collection Module– DDM: Data Discovery Module– DIM: Data Integration Module

Page 26: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 27

Design Overview -> Architecture

External Dependencies• Geo Server• Services

– Terminology– PID– Authentication

Page 27: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 28

Design Overview -> Architecture

Public Services (APIs)• Public REST Services

– Download a dataset– Metadata Harvesting

• R Interface

Page 28: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 29

Questions?

• Short break…

Page 29: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 30

Development Environment

Tools• Visual Studio• Team Foundation Server (task & source

management)• Github (Public Releases)

Page 30: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 31

Development Environment

Basics– .NET ecosystem– C#– MVC– ORM– jQuery

Page 31: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 32

Development Environment

DBMS• IBM DB2 version 9.x and upper• PostgreSQL version 8.x and upper• MS SQL Server 2008 and upper

Page 32: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 33

Deployment

• MS IIS• Dedicated Hosting• Virtual Machine Hosting• Portable Hosting• Multi-tier Deployment

Page 33: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 34

Outlook

Whats next in the talk series?

• The Conceptual Model in more detail• The database design

Page 34: 1 the big picture

BEXIS Tech Talk #1: The Big Picture 3535

Thanks!Questions?

Contact:[email protected]://fusion.cs.uni-jena.de/bexis

Acknowledgment