Data managment

05/03/23 1

GROUP H

• MUHAMMAD WAQAR ABID• MUHAMMAD ADNAN• MUHAMMAD ABRAR • SHARJEEL AHMED• UMER IRFAN• SOHAIB MANZOOR

05/03/23 2

DATA MANAGMENT

• Data managmet is the process of controlling the information generated during a research project.

05/03/23 3

PRINCIPLES OF DAMA• Research Data - defines the materials covered in

a data management plan• Data Planning - outlines steps to take before

beginning a research project• Data Management - describes procedures for

organizing and controlling research data• Data Security - provides considerations for data

access and long-term data stability• Data Sharing - explains why sharing research

data is important05/03/23 4

INTEGRATED DAMA

Integrated data management (IDM) is tools approach to facilitate data management and improve performance.IDM's purpose is to:

•Produce enterprise-ready applications faster•Improve data access, speed iterative testing•Empower collaboration between architects, developers and DBAs

05/03/23 5

TYPES OF DAMA

1. BUSINESS MANAGMENT2. DATA ARCHITECTURE AND DESIGN3. DOCUMENT AND RECORDS MA4. DATA SECURITY MANAGMENT5. CONTACT DATA MANAGMENT

05/03/23 6

Business Management

05/03/23 7

Business Management is a course of study leading to an A.A.S. degree. The coursework includes both general requirements (liberal arts courses) as well as curriculum requirements (business courses).

Data Architecture & Design

• Data architecture should be defined in the planning phase of the design of a new data processing and storage

05/03/23 8

Document & Records management

• Documents management is the process of handling documents in a way that enables then to be created shared ,organized stored & retrieved efficiently & effectively.

• Records management is the practice of maintaining records including classifying storing,securing destruction or archieval preservation ,which protects fragile historical archieves & assures permanent records are accessible & readable for years into the future.

9

Data Security Management

• Data security management is way to maintain the integrity of data and to make sure that the data is not accessible by unauthorized parties or susceptible to corruption of data..Data security is put in place to ensure privacy in addition or protecting this data.

05/03/23 10

Cotact Data management

• Contact data management vendors offer a range of services ,including data health check, list procurement, ongoing data cleansing & appending & specialized research services …

05/03/23 11

What are the specific duties of DMP (Data Management Platform)?

• Record Data:– Traffic Sources– Cookie– FB id– Operation Record

• Save Data:– All the data collected are segmented and

saved for analysis

05/03/23 12

Data management platform (issues)

05/03/23 13

• Lot of data maintenance

• Security and privacy concerns

• Considerable amount of cost and time spent during implementation

Data storage options

1. Personal computers (PCs) & laptops

2. External storage devices

3. Networked Drives

4. Cloud servers

05/03/23 14

05/03/23 15

Data storage options

15

Local Remote

Computer

External storage

Network server

Network server

Cloud storage

Google Apps

Box, Dropbox, etc.

05/03/23 16

Storage: PC/laptop

AdvantagesConvenient

DisadvantagesDrive failure common

Laptops: susceptible to theft & unintentional damage

Not replicated

Bottom LineDo NOT use to store master copies of data

Not a long term storage solution

Back up important data & files regularly

05/03/23 17

Storage: networked drivesAdvantages

Data in single place, backed up regularly

Replicated storage not vulnerable to loss due to hardware failure

Secure storage minimizes risk of loss, theft, unauthorized use

Available as needed (assuming network avail.)Disadvantages

Cost may be prohibitive; export controlBottom Line

Highly recommended for master copies of data

Recommended for long-term storage (~5 years)

Storage: external storage devicesAdvantagesConvenient, cheap & portable

DisadvantagesLongevity not guaranteed (e.g. Zip disks)

Errors writing to CD/DVD are common

Easily damaged, misplaced or lost (=security risk)

May not be big enough to hold all data; multiple drives needed

Bottom LineDo NOT use to store master copies of data

Not recommended for long-term storage

05/03/23 18

05/03/23 19

Storage: Google Drive Advantages

All same advantages of network & cloud storageFile sharing & collaboration w/variable access levelsUnlimited storage (GD), 30 GB non-GDAutomatic version control on GD

Disadvantages30 GB may not be enoughUpload/download bottleneck

Bottom LinePossibly recommended for master copies of dataPossibly not recommended for in-process data, large files

05/03/23 20

Data backup

“Keeping backups is probably your most important data

management task.”-Everyone

1. Some data backup is better than none.2. Automated backups are better than

manual.3. Your data are only as safe as your last

backup.

05/03/23 21

Data backup

Best Practice: 3 Copies of datasets

Aspects of Research Data Management

•DMPs/Planning•Storage & backup•File organization & naming•Documentation & metadata•Legal/ethical considerations•Sharing & reuse•Preservation & Archiving

05/03/23 22

05/03/23 23

Data sharing & reuse

“...digitally formatted scientific data resulting from unclassified research supported wholly or in part by Federal funding should be stored and publicly publicly accessible accessible to search, retrieve, and analyze.”

What is metadata ?

• Data about data• Structured information that describes,

explains, locates, or otherwise makes it easier to retrieve, use, or manage an information resource.

05/03/23 24

05/03/23 2505/03/23 25

File naming strategies

Order by date:1955-04-12_notes_MassObs.docx1955-04-12_questionnaire_MassObs.pdf1963-12-15_notes_Gorer.docx1963-12-15_questionnaire_Gorer.pdf

Order by subject:Gorer_notes_1963-12-15.docxGorer_questionnaire_1963-12-15.pdfMassObs_notes_1955-04-12.docxMassObs_questionnaire_1955-04-12.pdf

Order by type:Notes_Gorer_1963-12-15.docxNotes_MassObs_1955-04-12.docxQuestionnaire_Gorer_1963-12-15.pdfQuestionnaire_MassObs_1955-04-12.pdf

Forced order with numbering:01_MassObs_questionnaire_1955-04-12.pdf

02_MassObs_notes_1955-04-12.docx

03_Gorer_questionnaire_1963-12-15.pdf

04_Gorer_notes_1963-12-15.docx