Embed Size (px)
Citation preview
Digital Video Editing Fundamentals
Wallace Jackson
Digital Video Editing Fundamentals
Wallace Jackson Lompoc, California, USA
ISBN-13 (pbk): 978-1-4842-1865-5 ISBN-13 (electronic): 978-1-4842-1866-2DOI 10.1007/978-1-4842-1866-2
Library of Congress Control Number: 2016937524
Copyright © 2016 by Wallace Jackson
This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law.
Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark.
The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights.
While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein.
Cover image designed by Harryarts - Freepik.com .
Managing Director: Welmoed Spahr Lead Editor: Steve AnglinTechnical Reviewer: Chád DarbyEditorial Board: Steve Anglin, Pramila Balan, Louise Corrigan, Jonathan Gennick,
Robert Hutchinson, Celestin Suresh John, Michelle Lowman, James Markham, Susan McDermott, Matthew Moodie, Jeffrey Pepper, Douglas Pundick, Ben Renow-Clarke, Gwenan Spearing
Coordinating Editor: Mark PowersCopy Editor: Karen JamesonCompositor: SPi GlobalIndexer: SPi GlobalArtist: SPi Global
Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax (201) 348-4505, e-mail [email protected] , or visit www.springeronline.com . Apress Media, LLC is a California LLC and the sole member (owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc is a Delaware corporation.
For information on translations, please e-mail [email protected] , or visit www.apress.com .
Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. eBook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales–eBook Licensing web page at www.apress.com/bulk-sales .
Any source code or other supplementary materials referenced by the author in this text are available to readers at www.apress.com/9781484218655 . For detailed information about how to locate your book’s source code, go to www.apress.com/source-code/ . Readers can also access source code at SpringerLink in the Supplementary Material section for each chapter.
Printed on acid-free paper
This book is dedicated to affordable software developers like Corel as well as all the members of the open source software community who are working so diligently to make professional new media application development software,
as well as 2D and 3D content development tools, freely available for new media application developers, so that they can utilize these tools to achieve their creative dreams and their fi nancial goals. Last but not least, I dedicate
this book to my loving father, Parker Jackson, my family, my life-long friends, my content production ranch neighbors, and my business partners, for all their continual help, assistance, and those relaxing beautiful sunset BBQs,
underneath pink clouds on Point Conception.
v
Contents at a Glance
About the Author ............................................................................ xiii
About the Technical Reviewer ..........................................................xv
Acknowledgments ..........................................................................xvii
Introduction .....................................................................................xix
■ Chapter 1: The Tools of Digital Video: Non-Linear Editing Software ............................................................................. 1
■ Chapter 2: Digital Video Hardware: Confi guring the Workstation .................................................................................. 11
■ Chapter 3: The Scope of Digital Video: Setting Up Your Workstation .......................................................................... 23
■Chapter 4: The Foundation of Digital Video: Static 2D Concepts ......33
■ Chapter 5: Movement in Digital Video: Frames, the 4th Dimension ........................................................................ 47
■ Chapter 6: The Sound of Digital Video: Digital Audio Editing Theory .............................................................................. 59
■Chapter 7: Capturing Digital Video: Digital Camera Concepts ...... 75
vi Contents at a Glance
■Chapter 8: The Workfl ow for Digital Video: Capture, Edit, Export .....87
■Chapter 9: The Composition of Digital Video: Timeline Editing .... 101
■Chapter 10: The Spectrum of Digital Video: Color Correction ..... 115
■ Chapter 11: The Algorithms of Digital Video: Special Effects Filters ............................................................................. 125
■Chapter 12: The Data Footprint of Digital Video: Compression ..... 139
■Chapter 13: The Automation of Digital Video: Programming ...... 153
■ Chapter 14: Publishing Digital Video: Content Delivery Platforms ...................................................................... 167
Index .............................................................................................. 179
vii
Contents
About the Author ............................................................................ xiii
About the Technical Reviewer ..........................................................xv
Acknowledgments ..........................................................................xvii
Introduction .....................................................................................xix
■ Chapter 1: The Tools of Digital Video: Non-Linear Editing Software ............................................................................ 1
Open Source Video Editing Tools: Free!! .................................................. 2
Distributed Digital Video Editing: Lightworks 12.6 .................................................... 2
Under Development: Avidemux, Pitivi, and Blender .................................................. 5
Consumer Digital Video Editors: Low Cost ............................................... 7
Prosumer Digital Video Editors: Mid Cost ................................................ 8
Summary ............................................................................................... 10
■ Chapter 2: Digital Video Hardware: Confi guring the Workstation ............................................................................ 11
Digital Video Workstation: The Hardware .............................................. 12
Minimum System Requirements: Just Scraping By ................................................ 12
Video Capture, Import, and Export: Data Formats ................................................... 13
Suggested System Requirements: Realistic Editing ............................................... 14
viii Contents
Video Editing Consoles: Your Peripherals .............................................. 19
Affordable Digital Video Editing Shuttles: Contour .................................................. 19
Professional Video Editing Consoles: JLCooper ...................................................... 20
Summary ............................................................................................... 21
■ Chapter 3: The Scope of Digital Video: Setting Up Your Workstation .......................................................................... 23
New Media Genres: Multimedia Pie Slices ............................................ 23
Installing Your Open Source Software ................................................... 24
Digital Image Editing and Compositing: GIMP......................................................... 24
Digital Audio Editing and Effects: Audacity ............................................................. 25
Digital Illustration and 2D Modeling: Inkscape ....................................................... 27
3D Modeling, Rendering and Animation: Blender ................................................... 28
Visual Effects Software: BlackMagic Design Fusion ............................................... 29
Installing Paid Digital Video Software .................................................... 30
Summary ............................................................................................... 32
■ Chapter 4: The Foundation of Digital Video: Static 2D Concepts ....................................................................... 33
Computer Graphics: Raster versus Vector ............................................. 34
Basic Vector Shapes: Vertex, Line, Arc, and Curve .................................................. 34
Raster Concepts: Pixels, Aspect, Color, and Alpha .................................................. 36
Summary ............................................................................................... 46
■ Chapter 5: Movement in Digital Video: Frames, the 4th Dimension .............................................................................. 47
Digital Video Concepts and Terminology ............................................... 48
Digital Video Concepts: Frames and Frame Rates .................................................. 48
Digital Video Mathematics: Doing the Multiplication .............................................. 49
Digital Video Compression Algorithms: Codecs ...................................................... 49
Codecs: MPEG-4 H.264, MPEG-H H.265 and WebM ................................................ 50
Digital Video Resolutions: Industry Standards ........................................................ 53
Digital Video Storage: Captive versus Streaming.................................................... 54
ixContents
Digital Video Compression: Bit-Rates and Playback ............................................... 54
Digital Video Optimization: Encoding Software ....................................................... 55
Digital Video Optimization: Encoder Settings .......................................................... 56
Summary ............................................................................................... 58
■ Chapter 6: The Sound of Digital Video: Digital Audio Editing Theory .............................................................................. 59
Audio Concepts and Terminology .......................................................... 60
Foundation of Analog Audio: Sound Waves of Air ................................................... 60
Digital Audio: Samples, Resolution, and Frequency ................................................ 63
Digital Audio Data: Transmission and Digitization ................................................... 64
Digital Audio in Android: File Formats ..................................................................... 66
MIDI: Musical Instrument Data Interface ................................................................ 67
MPEG3 Audio: A Popular Low Quality Data Format ................................................. 68
FLAC: An HD 24-bit Free Lossless Audio Codec ...................................................... 68
OGG Vorbis: A Lossy Open Source Audio Codec ...................................................... 69
MPEG-4 Audio: Advanced Audio Coding (AAC) ........................................................ 69
PCM Audio: Pulse Code Modulated Codec .............................................................. 70
Converting Between Audio Formats ...................................................... 71
Summary ............................................................................................... 74
■Chapter 7: Capturing Digital Video: Digital Camera Concepts ...... 75
Digital Camera Concepts and Technology ............................................. 75
Still Camera vs. Video Camera: Static or Motion? .................................................. 76
Resolution: How Many Pixels Can the Frame Hold? ............................................... 77
Aspect Ratio: Shape of the Camera Image or Frame .............................................. 78
Zoom Feature: Optical Lens Zoom vs. Digital Zoom................................................ 78
Camera Sensors: Charge-Coupled Devices (CCDs) ................................................. 78
Image Data Formats: JPEG, TIFF, RAW, PEF, DNG .................................................... 79
Camera Interface: Firewire, USB3, Gigabit Ethernet ............................................... 80
On-Camera Compression: Uncompressed Frames ................................................. 81
x Contents
Capturing Audio: Attached vs. External Mics .......................................................... 82
Steady as She Goes: Professional Camera Tripods ................................................. 83
Lights, Camera, Action: External Lighting Arrays .................................................... 84
Conclusion: It’s Not Just the Camera That Counts! ................................................. 85
Summary ............................................................................................... 86
■Chapter 8: The Workfl ow for Digital Video: Capture, Edit, Export .....87
Top-Level Workfl ow: Capture, Edit, Share .............................................. 88
Digital Video Capture: Camera, File, Screen, Motion ............................................... 88
Digital Video Sharing: MPEG-4, AVI, MOV, and WMV ................................................ 89
Digital Video Edit: Primary Project Workfl ow Areas ................................................ 90
Summary ............................................................................................... 99
■Chapter 9: The Composition of Digital Video: Timeline Editing... 101
Timeline Editing: As Easy as Drag and Drop ........................................ 102
The Video Track: The Foundation for Your Project ................................................. 102
Adding Transitions: Effects between Video Clips .................................................. 103
Adding Video Titling: Custom Text Titling Effects .................................................. 105
Customizing Motion: The Customize Motion Dialog .............................................. 107
Adding Special Effects: The Algorithmic FX Filters ............................................... 108
Adding a Musical Score: Using the Audio Tracks .................................................. 109
Exporting the Project: Using the Share Tab ........................................................... 112
Summary ............................................................................................. 113
■Chapter 10: The Spectrum of Digital Video: Color Correction ..... 115
Color Adjustments: Plug-In Filter Settings ........................................... 115
Installing More Assets: Corel VideoStudio Content ............................................... 116
Selecting Media Types: Using Media Toggle Icons ................................................ 117
Using Filters to Apply Color Correction Algorithms ............................................... 118
Using an Options Panel to Apply Color Corrections .............................................. 121
Summary ............................................................................................. 123
xiContents
■ Chapter 11: The Algorithms of Digital Video: Special Effects Filters ............................................................................. 125
Pixel Processing: Pixel Based Algorithms............................................ 126
Mirroring Pixels: Using the Refl ection Algorithm .................................................. 126
Boris FX: The Boris Graffi ti Title Algorithm Engine ................................................ 129
Fluid Dynamics: Using the Rain Filter Algorithm FX .............................................. 132
Mercalli Video Stabilization: Algorithmic Steadying .............................................. 134
Summary ............................................................................................. 136
■Chapter 12: The Data Footprint of Digital Video: Compression ..... 139
Data Footprint Optimization: Pure Theory ............................................ 140
Pixel Scaling: The Bane of Image and Video Quality ............................................. 140
Digital Video Resolution: Popular Video Standards ............................................... 141
Digital Video Playback: Captive versus Streaming................................................ 141
Digital Video Compression: Bit-Rates and Playback ............................................. 142
Digital Video Codecs: An Encoder and a Decoder ................................................. 143
Digital Video Optimization: Key Encoder Settings ................................................. 144
Digital Video Asset Optimization: Why It Matters .................................................. 146
VideoStudio X9: Creating Codec Presets ............................................. 146
Summary ............................................................................................. 152
■Chapter 13: The Automation of Digital Video: Programming ...... 153
Content Delivery Programming Platforms ........................................... 154
Java 8, 9, and JavaFX: The javafx.scene.media API .............................................. 154
HTML5 and CSS3: New Media Asset Compositing ................................................ 157
Android Studio: Java’s PorterDuff Blending Modes .............................................. 159
A Video Player: MediaPlayer and MediaController ................................................ 162
VideoStudio Scripting: Handscript Filter .............................................. 163
Summary ............................................................................................. 165
xii Contents
■ Chapter 14: Publishing Digital Video: Content Delivery Platforms ...................................................................... 167
Open Data Formats: PDF, HTML5, EPUB .............................................. 168
Portable Document Format: Digital Video in a PDF ............................................... 168
HyperText Markup Language: HTML5 Digital Video .............................................. 169
Electronic Publishing: EPUB Digital Video Support ............................................... 170
Open Platforms: Java, Android, and Kindle .......................................... 171
eBook Readers: Kindle Fire, Android, Java, or PDF ............................................... 172
iTV Sets: Android TV, Java, JavaScript, and HTML5 .............................................. 172
Smartwatches: Android WEAR, Java, and HTML5 ................................................. 173
SmartPhone and Tablet: Android, Java, and HTML5 ............................................. 174
Game Console: Android, Java, JavaFX, and HTML5 .............................................. 175
Future Devices: Robots, VR, and Home Appliances............................................... 175
Paid Software Platforms: iOS or Windows ........................................... 176
Apple iPhone and iPad: Supported Media Formats .............................................. 176
Windows Phone: Supported Digital Media Formats .............................................. 176
Summary ............................................................................................. 177
Index .............................................................................................. 179
xiii
About the Author Wallace Jackson has been writing for several leading multimedia publications about production for the media content development industry, after contributing an article about advanced computer processing architectures for the centerfold (a removable “mini issue” insert) of the original issue of AV Video Multimedia Producer magazine distributed at the SIGGRAPH trade show.
Wallace has written for a number of popular publications, regarding his work in interactive 3D and new media advertising campaign design including 3D Artist magazine, Desktop Publisher Journal , CrossMedia , Kiosk ,
AV Video Multimedia Producer , and Digital Signage magazine, as well as many other publications.
Wallace Jackson has authored more than twenty Apress book titles, including several titles in the ever popular Apress Pro Android series, Java and JavaFX game engine development titles, digital image compositing titles, digital audio editing titles, digital video editing titles, digital illustration titles, VFX special effects titles, digital painting titles, Android 6 new media content production titles, and JSON and HTML5 titles.
In the current book on digital video editing and effects, Wallace focuses on Corel VideoStudio Ultimate X9 digital video software, and uses it to demonstrate digital video editing, as well as digital video effects and compositing fundamentals, to beginners who want to become more digital video editing savvy.
Wallace is currently the CEO of MindTaffy Design, the new media advertising agency which specializes in new media content production and digital campaign design and development, located by La Purisima State Park, in
xiv About the Author
Northern Santa Barbara County, on the Point Conception Peninsula, halfway between their clientele in Silicon Valley to the North, and Hollywood, The OC, West Los Angeles, and San Diego to the South.
Mind Taffy Design has created open-source, technology-based (HTML5, JavaScript, Java 8, JavaFX 8, and Android 6.0) digital new media i3D content deliverables for more than a quarter century, since January of 1991.
The company’s clients consist of a significant number of international brand manufacturers, including IBM, Sony, Tyco, Samsung, Dell, Epson, Nokia, TEAC, Sun Microsystems (Oracle), Micron, SGI, KDS USA, EIZO, CTX International, KFC, Nanao USA, Techmedia, EZC, and Mitsubishi Electronics.
Wallace received his undergraduate BA degree in Business Economics from the University of California at Los Angeles, or UCLA, and his graduate degrees in MIS/IT, Business Information Systems Design and Implementation, from University of Southern California located in South Central Los Angeles (USC).
Wallace also received post-graduate degrees from USC, in Entrepreneurship and Marketing Strategy, and completed the USC Graduate Entrepreneurship Program. Wallace earned his two USC degrees while at USC’s night-time Marshall School of Business MBA Program, which allowed him to work full-time as a COBOL and RPG-II programmer while completing his business and IT degrees.
You can visit Wallace’s blog at www.wallacejackson.com to view his multimedia production content. You can also follow him on Twitter at @wallacejackson , or connect with him on LinkedIn.
xv
About the Technical Reviewer
Chád (“Shod”) Darby is an author, instructor, and speaker in the Java development world. As a recognized authority on Java applications and architectures, he has presented technical sessions at software development conferences worldwide (in the United States, UK, India, Russia, and Australia). In his fifteen years as a professional software architect, he’s had the opportunity to work for Blue Cross/Blue Shield, Merck, Boeing, Red Hat, and a handful of start-up companies.
Chád is a contributing author to several Java books, including Professional Java E-Commerce (Wrox Press), Beginning Java Networking (Wrox Press), and XML and Web
Services Unleashed (Sams Publishing). Chád has Java certifications from Sun Microsystems and IBM. He holds a BS in computer science from Carnegie Mellon University.
You can visit Chád’s blog at www.luv2code.com to view his free video tutorials on Java. You can also follow him on Twitter at @darbyluvs2code .
xvii
Acknowledgments I would like to acknowledge all my fantastic editors, and their support staff at Apress, who worked those long hours and toiled diligently on this book, to make it the very best digital video editing and effects fundamentals title currently on the market.
I would like to thank the following people:
Steve Anglin , for his work as the Acquisitions Editor for the book, and for recruiting me, to write development titles at Apress, covering widely popular open source content-development platforms (Android, Java, JavaFX, HTML5, CSS3, JS, JSON, etc.).
Matthew Moodie , for his work as Development Editor on the book, and for his experience and guidance during the process of making the DVE Fundamentals book one of those fantastic digital video editing, compositing and special effects titles.
Mark Powers , for his work as the Coordinating Editor for the book and for his constant diligence in making sure that I either hit my chapter delivery deadlines or far surpassed them.
Karen Jameson for her work as the Copy Editor on this book, for her careful attention to minute details, and for ensuring the text conforms to current Apress book writing standards.
Chád Darby for his work as the Technical Reviewer on this book and for making sure that I didn’t make technical mistakes.
xix
Introd uction Digital Video Editing Fundamentals was intended for the digital artist, digital videographer, multimedia producer, illustrator, application developer, website developer, user interface design architect, user experience designer, social media user, effects compositor, matte painter or just about anyone who’s interested in generating superior quality digital video editing or special effects, delivered in popular MPEG and WebM video data formats.
This book covers digital video concepts, editing, special effects, titling, and transitions, and this equates to digital imaging and special effects fundamentals both combined together into one book, including technical terms, topics, concepts, and definitions. I will follow this book with a more advanced book entitled Video Effects (VFX) Fundamentals (Apress, 2016) next.
Each chapter will build upon the knowledge learned in the previous chapter. Thus, later chapters in the book have readers creating advanced digital video editing and effects projects by using clips, tracks, transitions, special effect FX algorithms, and similar video editing software features, dialogs, and tools.
There is even coverage at the end of this book regarding data footprint optimization, as well as creating digital video compositing pipelines using open source platforms such as Java, JavaFX, HTML5, CSS3, JavaScript, VideoStudio Scripting, and Android Studio.
In Chapter 1 we install open source Lightworks as well as Corel VideoStudio Ultimate X9, and other related 3D and effects software packages which would be useful for your digital video production workstation, including the impressive Blender software for 3D.
In Chapter 2 , we take a look at hardware requirements and at digital video editing peripherals, like jog wheels and edit control consoles, so you can optimize your DVE workstations.
In Chapter 3 we download and install the new media genres that can also be utilized in digital video content production.
xx Introduction
In Chapters 4 and 5 , we explore all of the “foundational” information behind raster image, video and vector illustration, because digital video is a fusion between these technologies, as at the end of the day, digital video is animated raster images.
Chapter 6 introduces audio concepts and fundamentals, as digital video assets also include digital audio components, in both stereo (musical score) and mono (vocal) audio tracks.
Chapter 7 covers digital video camera equipment including digital cameras, digital video cameras, tripods, and lighting equipment, all of which are necessary for your digital video content production studio and workflow.
Chapter 8 covers creating the basic digital video editing project, using Corel’s VideoStudio Ultimate X9, including using clips, transitions, motion paths, and special effects presets.
Chapter 9 covers digital video compositing in VideoStudio using your Timeline Editor, to “composite,” or compose, digital video clips, audio score, special effects transitions and plug-in filter algorithmic pixel frame processing special effects.
Chapter 10 covers VideoStudio Ultimate Color Corrections, and Color Adjustment, by using plug-in filter algorithms, which will isolate and address only the color channels in the digital video editing and special effects project.
Chapter 11 covers VideoStudio Ultimate algorithmic plug-in special effects using plug-in filter algorithms that process pixel locations rather than their color values. We’ll look at a motion stabilization system in Corel’s VideoStudio Ultimate and we’ll look at Borix FX Graffiti 6.1 during the chapter as well.
Chapter 12 starts to get into more advanced concepts like data footprint optimization, and what goes into this workflow. We look at how to optimize your digital video or effects assets using VideoStudio Ultimate X9, and, how drastically you will be able to reduce your file size, and thereby improve the speed of both your video content streaming, and therefore video playback smoothness, which can greatly enhance the user experience (UX).
Chapter 13 covers Scripting in VideoStudio Ultimate X9 as well as computer programming languages, and how they’ll factor into digital video related applications design and publishing. I will cover most of the popular open source platforms, such as Java 9, JavaFX 8, Android 6, Kindle 8, EPUB 3, PDF, and HTML5. I follow this up with a chapter on content publishing as well.
Chapter 14 covers publishing digital video deliverables, using leading content delivery platforms, and popular hardware devices, spanning from smartwatches to HD 2K iTV Sets to UHD 4K iTV Sets and everything in between, including e-Book e-Readers, HD and UHD tablets, gaming consoles, automobile dashboards, appliances, IoT devices and UHD smartphones.
xxiIntroduction
If you’re interested in digital video editing and special effects, and you want to learn all your basic fundamentals, as well as how everything works together in the digital video edit bay and special effects domain, from algorithmic FX filters to creating your multi-track, video project compositing pipeline, this is the digital video editing and special effects book for you to start your journey with.
The book is overflowing with tips, tricks, tools, topics, terminology, techniques, concepts, and work processes. Indeed, this Digital Video Editing Fundamentals book will give you the boost to transition from being a digital video neophyte towards being the knowledgeable digital video professional that you seek to become, at least where a digital video or VFX visual effects compositing pipeline is concerned.
