Terminology and Definitions

This page is In Progress. Please check back later for this page of the handbooks.

Build Requirements and Environment

This page is In Progress. Please check back later for this page of the handbooks.

Requirements

Skills:

Before attempting enable video encoding using the Open Media modules, you will need a basic understanding of following system administration skills:

• Samba file sharing and permissions
• Mounting SMB shares
• Configuring fstab
• Formatting and maintaining a RAID
• Installing FFMPEG
• Basic understanding of codecs

The Video Installation and Configuration documentation assumes at least basic competency in these areas.

Media Specific Modules:

1. Open Media Show -- generates the Open Media show content type, including fields for metadata collection as well as fields to hold the MPEG2, Flash & screen captures.
2. Media Mover -- This module is the heart of media file management in the Open Media System. Created and maintained by Arthur Foelsche, Media Mover provides a framework for designing a video management workflow including steps for harvesting, processing, storage and completion.
3. Media Mover Remove -- Adds a file removal step to the Media Mover workflow. By default Media Mover keeps a copy of all original files processed, which creates a storage problem when the source files happen to be raw, 10 gig MPEGS.
4. FFMPEG Wrapper -- allows for Media Mover to integrate with FFMPEG
5. Filefield -- Drupal's standard CCK field type for handling file storage.
6. Filefield Local -- A custom module developed specifically for the OMP, allows files to be attached from a network share in addition to uploading from a user's local drive. This is required at many stations due to the prohibitive filesize of raw MPEG2s frequently exceeding 10GB (too large for normal uploading)
7. Filefield Paths -- Allows for configuration of advanced rules for file paths, necessary to create video archives organized by project, and for managing specific naming conventions required by some playback servers.
8. Creative Commons -- Handles licensing for content sharing
9. Location -- for geotagging of content
10. Transliteration -- for manipulating & cleaning file names as content is submitted. This is particularly important for many public access and community television stations with playback servers that require specific filename conventions.

Other Module Dependencies:

1. Organic Groups
2. Content Construction Kit (CCK)
3. Views
4. Token
5. Computed Field
6. Voting API
7. ImageCache
8. ImageField
9. ImageAPI
10. Views Carousel
11. JCarousel

Module Installation

First:

1. Download ALL of the required modules and place them in the standard sites/all/modules directory
2. Enable Content and Filefield
3. Enable Show

Show will manage creating all of the necessary content types and fields. After show is installed, a few more modules need to be enabled:

1. FFmpeg Media Mover module
2. Media Mover Auto Run
3. Media Mover Node

That's it for the installation. On to configuration.

Setting up a Video Encoding Environment

This page is In Progress. Please check back later for this page of the handbooks.

Setting up a File Repository

This page is In Progress. Please check back later for this page of the handbooks.

Configuring Genre, Rating, and Language

Configuring a Video Encoder

At the moment, all operational Open Media System installs are using FFmpeg for encoding. Setting up FFmpeg will vary based on what operating system you are running. Ubuntu is the current recommended linux distribution for the Open Media project due to the large user base and generous documentation available. For those who are using Ubuntu and FFmpeg, this thread is frequently updated and includes instructions for compiling FFmpeg on the most common versions: http://ubuntuforums.org/showthread.php?t=786095

Some stations are planning on using third party encoders -- as solutions are developed for these alternatives, documentation should be posted here.

Using a server other than your local web server to encode video is supported by the ffmpeg_remote module included with the Open Media System. For more information on setting up remote encoding, please see the relevant handbook page in this chapter.

Using Rsync to store Archive on external host

If the remote webhost does not provide the option of adding a smb mount but does provide ssh access you can set up the rsync command as follows:

On the local machine create a public/private key if you don't already have one:

ssh-keygen -t dsa

It will ask for a pass phrase but just hit enter.

Once you have the key pair. Copy the public key over to the remote host and add it to the authorized key file.

scp .ssh/id_dsa.pub remoteusername@remoterhost:

#login to the remote machine
ssh remoteusername@remotehost

#add the public key to the list of authorized keys
mkdir .ssh
cat id_dsa.pub >> .ssh/authorized_keys

#Return to the localhost
exit

Now use the following command to sync your files:

rsync -avz --stats --exclude "*.mpg, *.mpeg, *.m2p" /var/www/[PATH TO SITE]/files/archive_local/ remoteusername@remoterhost:/[PATH TO ARCHIVED FILES]/

The closing slashes matter. Don't leave them out.

Tips:

Use the -n option to rsync for testing. (-n means do a dry-run).
Read man rsync to learn what the other options do.
Remove the -v option and copy the command into your crontab. Run it every night at 3am.

Defining a Video Workflow

Step 1: Adding Media Mover Configurations

Media Mover allows significant flexibility in regards to your video work flow through the use of user defined 'Configurations'. Configurations are managed in the Media Mover administration area, accessible in the general administration area under Site Building. If you have been following the installation guide up to this point, you should have no configurations -- so the first step is to add at least one (and probably more). You can add them manually in the Media Mover administration area by clicking "Add Config" and then working through the configuration screen. Each Media Mover configuration is broken down into four phases:

Harvest: defines where the system should look for new media files to be processed (ex: the "...Or Upload a new video" filefield on the show content type)
Process: configures how new media files should be processed, this is where you choose the encoding type (ex: MP2), set audio and video bitrate, and manipulate other command line options available from FFMPEG or your encoder of choice.
Storage: tells media mover where to store the newly encoded file (ex: the "Archival MPEG2" filefield on the show content type)
Complete:any operation that you would like run after the media file has been encoded and stored. (ex: MM Remove, remove harvest and processed files leaving only the final stored MPEG2)

There are numerous choices to make in this process, and far too many possible combinations too document here. In order to provide an example of a working configuration, I have included exports of Denver Open Media's Media Mover configurations below. At Denver Open Media three configurations are defined and run in this order:

1. Archival MPEG2: this configuration harvests new media files attached to the show content type on the "...Or Upload a new video" filefield (This filefield has an unusual name to make it easier on the end user when the form is displayed). It then processes them using a custom FFMPEG command that produces files compatible with TelVue/Princeton playback servers:
   -i %in_file -acodec ac3 -ar 48000 -ab 448k -vcodec mpeg2video -f dvd -copyts -s 720x480 -g 18 -b 8000000 -maxrate 9000000 -minrate 0 -bufsize 835008 -packetsize 2048 -muxrate 10080000 %out_file
   This encoded file is then stored in the "Archival MPEG2" filefield on the show content type, while the original file on the "Upload a new video" is deleted along with any temporary files produced during the encoding process.
2. Flash: this configuration harvests new media files attached to the show content type on the "Archival MPEG2" filefield. It then processes them using a standard FFMPEG flash configuration (Audio bitrate 64k, Audio sample rate 22khz, libmp3lame audio library, 320x240 aspect ratio, 25 frames per second, 750kps video bitrate). This encoded file is stored back on to the "Flash" filefield on the show content type, while any temporary files produced during the encoding process are deleted.
3. Screen Capture: this configuration harvests new media files attached to the show content type on the "Archival MPEG2" filefield. It then processes them using FFMPEG to generate a 704x576 pixel screen shot which is stored back on to the "Screen Capture" filefield on the show content type, while any temporary files produced during the encoding process are deleted.

WARNING REGARDING USING THE EXPORTS: While Media Mover will import most of the information properly, it does not pick up the proper storage location on each import. For the MPEG2 import the storage step regarding "Save the file to this CCK field" needs to be changed to store the file in the "Archival MPEG2" field. For the Flash import, adjust the same setting to store on the "Flash" field. For the Screen Capture import, adjust it to store on the "Screen Capture" field.

Step 2: Adjusting file storage locations

Where the media files are stored (when originally uploaded, as well as after they are encoded) is set on the relevant filefields on the om_show content type. Navigate to the content types via the administration area, then click manage fields on the Show content type to get to the appropriate area.

There are three fields inside of the Video group you can adjust, plus a fifth field at top "...or upload a new video" which controls where newly uploaded files or files selected from your local ingest folder are stored. To set the storage path, configure each field and look for the collapsed fieldset titled "Path settings". Expanding this fieldset will show the default path set by the show module, something like "archive_new/[ogname-raw]". Thanks to the filefield paths module, this setting allows for tokens. At Denver Open Media, and most of the Access stations using the Open Media suite, this default setting is in use. Basically it stores all files inside of the sites/default/files/archive_new folder, inside of a subfolder with the name of its associated project (organic group). This allows a station to browse media files by project. You could easily adjust this to whatever storage scheme you prefer. For instance, if you wanted to store files organized by user accounts you could adjust it to "archive_new/[user]", or you could use any of the other dozens of tokens available listed under the fieldset.

Configuring Remote Video Encoding

Encoding on an external LAMP server setup with FFmpeg can be accommodated via the FFmpeg Wrapper Remote module. Steps are as follows:

1. Mount the sites/default/files folder from the primary web server on your encoding box. On Ubuntu you will typically do this by setting up a samba share on your primary web server, and then mounting this share on your remote encoding box. You need to be careful that permissions are setup correctly, and that the encoding box has all of the necessary privileges to read/write to the share. This can get complicated in a hurry if you are already dealing with an external RAID which is mounted by your web server which is mounted by your encoding box..... good luck!
2. Enable the FFmpeg Wrapper Remote Module on the primary web server
3. On the encoding boxes web root, add encode.php available from the Open Media Project repository: http://openmediaproject.org/code/encodephp-installed-when-using-ffmpeg-w.... This is a simple script that accepts http commands from the ffmpeg wrapper module on your primary web server.  When correctly configured, your remote encoder should be accessible from the main Drupal box and display a page like the following image.

   

   If your server doesn't have a graphic interface and/or browser, you can check this from the commandline using wget http://[YOURSERVER]/encode.php

4. Go to the FFmpeg Wrapper configuration page via the normal Drupal admin area in the Site Configuration section.  Check the Use FFMPEG Wrapper Remote option (requires patch to FFMPEG Wrapper)

   

5. Go to the FFmpeg Wrapper Remote configuration page via the normal Drupal admin area in the Site Configuration section. Fill in all of the fields on this configuration page, defaults are provided as examples in each field.
6. Once this page is saved with the correct settings, the two fieldsets at bottom should be expandable and should show valid information returned by FFmpeg on the remote server. If this is the case, you're done. If not, keep checking paths and permissions until it works.

Codecs That Work

This page is In Progress. Please check back later for this page of the handbooks.

Before You Submit a Video

If you are submitting a video to your local open media station, the open media system makes it easy for a producer to create a project for their show and schedule their show for its appropriate theme block.  If you want to learn how to successfully air your show for the world to see, continue reading this section.

Creating a Profile
The Open Media system was created to allow an administrator to easily manage different types of users with minimal oversight.  Once a person decides to become a member of an Open Media organization, they will need to create a profile. Based on the membership types that each organization offers, a member will be able to log in and follow through with specific actions on their profile page and with their member tools. With a member profile, you can:

• Upload your profile picture
• List your projects
• Show others the projects you like

Create a Project

About

In order to streamline the process for producers who are submitting content for a series and station managers who want to effectively manage their station's schedule, the Open Media System requires that all shows belong to a Project.  This allows multiple producers to collaborate on a show and web viewers can also easily watch a series from beginning to end.  With this Project-based user system you can:

• Create a Project
• Personalize Your Project
• Add Users to Your Project and Let Users Join Your Project
• Submit shows
• Schedule your show within a community-based timeslot scheduler

What is a Project?

A project uses the available information submitted by a member when they create their profile to group together all relevant information associated with that member's content.
The Open Media tool set uses a Drupal Module called Organic Groups to make it easy for producers and members of public access stations to manage their projects. 
Steps for creating a new Project:

1. Log into your account on the homepage.
2. Under My Member Tools select Create Project; you will now be directed to the Create Project page.

Submitting a New Video

Preparing Video

This process will likely be station specific.

Handbrake

Download the GUI version of Handbrake from http://handbrake.fr/?article=download

GUI stands for Graphic User Interface.  The commandline version is only for advanced users.

Select the source you want to convert.  In most case this will be a DVD.

For DVD's you can select the specific chapters you'd like to convert.

 

Mpeg StreamClip

Mpeg StreamClip Downloading and Installing Tutorial

 

This Tutorial is to help you find, download, and install Mpeg StreamClip onto your Mac or PC to allow you to ingest at home.

MAC TUTORIAL for downloading MPEG Streamclip 1.9.1

1. Go to www.apple.com/downloads/macosx/video/mpegstreamclip.html

2. Make sure your Mac has all of the necessary system requirements

3. Then at the bottom of the page hit the download button:

4. A window opens that asks you to save the file. Hit the Save file button

 

5. A window opens and shows the downloading progress. Once downloaded There will be an icon labeled MPEG_Streamclip_1.9.1dmg. Double click that icon.

6. Your Mac will launch MPEG and will open a window that resembles your finder. This is where you can access your MPEG software icon that you can drag from the open window, down to your dock to display MPEG Streamclip.

7. Once the icon is in your dock you can drag the MPEG icon that resembles a hard drive to the trash. It may appear again once you open MPEG Streamclip but can be dragged to the trash after exiting MPEG each time.

 

You now have MPEG streamclip for your at home use.

 

PC TUTORIAL for downloading MPEG Streamclip (the only versions available for PC are MPEG Streamclip versions 1.1 and 1.2)

1. Go to www.squared5.com/svideo/mpeg-streamclip-win.html

2. Review the requirments needed to download MPEG Streamclip by scrolling to the bottom of the page and read REQUIREMENTS listing.

3. Once you have fulfilled the requirements to download MPEG streamclip, choose the version which best suits your PC. The download for PC's come with a tutorial that is included in the zip folder which appears after you click on one of the colored arrows that is pointing down next to the version name. (Note that if you choose to download MPEG streamclip 1.2b2 beta you will have to refer to the previous versions tutorial).

4. If you want to skip reading the tutorial hit the green downward arrow and a window appears that asks you if you want to save or run the program.

5. Click save and that opens another window where you will choose where your program will be saved.

6. It will then download the program to where ever you have saved it. Click the open button once the download is complete.

7. When the window opens which shows all of your MPEG files, click on the icon that is intitled MPED_Streamclip. If you recieve any warnings after clicking on that icon just hit run.

8. This takes you into MPEG Streamclip where a window appears that asks for license agreement. Hit Agree and you have MPEG Streamclip! Congratulations!

 

Uploading Content from a DVD

Getting Started

IMPORTANT:

When ingesting content ALWAYS log on to the editing system as DOM INGEST ONLY, the password is DOM

*Double-click the "START HERE" icon in the center of the screen before you begin *

You should see both the "ingest" server and the DOM site should load the user guide directory:

http://www.denveropenmedia.org/handbooks/user-guides/uploading-content

Go ahead and log in to your account on our website.

Import

1. Insert your DVD into the editing station. (if it starts autoplay, Stop and Quit DVD Player)

2. Open Mpeg Streamclip from the dock or applications folder.

Next you will want to open your media files in Mpeg Streamclip. You can do this one of two ways: a) The fastest way is to simply click and drag your DVD icon from the desktop to the center of Mpeg Streamclip. If you have more than one video on the DVD it will ask you which one you want to open. Once finished with this step skip down to step 5.

<-- Drag DVD icon to the center box in MPEG Streamclip -->

Or b) From Mpeg Streamclip choose File>Open Files and select the DVD. (You may need to wait a minute or so for the DVD to be recognized).

c) Select the VIDEO_TS folder. You may see many VIDEO_XX.VOB files. Click on each one starting from the top most until you find the largest first file that is greater than 1000MB (1Gig) in size, then select OPEN.

If there is no file greater than 1GB, choose the file with the largest size. If a message “Would you like to open all files of the stream together?” appears, select OPEN ALL FILES.

5. You may see "Warning: the stream may contain Timecode breaks." Choose FIX NOW and then click PROCEED. If you are not prompted to do this, go to Edit>Fix Timecode Breaks. Select PROCEED. This will take a few minutes to complete. Your video is now loaded on the editing station.

Trim & QC

6. You can now play the video by either touching the space bar or “L” key. You can also drag the play head using the mouse. Verify that there are no color bars and that the program begins and ends with NO MORE THAN a frame or two of black or begins or ends on the first or last frame of the program. If no trimming is needed go to step 8.

7. Trimming the beginning and end of the program is simple: Set the IN POINT by pressing "I" and set the OUT POINT by pressing "O".

Starting from the beginning of the program either play or move the playhead to the location where the program should start, then press the “I” key for IN. Then move the playhead to where the program should end and press the “O” key for OUT. For Fine Tuning: go frame by frame and use the right and left arrow keys on the keyboard.

Press Command and "T" or go to EDIT< TRIM in the Menu bar. ***Make sure that you have cut out (trimmed) all black, bars or anything else that is not part of your actual show.

Export & QC

8. Now export the program by going to File>Convert to MPEG with MP2 Audio.
Save As: Should be the name of the program and episode number (if applicable) VERY IMPORTANT: Do not use any symbols when naming your program.

Where: From the drop down menu, select the edit station you are at (ie DOMEDIT1) then select INGEST. Click Save.

9. A small window with a progress indicator should pop up. When completed, quit MPEG Streamclip and eject your DVD.

10. QC!!! Quality Control! Please check your video file after you ingest, no one will do this but you! If it doesn't look right you don't want it to go on air.

**Please note your show will be under whatever it is you named it when you saved**

Open the INGEST folder on your desktop< find your file< Hold down CTRL Key and click on your file< select OPEN with MPEG STREAMCLIP. This will reopen Mpeg Streamclip and allow you to scan through the audio and video of your file. Make sure the whole video is there, it looks and sounds good and that there with no black or color bars before or after it (less a frame or two of black).

 

 

YOU ARE NOT DONE YET!!! You still need to create a show and attach your video to a show page.

 

Uploading your Video onto the Website

Log on the main website (denveropenmedia.org), click onto "my projects." which is on the right hand column.

Click on the project/video that you want to be uploaded on to the website.

Once you click on your project, the right hand column will have a "create a show" option.

Click on "create a show" and it will lead you to the form that you must fill out when creating or uploading the show on to the website. It is is simple and easy, just follow the directions and fill out the form.

Step by Step:

Select the video that you uploaded or you also have the option to upload one at that moment.

Create a title and the epsiode number

Write a full description about the show and maybe some exciting tidbits.

Choose the specific theme/category that your video falls into.

Choose the timeslot. For example, Latino or General Youth timeslot.

Make sure you choose the right audience and whether it is suitable for all ages.

After filling out the entire form, click on save and your video will be uploaded onto the website in the next 4-8 hours.

SUCCESS you are finished!! Its easy, its simple, and you have now completed uploading your video!!!

Editing or Deleting Existing Videos

This page is In Progress. Please check back later for this page of the handbooks.

Other Fun Stuff You Can Do With Your Video

This page is In Progress. Please check back later for this page of the handbooks.

External Resources

External Resources are playback server specific resources that can be attached to a om_show instead of a video or used on their own.

Currently the Open Media modules don't contain the code necessary to attach External Resources to a Show. The content type was structured based solely on the options available to schedule switches, overlays, and interstitial on Telvue Princeton servers.

Most External Resources will have to be created by staff members who understand the settings. By making a producer the author of an External Resource, that producer could schedule a switch event for a live show at a specific time based on their Project's Timeslot Events.

These are all the option available on a Princeton:
Output,Date,Time,Type,Source ID,Source Name,Offset,Duration,Output Name,Program Code,Episode Code,Program,Title,Episode,Description,Preroll,Postroll,OSD,OSD Path,OSD File,Include In Guide,Track Content Attributes,Overlay Alpha Blend,Overlay Chroma Key,Overlay X Coordinate,Overlay Y Coordinate,Overlay Width,Overlay Height,Program Number,Switch Command

The Encoding Control Panel

This page is In Progress. Please check back later for this page of the handbooks.

Reporting on Your Video Library

This page is In Progress. Please check back later for this page of the handbooks.

Troubleshooting

This page is In Progress. Please check back later for this page of the handbooks.

Other Resources

This page is In Progress. Please check back later for this page of the handbooks.

Video Reporting with More Functionality

This page is In Progress. Please check back later for this page of the handbooks.

Metadata Workflow for Sharing Videos Between PEGs

This page is In Progress. Please check back later for this page of the handbooks.