MediaManager Release 2.2

Media Manager v2.2 has been released. This is a major update that focuses on iTunes integration. Here is a list of the major changes:

• Able to use the latest XBMC addons as media information sources.
• Many improvements to the XBMC addon source.
• Handle TV episodes that contain more than one episode
• Added new File Database store
• Added ability to store seen file information within a database resources
• Added command line tool to print database schemas
• Added configuration option for strip tokens.
• If sources, stores or actions are configured, sensible defaults are used
• Added new database store
• Show/Film search make use of ignore tokens to find media name
• Added ability to configure database resources
• Added images for seasons of shows. These are used by default for mp4 files.

This has been quite a while coming, but it's finally here. The project website has now move to here. Please use the project website to let me know of bugs or feature requests. Also if you find the application useful then let me know on my blog. 

The main focus of this release has been updating the XBMC scraper support to work with the latest scrapers and stores that make use of databases.

The Road to MediaManager 2.2

The The next release (2.2) of Media Manager is has been quite close for quite a while now. Or at least I though it was. Each time I've been getting close to a relase I've had to put it off due to lack of time.

Well the good news is that it's had quite a lot of development over the last couple of months. It's also now hosted on bitbucket. The main reason for this is the removal of Google code features such as downloads! I consider hosting on github, but currently prefer bitbucket/mercurial. The move over will be completed when I make the next release, however all the code is now pushed to bithucket. Visit the project page here.

The main focus the last couple of months has been supporting the lastest XBMC media scrapers. Their have been a lot of changes in the scraper format since I first added support for them. Some of the changes has caused things to break and media info to be missing. The XBMC scrapers are quite a bit more advance than the initial versions I started using. Media Manager now handles these new scrapers, allowing full information to be fetched for TV Shows and films. We are also now default to the frodo branch of the XBMC scrapers.

In order to support the new features of the XBMC scrapers I created a lot of new unit tests. The scrapers are some of the most heavily tested parts of Media Manager. These test will help a lot with future changes to XBMC scrapers.

The main driver for this was getting TVDB show images to work correctly. Their were quite a few problems with the scraper custom functions that had to be addressed. Most of the web documentation on the scrapers seems to be quite out of date now. This took a lot of trail and effort, but it seems to be working very well now.

Their are still a number of features left to implement for 2.2, the biggest is a pure Java replacement for atomicparsely. This is almost their, just needs testing....

Media Manager 2.2 nearly here!

The next release (2.2) of Media Manager is almost ready. Just need to set aside the time to do start the release process. I just wanted to give people a heads up that from this release I'm not planning to create packages for Linux distributions. So their will be no .deb or .rpm files. Instead people will have to use the Linux installer.

I realise this is less than ideal as I prefer to use packages on my own system, but I was spending too much time with each release making sure the packages worked and had the correct dependencies. I their is anyone who wants to help create packages of media manager, I'd be happy to support them in this!

Media Manager v2.1 released

Media Manager v2.1 has been released. This is a major update that focuses on iTunes integration. Here is a list of the major changes:

• Seen files can be ignored
• Directories can be watched for new media, which is then moved to the correct media directory.
• MP4 Files metadata now handled by fork of atomic parsley.
• Much improved MP4/M4V metadata.
• Support for High Def media.
• New Store for notifying iTunes of media file changes via a remote server running on the iTunes box.
• Improved windows support.
• Improved TV Show/Film searching.
• Fixed issues with launch scripts.
• Debian/Ubuntu install packages.

This has been quite a while coming, but it's finally here. Please use the project website to let me know of bugs or feature requests. Also if you find the application useful then let me know on my blog. 

I'm hoping that project releases will come quicker now with a smaller feature set. Currently work in in progress on the next release which will include a database store and a update to the XBMC scraper support.

The native tools that Media Manager uses have changed since the last release. It now uses media info and my Atomic Parsley fork. The new iTunes store also makes use of my remote itunes controller project.

To download the latest release please visit the project website. Their is a generic installer for most platforms and OpenSuSE/Debian/Ubuntu packages. Also you can find the latest OpenSuSE builds via my OpenSuSE source.

Adding more meta data capabilities to MediaManager

I'm please with the progress that have been make towards the next release of Media Manager. The biggest difference in this release will be much improved meta data stored within iTunes files and the ability to keep iTunes in sync. These achievements have cause be to create other projects. The first of these I already mention was a iTunes remote control server written in ruby. This is nearing it's first release, it just needs it's windows support finishing off.

I wanted this release of media manager to start a lot more meta data in m4v files so that they look a lot more like iTunes meta data. This means when you rip a DVD and want to iTunes to see it, it will look as if it can from the iTunes store. In turn this should mean it is viewable on iPads and apple TV's etc...

This release of Media Manager move to using the AtomicParsley command line tool to encode and view mp4 metadata. This tool has been around a while, but the orginal site has not been updated in a long time. Since then their have been new atom types that have been added to iTunes. So I came across  a fork of atomic parsley. This is pretty good and has had a number of features and bug fixes. This still does not do everything I would like, so in turn I've forked this project. I'm hoping that my fork's changes can be push upstream once they are ready. My fork can be found here https://bitbucket.org/shield007/atomicparsley.

So I will be packing up my fork of AtomicParsley with Media Manager. The new features I've add so far are the ability to set the flavour atom (flvr) and a output option to list iTunes atoms in a XML format.

The flvr atom can be seen in files downloaded from the iTunes store. So that I've found that it contains these values:

• 1:128
• 2:256
• 4:640x480LC-128
• 6:640x480LC-256
• 7:720p

It took me a while to work out what all of these mean, by I think I have it now. 7:720p is for videos that are 720p. These also don't have to be 16:9 aspect ratio.  1:128 is for audio files encoded in 128Kbs lossy. Simlary 2:256 is audio files encoded in 2:256 lossy. 4 and 6 were the tricky ones. It turns out that 640x480 is the 480p resolution, LC is the format profile of the audio. and 128/256 is the Kbs of the audio.

Usually 4 is used by low definition films and TV, 6 is used by music videos and 7 is used by High Def content. Their are probably other entries for this atom. If people know of any let me know. I can cater for them as well.

Media Manager is now making use of a tool call mediainfo to query the video and audio information of the file.   This enables media manager to know thinks like the flavour, aspect ration, type of audio etc...

New Project: itunes-remote-control-server

The other day I create a new opensource project on Google code called itunes-remote-control-server. The idea behind the project is to create a TCP server that can be used to control iTunes. This will allow easy headless control of a iTunes machine.

I'm aim to use the server with my other project Media Manager. The idea being that once media manager has made changes to media files it can tell iTunes about the changes. This will keep iTunes in sync with the media directories been managed by media manager. Their are two parts to this, a new store within Media Manager which will hopefully be in the next release and a TCP server on the iTunes machine.

So I've created a basic server that works on Mac OSX. It's written in ruby and uses mac ruby script bridge to talk to iTunes. I'm hoping to add windows iTunes support before a official release, but this is still at investigation stage at the moment.

Currently the server will allow you to add or remote tracks from the iTunes library as well as listing/removing tracks whose files can't be found any more (Dead tracks). Their is simple authentication support and it's configuration is done via a XML file.

Their are also some command line utilities that can be used instead of the server if people want to drive iTunes from the CLI without the server. So far these are for finding tracks not in the iTunes library and dead tracks.

So currently I've not released it, though I hope this will not take to long. Just need to look into the windows side of things. If people want to try it out, then they will need to do the following:

git clone https://jp.stanford@code.google.com/p/itunes-remote-control-server
cd itunes-remote-control-server
gem build ./itunes-controller.gemspec
gem install itunes-controller-0.1.0.gem



This will install the build gem and provide the command line tools:

itunesController.rb   <- The TCP Server
llistDeadTracks.rb
listNewTracks.rb
removeDeadTracks.rb

Anyway I'll post a update again when It's time for a official release. At that point the ruby gem will be downloadable from the website.

Media Manager v2.0 Released!

Media Manager v2.0 has just been released. The project has had a name changed since the last updated (previously known as MediaInfoFetcher). This is a major update that focus on managing media (Currently TV Shows and Films) and much greater reliability when fetching meta data.

Some of the change high lights are as follows:

• Better searching for film and TV information using XBMC scrapers
• Tool to download and stay uptodate with the latest XBMC scrapers
• Much improved film title and show name lookup by variours searching strategies
• New actions, such as ability to execute system commands on media files and rename the media files
• Enhanced renaming patterns which new token types and optional parts to patterns.
• Can lookup film information from .NFO files.
• Improved configuration options
• New XML store for caching media information
• Improved tag chimp source, that will use the sites API instead of scraping the HTML.
• Maybe new configuration options (and a new configuration format).
• New installer for all platforms.

This has been quite a while coming, but it's finally here. Please use the project website to let me know of bugs or feature requests. Also if you find the application useful then let me know on my blog.

So click here for more information.

MP4 Libraries in Media Manager

MediaManager 2.0 is pretty much ready to release apart from a problem with the MP4ItunesStore. This store is used to save metadata into mp4/m4v files so that they appear correctly in iTunes and can be used with AppleTV, iPad's etc....

In version 1.x this store was based around a command line application AtomicParsely. However this always anoyed me as it was not very easy to use and was slot to drive it from java.

In version 2.x I've been working towards a pure java solution. I first of starting to use jaudiotagger. I found this while working on my podcaster application. This is more about audio files than video though. It works well for podcaster, but not very well for MediaManager. I had to hack it quite a bit before it would work, then I started to find problems with parsing some MP4 files.

I stumbled across mp4parser next. This is pretty good and does everything I need or so it seemed at first. I found a number of bugs in the library. I fixed a number of these and sent patches to the project (Still not been applied :-( ), I then found a case where a DVD I had turned into a MP4 file would get corrupted.  raised a issue on this also. Not only did it courrpt the file, but it gave me no way of detecting a error. Due to these problems I had to stop using the library. The project has a hight amount of activity so I'm still hoping these things might get fixed.

I've looked around for other Java solutions, but not found any. I could possibly write my own or fork one of the others, but that's too much work for now. Instead I've started to look at using a native library called MP4v2 which is used by a number of other C/C++ projects. To create the bindings I'm using JNA. This as not been without problems though. Currently on Linux I'm seeing segfaults unless I use a 32Bit sun JVM. Strangely this happens on a 64Bit sun JVM also. I'm currently hopeing to find out why and fix the problem, but will see what happens.......... It might mean we only have iTunes support for curetain Arch/JVM's.

Anyways once these problems are solved, MediaManager will be ready for release

MediaInfoFetcher is no more, long live MediaManager

No need to panic, MediaInfoFetcher has been renamed to MediaManager to reflect that the next version will be much more that a tool to fetch media information. It is not a tool for managing Media collections.

Since my last post, Media Manager as really started to take shape. Many bugs have been found and fixed with is bringing it nearer to a release. Also it now has nearly all the features that will be present in the next release. These include the following:

• Better searching for film and tv information using XBMC scrapers
• Tool to download and stay uptodate with the latest XBMC scrapers
• Much improved film title and show name lookup by variours searching strategies
• New actions, such as ability to execute system commands on media files and rename the media files
• The renaming as also improved quite a bit as the patterns have new elements like optional parts.
• Can lookup film information from .NFO files.
• Improved configuration options
• New XML store for caching media information
• Improved tag chimp source, that will use the sites API instead of scraping the HTML.
• New installer for all platforms.

As you can see that is quite a impressive list of features going into the next release and their are still a couple in the works. The previous version had the concept of sources and stores, but now has the concept of actions. Actions are performed on the media files when they are found. So a new action as been created for renaming media witch used to be the only thing the old version could do.

Users are able to write the own custom actions, stores and stores in Java and use them. This gives a great way for custom things, but also allows for testing of new actions, stores and sources before they make it to a release.

Anyhow the next release is getting closer......

MediaInfoFetcher version 2.0 progress so far....

It's been a little while since I posted any kind of update on the my open source project MediaInfoFetcher. For those not familiar with the project. MediaInfoFetcher is a application and a API which can be used to retrieve TV show and movie meta data from Internet sources. This information is then stored locally and can be used to rename media files with the correct title.

Version 1.0 was released sometime ago now, with several updates since then. However it was always had problems keeping up with the web sites that it scraped for information. So I've been working on version 2.0 for a little while now and it's making good progress. A lot of things will change in the next version which will help to keep it up today and always working in between releases.

Some of the features to look forward to:

• Added a source that uses XBMC media player scrapers.
• Checks for and downloads updates of XBMC scrappers.
• Removed the old XMLStore and replaced it with a new one that stores all media files in a single XML file.
• Removed some of the source which were always broken. Now using the XBMC source instead.
• Much better searching of media data (films and tv).
• No longer uses Atomic Parsely to write .mp4 metadata. Uses a pure Java solotuion instead.
• And much more to come....

Things are shaping up nicely, but it still has a way to go before it's release ready. I'm very pleased with it's ability to use XBMC scrapers. This means it can always obtain media information without having to worry about it going out of date. It also means their are many more sites that media data can be obtained from as their are quite a lot of different XBMC scrapers.

Just released version 1.1 of MediaInfoFetcher

I've just released version 1.1 of MediaInfoFetcher. This is a application that can be used to find Film and TV Show meta data, and store it in various formats. It also can be used to rename media files using this data. The latest version can be found here.

Changes are as follows:

• Able to rename Films with data fetched from the web.
• Added new Film source for fetching film information from www.imdb.com.
• Updated stores to store film information.
• Added new MP4 store for storing metadata in mp4 files used in iTunes.
• Added support for renaming .mp4 and .m4v files.
• Film posters are fetched from the Internet and stored in .mp4 and .m4v files.
• Updated to the latest format changes of www.tv.com site.

Happy Christmas! let me know if their are any bugs in this release.

Media Info Fetcher

I was face with a problem a while back, I had quite a few media files that and the wrong names. I wished to rename these too the correct names. I wished to be able to define what I though was a correct name. The main reason for this is that they show up in my media centre. A second thing I wanted, was meta data associated with each of the media files that could be displayed in the media centre.

It was for these reasons that I hacked together some Perl scripts that used the great Perl module. This allowed me to retrieve the meta data that I was after. However I prefer to work with Java over Perl and as my application was needing more and more features, I decided to rewrite it in Java.

So Media Info Fetcher was born. This is a java application that can retrieve Film and TV Show information, and rename it according too data it looks up off the Internet. This information is then cached using configurable stores so that hopefully it can be used by media centres.

I think I've achieved my first aim so far, but my second aim of getting a media centre too use the retrieved data has yet too happen. This is probably going to involve creating a plug-in for other media centres. Though I'm open too ideas about this.

Anyway I've just made the first release of the 1.0 version of Media Info Fetcher. So check it out here.

I've some plans for the next major version. These may change, but include:

• Adding support for Films.
• Adding more stores and sources.