WWDC2004 Session 214

Transcript

Kind: captions Language: en well welcome to welcome to the session my name is ian ritchie i've had the opportunity of managing part of the quicktime engineering team this last year Ashley for a number of years and we decided to what we in fact something you were here last year and we mentioned that we're working on a new set of cocoa classes for QuickTime and we listen to your concerns we heard in s movie and in its movie view had some issues you want to just to take care of and said well how are we going to do this because we're quicktime engineers we know quicktime inside and out we didn't know a lot about cocoa so we actually the whole team took coco classes and we met with the coco development team holly Ozorne andrew clatter and others and a lot of direction from even executive management on how to work on these classes and we'll explain today what we've come up with you're going to learn about the new AP is that we offer Tim Monroe will come up and talk about the classes will show you some sample code that we worked on we like what could you get working on today you know just to after a few minutes you have it on your DVD and then we'll go into what if you had a few days to work with this some things we came up with these last few days after we finished working on the seed for your DVD that you have and then we have a special guest at the end of this so the old classes in this movie in this movie view when we tried to use these just like you real flash you ran right into carbon you go oh no i've got a idol of movie well i don't know about that and what's a handle you know I since Mac OS 9 most people don't know these or are not used to using these structures and data types so you ran into limitations that we decided to address and of course there were an occasional buggers who than the old classes so you've probably heard Apple explain we're committed to Coco we want you to use cocoa if you're going to develop an application on OS 10 use cocoa and they mean it we develop an application on both OS 10 and Windows the quicktime player and we are committed to developing the quicktime player for let's pan in cocoa explain in a minute how we did that we developed a QuickTime broadcaster a lot of the ayats' that you see iphoto imovie other apps we have an apple are using cocoa so we encourage you all to embrace this technology and Apple is committed to providing access to other parts vos in cocoa classes so we looked at it as a cocoa programmer would we removed all the carbon isms so you can get up and get running in no time with your cocoa background and this next well where possible we adopted the cocoa model there's a few places that will tell you about that we made exceptions and we also provided a new palette to Tim and roll will go through in a little bit that will show you the new functionality so on the abstraction we have to deliver quicktime virtually everywhere we have ninety ninety-five percent of our users are on Windows so when you're developing an application we said well where do we put the code where do we put most of it push it down in a quick time as much as possible and then above this we have two layers we have an activex layer and we have a cocoa layer and these one of the layers here today that we're going to talk about is the cocoa layer that's what we built the player up on both for windows and mac so your application should be relatively quick time agnostic and just use the classes and be able to get up and running in no time I like to introduce now I even wrote some of these things down one of the Apple premieres multimedia engineers this is all imprinting look it up on the internet he is the resonant quicktime guru in many circles an author extraordinaire you've seen many of his articles in and he's also written the QuickTime toolkit volume welcome to i encourage you to run out and get this book let's bring him up now here Tim enroll he's also the tech lead of the QuickTime Coco kid come on a family Thank You Ian what I want to talk about here is briefly go through the kit give you an overview of what classes are in it and then I want to do a real quick demo that shows how to use the kid and then I want to get out of the way so that the really fun demos can come forward so there are five classes in the QuickTime for Coco kit and there are two data structures so let me start down toward the bottom with the data structures because we'll need those when we get to the classes we are providing a data structure called QT time that is going to be our preferred method for indicating a time or a duration in a QuickTime movie and you can see there is three fields here a time value and the time value is interpreted relative to the time scale which is the number of time units per second and finally we've added a flag field here and this allows us to do some interesting things like indicate that a time that we're passing back to you is not really a valid time or is perhaps an indefinite time this might happen for instance if you ask for the duration of a streaming movie we don't it doesn't really have a duration so we might pass you back the flag that it's indefinite you can see the QT time is indefinite like they're so we have a bunch of utilities for creating QT time structures for adding them together for comparing them we've tried to do everything as much as possible in the cocoa flavor and there are two predefined QT time structures that you'll be working with namely cutie zero time which is a zero time or duration with a non zero time scale and then the Qt indefinite time which has that flag that fits it and flag if you take two to QT time structures try that fast and put them together you have a cutie time range and that indicates a start time of the range and the duration of the range and once again we have a number of utility functions that you can use to operate on time ranges for instance QT time in time range will give you back up boolean value and finally we have added categories on the NS coder class that allow you to encode or decode QT time ranges and QT times trucks so when you archive or on archive objects you can add these items in so let's get to the classes now the main class you want to work with is QT movie this represents a cutie movie and movie controller we don't see any use in separating those two items into separate classes there are quite a number of ways to create a cutie movie instance I've got some of them listed here if you have a movie in a file you can give us a file name if you have a URL will take that if you have what a cutie data reference which I'll talk about in a second we can initialize in QT movie objects from that NS data or finally if you want to put a QuickTime movie in your nib we also have this method movie named which you may recognize this similar to the image named method for reading the movie out of your nib file now so once you've got a cutie movie object we have a large number of methods that you can use to navigate within the movie or to get movie attributes let me just talk about the attributes for a second there's a few methods that will give you a specific attribute directly for instance the current time method will give you back a cutie time structure which represents the current time now we could have defined methods for all the very many attributes that you might want to get but we haven't done that what we will give you is an nsdictionary that contains key value pairs of a large number of keys and the associated values if you just want one particular attribute then there is a method movie attribute for key so you can pass this with a specific key and we'll give you back the associated value so if you have a movie you can also get an array of tracks in that movie and finally if you need to go underneath a kid if there's something the QT kit doesn't do and you really like work with models karbonn ap is you can get the movie or the movie controller identifier and use that in your code the next class we're talking about is cutie track as you know QuickTime movie is composed of tracks so we will give you back if you wanted a list of tracks of QT track objects in the movie now there's only one way for you to create a cutie track object yourself and that's if you already have a QuickTime track we you can initialize a cutie track object from that existing quicktime track the way that you get and set track attributes is exactly parallel with the way that you do it with movie attributes finally you can get the media object that's associated with the track and also in the case that you need to go underneath the kit and work directly with the QuickTime track you can get that track identifier not much to say about media each cutie track has one media associated with it again if you want to create a media there's only one way to do that which is to start with an existing quicktime media and called the unit with quicktime media method media attributes works just the same way as movie and track attributes you can get the track associated with the media and finally if you need to go underneath the kit you can get the media identifier there's a cutie data reference class which I don't want to say much about because we'll talk about it a bit later but the standard way of talking about of referring to data in a movie is with a data reference so we'll talk more about this later and finally the the view object that will be working with is QT movie view it's a subclass of NS view that is associated with a particular QT movie object I've listed some of the attributes that you can get in set we'll look at this more in a second when we get to interface builder and finally there's a large number of IB actions that you can wire up to menus or buttons in your interface so that's really the kit they have asked us to mention a few issues that you will run into if you start working with version of the kit that's on your DVD but I've listed three of them here there are some cosmetic drawing issues that you'll run into that you won't see here today because we have a fixed version of it currently you cannot usefully subclass a cutie movie view and get the event handling to work just right and finally I would not recommend trying to rotate a cutie movie view right now so let's go to a demo with this and I'm going to show you with six lines of code just how easy it is to write a multi document quicktime display and editing application so let me launch Xcode here and i'm going to ask for a new project and I want a new project that is the cocoa document based application let's call this demo don't tell me you're crashing there we go i'm a pessimist let me open the dot H file and I'm going to need one instance variable here actually first I need to do this when i'm using the kit i need to of course no include cutie kitty h and then i'm going to want to have one instance variable here i want a cutie come on movie view and let's call that movie view what now this will work so let's say that that's all we need to add to my dot H file let's go into the dot m file and so I'm going to be loading windows from nib files so I want to come down to the window controller did load nib method and add a few lines of code so in the instance that I am loading a movie from a file so if self file name is not nil I want to do something and that is to create a cutie movie and let's call that movie and how am I going to create that I'm going to call the class method cutie movie movie from file and what's file self file name and if I get a movie i'm just being careful here I want to assign that movie to the movie view which is going to be loaded so I will say movie view set movie to movie and I believe I'm done with my code so let's save that now I need to set a few things in my target here first thing I want to do is when I'm building oh goodness I don't want to do the pre compile the prefix header because that will take too long and finally I want to set my document type so that when the Open File dialog comes up i can open MOV files and that's all I need there I could add in other document types here but i'll refrain from that so let's see if i can build this build succeeded most excellent but I'm not quite done yet because I need to set up my user interface so let me open the document nib I'm going to get rid of that text thing and the first thing I want to do is resize my window you'll notice that I didn't put any code into my source file that resizes the window to fit the movie so I'm going to shut this i'm going to set the size of the window to a known size that will fit my movies ok and now i want to drag a movie view object into my window set it down here i want to set its size to resize to fit the movie window when I resize it and now let's say a few attributes on the movie view you can see I can show or hide the control or I'll show it and I want to make this editable and I need to do one last thing I need to set up an outlet for the file owner so I'll come in here and add an outlet and we need to call that movie view now let's come over here and wire it up I will control click make the connection save that and if the demo gods are smiling on me i can go ahead and run this and demo is running and there isn't so let's now go over here to the open file and open a movie file after good thank you one thing you cannot forget to do is add the QT cage framework to your project or it will run so we're going to go to system library frameworks look down here for the Qt kit framework add that to our project yes now let's build and run and now things are working fine so i can open let's open that one but i tried to open before movie from file ah thank you it's not moving from file you think i know this stuff now it's a movie width file okay now that we've got that let's try running this oh I'm still running it there I look there we go now this should work was cause our fingers open that thing go we've got it this is actually a flash file one thing let me show you real quickly in the keynote on monday i showed you that there's a contextual menu for movies and if I control click and this is a flash movie I actually get items here that are relevant to flash so I can zoom in zoom out and so forth alright let me very briefly show you one more thing and this is to show you that the kit provides you a large number of behaviors for free ok so I've opened three movies here I have to be our panoramas and let me line this up just right so this is donner lake in the winter and donner lake in the summer and oh that's exciting so let me try opening that again alright so something is missing here what I had was a wired sprite movie that sent messages to the two panoramas to tell them to pan so I can't do that here because the movie isn't opening correctly but that Illustrated one thing that you get for free with the kit which is automatic inner movie communication so with that bumbling through let me bring up Tom Maremma and he will discuss what you can do hopefully with more success if you've got an afternoon to play with a kid all right where is the clicker huh is it how do I go forward on this I'm Tom Maremma I right technical documentation for Apple I've been working with a QuickTime team for the last seven years and this is just awesome stuff I decided to see what I could cook up with the framework basically in an afternoon whoops that was too fast how about going back here and I wanted to basically build a little quick time kit media player app and tiger something it was tasty easy to cook up and wouldn't burn my fingers I basically wanted to do us an app that could play display QuickTime movies import export and also do some editing beyond simple cut copy and paste and this would involve maybe a couple hundred lines of code so what did I need well first of all tiger cookbooks yes we have some tiger cookbooks to do to work with a QuickTime kit framework second thing is sample code which you can download which is piece of cake and then some basic cocoa programming third thing ingredients start with Xcode obviously make sure Panthers or tiger is installed and the key is add quicktime six dot six and then we're going to bake it up with the new classes when completed invite friends over to watch and enjoy my player up doing its thing finally all the documentation the reference and the programming guide is available plus the sample code that i use to build this app notice that we have not included the 3300 pages that are part of the procedural capi you won't need that nor will you need the thousands of other pages that we've written over the last ten years documenting this awesome quicktime technology so can I go to the demo please whoops that's going I'm going to just close think this is ten stuff we'll just do this around a little bit this is my cutie kit player app and as you can see i have added my cutie kit framework which is Tim what what Tim was showing this is basically an app that we've cooked up in a couple of days and what I want to show you is just a few features that are unique to it I also use the cutie kit palette and was able to drag here's my my cutie movie view and from here what I'm going to do is show you what you can do as far as adding some of the actions the as as you can see I have specified my fill color is blue Mike I'm showing my controller and I'm not going to be showing the editing cart yes my let me just go back to this and I want to show you what I've wired up here hey this is the cool stuff that comes with the kit as you can see i can add add scaled in addition to the cut copy and delete i can specify my actions to go to the beginning to the end i can replace it can start backward etc then from here let me just pop open real quickly thank you the main menu nib i don't know if you guys can see this is getting a little bit crowded here I should probably and here I've added importing plus and export view object I've added some of my other menu items and in my edit menu and also in my movie so from there let me just close close this down a little bit Alice ate anything and now just close say anything now here's where the here's the good stuff in my declarations they're all very straightforward I think this is standard cocoa stuff you can see what we're doing as far as the class methods in its some of the setters this is probably the most commonly used of our methods in the Qt kit and down here here all of our IV actions things get a little bit more complicated in the implementation file this puppy is a is somewhat longer as you can see here I have a pound to find that it specifies the width of my movie at 320 this is primarily to open up audio movies and this code sample code is all available for download and it's all documented block by block the interesting parts i think have to do with and I think Kevin Calhoun will talk a little bit more about some of the issues involving sizing and and here we're we're opening up our document with the contents of the file and this is partly where we're going to be doing some of our importing the beauty of working with the Cutie kid I think is that that it doesn't take a lot of code and it really it really dances for you so I'm going to just quickly build and run this puppy and there's my cutie kid player app as you can see this is the default now here's where it gets a little bit interesting I can basically import and I have control well if we get some sound we have sound we have sound on this issue ok the next item that I want to import for you guys is my mpeg-4 file now here we've got we got some control of our movie playback hopefully you don't have to flip with cockroaches like that and guess what we've added we have picked capability which I don't have time to demo now of additional editing functions that add as skilled replacement trim we can toggle the controller and if we want we can even clone it there we are okay things get pretty hot we can in vian even import JPEGs still images and my favorite import item being a guy who does documentation I decided to actually import a PDF of the documentation which for you guys and it has a scroller down here for if you guys can read it 30 frames a second there you are okay happy cooking so the document is available that you just saw now since you read it so quickly you don't need to pick it up off of your seed but for others at the conference you might point out to them that the QuickTime kit reference for objective-c and the QuickTime kid programming guide are available I am Kevin Calhoun i'm still a software engineer at apple computer and i'm going to talk to you about some more advanced scenarios once you get involved programming with the QT kit you are going to have needs that go beyond the things that you can do in a morning or an afternoon you might have to work into the evening these are the nighttime topics let me go through them one at a time for you as Tom mentioned there will be some code that's necessary if you want when you load you when your windows nib is loaded if you want the size of you or size the entire window to fit the natural size of a movie we've always made this easy for you it's possible by means of one of the methods that Tim mentioned earlier the Qt movie movie attribute method to find out what the natural size of the movie then you can use that size to set the size of your view or your window accordingly you can check whether the movie is displaying the movie controller and adding the size of the movie controller as it is and that code in fact code that looks exactly like this is in Toms sample application which we were distributed to you so you can see it in action Tom's of application you call that the Qt kit player is capable of opening any of the media formats that quicktime is capable of opening and it does this merely by calling the method QT movie movie with file that's all you have to do and you can open mpeg-4 all the still image formats that QuickTime supports avi a whole range of formats even QuickTime movie files but you might want to tell NS panel in its open panel when you bring it up that you want it actually to make all of those different file types selectable there are two ways to do that this is one of them here you can use the class method on QT movie can in it with file in order to determine whether a file should be selectable in NS open panel you do it just like this you set yourself as a delegate for the panel and you handle the method panel should show file name and you can respond should I show this file by calling Canon it would file the other thing that you can do is you can actually get from QT movie there's a class method that will return an array of all of the file types that QuickTime can open if that's what you need to do it's really a trade-off if you have a small number of files you might want to pass them for a filter like this if you have a wide range of file types it might be more efficient for you actually get that whole array okay other topics we showed you opening movies from files we mentioned that you can open movies from URLs well what happens if you have media data stored in an instance of NS data I've got Anna status inning around and I've got a VI in it or I've got mpeg-4 in it I want to make a cutie movie out of that well that's very very easy there's a class method on QT movie movie with data but I wanted to show you just a little under the hood what that method actually does it initializes and it well it creates an instance of QT data reference that essentially refers to your NS data as the source of the media that the movie will be able to play and manipulate when you do this it's very handy if you give QuickTime a clue about the format of the data in your instance of NS data there are two forms of clue that we're able to read one is a file name with a path extension if it's if it ends in dot mov or mp4 that's a good clue about the format of the data that's in the NS data or you can give us a mime type and that will help us determine how to import that data in your NS data then you can manipulate media data in instances vanness data using the very same methods that you saw demonstrated and use with files ok that's media data coming into the kit what about going out you have a lot of options for storing your movies in files and for re-encoding your movies into other forms of media option one you can simply write your movie out to a QuickTime movie file a file which only stores a reference to the media data which is stored externally that's easily accomplished via the Qt movie instance method right to file with attributes the second option is perhaps you want to save your movie after you've performed all the manipulations on it that you want to perform out to a QuickTime movie file but you want to store a complete copy of all the media that that movie requires that's easily accomplished by means of the Qt moves movie method right to file with attributes I've achieved a theme for my talk I'm satisfied I can move on but in this case you have to put in that nsdictionary that you pass for with attributes some information that tells the Qt kit that you want to flatten you want to copy all the media data to the output movie file so that's what this code accomplishes of course if what you want to do is to store your your model by means of an S archiver you can use that with QT movie instances as out you can archive the movie as part of your whole object hierarchy finally the last option is you can just get in an instance of NS data the serialized freeze dried form of a QuickTime movie using the method movie format representation once you have that you can store it anywhere you like an instant savannahs data which you can write to a file or do whatever you need to do it finally if what you want to do is not store your movie but re-encode it or export it or somehow turn the media that that movie plays are represents into another format how do you do that well you can simply use the method right to file with attributes some of the attributes that we support tell us what kind of container format do you want to store it in other words what quicktime movie exporter do you want to process the media and store it in that container format you can tell us you want ABI you can tell us you want aiff what have you and furthermore you can tell us what compression settings that you want to apply to the audio and the video as your media is recompressed and stored in that container format now this particular snippet of code the longest one that I'll show you today shows you that you can load some presets from a plist that you store inside of your application bundle that ink that contain those those export settings that i mentioned well the question is where do you get those export settings from that you might want to store and peel it well I wrote a little sample app that does exactly what you would need to do so let me come on over to the demo machine if a left-handed demo machine today and I wrote a very simple application that brett really does one thing only it manages a list of export settings and it saves them to a p list of exactly the form that i mentioned in that code snippet here this is a very simple coco app all that it does is show you an array of export settings such as high quality or digital video and for each of these priests so I want to use in my application I can edit those export presets let's see I want high quality to use the video compressor oh let's see what do I want to use I what do you want to use Michael pick slit and I want that to be high quality and I like 30 frames per second and i want my sound to be stored as apple lossless at 48 kilohertz because i know that's the audio format that i'm going to be working with and I'm not interested in preparing for internet streaming because i'm just using this in my production pipeline but if i'm delivering the cd-rom perhaps i want a different set of settings i may want to encode my video to mpeg-4 with medium quality and I want my audio in this particular case to go to mpeg-4 audio AAC looks good and so all I'm doing in this application is editing and saving these presets I set my high quality beat Apple pick slip video and apple lossless audio and I set my cd-rom a preset to be mpeg-4 video and mpeg-4 audio now I can save this collection of presets to a document i'm going to say these are my export settings and i'm going to store them out on the desktop and what I actually save in this application is a plist and inside of that P list which has the file type if only you could see the file type dot export settings it's a simple p list that contains those export settings that i can load in my application later on and apply to an export operation this is sample code that will distribute to you if you want to implement something for example like iMovie I can come back over to slides please if you have something like I movie that has a panel that says export to web export to cd-rom this is exactly how you can implement that in your own Apple patience finally my last scenario has interest when you're dealing with media the interesting thing about media is that it can come from any places and have a variety of characteristics one characteristic is that it can be slow it can be coming from remotely over a network or it can be a media format that quicktime supports that might take us a while to scan in order to apply all these great features for it for example if it's primarily a streaming format but you want to do editing on it quicktime might have to do a little bit of work to prepare it for that what you need to do in your applications is to check the load state of QT movies to determine whether or not they're ready for the operation that you want to perform check to see if the load state is complete before you perform editing or saving operations we're making it easy for you by giving you the movie attribute the QT movie load state that you can check for this and our own operations for example if you call right to file with attributes to do export will do the checking for you but it's something to be aware of okay so those are my higher-level scenarios of interests I'm going to turn the stage over to Adrienne bear locker who's going to show you some of the cool things that he built I'm not sure if you did it in the middle night or when but he'll tell you so can we switch to the demo machine please I'm going to show a couple of very simple demos using QT kit in tiger so the first demo I have is a movie screen saver so Tiger OSN has a screen saver framework for writing your own screen savers and you basically just returned a screen saver view so in this case we want to use a cutie movie view so we programmatically we can create a cutie movie view and add it as a subview to our screen saver view and in this case we've set some attributes of the view to to hide the controller and preserve the aspect ratio so this is this is a very this is only about 200 lines of code or so most of this actually involves like setting up there's some a configuration sheet in this case the only other thing i want to show here was the only up so we also we observe a notification there's about 16 different notifications on QT movie and in this case we we observe the QT movie did and notification so that we can know when the movie finishes and go on to the next one so what most these notifications are useful if you if you want to customize your user interface you see a little preview like other screen savers and this is just picking up movies in the feed from the movies folder and we can select which ones we want to put in here and loop them or mute them and picking crush test and as we go on to the next movie beep this one would finish so it's a really simple example the other example I have here is of a movie plug in New in Safari the thing in serene in tiger WebKit has exposed the cocoa plug-in API and it's actually very easy to write your own plugins for WebKit and so we just there's a message you you provide a class method plugin view with arguments and we get a dictionary this is just a dictionary of the attributes you get in the ambit from the embed tag in HTML and so I use those two to initialize our QT movie view subclass plug-in movie view and also create the movie and set that on the view and so the subclass in this case also so this is a plug-in protocol so in this case we return self the plug-in movie view itself to form the object for the web Script object so it's also very easy to add JavaScript support and you just need to implement these two methods is selector excluded from web script and web script name for selector and this is just mapping the cocoa selectors to the javascript function names themselves you see I have like play stops stepping and go to end and full screen and most of these just mapped to QT movie view so i just actually just called super for these except for full screen but it's actually very easy to do full screen in in cocoa i mean we just we can just create a window set the level to around screensaver level set the background color and add our QT movie view to the windows content view so let's just run this so not the greatest you I but all of these buttons these are all plugins they're coming to me visit we can we do so little empathy we need the quick and we can step and I'm sure you can think of much more interesting things to do so these are just a couple of very simple examples of what you can do using QT kit I'm sure you guys can come up with much more interesting things thanks so we're here huh well you've seen a few other things we've done recently with the cocoa classes in quick time you've been to some of the other quicktime sessions i hope and it's not a lot of new exciting technology is in this next version of quicktime and the cocoa developers that in vase the kit the quicktime kit will get a lot of these technologies for free we're going to continue to develop the classes going forward and there's a lot of functionality now that's in the kit today so adopt them put them in your app and we'll do the hard work and the heavy lifting for you you have the rest of the QuickTime team behind you okay thanks for coming that's our show oh wait one more thing oh there was one man that is more responsible for what we've accomplished here the instigator I guess be the man behind the throne that and also our number one QA person because from early days he was encouraging the QuickTime team and Apple to get behind the cocoa effort and has adopted the kits from early on and helped with the design and guideline and I'm very proud to have him here and you're in for a treat is dr. Michael Johnson of Pixar let's bring him up well thank you you know that was way too nice now I owe him money again um well yeah so just to start off on a group called mpg every year I come i'm in a different group so eventually they're going to get rid of me but they haven't yet so people are asking what MPG was it's actually the moving pictures group but you know the various jokes or your mileage may vary we move the pictures so you don't have to there's no experts here or the expert is silent and other people at pixar think of us as the media pipeline group and and really we're the people who are responsible for a chunk of in the studio tools group the apt technology and workflow for kind of what i think of is film development and that's really kind of development it sort of trying to come up with the movie the story department get a tutorial department the layout departments and these are the groups that really deal with is a film as a large-scale entity and a lot of the other groups at pixar on the production pipeline are dealing with a shot or a model and and and so we actually deal with sore larger chunks and so one app that some of you may have seen that we wrote back about three years ago is this thing called pitch doctor which we use in the in the story department and another one which some of you have also seen is the thing we call review sketch which lets our directors actually draw on top of any of the footage that they're seeing in the screening rooms and for the last year so we've been working on this thing we were calling the was still are calling the film online kit and it's a it really would not have been possible without this effort by all these amazing engineers in the quicktime group and it was something that I wanted to do because in you know a couple years ago my view quicktime was a quick time it's too big it's hard it scruffty and it's fragile in the sense that I had to know to call this and then that and then have this thing initialized or whatever and you know quick times api's they make me tired and and if you're a cocoa program actually that's so let's take a live a here how many of you would consider yourself coco programmers who want to learn something about quicktime today interesting how many of you would consider yourselves you know quicktime people they're sort of old-school carving people and you're trying to learn more about cocoa this time okay yeah it's about the mix I figured so but see that's the thing is like for those of you you know the second group there I really really really really want what quicktime can do for me like you know I I don't want to do this stuff myself and you know because my group of pics are we know we're pretty small group relatively speaking and we're all about leverage and quicktime is all about leverage and so I had an idea so so now here it is a you know from 2002 than a year on I had a different view because they'd come to me and I said you know we're working on that thing and want to do it and like what do you need out of this thing because here's what we're doing and so I said you know well actually pretty simple needs you know quicktime is this enormous enormous thing so i want you know a model level class 4a for a QuickTime movie it's pretty straightforward teams I want a really nice view level class for a QuickTime movie and so what do I mean by nice well the first obvious thing is maintain the aspect ratio that drives me nuts your work on a film like you know you can't know that's I got the bars don't mess with ya and so and then this was the thing that I think I think may have thrown them a little bit for a loop but I also think that it's kind of the obvious thing and I don't know if this is from because I work at a place like Pixar where we make cartoons or if it's because I'm a cocoa guy but I wanted to easily and quickly make movies of movies and there's a bunch other stuff I want it as well but but the sort of movies of movies who say what it what would this be and so this was actually one of the things that fundamentally appealed to me about quicktime was that if you looked at any of these other media formats and I don't even know what that means but but ways that you could imagine storing synchronized audio and video you know way back when I was a place called the Media Lab at MIT a long time ago and you know we would did stuff early on with quicktime and remember very early on hearing somebody talking about the fact that you could make a movie that had other movies in it and I was like well of course that's the obvious right thing and and so that's always always stuck in my head and so for us you know what that means is you know when I think of a movie I literally think of a movie that we're working on that's X 1 2 & 3 a given act has a bunch of sequences in it a sequence has a bunch of shots a shot has a bunch of frames and then those frames I'll have you know some set of layers on there so place i went to the ian and kevin actually and said this is sort of what i wanted in Kevin god bless him I gave me like a bunch of code that I did not understand and it did exactly what i wanted and every time i would say you know i would send him to man i would say Kevin um you know you old-school carboni quicktime guy um you know what I really wanted was I wanted to be able to do this thing with this in and out point he's like yeah Michael it's in the code just just use the code that I gave you and so you know but it was a lot of code and so I got confused easily so eventually I finally learned enough about quicktime to be able to ask the right questions and figure out how to actually implement this stuff myself in the kit and i like to think that those discussions had some influence on the api to make the kinds of things that I wanted to do much simpler for you guys now one of the things that that will sort of come up in this is you know is this stuff fast enough and I sort of have measures of of what's fast enough and so for me it does it get me the leverage I need and it absolutely does and and it's always you know it's the old one it is it's magic because if this stuff works at all to me I just remember a line from Alan Kay back a long time ago and he was had some harsh words for the Macintosh and somebody was like you know why you harsh it on the mac he said oh well it was the first personal computer you know worth insulting and and so this is like so I feel like what's with the kit it's like i finally met the point now where I can have a conversation about quicktime and actually you know say something give some useful critical feedback because because now it's finally good enough in the sense of like that i can actually do something real with it so this is i'm going to toss this up and I'm going to talk about a little bit now and then i'm going to give a bunch of random demos but this is this is pretty much the code that's like at the core little thing that I asked Kevin for a while ago and the idea was here is I have a little thing in my film online kit the fol kit there's a little thing called fol element and an fo element basically just has a movie and it has an in an out point it has some other little bits and pieces of information there but the idea was is you have an fol element then you have an fol sequence and that would be a subclass off of it so an fol sequence was an ordered list of fol elements and the idea there was so you could have movies of movies of movies I didn't want to just have it be I wanted to be as thin as possible layer on top of the kit but I wanted it to be a layer I didn't want to just you know try and convince Apple to basically you know write it for me I've done that before and I think you guys have that codec and and so so this is all it really came down to and what's cool about this is that you can do the whole thing with QT time which is a wonderful wonderful little struct and again sort of goes back to sort of the core getting it right with quicktime thing the fact the QuickTime has always thought about time correctly and they always thought about it as you know a value with reference to a scale you know to just you know Jim that's off and and so what's going on here is basically I'm grabbing the movie out of out of this sequence that I'm in and and I'm grabbing the movie that I want to stick in there and I find the I find the time that I want to move the thing into there and then I call this method this insert segment of movie time range at time and and magic happens so some other things to think about and I'm gonna give you a bunch of demos here but I want to kind of put a bunch of ideas in your head when you get your hands on this stuff one of the cool ones is we worked with the the final cut folks to come up with I mean they did all the heavy lifting we gave them one good idea on this XML format I've got the Earl here I went and checked that last night to make sure that was that was a live link there and it's a great file format and what's cool about this is especially if you're like me and you're building things on top of the QuickTime kit and the in QuickTime is great file format don't get me wrong but there's a lot of times you're going to want stuff to basically be editable somewhere else especially if you're like me and you've got you know you own a teeny part of a very large production pipeline and you need to have things flow around there this XML format is really great for that and in our kit we actually support we can read and write it and so that means you can sort of put these things together and then you can save them out and just double click open them up and final cut and it just works another thing that I've been sort of thinking about as I've been here I mean the command line apses is a big thing also for us and with cool about the kit is so again I've been trying to learn quick time for years okay failing miserably for the most part until this stuff came along and one of the things that sort of always comes up is people wanting to make reference movies right you've got like these five movies and you'd like to make a move there's my movies with movies game again but you know and I guess there's I guess there's this guy Peter hottie and he wrote this thing a million years ago and people all go and get this you know it's over hero runs and classic and you know there's there's some little thing for doing this stuff and I'm sure all the QuickTime gurus are going well no Michael you just do this but but as far as I could ever tell you know it's just sort of black magic and you can write this in like three lines now with the kit that's just so killer you know you can basically open up a movie do you know insert movie of movie into that movie as you iterate over your movies and then save the thing out again and now you know you can even transcode it to a different codec if you want amazing and then also I was just thinking when i went to the automator talk the other day about the fact that you know if you think about these things little command line apps you can imagine doing all sorts of really neat things with QuickTime movies so anyway the other thing that you may want to do is you may want to put whatever stuff you do on the kit on an ib palette and that's what we did so so we have this idea of what we call a sequence provider and a sequence provider is basically a model object that is holding on to its basically fronting for one of these sequences it's basically providing that thing for you to a model controller layer and we have a set of formal protocols that these sequence providers can form to so there is the notion of an fol sequence providing there's an fol mutable sequence provide a providing an fol beautiful movie sequence providing we're way to protocol E and so we've actually implemented this for two things one of them is actually a very lightweight thing you know think of like iTunes except think of it for movies and so you'd like to basically have huge lists of movies big cut list of movies but you really don't need to play them you know you're really just kind of organizing them it'd be like bringing up iTunes where you're getting ready for a party and you know all this music you don't need to actually play it you just kind of want to rearrange it and put it in a particular order the next one is an actual hardcore editable playable movie sequence something where you can hit spacebar and it's just going to play play for you and so so we implemented these two things as serve objects on the pallet there so with that go to bring up I be everybody has to arrange their little I be world differently myself included oh yeah hmm right all right so just start off with a simple thing no document opening error occurred well that's good we should have rebooted this this machine all right we'll make a new one see I tried all my stuff on Panther and then they put me on a tiger machine so the the basic idea here is here's here's our little palette here we have a whole bunch of different objects a bunch of which you're not going to see today sorry so so the first thing we want to do is you want to actually drag out this little object that has a bunch of movies in it and because we are very firm believers in the sort of iterate really quick kind of thing we actually have I can go and I can add and delete movies to this thing here which I will later on this but it comes up and it starts up having just a bunch of movies to a bunch of tests movies sort of built in there to provide out so the first thing you want to do is you know pretty much what everybody else has been doing here which is you drag out a little you drag out a little movie view and in my case I actually wire it up to a sequence provider so now if i go into test interface mode i actually go and build up a little sequence of those movies there and so I just have this simple little movie that's there now that's not super interesting it's sort of what the other guys were doing and I must be the sexy demo so I have to do something better than that so one of the things that is really really neat about this and the things thing that they got really right is the fact that this is very you know and again happy that most of you raise your hands on the cocoa side of the fence there is that this is you know the QuickTime kit makes it very very easy to make very NBC kinds of things and so you know here we have old table which is representing the movie and as we're playing this thing here you know it sort of showing up that stuff there and we can do all the sorts of things you would expect I can drag and drop these things around now what's going on here I'm editing a movie okay I'm editing a movie of movies here and it starts to get really interesting of where it's actually just updating this stuff so we'll put some more yeah see I know why those guys don't want to open that's weird anyway we'll go and instead of having a just a table view we can use a an outline view and so you can notice now that when we get with some of these things there were little disclosure triangles on them and that's because these themselves are movies of movies of movies so in our little test thing that we've got there we actually have it set up so that it's not only to sort of one level of hierarchy but it's too and in all the sort of stuff that you expect to have work works you know you can serve drag between them and stuff like that and we're doing you know we're doing some heavy lifting there but the fundamental quicktime activities going on there is that little function that I put it there which is basically all I'm doing is I'm inserting element I've got sort of a companion one of that which is basically delete element from segments and these guys really did it right it's really sort of works the way you would expect it to work and again we've got with the kit that we've been working on we have a whole sort of raft of these these UI elements so let's just go and see if we go and we said let's put that in a tab view where do I put on shampoo something's been puttin up to have you so let's put this guy in a tab view there and then we can actually go and we have another another view which is a tableau view and so if we wire that guy out to sorry I'm try going to scroll view and this guy will go and let's actually also drag a little slider so we'll do the sort of iphoto kind of thing so we can see our our movie that we have here as both as but looking at it that way or this way and again sort of all the same kinds of things we can go and move these things around and and then we can go and I should have made it continuous that's what you want to use I be so now when you go in there you can try that sort of stuff now i really want to sort of take this moment here since you're since your cocoa folks here to evangelize a few things people i came from the old nextstep world that's sort of how i got to cocoa and one thing that used to happen a lot more in the in the next step world and it seems to be happening in the cocoa world is people would put things on pallets and and it makes me sad that i don't see more IV pallets and i pushed really hard on the QuickTime kick guys to get sort of all their ducks in a row on there so in terms of you know the all the encoding methods and things like that are in there so that you can actually go and put all this stuff in there put it in a nib and there's a certain rigor that that happens when you actually go to the trouble of putting things on an IV pallet and there's a certain cost up front in terms of actually making it so that all your objects know how to serialize themselves out and that they're using key coding you know correctly and and there's you know there's some work you have to do there but it's really worth it because there's nothing like you know taking out another app to to know when you've got bugs in your code and the cool thing about ib is you know I'm you know in a test interface mode there if I'm not releasing everything correctly or I'm doing some bad trouncing on things there I'm going to pay for it really quickly and I much prefer to sort of take the pain of that kind of stuff not quite completely upfront but you know people don't sort of go and finish things out well enough i think in it it kind of makes me sad so i'm hoping people will see you know this thing as a kind of a non-trivial example that was basically done by there's like you know for people that contributed to the code on this thing here so it's not a huge wasn't a huge huge effort but but it is something that you want now take out against or there's the obvious thing then that if you're going to really start trying to do Production apps with this stuff the one thing that I think you know we all know that we need is a timeline and so we have a little Timeline view that we can drag out here and eventually start up there so here we have a little time line and same sort of stuff happens you know you've got selection you can see it happening between them there we've got interactive we can serve change the in and out points on there and then indicate those things and and what here's sort of a neat thing so remember this is a movie of movies inside our movie right so and remember that that little movie had if we look it had it was made up of three and four but it's a movie and it has in and out points so theoretically we could actually change the end points of that thing and move it in far enough that that it's sort of representative first frame is no longer three but four and so that sort of just proving that I sort of have no you know I'm not lying here another thing that you could do on this kind of stuff is you can use sort of non-trivial movies so let's actually get rid of my trivial movies and show you some non-trivial once now unfortunately when I grabbed these movies I grabbed them off the disc farm and we made them from there and so these movies have no sound but but they are real movies nonetheless and so this is some stuff from a little movie we're working on this year called The Incredibles and and so this was from the trailer and so this is pretty interesting because these are the real are we we're in a bad place right now let me just check this again sorry I'm going to quit I be for a second here and do this again because some things say they're being freed in the middle there you probably want to start again okay so if we drag out a little movie view here and we drag out a timeline and then we pull out a sequence provider and then we'll go and we'll edit that sequence provider in order to add those movies and again and so that you know what I'm hoping that that you're you're getting from this is the fact that you can you can use this kit to do real things you know these guys have done there's still I think I think there's still lots of there's lots of quick time left that's not really exposed in in the kit right now but I think there is an enormous amount of work that these folks have done so here's our little sequence here and what's fun with this is that you know you can even actually edit this thing you know while it's playing this is what i mean by it's magic I didn't do anything to get that you know domain like I'm just like editing the movies of movies there and these quick time folks are just making that all work and and I don't really know you know sort of what they're doing and I don't have to know that's the point of doing stuff with cocoa right leverage it's all about leverage and trying to get and trying to and to leverage what what these folks are doing so you can get back and do sort of the real work that you want to do is that the time for talk or do we need to leave time for questions for talk okay good it's that Professor okay I'll wrap this up here so that's its kind of dark up there that's too bad this is this is actually full film res pic slit playing back there and and we can also there's other things in the kit that I sort of haven't talked about but I can do things like we have this notion of markers that you can drop down and you can drop markers on things and and snaps into things or we can put a I could put like a marker here and then I can extend that thing out and and then I can do things like drawing on top of it there and then I can actually go and just play and like the drawing there is actually using a child window so there's actually this is again it's sort of the magic of cocoa right is I've got the child window stuff over here so i did that drawing in a separate window that's coming in cutie movie view that has no knowledge of that stuff at all the GPU is doing the compositing there so i didn't have to like you know draw some sketch track inside of quicktime and then hope the quicktime you know it was a fast path in quick time to sort of composite that stuff together you know I can sort of have that little drawing up there and this is the kind of stuff that we do all the time and have it not cost me anything from quicktime and what's so great about this from again from a coco person's perspective is the quick times finally sort of you know arrived in you know to my party where you know they were having a great party over there by themselves here but now like I get to use them and I get to make them plug and play with all the things you know interface builder and child windows stuff and and just being able to build a framework and to be able to sort of move things around really easily and that's just that's just enormous and sort of what you know these folks have actually accomplished you know sitting on the shoulders of the Giants of all the QuickTime efforts for the last ten years you know I just you know I'm the Klimt it's just really huge and so that's that's all I've got thanks you