Donatello – A Browser-Based Image Annotation Tool

Marq Jefferson '11 demonstrates Donatello.Instructional Innovation Intern (i3) Marq Jefferson and Ken Panko of ITG lead our first TwTT of the new year, discussing an image annotation tool that Marq created called Donatello.  Marq began the talk by telling us a little bit about the history of Donatello.  The program was developed in response to archeologist professor Harvey Weiss’s desire to show building plans, excavation field notes and images associated with the Leilan Akkadian palace excavations in Syria.   To create a tool that would do this without reinventing the wheel or requiring software like Flash, Marq built the browser-based tool using existing technology: a javascript library called Raphaël.  With Donatello, administrators can create shapes in an array of colors with varying opacities on top of the image to which they want to add more information using the square, circle, or polygonal tool.

The plan of Prof. Harvey Weiss' Tell Leilan dig visualized in Donatello.Donatello keeps all of the data on Yale servers, and is easily customizable to specific needs.  The instance created for Professor Weiss’s class shows a map of the dig, with annotations for different parts of the site, both in hoover text and displayed on the side bar with a double-click.  Professor Weiss wanted the tool to be a useful reference tool, one that allowed schematics of the site to look more realized by associating them with photographs.

The plan of Prof. Harvey Weiss' Tell Leilan dig visualized in Donatello.After explaining how Donatello had come about, Marq spoke about other instances of the protype, speaking to the evolution of the tool.  A current beta version of the project annotates a painting by Raphael, featuring hot-spots on the image which provide a deeper comprehension of what’s being seen.  Sidebar data is shown through double-clicks, and can be edited through html content – anything from a youtube video to plain text.  In addition to the data that can be shown in the mouse-over and the sidebar, Donatello allows an administrator of the page to link images to outside links (think: Wikipedia) or other images (such as different images of the same person being depicted).   Marq explained that webpages could also be constructed through the site, and linked in to the network of data that an instance of Donatello would contain.

Raphael's "The School of Athens" visualized in Donatello.Marq closed by explaining that one of his motivations for working on the project – beyond assisting Harvey Weiss – was to provide a tool that would help students in classes.  He felt that the most interesting and memorable classes in which he had participated were those with lots of media; a graphic view helped make information easier to ingest.

Audience members were curious to know more about access to the program. Marq explained that professors could request new instances as they’ve reached a stable version – though the program is “always sort of in development.”  [Ken noted that those interested in pursuing use of the program would need to keep in mind that they would be early adopters of the program and should go in with those expectations.]  With regards to privileges, as it stands, the program can be used from any web browser, but only the administrator can add content – although use of the site could alternatively be contained through Net ID restrictions.

Ken asked the audience if they had any suggestions, or noticed any functionalities that appeared to be missing.  Suggestions included enabling freehand drawing of shapes (or an imported polygonal tool set), adding audio capabilities to the site (a project Marq has already begun work on), providing multi-lingual character support (which lead to a brief demo of Marq’s other project, Rubicon), the capacity to thread together multiple background images and similarly, the capacity to annotate one image on multiple occasions.

Wrapping up the session, Ken wanted to draw attention to the fact that Donatello – and Marq! – are excellent examples of why the i3 program is such a success and awesome opportunity.  Anyone with project suggestions (or student suggestions) should get in touch with Robin Ladouceur who is currently in charge of the internship program.

For full coverage of this session, please click the video below (note a slight delay upon initial playback).

Library Digital Collections tool

Carolyn Caizzi, Technology Specialist for Yale’s Visual Resources Collection, Mike Friscia, Web Developer for the Yale University Library, and Aaron Hyman, graduate student in History of Art presented the new Library Digital Collections tool and how to incorporate it in teaching and learning scenarios.

Carolyn Caizzi chronicled the history of the Digital Collections tool. She indicated that it had undergone two major transformations in the past 2 years. From about 1998 until 2008 there was a unified interface to Yale’s digital collections, but it was only a front door to the separate interfaces of the collections themselves. Searching was really only practical for advanced users, who knew what they wanted, precisely and in some detail. There was no browsing capability. In 2008 there was a reformulation and redesign, creating Metagallery [for a CLC blog entry on Metagallery, click here]. Metagallery was the product of a collaboration by the Library and the Yale Center for Media and Instructional Innovation [CMI2]. The biggest feature addition was the ability for a user to create groups of images and share them with other users. Metagallery, however, only searched the Visual Resources Collection.

The latest tool, the Library Digital Collections tool searches 15 collections with over 600K items (not all of Yale’s current collections, but about half — there are plans to include more collections subsequently). This newest iteration provides for many different ways to search and browse, allowing searches by a broad range of users. The most significant advancement is the ease of creating, annotating, and sharing groups of images with others. The tool also allows a variety of browsing modalities that enable users to maximize relevant finds that they would be unlikely to uncover with standard searches. Site statistics reveal that the tool is being used for at least 20K searches per month. The biggest challenge for users is the lack of standardization of metadata across collections; searching may return skewed results depending on the field(s) used and the values entered. Mike Friscia, the tool developer, is working with the various collections to standardize metadata conventions used to pull in search items.

The major features of the site are convenient browsing (top down, bottom up, lateral); the visual presence of related items fields; tagging (which will become more useful as more students and faculty tag items); the ability to save an entire page of results or a subset of them; searching within a result set; the slideshow presentation mode for a saved group, useful for displaying a small group of images in class; the ease of downloading images singly or from a group, all with a metadata text file; sharing groups publicly or to a specified set of netids; allowing students or colleagues to edit groups (useful for class/section assignments and collaborative work); storing recently viewed items and searches for subsequent logins; and uploading non-Yale collection images to a user’s group.

Aaron Hyman of History of Art has been using the Library Digital Collections tool in his course for the past month. Though an admitted technophobe himself, the tool’s ease of use has made incorporating it into his course a no-brainer. He and his students have found that the tool enhances both in-class discussion and the execution of a wide range of assignments. It helps in History of Art courses to start with a selection of images relevant for a particular section meeting and build the session around the selection. The Digital Collections tool allows users to do exactly this. Aaron would regularly create and save off a group relevant for a particular section and share the link to the group with his students. Students can then be assigned a group of images to evaluate/investigate ahead of class, just like assigned reading. To enhance class discussion with concrete examples, the image group could then be presented during the class/section. Images found in Library Digital Collections searches and grouped together by the section leader are often better examples of the artwork under discussion than poor reproductions of textbook images. Aaron has found that for teaching, the group feature is very useful for preparing for section. The individual image view with metadata can be used like flash cards to help students prepare for an exam. Aaron proposed that graduate students in History of Art, or any other visual media-heavy discipline, could use the Digital Collections tool to prepare for their PhD orals as the group tool allows one to created collections of images relevant to certain overarching topics.

Mike Friscia then ended the session by sharing what’s in store for the Digital Collections tool in the future. Development projects currently include location-based browsing, a mobile version (expected summer 2011), collection-specific browsing methods (e.g. searching a periodical collection by year), and improved language awareness (e.g. in search results sorting and search suggestions).

iPads

There has been, and continues to be, much speculation about what role Apple’s iPad could play in education. Almost 6 months after the iPad’s release, ambivalence about the iPad’s place in higher education reigns. The device appears best suited to media consumption situations and not media/document creation scenarios. Despite hopes for the tablet to act as a collaborative learning tool, it does not work well as an in-class teaching tool due to the inability to project the screen from within most apps. Given the uncertainty surrounding the iPad as a teaching/learning tool, what plans does Yale currently have for incorporating it in the university’s Educational Technology toolbox?

Barbara Rockenbach kicked-off the session with a welcome and announcement of the new Fall 2010 TwTT series. [Please find the schedule here.] She then introduced the speakers – Scott Matheson, Web Manager for the Yale University Library, and Ken Panko, Manager of the Instructional Technology Group.

Scott Matheson revealed the Library’s plan to use the iPad as an interactive service kiosk as a part of their digital signage campaign. To render the device secure, the Library had a customized lockable case constructed. The case will be bolted to a podium so that library visitors may use it as an interactive touch screen to learn more about the collections. The kiosk has been designed to stand in the nave at Sterling Memorial Library. It will list staff, have an array of collections maps, and provide links to various catalogs. The iPad will connect to Library web pages via a wireless connection. A small charger may be stored in the case to power the iPad. Speakers may also be attached for audio, though at this time, such audio would be unwelcome in the nave of the Library. The iPad is currently using a template system that limits the options available to any user. The template can be altered by “pushing out” a new one to the folder structure for the iPad files. Scott also mentioned that an iPad is currently in use as a video display tool in the corridor in Sterling as part of an East Asian exhibit.

Ken Panko opened his segment of the session by lamenting the fact that not everyone had an iPad to experiment with during the presentation. He then posed a question to the crowd: “Why do we think we are here today? What is it about iPads that garners such curiosity?” Someone in the crowd commented that the iPad represents a fundamental change – in terms of mobility and media consumption. It’s small with a long battery life and thus, eminently portable. It easily and attractively packages a wide variety of media – newspapers, music, images, and movies. Ken reiterated that the iPad is the first truly mobile computer. Of course, any tablet fits this bill, but right now the iPad has the largest market share. It truly is superb for media consumption, but it currently is not a good device for an instructor to take into a classroom. It’s too expensive. Apple should follow Kindle’s lead and push the price point for the iPad way down. There are many other reasons why the iPad is not ideally suited to higher education teaching and learning scenarios than just the price point. At present you can not use the VGA-out cable to mirror your display or project from it. You can only project from a few applications or from a few functions within those applications (ex.: slideshow mode in Photos or in Keynote).

It is great for e-editions of some textbooks. This is a very promising feature as it is far easier to carry one iPad than 3-4 large textbooks. The catch is there are currently very few iPad versions of textbooks available. This will of course change in time, but who knows how long it will take for that market to grow? The other downside is that in e-textbooks, you cannot write in the margins. You can annotate and highlight, but is that function sufficient? There is currently no system available for selling back e-texts as there is for actual textbooks. That, coupled with the higher than one would expect pricepoint for e-textbooks makes them a less economical option. Scroll Motion, an iPad app developer, created the Iceberg Reader that allows one access to e-textbooks with a high resolution graphics-rich experience.

The course management apps developed for learners are more promising for higher education. Blackboard’s CMS app for the iPad is impressive. Itallows you to manage your courses from within your iPad. iStudiez Pro similarly allows students to organize and manage their academic life on their iPads. There are several note-taking apps available as well, but unfortunately, the electrostatic keyboard on the iPad is rather unfriendly. If you want to really explore taking notes with your iPad, you need to carry around an external bluetooth keyboard.

Other apps of interest:

Elements

Papers

Shakespeare Pro

ideaboards

Remote desktop apps:

Logb

SpaceTime

TwTT Student Created Video

February 9, 2010

Student Created Video

11:00 – 12:00

Bass Library L01 (lower level of the library)


As digital media becomes easier to create and disseminate, faculty have come to embrace the technology in course learning initiatives and objectives. One such example is the video project Professor Andre Taylor from Chemical Engineering assigned his CENG 210 students in the fall of 2009. The students of CENG 210 were charged with the task of creating short promotional videos for various target audiences of prospective engineering students at Yale. While the project served to deepen the students’ understanding of Chemical Engineering’s connections to other disciplines and fields, it also modeled the type of teamwork students would encounter as a regular component of a career in Chemical Engineering. Members from the Instructional Technology Group (ITG) and the Visual Resources Collection (VRC) worked closely with Professor Taylor and his students in offering course design, student consultations, video camera and video editing workshops, and grading rubrics.

Please join Professor Andre Taylor, Matthew Regan and Yianni Yessios from ITG, and Carolyn Caizzi from the VRC in a discussion of the project from conception to crux to conclusion.

Teaching w/ Technology Tuesdays – VoiceThread

Robin Ladouceur, Foreign Language Resource Specialist, from the Center for Language Study gave a demo of VoiceThread. VoiceThread is an online media album that can hold any type of media (images, documents and videos) allowing people to make comments in 5 different ways – using voice (with a microphone or telephone), text, audio file, or video (with a webcam) – and share them with anyone they wish. A VoiceThread allows group conversations to be collected and shared in one place, from anywhere in the world.

Voicethread is a free, online program that, like flickr, you can pay a small fee ($29.99/yr) to upgrade your account for more flexibility. You can use VoiceThread to browse already existing VoiceThreads or to easily create your own. You can start with images or video imported from anywhere (flickr, Facebook, Powerpoint, Excel, Word, PDF) and then add either a textual or audio comment.
Robin showed the following to explain, http://voicethread.com/#home.b409.i3113.

Robin showed created a VoiceThread during the session:

Continue reading