vanderwal.net

That Synching Feeling in Amsterdam

No I am not in hiding, I am popping up on some favorite lists and comment sections of sites. I am spending my free time working on a presentation for Design Engaged entitled "That Syncing Feeling". The focus of the 15 minutes presentation (yes, this is hell for me) is the future of keeping your information with you, particularly when you need it. Yes, this is an essential part of the Personal InfoCloud, which still requires a manual process today. I will hopefully show how close we are and what metadata will be needed to help us accomplish this feat.

If you are not one of the 25 folks in Amsterdam for this session I will post the presentation, perhaps even an annotated version if you are good like you always are.

Personal Information Aggregation Nodes

Agnostic aggregators are the focal point of information aggregation. The tools that are growing increasingly popular for the information aggregation from internet sources are those that permit the incorportation of info from any valid source. The person in control of the aggregator is the one who chooses what she wants to draw in to their aggregator.

People desiring info agregation seemingly want to have control over all sources of info. She wants one place, a central resource node, to follow and to use as a starting point.

The syndication/pull model not only adds value to the central node for the user, but to those points that provide information. This personal node is similar (but conversely) to network nodes in that the node is gaining value as the individual users make use of the node. The central info aggregation node gains value for the individual the more information is centralized there. (The network nodes gain value the more people use them, e.g. the more people that use del.icio.us the more valuable the resource is for finding information.) This personal aggregation become a usable component of the person's Personal InfoCloud.

What drives the usefulness? Portability of information is the driver behind usefulness and value. The originating information source enables value by making the information usable and reusable by syndicating the info. Portabiliry is also important for the aggregators so that information can move easily between devices and formats.

Looking a del.icio.us we see an aggrgator that leverages a social network of people as aggregators and filters. Del.icio.us allows the user to build their own bookmarks that also provides a RSS feed for those bookmarks (actually most everything in del.icio.us provides feeds for most everything) and an API to access the feeds and use then as the user wishes. This even applies to using the feed in another aggregator.

The world of syndication leads to redundant information. This where developments like attention.xml will be extremely important. Attention.xml will parse out redundant info so that you only have one resource. This work could also help provide an Amazon like recommendation system for feeds and information.

The personal aggregation node also provides the user the means to categorize information as they wish and as makes most sense to themselves. Information is often not found and lost because it is not categorized in a way that is meaningful to the person seeking the information (either for the first time or to access the information again). A tool like del.icio.us, as well as Flickr, allows the individual person to add tags (metadata) that allows them to find the information again, hopefully easily. The tool also allows the multiple tagging of information. Information (be it text, photo, audio file, etc.) does not always permit itself easy narrow classification. Pushing a person to use distinct classifications can be problematic. On this site I built my category tool to provide broad structure rather than heirarchial, because it allows for more flexibility and can provide hooks to get back to information that is tangential or a minor topic in a larger piece. For me this works well and it seems the folksonomy systems in del.icio.us and Flickr are finding similar acceptance.

Feed On This

The "My" portal hype died for all but a few central "MyX" portals, like my.yahoo. Two to three years ago "My" was hot and everybody and their brother spent a ton of money building a personal portal to their site. Many newspapers had their own news portals, such as the my.washingtonpost.com and others. Building this personalization was expensive and there were very few takers. Companies fell down this same rabbit hole offering a personalized view to their sites and so some degree this made sense and to a for a few companies this works well for their paying customers. Many large organizations have moved in this direction with their corporate intranets, which does work rather well.

Where Do Personalization Portals Work Well

The places where personalization works points where information aggregation makes sense. The my.yahoo's work because it is the one place for a person to do their one-stop information aggregation. People that use personalized portals often have one for work and one for Personal life. People using personalized portals are used because they provide one place to look for information they need.

The corporate Intranet one place having one centralized portal works well. These interfaces to a centralized resource that has information each of the people wants according to their needs and desires can be found to be very helpful. Having more than one portal often leads to quick failure as their is no centralized point that is easy to work from to get to what is desired. The user uses these tools as part of their Personal InfoCloud, which has information aggregated as they need it and it is categorized and labeled in a manner that is easiest for them to understand (some organizations use portals as a means of enculturation the users to the common vocabulary that is desired for use in the organization - this top-down approach can work over time, but also leads to users not finding what they need). People in organizations often want information about the organization's changes, employee information, calendars, discussion areas, etc. to be easily found.

Think of personalized portals as very large umbrellas. If you can think of logical umbrellas above your organization then you probably are in the wrong place to build a personalized portal and your time and effort will be far better spent providing information in a format that can be easily used in a portal or information aggregator. Sites like the Washington Post's personalized portal did not last because of the cost's to keep the software running and the relatively small group of users that wanted or used that service. Was the Post wrong to move in this direction? No, not at the time, but now that there is an abundance of lesson's learned in this area it would be extremely foolish to move in this direction.

You ask about Amazon? Amazon does an incredible job at providing personalization, but like your local stores that is part of their customer service. In San Francisco I used to frequent a video store near my house on Arguello. I loved that neighborhood video store because the owner knew me and my preferences and off the top of his head he remembered what I had rented and what would be a great suggestion for me. The store was still set up for me to use just like it was for those that were not regulars, but he provided a wonderful service for me, which kept me from going to the large chains that recorded everything about me, but offered no service that helped me enjoy their offerings. Amazon does a similar thing and it does it behind the scenes as part of what it does.

How does Amazon differ from a personalized portal? Aggregation of the information. A personalized portal aggregates what you want and that is its main purpose. Amazon allows its information to be aggregated using its API. Amazon's goal is to help you buy from them. A personalized portal has as its goal to provide one-stop information access. Yes, my.yahoo does have advertising, but its goal is to aggregate information in an interface helps the users find out the information they want easily.

Should government agencies provide personalized portals? It makes the most sense to provide this at the government-wide level. Similar to First.gov a portal that allows tracking of government info would be very helpful. Why not the agency level? Cost and effort! If you believe in government running efficiently it makes sense to centralize a service such as a personalized portal. The U.S. Federal Government has very strong restriction on privacy, which greatly limits the login for a personalized service. The U.S. Government's e-gov initiatives could be other places to provide these services as their is information aggregation at these points also. The downside is having many login names and password to remember to get to the various aggregation points, which is one of the large downfalls of the MyX players of the past few years.

What Should We Provide

The best solution for many is to provide information that can be aggregated. The centralized personalized portals have been moving toward allowing the inclusion of any syndicated information feed. Yahoo has been moving in this direction for some time and in its new beta version of my.yahoo that was released in the past week it allows the users to select the feeds they would like in their portal, even from non-Yahoo resources. In the new my.yahoo any information that has a feed can be pulled into that information aggregator. Many of us have been doing this for some time with RSS Feeds and it has greatly changed the way we consume information, but making information consumption fore efficient.

There are at least three layers in this syndication model. The first is the information syndication layer, where information (or its abstraction and related metadata) are put into a feed. These feeds can then be aggregated with other feeds (similar to what del.icio.us provides (del.icio.us also provides a social software and sharing tool that can be helpful to share out personal tagged information and aggregations based on this bottom-up categorization (folksonomy). The next layer is the information aggregator or personalized portals, which is where people consume the information and choose whether they want to follow the links in the syndication to get more information.

There is little need to provide another personalized portal, but there is great need for information syndication. Just as people have learned with internet search, the information has to be structured properly. The model of information consumption relies on the information being found. Today information is often found through search and information aggregators and these trends seem to be the foundation of information use of tomorrow.

43folders for Refining Your Personal InfoCloud

I have been completely enjoying Merlin Mann's 43folders the past couple weeks. It has been one of my guilty pleasures and great finds. Merlin provides insights to geeks (some bits are Mac oriented) on how to better organize the digital information around them (or you - if the shoe fits). This is a great tutorial on refining your Personal InfoCloud, if I ever saw one.

Everytime I read this I do keep thinking about how Ben Hammersley has hit it on the head with the Two Emerging Classes. The volume of information available, along with the junk, and the skills needed to best find and manage the information are not for the technically meek.

vanderwal.net RSS Feeds now Optimized and aggregated by FeedBurner

We are now providing a consolidated feed of the main blog RSS feed, our vanderwal del.icio.us feed, and vanderwal Flickr feed in one vanderwal.net Feedburner feed. You ask about the feed of our Quick Links? Currently, it is not included in the Feedburner feed, but we have optimized that active feed with Feedburner also at, vanderwal.net Quick Link FeedBurner feed.

If you like the feeds the way you have been getting them you can still do so. Lately the Quick Link and del.icio.us feeds are being updated more frequently as they take much less time to post to. These are just snippets of things I am interested in coming back to or have found of interest and have not found the time for a full blog entry.

We are considering replacing the Quick Links with our del.icio.us feed at some point in the not too distant future. Tell us what you think.

Emerging Class Divide with Technology

Ben Hammersly does a wonderful job of highlighting the current state of The Emerging Two Cultures of the Internet and extends it in More on the Emerging Two Cultures. The two cultures are the geeks and real people. There are many tools and means to access digital information on the internet, but these are mostly available to the geeks that are early adopters or in some cases the adopters. Ease of use has not hit many of our friends and relatives.

Ben looks at the web as an place that again takes increasing knowledge and understanding of the arcane to get through the mire of spam, nefarious pop-ups, and viruses. There are some of us that understand how to go about doing this dance (or bought a Mac to make the whole thing easier) and do not find it difficult, but many would like to have the hours back to work on things more fun. The average person does not have the capabilities or time to stay on top of all these things. Ben's description of the Windows XP SP2 pitfall is right in line with the diverging communities. There is not a need for these, if things were done better in the first place.

Easing the Digital Realm

We have a system of tools that make information creation easy in digital formats. These tools may not be our best friend as of yet as many tools may be seemingly easy to use, but the tools are lacking when trying to easily develop information in an optimal format to ease the use of the information by the person consuming or interacting with that information. As people accessing information we find a lot of information, we may not always find the information we desire or need.

But, once we get the information and try to consume that information by copying parts into our reference notes for our work we run into difficulties. We also have problems storing the information so we can have it at the ready when we need it. It is very difficult, not impossible, to have information follow us in our Personal InfoCloud, which is our repository of information we want following us for our easy use and reuse.

Unfortunately those of us that can wrangle and have the time to wrangle with the tools to get them to easily, efficiently, and accurately perform in a manner that makes our lives easier are relatively few. There should not be two classes of people, things need to get better. The focus needs to get on the people using information and trying to reuse it.

Personal InfoCloud Rescues the Day

I had a wonderful experience where my own Personal InfoCloud worked successfully (I have had many problems having the right informaiton I need at my fingertips). I had been having general conversations about a lunchtime presentation or roundtable as part of a string of Adaptive Path training, but I was not exactly clear on the concept or the format of the discussion. I knew it was to be informal, but could also use slides if wanted. I thought I would just use some handouts of the content of the Accessibility is Little More Than Web Best Practices presentation (10 copies surely would be enough for a roundtable. When I go the the training session I looked around and could not figure who other folks doing roundtables would be so I asked the manager who else was doing the lunchtime stuff and the format. I was the only one and the format was wide open.

That morning I had converted the presentation from Keynote to PDF and e-mailed it to my mobile phone address and my gmail account. I was standing next to Bryan and mentioned I had my presentation in PDF on me, which got an inquisical look until I said it was on my phone (Treo) and I could e-mail it to a laptop and present from that. So I sent the presentation to Jeff's laptop, which had WiFi (they all had WiFi actually). In a couple minutes a PDF version of the presenation was available to click through and present from.

Not only did I have the times and addresses in my phone, but I had my presenation as a back-up. The PDF was fine for these slides as they are designed as handout to use as lists. Were it not this way I would have been kicking myself for not also having the Keynote version.

As a sidenote the number of Treo users was impressive. I know of eight Treos that I saw at the sessions. I also saw many Macs laptops of attendees taking notes and only saw one or two PCs. This would be in a population of 40 or so folks.

Gmail Simplifies Email

Since I have been playing with Gmail I have been greatly enjoying the greatly improved means of labeling and archiving of e-mail as opposed to throwing them in folders. Many e-mails are hard to singularly classify with one label that folders force us to use. The ability to drive the sorting of e-mail by label that allows the e-mail to sit accessibly under a filter named with the label make things much easier. An e-mail discussing CSS, XHTML, and IA for two different projects now can be easily accessed under a filter for each of these five attributes.

Dan Brown has written a wonderful article The Information Architecture of Email that dig a little deeper. Dan ponders if users will adopt the changed interface. Hearing many user frustrations with e-mail buried in their Outlook or other e-mail application, I think the improved interface may draw quite a bit of interest. As Apple is going this way for its file structure in Tiger (the next OS upgrade) with Spotlight it seems Gmail is a peak at the future and a good means to start thinking about easier to find information that the use can actually manage.

Tantek Mulls Contact Info Updating

Tantek mulls a means to keep contact info upto date. This should be much easier than Tantek has made out. This could be as easy as publishing one's own vcard that is pointed to with RSS. When the vcard changes the RSS feed notifies the contact info repositories and they grab the vcard and update the repository's content. This is essentially pulling content information into the user's Personal InfoCloud. (Contact info updating and applications are a favorite subject of mine to mull over.)

Why vcard? It is a standard sharing structure that all contact information applications (repositories understand). Most of us have more than one contact repository: Outlook at work; Lotus Organizer on the workstation at home; Apple Address Book and Entourage on the laptop; Palm on the Cellphone PDA; and Addresses in iPod. All of these applications should synch and perfectly update each other (deleting and updating when needed), but they do not. Keeping vcard field names and order constant should permit the info to have corrective properties. The vCard RDF W3C specifications seem to layout existing standards that should be adopted for a centralized endeavor.

What not Plaxo? Plaxo is limited to applications I do not run everywhere (for their download version) and its Web version is impractical as when I need contact information I am most often not in front of a terminal, I am using a Treo or pulling the information out of my iPod.

While Tantek's solution is good and somewhat usable it is not universal as a vCard RDF would be with an application that pinged the XML file to check for an update daily or every few days.

Future of Local Search on Mac

One of the best things I found to come out of the Apple WWDC keynote preview of the next update of the OS X line, Tiger, Spotlight. Spotlight is the OS file search application. Not only does Spotlight search the file name, file contents (in applications where applicable), but in the metadata. This really is going to be wonderful for me. I, as a user, can set a project name in the metadata and then I can group files from that point. I can also set a term, like "synch" and use AppleScript and Search to batch the files together for synching with mobile devices, easily. Another nice feature is the searches can be saved and stored as a dynamic folder. This provides better control of my Personal InfoCloud.

Steven Johnson provides the history of search in Apple, which has nearly the same technology in Cosmo slated for release in 1996.

Model of Attraction and Personal InfoCloud Presentation

This evening I presented Understanding the Personal Info Cloud: Using the Model of Attraction to Vera Rhoads User Interaction with Information Systems class (INFM 702) in the University of Maryland, Master of Information Management program.

This was a great opportunity to present the Model of Attraction and the Personal InfoCloud information in one sitting. I have realized there is a lot of information in combining the two, but also some areas I could trim. I think the presentation could use a couple clear examples. It was also good to be back in a classroom, although slightly different from the presenting side.

Now I can focus on finishing the drafts of the articles on these subjects.

Stitching our Lives Together

Not long ago Jeffrey Veen posted about Will you be my friend, which brought up some needs to better stitch together our own disperse information. An excellent example is:

For example, when I plan a trip, I try to find out who else will be around so I have people to hang out with. So my calendar should ask Upcoming.org, "Hey, Jeff says he's friends with Tim. Will he be in New York for GEL?"

This example would allow up to interact with our shared information in a manner that keeps it within our extended Personal InfoCloud (the Personal InfoCloud is the information we keep with us, is self-organized, and we have easy access to). Too many of the Web's resources where we store our information and that information's correlation to ourselves (Upcoming.org, LinkedIn, etc.) do not allow interactivity between online services. Some, like Upcoming and Hilton Hotels do provide standard calendaring downloads of the events and reservations you would like to track.

Some of this could be done with Web Services, were their standards for the interaction. Others require a common API, like a weblogging interface such as Flickr seems to use. The advent of wide usage of RSS feeds and RSS aggregators is really putting the user back in control of the information they would like to track. Too many sites have moved toward the portal model and failed (there are large volumes of accounts of failed portal attempts, where the sites should provide a feed of their information as it is a limited quantity). When users get asked about their lack of interest in a company's new portal they nearly always state, "I already have a portal where I aggregate my information". Most often these portals are ones like My Yahoo, MSN, or AOL. Many users state they have tried keeping more than one portal, but find they loose information very quickly and they can not remember, which portal holds what information.

It seems the companies that sell portal tools should rather focus on integration with existing portals. Currently Yahoo offers the an RSS feed aggregator. Yahoo is moving toward a one stop shopping for information for individuals. Yahoo also synchs with PDA, which is how many people keep their needed information close to themselves.

There are also those of us that prefer to be our own aggregators to information. We choose to structure our large volumes of information and the means to access that information. The down side of the person controlling the information is the lack of common APIs and accessible Web Services to permit the connecting of Upcoming to our calendar (it can already do this), with lists of known or stated friends and their interests.

This has been the dream of many of us for many years, but it always seems just around the corner. Now seems to be a good time to just make it happen. Now is good because there is growing adoption of standards and information that can be personally aggregated. Now is good because there are more and more services allowing us to categorize various bits of information about our lives. Now is good because we have the technology. Now is good because we are smart enough to make it happen.

Tools to Manage Information On Your Personal Hard Drive

I have posted my thoughts on Tools to Manage Information On Your Personal Hard Drive for Mac OS X in particular. I have posted this on my Personal Info Cloud site. This is the first piece of content that I am not posting in both places. This may become a trend as I am spending a fair amount of time thinking through ideas related to the Personal Info Cloud in one place. The Personal Info Cloud has an RSS feed and I will be posting notices that new info has been added there as it happens.

Project Oxygen Still Alive

Project Oxygen has progressed quite well since we last looked in (Oxygen and Portolano - November 2001). Project Oxygen is a pervasive computing system that is enabled through handhelds. The system has the users information and media follow them on their network and uses hardware (video, speakers, computers, etc.) nearest the user to perform the needed or desired tasks. Project Oxygen also assists communication by setting the language of the voicemail to match the caller's known language. The site includes videos and many details.

Project Oxygen seems to rely on the local network's infrastructure rather than the person's own device. This creates a mix of Personal Info Cloud by using the personal device, but relies on the Local Info Cloud using the local network to extract information. The network also assists to find hardware and external media, but the user does not seem to have control over the information they have found. The user's own organization of the information is important for them so it is associated and categorized in a manner that is easy for them to recall and then reuse. When the user drifts away from the local network is their access to the information lost?

This project does seem to get an incredible amount of pervasive computing right. It would be great to work in an environment that was Project Oxygen enabled.

Keeping the Found Things Found

This weeks New York Times Circuits article: Now Where Was I? New Ways to Revisit Web Sites, which covers the Keep the Found Things Found research project at University of Washington. The program is summarized:

The classic problem of information retrieval, simply put, is to help people find the relatively small number of things they are looking for (books, articles, web pages, CDs, etc.) from a very large set of possibilities. This classic problem has been studied in many variations and has been addressed through a rich diversity of information retrieval tools and techniques.

This topic is at the heart of the Personal Information Cloud. How does a person keep the information they found attracted to themselves once they found that information. Keeping the found information at hand to use when the case to use the information arises is a regular struggle. The Personal Information Cloud is the rough cloud of information that follows the user. Users have spent much time and effort to draw information they desire close to themselves (Model of Attraction). Once they have the information, is the information in a format that is easy for the user or consumer of the information to use or even reuse.