webservices

June 09, 2007

Status Contests and Attention Aggregators

plazes statusI find myself updating my status, or answering the question "what are you doing?" across Twitter, Jaiku, Plazes and Facebook.  This is made easier through clients like Twitterific, Juhu, Plazer and some Facebook hacks that are less attractive.  I'm using these clients for more than updating status easily, however.  They are a new kind of attention aggregator -- bringing the status or lifestreams of my social networks to me in real time.

They are pretty cool tools, if you haven't tried them.  For Twitter, having a client fits my laptop-oriented daily use, so I can mostly turn the mobile client off (text "off" to 40404, and "on" when you are roaming around) and subscribe to a larger social network.  For Jaiku, having a client brings continuous partial presence to my laptop, that is far richer because people are lifestreaming (adding feeds from other tools like blogs to enrich their presence).  For Plazes, the Plazer has always let me share my location, but now it is richer with status sharing and a reverse-chronological view of your network.  Facebook will surely have a better client soon as part of their quest to be the social operating system, and hopefully incorporate your Mini-feed.

jaiku statusBut all this client development seems like one-offs, status service providers have stayed out of development perhaps wisely, and there is ample room for innovation.  As is usually the case, we've been here before -- a lack of standardization and cooperation yields less and leaves room for a large service provider to monopolize.

twitterific statusI don't think we want to wait for Google, Yahoo or Microsoft to provide a status and lifestream integrated user experience that flows through clients, let alone browsers or operating systems.  I do think this will happen as status services fill a valuable niche in our demand for social interaction, let alone being a new command line for web services.

Compare where we are to how RSS and Atom provided common standards for developers to innovate.  There was a time where almost every graduate CS student would write a news aggregator for fun and new startups proliferated.  Adriaan Tijsseling leveraged Atom from the earliest versions to create client blog editor, Ecto, and went beyond the Flickr Uploader to also offer aggregation with 1001.  Some, like Newsgator, plunged deep into clients across operating systems, email clients and mobile clients to let you work across them.  But the result isn't the case where one vendor, could own publishing, syndication and reading including clients.  We have a healthy marketecture that continues to innovate.

There is a new kind of aggregator, for more real time attention, that needs to be build to work across status services.  I'm not sure if it will be built into existing news aggregators, if existing status clients will evolve into them, or it will be something new.  I just know it is coming.  It will leverage status service providers and Lifestreaming you find in services like Dandelife and Jaiku.  You will be able to edit your status and perhaps more, like location to Plazes or a blog entry.  Maybe it will be built on Apollo or Google Gears, maybe a Firefox extension or a mobile version on WidSets.  But it won't happen too soon.

The problem is, while the REST APIs are easy to work with, they aren't standardizing.  Maybe they will converge on using the Atom Publishing Protocol.  Maybe they can work out a way to let you write your status once, publish everywhere, and remove dupes when aggregating.

May 07, 2007

Enterprise Mashup Summit

ibm mashup summitI'm at the IBM Mashup Summit in San Francisco today.  As we are within the bowels of a large enterprise, there is a process to follow to get wifi access, so I'm offline.  We're here to talk about mashups within the enterprise.  With all the innovation on the web with mashups and widgets, real work needs to be done on standards, identity, process and security to bring them into the enterprise.  We aren't just talking about technical work to make things work, but how to market it before insecurity FUD curbs innovation.

Dion Hinchliffe phoned in an introductory talk about what he is seeing in the space (I'll try to find notes to link to, and update this post later).

Then Pete Kaminski (Socialtext CTO & co-founder) and I gave a little talk about the things we have seen, done and questions we have.  Unfortunately, Open Data is being seen as enough in this space.  Be like Flickr, just put up an API, let people innovate, and that's good enough.  But it isn't good enough for enterprises, which is an opportunity for us to work on standards that may conversely enhance the consumer web.  For an enterprise, to develop upon a service, they need to know if their effort is at risk, as the API may change.  Especially when services are built upon services upon services.  Enterprises also pay particular mind to switching cost and lock-in risk, and standards and open source provide ways of reducing cost and managing risk.

Mostly we talked about Amo, which means "to carry" in Hawaiian and is a REST API for wikis we hope becomes an ad-hoc standard.  It incorporates the Atom Publishing Protocol thanks to some good work Chris Dent did over a weekend.  Unfortunately, the folks really working on this stuff are up at our hackathon in Vancouver this week.  But it gave us a chance to share what we have heard and not from enterprises over the last four years.  Customers have stronger needs to integrate with directory systems for single sign on, and despite our efforts to make auth pluggable, the lack of standardization in this area is a problem not just for deploying a wiki -- but signals the complexity and perhaps greatest risk in enterprise mashups, that of identity.  When a mashup platform has multiple services and multiple logins, where and how are they stored is an exponential problem that puts security and system cost in conflict with usability.  We didn't get customers coming to us asking for mashups in numbers, but we did get people asking for data to be available and offline editing.  We created RSS and Atom feeds for every page, tag, search query, watchlist, weblog and wiki.  In absence of other clients, we used the Atom API for offline editing using Ecto, a blog editor.  Most recently, we created SocialPoint for Sharepoint portal integration using our SOAP API.  With the REST API, we worked with Jeremy Ruston to create Socialtext Unplugged for offline wiki reading and editing.

Pete made an interesting point about the currency and quality of data that reminded me of a post by Allen Morgan I read yesterday.  Pete pointed out how the rise of the convenient cell phone has changed user expectations for call quality within land-lines themselves. Allen is exploring similar trends in audio and video: fidelity declines with the rise of convenience.  Pete gave the example of how a user of Socialtext Unplugged can board an airplane to Hong Kong with a reasonable expectation they will be working with less current information the further they travel.  What user expectations and education will they have when using mashups across different data from multiple processes.  This is an important question because it also informs how expensive it should be to build and operate these systems.  Rod Smith suggested there should be a "freshness dial."

I emphasized that there are some areas you don't want to automate, such as merging revision conflicts, because people are better than algorithms for many things, and suggested other service providers borrow from some elements of wiki design like revision history.

I shared our experience with open source application licensing.  From the conversation, I think people understood the need for a different license for open source web applications compared to infrastructure.  But it also was clear to me that I've not communicated our current status, as someone in the know asked if we were "Open Source."  Nobody owns the term and can modify it in their own way, but there is a significant role for OSI to accredit project as OSI Certified.  Socialtext is almost six months into the process of getting it's license OSI Certified, we don't claim we are yet, but we do say rightly we are a commercial open source provider.  We are about to submit a third revision of our license, so I write more later, but if the process concludes in the negative, we will choose a different OSI license.  Not because it will suit our needs, in fact it will decidedly not, but because of the role we want to play in the community.  We'll see what the other 15 MPL+Attribution projects do.  But attribution is an important issue for mashups, and people here seemed to be in favor of it.

Stephan from Kapow technologies sees the stack as Mashup builders like QEDwiki, Teqlo and Excel and Mashup enablers like Kapow and RSSBus..  Because we don't have UDDIs and WSDLs of the web services world, we need service discovery through a central service repository and builder specific repository. How do I find the data I need and get it into the format I need? Within the enterprise, users want to be able to get to data without involving IT.  An example of this is IBMs Mashup Hub, and while more service descriptors are needed, people just want to grab two values off of different sites (using Kapow's web-scraping) and put them together in Excel or SocialCalc. Need to communicate through WS* (he assumes SOAP is what legacy speaks.  Someone pointed out that at Mysql conference nobody knew about SOAP, and he countered that people in Europe don't know REST), REST, RSS/Atom feeds, Atom Publishing Protocol, APIs.  And access the data through HTTP and HTTPs.  Suggested solution: Define microformats to describe each type of service.  Define a simple way to inform Builders of the existence of services and define a simple way for Enablers to request service information from central repositories.

At a certain point the notion of having a market of services that people could purchase on a granular billable basis came up.  I suggested to start from the opposite side, encouraging the commons.  Or more specifically this group could go to Creative Commons and try to host a directory of CC licensed APIs.  We also discussed availability, and I pointed out that in other industries we would start with conversations about standardizing SLAs.

Paul Raymond who is in the commercial division of AccuWeather, which provides weather info to 106 million Americans each day.  Their primary asset is their brand, they copyright much of their material and want to syndicate under control.  Web scraping creates new business models for them, even if it is just linking back.  They co-brand over 20k affiliate sites, provide a number of mapping web services and work with other mapping services, have a number of widgets and more.   Other business models: subscription and fixed pricing that is secure and authenticated -- or CPM-based control content, campaign, source and cost.  Their basic approach is let people hack upon it, but largely encourage marketing attribution in return.

I had to leave before the afternoon sessions by SnapLogic, Jeff Nolan, Reuters and Mashery.  We still haven't really talked about security, or the marketing thereof, which is the elephant in the room. It will be interesting to see if a common roadmap emerges.

A guy from the EPA was asked about politicizing of data.  He shared how there is a law where you can dispute the bias or accuracy of data and gain resolution.  He told the story of how a US Satellite over the north pole started picking up anomalies in ozone levels and scientists believed it was impossible so they normalized the data syndicated.  It wasn't until British scientists used balloons to find unreported change that they opened up the logs and corrected the feed. 

Data is political and when you have so much change it is the politics, as much as the technology, that needs to be worked out by the community.

UPDATE: More coverage from Jeff Nolan, SnapLogic, and otherwise I'm disappointed more participants aren't blogging this.

April 08, 2007

Jaiku Tips the Tuna?

Did Jaiku tip the tuna yesterday?  Leo Laporte  jumped ship from Twitter to Jaiku, his 4,000 followers followed.  The Twitter herd debated platforms, has herds do when chosing to migrate.  Suddenly the story was Twitter vs. Jaiku and Jaiku team dealt with digesting a big chocolate Easter Bunny.

Let me provide some context first.  I was exposed to Jaiku at Aula in Helsinki last June.  From my notes:

Jyri Engeström and Mika Raento on social peripheral vision.  Phones are designed with the assumption that you know who you want to call before you do.  You need to process social signals before using the device.  Jaiku, their startup is looking to augment basic functions of a phone by pasting onto it what is happening on the internet.  If you can't find anyone in your contact book, you can search a directory made of everyone's contacts. Calendars let you share future events to let you plan together.  The demo shows very rich profiles based on phone usage (automatic data) and more social signals (more manual) -- which provides a different form of Presence.  In usage, people still call regardless of presence, but when someone doesn't answer, you leverage the presence to understand why. Integrated IM is more convenient than SMS, and includes group messaging.

Since then, Twittr came on the scene and Jakiu's web interface got a major upgrade.  It's important to understand the significant differences between the two services, their design thinking and strengths.  Joi Ito:

Looks like a bunch of people are trying out Jaiku after "tasting" co-presence with Twitter. To me, Jaiku, which existed before Twitter, is a bunch of Helsinki mobile jocks getting into the Web 2.0 of it all whereas Twitter is the Web 2.0 crowd "getting" co-presence...

Jaiku comes from a "presence" background allowing bluetooth proximity, phone idle time, ringer mode and other things to trigger state changes - the messaging came later. Twitter, on the other hand, is primarily messaging, which as we all know, is just a flexible and manual vector for presence information.

To understand where Jaiku is coming from, I encourage you to read this interview with co-founder Jyri Engeström and his post on social peripheral vision (the ability to have your finger on the pulse of your friends, family, and colleagues).


  Twitter on paper 
  Originally uploaded by jack dorsey.

In digging around for some of the thinking behind Twitter, I found Jack Dorsey's napkin design for Twitter:

from a note circa Jan 2006.

casual awareness.
"what are you up to?"

multiple entry point to set status
- web
- email
- phone
- sms
- im

multiple ways to "subscribe" to status
- web
- email
- phone
- sms
- im

3 aspects
- set status
- timeline (collaborative)
- configuration

The interesting thing is that I found it on Jack's Jaiku page where he had included his Flickr stream as part of his presence.  For a long time I've wanted the Xfire for social software, and today Jaiku provides this kind of persistent presence.

Jaiku lets you incorporate feeds from your blog, bookmarks, photos, location -- and Twitter if that is where you prefer to post status.  Every post of any kind becomes an object for conversation, through comments.  This works easily in the web UI, but it also works in the Nokia mobile client because presence isn't overwhelming. Presence is something you can glance at, not an SMS interruption. 

Unfortunately today this requires a Nokia phone, but they are working on a Java version that also specifically supports commenting (kind of like Radar.net, more on that later).  People coming from Twitter won't expect the ability to add their attention breadcrumbs to their attention stream (developers will) and will probably expect something they can adopt on their mobile easily.  In the US, this is a significant barrier (Sidenote: fuck you Cingular.  Making me change calling plans to switch SIM cards from my Blackberry and claiming the handset wont work because you don't sell it even though it runs the same software is an easy way to lose me as a customer, as if I had alternatives.).  Jaiku isn't ready to Tip the Tuna until their next mobile client comes out. 

But until then I'd expect a lot of people to use the web version as an attention pool.  Posting to Jaiku via Twitter is a no-brainer and I'd hope you can do the opposite without loops and dupes soon.  Rafe asked the right question:           Is it possible Twitter and Jaiku will end up sharing users, instead of hoarding them like the IM services did early on? I responded: systems of record are being replaced by systems of discovery. 

In other words, in the first web I would worry about which service I would commit my social network, presence and persistence to.  But services are increasingly making data discoverable and discovering data from other services.  We used to worry about transporting our FOAF relationships, but then I think we realized that each tool is different and being able compose a different social network was a virtue (not just because of faceted identity, but that different tools need different filters and the social network is the filter).

UPDATE: This post was written in haste before going out for Easter.  Jaiku released their API and developer site.  I forgot to highlight Marko Ahtisaari's why I use Jaiku:

1. Silent sociality - checking up on what my friends are up to when convenient, and posting my own state knowing that I won't be disturbing others (unless they have explicitly asked to be alerted).

2. Small-group sociality - Jaiku is not about celebrity. I'm interested in sharing state with a small group I'm nearly always in contact with, what Mimi Ito has called full-time intimate community.

3. Mobile sociality - Jaiku was designed with the mobile "living phonebook" interface in mind. SMS alerts crowding the inbox of one of the few working personal and functional communication channels is not my idea of improving communication. I use the SMS-in posting to Jaiku when I'm using my Nokia 8800 and with my N70 I use the Jaiku phonebook.

4. Background sociality - Jaiku allows me to integrate other online identities and feeds (including delicious, flickr and any RSS) into my single jaiku presence feed. This is done in a way that doesn't confuse these background posts with my explicit state messages.

Rafe posts about adding your Twitter to Jaiku.  And I wanted to add one last thing.  If you aren't trying it with a mobile client, you can't get the real experience.

March 22, 2007

Being the Choice Leader

Nick Carr reports on two studies of Enterprise 2.0 adoption by large enterprises:

Some hard data is coming out this week on the adoption of Web 2.0 tools by companies. Yesterday, Forrester released some results from a December 2006 survey of 119 CIOs at mid-size and larger companies. It indicated that Web 2.0 is being broadly and rapidly brought into enterprises. Fully 89% of the CIOs said they had adopted at least one of six prominent Web 2.0 tools - blogs, wikis, podcasts, RSS, social networking, and content tagging - and a remarkable 35% said they were already using all six of the tools. Although Forrester didn't break out adoption rates by tool, it did say that CIOs saw relatively high business value in RSS, wikis, and tagging and relatively low value in social networking and blogging.

McKinsey did a broader survey of 8,300 executives with similar demand and adoption patterns:

It found that social networking was actually the most popular tool, with 19% of companies having invested in it, followed by podcasts (17%), blogs (16%), RSS (14%), wikis (13%), and mashups (4%). When you add in companies planning to invest in the tools, the percentages are as follows: social networking (37%), RSS (35%), podcasts (35%), wikis (33%), blogs (32%), and mashups (21%).

But the highlight of the Forrester study for Nick and Richard MacManus is CIO attitudes towards incumbent vendors vs. startups.

74% of CIOs said they'd be more interested in investing in Web 2.0 if all the tools were offered as a suite, and 71% said they'd prefer the tools to be "offered by a major incumbent vendor like Microsoft or IBM [rather than] smaller specialist firms like Socialtext, NewsGator, MindTouch, and others."

Nick concludes: "You can bypass the CIO on a small scale, but it's difficult to bypass the CIO when it comes time for a company to standardize on a particular product and vendor."  Yup. It has always been the case for enterprise software.

CIOs of large enterprises will largely give preference to the incumbent vendors they have relationships with to realize economies and standardize architecture.  Especially when almost all of their budgets are sunk with maintainence fees of said incumbents.  Part of expressing preference for suites is that suites are now available, beginning with SuiteTwo (Socialtext, Six Apart & Newsgator best of breed core offerings).  I find the results of the survey very encouraging -- that SuiteTwo is a comparable preference to Microsoft or IBM.

Some CIOs will go what what (or whom) they know and stick to existing vendor relationships.  That's why we created SocialPoint for the best-of-breed wiki to work with Sharepoint.  As Lawrence Liu from Microsoft said: "More and more SharePoint customers who want advanced wiki functionality are looking to the specialized wiki ISVs like SocialText to provide it with an integrated user experience in SharePoint by way of 3rd party webparts."

As I've said before, when competing in a market of abundant choices, you have to be the choice leader.  Choice is good.  In some cases, you create choice through channels and partnerships.  But you also have to do so through your core offerings.  Today we have more deployment options than any established or upstart vendor.

Part of why we have choice is not all of our customers are CIOs of large enterprises.  Lee Bryant of explores choice and the convergence of SaaS and Enterprise 2.0 in Bottom-up and inside out - the future of enterprise IT?

Euan's subtle insight on how to do Enterprise 2.0 is that there are powerful grassroots energies to not only tap into, but if you impede them you risk your deployment more than anything.  While there is a certain inevitability of Enterprise 2.0 proliferation thanks not only to SaaS, but namely open source, his message is less about the tools than the demand for them and practices that make it work.

Dion Hinchcliffe explores this and notes "Those that represent to be doing Enterprise 2.0 solely through tool rollout and no infrastructure remediation will almost certainly be among those reporting less encouraging results."

This is all in the context of the alternative to how this post began.  Besides large enterprise CIO preferences, there is the bottom up.  And smaller companies.

Lee discusses the challenges of a completely bottom-up approach:

On the technical level, the integration challenges are non-trivial:

  • identity / Single Sign On (SSO);

  • internal application integration;

  • legislative obligations for data retention, privacy and audit; and,

  • availability.

But the integration of people, practise and (dare I say) process is even harder, with challenges such as:

  • devolving responsibility and promoting a DIY culture;

  • encouraging people to grow their own internal and external networks;

  • stimulating conversation and debate by overcoming fear of exposure; and,

  • for many people, simply overcoming the idea that any form of online communication beyond email is "not part of their job."

Those challenges become opportunities when you have buy in from the top down and IT supports.  And when you have actual leadership, as Suw Charman noted: you have the best adoption strategy.  Lee specifically explores SaaS and rightly notes that it isn't a fit for many enterprises that have customization needs.  He sees two trends in SaaS that have potential to close this gap:

The first is in the area of specialised appliances or systems that live inside the firewall, where they can happily integrate with internal apps ad data, but which can also be updated and fed by managed connections that extend outside the firewall. The Socialtext managed appliance seems to be a good example of this approach, which is a workable compromise between SaaS and purely internal systems.

The second area is enterprise software that takes advantage of managed connections with web services to add value to internal systems. Movable Type was a pioneer of this approach with its blog ping service to feed a public list of recently updated MT blogs. Their impressive roadmap for the enterprise version of this market-leading blog platform suggests they will take this a lot further in MT v4.

You really should go read his post, at least for the Star Wars metaphor.  He concludes that SaaS still has a way to go:

...But the emphasis will shift from software, which is just a mechanism, to services, which is the actual product. Some of these will be new and imaginative forms of what we might recognise as applications, but many will be pure data or data transformation or sharing services. But whilst we will see adoption among SMEs for cost reasons, enterprises will not embrace SaaS for their mission critical systems or data until such a time as we find robust solutions for the key integration and data management challenges.

I see promise on resolving some of these challenges for the enterprise from innovations borne on the web.  OpenID is a good start for identity and authentication, and will find its way into the bowels of enterprise directory authorization.  RESTian APIs are shaking up pre-conceived notions of SOA.  Open Source provides more options for not only these challenges, but is the dark horse for Enterprise 2.0 the adoption race.

March 20, 2007

SaaS Appliance

Last week we quietly launched the Socialtext Managed Service Appliance.  Initially we thought this infrastructure innovation would simply give us some operational efficiencies.  But as we ran it by customers, passing their security audits and discussing how it changes IT Operations -- we discovered it was something greater, the delivery of Software-as-a-Service behind the firewall.

When we first created the Appliance deployment option, we worked hard to streamline administration, from setup in 10 minutes to simplifying upgrades.  Fedex a CD, have someone stick it in and type go for an upgrade.  Admittedly, we had one notable failure.  One customer put the CD on top of the server, got some coffee or something, came back and couldn't get it to go.  Turns out CDs melt.  So we started shipping USBs (download has always been an option too).

Practically, the Appliance model is halfway between the latency of SaaS (near zero) and Onsite deployment (near infinity).  Even if you make tasks like a routine upgrade fast and simple, it doesn't mean they will actually happen.  In some IT departments, particularly those who have outsourced IT with firm SLAs, an upgrade is considered a degradation of service level!

This means that even if the upgrade includes an important patch or desired feature, the vendor gets a scheduled window of opportunity, measured in months or quarters, which can be a lifetime.  On our SaaS version we do upgrades measured in hours or days.  Given the constraint to get our best stuff behind the firewalls of customers we developed the operational discipline and QA processes to really give them our best stuff.  We will serve no wine before its time.

As is common practice for startups, eating our own dogfood (or drinking our own champaign) means our company runs on staging versions.  Not the highly experimental branches you might find in our open source repository, but we bang on it before you do and sometimes it bangs on us.

With a SaaS Appliance, our general release process remains relatively the same, but accelerated.  Turns out IT departments not only love how they don't have to touch it, it simply works, but they can realize a lower TCO -- and shift the SLA burden to the vendor.

Among Phil Wainewright's roundup of 2007 SaaS Predictons was this from Saugatuck Technology on SaaS 2.0:

"SOA's impact on SaaS has lead to development of the Extended-Enterprise Service Bus (X-ESB) as a managed-service appliance … We expect to see an increasing number of SaaS Appliances emerge over the next few years as SaaS becomes fully integrated into the enterprise."

One forward looking enterprise we worked with has the strategic version to move all applications off of their network and rely on SaaS across the public internet.  Not everyone has this vision.  And regulations dictate that some never will.  But nobody is in a better position to take the pulse and manage the health of software than the vendor.  A Managed Service Appliance is a model that meets security and regulatory needs, enables the service of SaaS while offering SOA integration within the enterprises' security framework.  Not all enterprise software will be delivered this way, but it is an option on the rise for good reason.

SEE ALSO: Why Appliances Are Good

December 29, 2006

Always Be EchoSign

I'm blogging this on the last working day of Q4, the busiest sales day of the year. And I have the time to blog this because of a seriously great deal execution web service called EchoSign.

This morning I had a deal to be done with someone who doesn't use Word out of principle (hey, we are wiki guys and all for it), threw away their fax machine when spam ate all the ink and paper and didn't have access to a scanner.  Another person was on vacation and I didn't want to burden them with the manual labor or a Kinko's run.  I signed up for a free account, uploaded an agreement, sent them, tracked progress during the day and got counter electronic signatures.  CCd the lawyer in the process.  Deal done hassle free.

I can't think of many reasons not to do business like this.  There will be some larger enterprises that will need to be sold on the process, but the mid-market is ripe for this.  And the good old fashioned signing ceremony for big deals won't go away.  But at the very least, the Valley should work this way, from VCs to Law Firms to Boards to Sales teams.

They happen to be two doors down from Socialtext in Palo Alto 2.0 and the funny thing is I first met them when they bought an AdWord on our brand. I walked in and complained.  Next time I checked they bought a new ad supporting our Wiki Wednesday event.  Cool.  Now we wave while they get refreshers from Peet's.

If you want to try it, send me your email address and I'll send you a license agreement to buy a wiki anytime.  Happy closing.

Feeds


Flickr


  • www.flickr.com

Dandelife


Ligit

About


  • Ross Mayfield is the Chairman, President & Co-founder of Socialtext, the first wiki company and leading provider of Enterprise 2.0 solutions,
My Photo

The 150



  • View Ross Mayfield's profile on LinkedIn
Blog powered by TypePad
Member since 08/2003