Q&A: X1 and The Future of Finding Stuff

By | November 24, 2011
  Full text of email interview with Mark Goodstein of X1 (see my column in WSJE and FEER this week)
 
— Who are you aiming at with this product?
 
Not to be too simplistic, we’re aiming at two groups: consumers and professionals, specifically those who have a lot of email and files and who spend more time than they want searching for information on the Internet or intranet. The free version offers a substantial set of features that we hope will entice legions of users to use the product at
home and work, for all their information finding needs. The pro version has features that power users will demand, like indexing network drives and viewing files in their native formats, regardless of whether they have the native application installed. Both versions will continue to get richer over the coming weeks and months, as we add more consumer features, like media-specific tabs (pictures, music, etc.) and more powerful web searching and eCommerce-related features. The pro version will get support for indexing attachments, contacts, events, PDFs, and archives. We think these two prongs will encourage great numbers of people to use the product and will eventually allow us to crack the enterprise market, which is straining for simple interfaces to complex data: X1’s specialty.
 
 
— I’ve always thought this kind of product was really basic, and when Enfish came out in 1999, I assumed it would be massive. But it wasn’t, and nothing since has really caught on. Why is this? Does it have to do with new paradigms, or just the product wasn’t right, or people aren’t ready for it, or what?
 
Our approach isn’t that much different than others, but we’re staying focused on simplicity and speed. X1’s interface is visceral and innovative: allowing the user to winnow the searches down from all to just a few, instantly, as opposed to the normal none to many (sometimes with a coffee break) of today’s search engines and desktop search utilities. This interface gives the user the feeling of control over chaos, which is hard to underestimate. Many people have built up complicated directory structures for storing their files and email, all in an effort to just keep track. X1 allows the user to stop caring about the organization and more about the work!
 
This is a difficult question to answer because it seems like Enfish and others have done many of the things we’ve done, but several years in advance. I’m not sure why they failed to catch on like you assumed, but I don’t think the fundamentals have changed. The amount of data we’re responsible for is large and always growing; it’s in disparate formats and locations; the tools that help users wade into this sea of information are, maybe justifiably, difficult to understand and use; and there’s no incentive for market leaders, like Microsoft, to innovate. It doesn’t help that the dotcom bubble excited expectations and the companies responsible never followed through.
 
That said, we really do think we’ve created a beautiful interface to complicated data sets. We think of it as something between a spreadsheet and a database. So, like you said, Enfish should have caught on big, and didn’t. Just like databases were supposed to catch on big at the end-user level, and didn’t. Spreadsheets have tried to fill the gap,
becoming more database-y over time. But that’s a little ridiculous, as many people have come to realize.
 
— What’s under the hood? Presumably these programs have different technologies underpinning them? Could you explain a little of the challenges to minimize the downside of such programs — index size, performance loss, ease of use, success ratio of finding what you’re looking for, etc?
 
I assume most indexing technologies are actually pretty close cousins, separated by clever coding and intelligent choices. We all deal with the same limitations of compression, physical memory, disk space, etc., and all have to make trade-offs to deliver a product to market. X1 has an inverted index with all sorts of clever tricks to manage memory and
processor use to keep the indexing as invisible and painless as possible. Our goal, from the beginning, was to make a product that was as simple to use as possible, as fast as a machine would allow, and as invisible as possible. We’ve had success on all fronts and we’ll continue to improve and innovate as time goes by. We think the bottom line here is speed and simplicity. Speed allows us to skip all those complicated, frankly under-used, search features, while allowing the user to iteratively search (quickly) through their data. They may search twice before success, but certainly it’ll be faster and more satisfying. This is compounded by our innovative multi-field search interface. That’s it.
 
— Where do you see this going? Is searching a hard drive going to get more sophisticated a la data mining? Or is this a rough and ready product that will always fit the brute force approach?
 
Not to harp on this too much, but we honestly believe that our mission will be fulfilled and we’ll achieve big success if we stick to our dual goals of speed and simplicity. We can let Oracle do the OLAP while we do away with the DBA…
 

Column: Finding The Holy Grail of Finding Things

By | November 24, 2011
 I have lost count of the number of times I have written about finding text in files on your computer.  It’s such a basic idea that you would think it would come as a standard function on most operating systems.  In fact, if you’re a Mac user, it does.  For the rest of us, finding stuff is a lot harder than finding something on the Internet.  This has to be the dumbest thing that future generations will laugh at us for, except perhaps for considering white plastic garden chairs a charming lawn ornament and acceptable seating option.
 
But it’s not through lack of trying.  I remember a program from the late 1980s called askSam (www.asksam.com) which did a very passable job of allowing users to search through large chunks of text quickly and efficiently.  But it was quirky and required a lot of patience on the part of the user: In fact, it’s still going (and still quirky).  In the late 1990s, a company called Enfish Corp (www.enfish.com) launched a great product called Tracker Pro which indexed your hard drive and allowed you to search for text or chunks of text, and not only find them instantaneously, but also to view them inside Tracker itself.  Tracker Pro was ahead of its time, and like all things ahead of its time now is sitting in the corner mumbling to itself, ignored, dribbling out of the corner of one toolbar menu. Enfish continues to push something called Find that it is a shadow of its former self, and seems aimed more at the commercial customer than the individual.  There’s also a product called dtSearch (www.dtsearch.com) which also does text searches and does it very well, if a little brusquely.  But now, the Holy Grail may have arrived.  It’s called X1 and it will be officially launched later this month.
 
Read the full column at FEER.com (subscription required)
 

News: XP Has Made Everything Better. No, Really

By | November 24, 2011
 From the I Must Be Living in a Parallel Universe Dept,  I read with interest of PC Magazine announcement today that it has issued its “Annual Report Card on Service & Reliability Of Major Technology Companies” in which it says that ”consumers are more satisfied with the computer products and peripherals they’re using and the companies behind them this year than in 2002″. That seems unlikely, based on my experience and mailbag, but I did splutter some serious coffee when I read lower down their press release that “Overall, service and reliability has improved, due in large part to the effect of Microsoft Corp.’s Windows XP”. The release went on to say that ”Windows XP has brought computer users the stability of Microsoft’s corporate operating systems – Windows NT and 2000.” Editor in chief of the magazine, Michael Miller, is quoted as saying: “If an OS performs better, so does the hardware it controls.”
 
 
Well, yes, that’s true. But why do I keep having to reboot my XP preloaded notebook because it goes slower than my grandpa’s Vespa? And why do some minimized programs just flash away when I try to switch programs, as if it’s a Dirty Old Man’s convention? And why does the computer spontaneously reboot of its own accord, usually on Monday afternoons or when there’s a half moon? I may be in a minority around here, but my impression with XP is that it’s somewhat better than Windows 98, but it still gives me the shivers. The idea that somehow things are much, much better is just silly.

News: Bothered By Mosquitoes? Use Your Cellphone

By | November 24, 2011
 From the Why Use Bugspray When You Can Use Your Cellphone Dept, a report from the Korea Times on a new service by SK Telecom. Its seems South Korea’s top mobile operator is offering downloadable ring tones which, er, generate anti-mosquito sound waves that deter mosquitoes within a range of one metre.
 
 
The mosquito repelling service uses a particular spectrum of sound waves, which are undetectable by human ears. But the frequencies annoy mosquitoes, SK Telecom said. And presumably you, when you get the bill, at 3,000 won a download. One of the other downsides pointed out by the correspondent is that “the service takes up more battery power, but customers can effectively use the service with rechargeable equipment.” Or you could just throw your cellphone at the mosquitoes when the battery runs out.
 
Who said technology isn’t making our lives easier?

News: The Spam Top Ten

By | November 24, 2011
  From the We Already Knew That But It’s Still Interesting Dept,  FrontBridge Technologies Inc, which calls itself “a trusted provider of email protection and secure
messaging services” (as opposed, presumably, to those Distrusted Providers of Email Protection, or the Somewhat Trusted Except When They’ve Had A Beer Or Two Providers of Email Protection) have, after evaluating hundreds of millions of messages (no really, they say this, I’m not making it up), “today revealed the top ten deceptive subject lines that spammers use to entice their target recipients into opening spam emails”.
 
This, of course, is all an effort to promote something called the FrontBridge TrueProtect(TM) Spam Analyzer, which “filters and analyzes message characteristics for more than 1,200 enterprise email domains” but sounds much more like something out of Monty Python and the Holy Email or an old Woody Allen flick. Anyway, in case you’re still interested, FrontBridge’s spam analysts “assessed deceptive subject lines in spam received by the company’s large base of business customers, and then ranked the subject lines based on frequency”. Here’s what they found (they even tell you the deception strategy, just in case you’ve had a lunchtime beer or two yourself and couldn’t figure out the spammers’ devilish ways on your own):
 
The Top 10 Trickiest Spammer Subject Lines:
 
Subject Line:                                    Deception Strategy:
 
1. RE: Information you asked for           1. Implies you’ve requested something
2. hey                                               2. Most common friendly intro
3. Check this out!                               3. Common intro to friendly forward
4. Is this your email?                           4. Poses as old friend or colleague
5. Please resend the email                   5. Implies you’ve sent an email first
6. RE: Your order                               6. Implies you’ve bought something
7. Past due account                           7. Worries recipient re: financial debt
8. Please verify your                           8. Implies a sign-up or order placed information
9. Version update                              9. Fake software update via email
10. RE: 4th of July                           10. Guesses at holiday plans
 
So now you know. Actually, buried in all this glaring obviousness is an interesting point. The use of these kind of tactics has increased, FrontBridge say, more than 50% in the first six months of the year. That’s quite a trend.
 
The moral of the tale? If you send someone an email, try to think of a subject header that doesn’t sound like it could be this new kind of spam. Oh, and pity the FrontBridge spam analysts having to trawl through all this dross to compile their top ten. Let’s hope they aren’t planning to update it every week.