0 Lattice Engines Automates All Steps in Prospect Discovery

There’s nothing new about using public information to identify business opportunities: it’s why lawyers chase ambulances and bankers phone lottery winners. But the Internet has exponentially grown the amount of data available and made it easily accessible. What’s needed to fully exploit this resource is technology that automates the end-to-end process of assembling the information, identifying opportunities, and delivering the results to sales and marketing systems.

Lattice Engines was founded in 2006 to fill this gap. The system scans public databases, company Web pages, and selected social networks to find significant events such as title changes, product launches, job openings, new locations, and investments. It supplements this with data from the clients' own systems including customer profiles, Web site visits, and purchases. It then looks at past data to find patterns which predict selected outcomes, such as making a first purchase, buying an additional product, or renewing. It uses these patterns to identify the best current prospects for each outcome, and makes the lists available to marketing systems or sales people. The sales people also see explanations of why each person was chosen, what they should be offered, and recommended talking points.

Each of these steps takes significant technology. Lattice Engines currently monitors Web sites of five to 10 million U.S. businesses, checking daily for changes.  The system’s semantic engine reads structured texts such as management biographies and press releases, extracting entities and relationships but not trying to understand more subtle meanings such as sentiment. Clients specify blogs to follow, which receive similar treatment. The company also monitors Twitter, Facebook company pages, Quora, and LinkedIn profiles of people within each sales person’s network. Additional data comes from standard sources such as business directories and from special databases requested by clients. Information from all these sources is loaded into a single database available to all Lattice Engine clients.

Lattice Engines also imports data from the clients own systems, although of course this isn’t shared with anyone else. Again, there’s some clever technology needed to recognize individuals and companies across multiple sources. Lattice Engines doesn’t try to link personal and business identities for individuals.

All this information is placed in a timeline so that modeling systems can look at events before and after the target activities. The models themselves are built automatically, once users specify the target activity, product, and time horizon. Users can then build a list of customers or prospects, have the model score it, and send high-ranking names to marketing or sales for further contact. Results can be exported to a marketing automation system or appear within the sales person’s CRM interface. Lattice Engines is directly integrated with cloud-based CRM from Salesforce.com, Microsoft Dynamics, and Oracle, and via file transfer with SAP CRM. Users can export lists to Excel and Marketo, with connectors for Eloqua and other marketing automation systems on the way.

The net result of this is a single system that performs all the tasks needed to exploit the wide range of information available about customers and prospects.  Marketers could theoretically use separate systems for each step in the process, and integrate the results for themselves.  But few really have the skills to do this.  And, in most cases, it would be more expensive than purchasing a single system like Lattice Engines.  It's particularly helpful that Lattice Engines supports both prospecting and customer management -- further reducing the need for multiple products, and further encouraging cooperation between marketing and sales departments. 

Pricing for Lattice Engines starts at $75,000 per year and grows based on the number of data sources and sales users. Client data volume doesn't affect the cost, since Lattice Engines’ own databases are vastly larger than any client data. The company has close to 50 deployments, nearly all at large B2B marketers including Dell, HP, Microsoft, ADP, and Staples.

0 Marketing Automation Beer Goggles: What I Think I Learned at Dreamforce

I’m writing this on my way home from Dreamforce, the Salesforce.com user conference that has become the primary industry gathering for marketing automation vendors. With a reported 90,000 attendees (I didn't count them personally), the show is fragmented into many different experiences. My own experience was mostly talking to marketing technology vendors in the exhibit hall, private meetings, and maybe a party or two. I did attend the main keynote and the “marketing cloud” announcement, but neither contained  major product news and the basic story – that social networks change everything – was true but far from novel.

So what did I learn? On reflection, there were two themes that hadn’t expected when I arrived.

The first was data. I generally think of marketing systems as relying primarily on data from the company’s own marketing, sales, and operational systems. But the exhibit hall was filled with vendors offering information – mostly from Web crawling or social media – to supplement the company’s internal resources. Of course, this isn’t new but it seems that external sources are becoming increasingly important. The main reason is so much valuable public information is now available. A lesser factor may be that there’s less internal information, at least for sales and marketing, because so many prospects engage indirectly and anonymously until deep in the buying process.

But there’s more to data than the data itself. The theme includes easier connectivity to external data, via standard connectors in general and the Salesforce.com AppExchange in particular. A closely related trend is real-time, on-demand access to the external data: say, when a salesperson views a lead record or a lead is first added to marketing automation. This requires immediate matching to find the right person in the supplier’s database, and, sure enough, matching was another popular technology on the show floor. I also saw broader use of Hadoop to handle all this new data: as you probably know, Hadoop effectively handles large volumes of unstructured and semi-structured data, so it’s a key enabling technology for data expansion. A final component is continued growth in the reporting, analytics, and predictive modeling systems that make productive use of the newly-available data.

Some products combine all these attributes, others offer a few, and some just one. Obviously a single integrated solution is easiest for the buyer, but as Scott Brinker recently pointed out in an insightful blog post, platforms like Salesforce.com may actually make it practical for marketers to mix and match individual products without the technical pain traditionally associated with integration. It therefore makes sense to view the data-related systems as a cluster of capabilities that will develop as parts of single ecosystem, collectively raising the utility and importance of external data to marketers.

The second theme, considerably less grand, was lead scoring. I suppose this is really just a subset of the analytics component of the data theme, but I saw enough new lead scoring features from enough different vendors to treat it separately. In particular, predictive modeling vendor KXEN announced a free, cloud-based service to automatically score a new Salesforce.com lead’s likelihood of converting into a contact. (If you’re not familiar with Salesforce.com terminology: contacts are linked to an account, while leads are not. The conversion usually indicates the salesperson has deemed the person a valid prospect and is thus a critical stage in most sales processes.)

The KXEN service requires absolutely no set-up; users just install it from the AppExchange. KXEN then reads the data, builds a predictive model based on past results, and returns the scores on current leads. From a technical standpoint, the modeling is nothing new, and indeed the people I met at the KXEN booth seemed to feel the product was barely worth discussing. But I’ve long felt that an automated, predictive-model-based scoring service was a major business opportunity because it would replace the time-consuming, complicated, and surely suboptimal lead scoring models that most companies now build by hand, usually with little basis in real data. Of course, there are plenty of other predictive modeling systems available for marketers, but I’m excited because I don’t think anyone else has made model-based lead scoring as simple as the KXEN offering. Maybe I need to get out more.

Speaking of which, I met SetLogik at a loud party after several glasses of wine, so I may have been wearing the marketing technology equivalent of beer goggles. But if I understood correctly, it tackles the really hard part of revenue attribution by using advanced matching technologies to connect the right leads and contacts to sales (reflected in closed opportunities in Salesforce.com). Once you’ve done that, determining which marketing touches influenced those people is relatively easy.  It’s a unique solution to a huge industry problem. Come to think of it, correct linkages are also critical for building effective lead scoring models, which it turns out that SetLogik also does. (I'll admit it: I Googled them the next day.) So they're part of that theme as well.

As I mentioned earlier, data and lead scoring were themes that emerged for me during the conference. I did have some other themes in mind when I started, which are also worth sharing. I’ll do that another day.

Finally, it’s worth noting that the conference itself was tremendously well run. It sometimes felt that one-third of those 90,000 people were Salesforce.com employees hired to stand around and answer questions. Where they found so many cheerful people outside of the Midwest I’ll never know. Congratulations and thanks to the Salesforce.com team that made it happen.