David Rubinstein: Data Streaming Crosses the Chasm



Email    print   
December 15, 2007 —  (Page 1 of 2)
This is the time most publications wax nostalgic over the year that was, recounting the highlights and lowlights, and trying to put it all in perspective. Count us among them; SD Times will publish its traditional "Year in Review" issue Jan. 1.

So, what to write about in this, the final issue of 2007? Why, what we can expect in 2008, of course. You've got to see where you're going to know where you've been…or something like that!

Anyway, with the help of Daniel Chait, founder of software consulting company Lab49, here are some recent trends that are poised to cross the chasm, pass the tipping point and take off into the everyday world of software development.

The first area that will become much more commonplace in 2008 is data streaming, otherwise known as complex event processing. CEP, which had been relegated to highly specialized applications such as financial trading, will make its way into retail and other markets that have a need to perform calculations on data and see patterns in near real time.

The financial services industry has driven CEP, because institutional, algorithm-driven trading has led to massive increases in trading volume. "The old method of store and process for data is falling by the wayside," Chait said. "Writing processes in batch jobs at the end of the day is increasingly inadequate." Financial services companies need information on activity, trading and market information throughout the day to remain competitive.

Complex event processing came out of the world of academia, Chait noted, where the work was focused on processing data from sensors. In the area of weather prediction, sensors that can collect data on temperature, humidity and wind speed need to be read in real time to be useful.

For retail, Chait said companies can analyze traffic and consumer patterns. "Using CEP engines, they can do clicksteam analysis, to see what's going into a shopping cart, what add-ons are being chosen, when dropouts are occurring," he said. A company might use that data analysis to decide to mark down a certain item on its Web site for a certain time period of the day to drive sluggish sales, for example.




Pages 1 2 


Share this link: http://sdt.bz/31419
 
Most Read Latest News Blog Resources

Add comment


Name*
Email*  
Country     


  • Comment
Loading




close
NEXT ARTICLE
Mobile developers must sidestep data limitations
Bandwidth constrictions from carriers and mobile devices require different measures to bypass Read More...
 
 
 
 
News on Monday
more>>
SharePoint Tech Report
more>>


   

 
 

Download Current Issue
FEBRUARY 2012 PDF ISSUE

Need Back Issues?
DOWNLOAD HERE

Want to subscribe?


 
blogs tab
Are you at risk for burnout?
Burnout is a severe problem and it can strike at any time. Here's how to tell if you are nearing the edge.
02/09/2012 02:16 PM EST

Agility, mom, and apple pie
If we're to evaluate the state-of-the-art in software development, we should start with the values espoused in the Agile Manifesto.
02/07/2012 11:57 AM EST

RIM woos developers with free tablet
How do you get more apps ported to the BlackBerry PlayBook? By giving every developer a free tablet, of course!
02/04/2012 01:57 PM EST

GitHire: Use Headhunters to Find Your Perfect Programmer
Are you a hiring manager tired of scouring the job boards? Check out this new service that will find 5 people interested in your jobs.
02/03/2012 12:17 PM EST

Facebook claims hacker cred
Facebook's SEC S-1 filing form includes a short essay on the Hacker Way by Mark Zuckerberg himself.
02/02/2012 08:26 AM EST

Ryan Dahl steps down
Ryan Dahl, creator of Node.js, steps back from his position as gatekeeper for the project.
02/01/2012 04:58 PM EST

 
Events calendar tab
2/13/2012 to 2/16/2012
Santa Clara
TechWeb

2/26/2012 to 2/29/2012
San Francisco
BZ Media

2/27/2012 to 3/2/2012
San Francisco
RSA

3/4/2012 to 3/7/2012
Las Vegas
IBM Tivoli

3/5/2012 to 3/9/2012
San Francisco
TechWeb