LOGIN | REGISTER NOW | SUBSCRIBE
 

Rekindling a GemFire


Distributed data manager sees cache, partitioning updates

By P J Connolly
Email    print   
November 15, 2007 —  There’s been so much talk about the ways application development has to evolve in the modern era of multicore hardware and virtualized systems that it’s easy to forget data has its own issues to consider. This gets especially tricky as companies seek to build distributed, resilient data architectures as part of a next-generation disaster recovery scenario.

GemStone Systems announced on Oct. 30 the release of GemFire Enterprise 5.1, a distributed operational data management infrastructure that allows data sharing and event distribution in environments where clustered application processes need reliable and secure access to back-end data sources.

GemStone architect Jags Ramnarayan explained that the large number of variables inherent to distributed systems significantly increase the possibility of error. Such stress-inducing points range from missed event notification to data consistency failures, all the way to application, operating system or hardware failure.

GemStone claims to have improved the redundancy of data partitioning in GemFire Enterprise 5.1 by allowing multiple levels of redundant data. The partitioned data regions can be managed with user-defined policies, allowing events to be properly ordered without requiring locks or similar steps. This, the company claims, allows all data updates to be fed through the primary partition, for a balanced memory usage profile.

Evening Out Events
Event delivery is important in a clustered data environment, and GemFire Enterprise uses distributed event notification to permit the even spread of updates across a data grid for event processing. It also allows the use of Object Query Language as a way to execute “scatter-gather” algorithms.

Users can control the way a workload is spread across the system, parallelizing data traffic to peers in an attempt to provide better throughput with multihomed nodes. So-called “lazy” connections are also possible.

The persistence implementation is designed to allow every operation to be recorded, with log files designed to roll over at a configured size. The system also pulls log files back together to reclaim disk space, which the company claims results in a 50 percent gain in throughput for synchronous persistence, and full 100 percent gain for asynchronous persistence.

GemFire Enterprise 5.1 also implements new native C++/C# client cache behaviors designed to enhance data sharing and cross-application collaboration, important in today’s distributed environments. Since objects in the cache aren’t always the same size, it’s possible for a client cache to become fragmented; the GemFire update implements heap LRU (least recently used) algorithms at the cache level to alleviate this.

GemFire clients execute queries on the server side and are subscribed to event notifications; according to the company, this keeps client-side performance from bottlenecking the cache server and impeding a data grid’s ability to scale.




Share this link: http://sdt.bz/31373
 
Most Read Latest News Blog Resources
Zeichick’s Take: Radio moves from analog waveforms to digital packets
Streaming radio highlights the need for streaming applications to be designed to take up as little bandwidth as possible
Taking enterprise architecture to the business side
Startup Corso is bringing out a cloud-based planning platform that ties into business plans
Appcelerator Acquires Cocoafish to Add Instant Mobile Cloud Capabilities to its Industry Leading Titanium Platform
Appcelerator Offers Messaging, Social, Location and Storage Mobile Cloud Services to All Mobile App Publishers
ComponentOne Releases a Collection of 40+ UI Widgets Powered by HTML5 and jQuery
ComponentOne has announced the 2012 release of Wijmo: a kit of UI widgets for HTML5 and jQuery development
Digg!  Digg
Reddit  Reddit
Slashdot  Slashdot
Share on facebook  Facebook
Share on Twitter  Twitter


Add comment


Name*
Email*  
Country     


  • Comment
Loading




close
NEXT ARTICLE
GemFire Adds Hierarchical Cache, 'C' API
Dynamic hierarchical caching and support for C/C++ applications and Java processes are among the new features in GemFire Suite 2.2, Read More...
 
 
 
 
News on Monday
more>>
SharePoint Tech Report
more>>


   

 
 

Download Current Issue
FEBRUARY 2012 PDF ISSUE

Need Back Issues?
DOWNLOAD HERE

Want to subscribe?


 
blogs tab
Are you at risk for burnout?
Burnout is a severe problem and it can strike at any time. Here's how to tell if you are nearing the edge.
02/09/2012 02:16 PM EST

Agility, mom, and apple pie
If we're to evaluate the state-of-the-art in software development, we should start with the values espoused in the Agile Manifesto.
02/07/2012 11:57 AM EST

RIM woos developers with free tablet
How do you get more apps ported to the BlackBerry PlayBook? By giving every developer a free tablet, of course!
02/04/2012 01:57 PM EST

GitHire: Use Headhunters to Find Your Perfect Programmer
Are you a hiring manager tired of scouring the job boards? Check out this new service that will find 5 people interested in your jobs.
02/03/2012 12:17 PM EST

Facebook claims hacker cred
Facebook's SEC S-1 filing form includes a short essay on the Hacker Way by Mark Zuckerberg himself.
02/02/2012 08:26 AM EST

Ryan Dahl steps down
Ryan Dahl, creator of Node.js, steps back from his position as gatekeeper for the project.
02/01/2012 04:58 PM EST

 
Events calendar tab
Cloud Connect
2/13/2012 to 2/16/2012
Santa Clara
TechWeb

SPTechCon: The SharePoint Technology Conf.
2/26/2012 to 2/29/2012
San Francisco
BZ Media

RSA Conf.
2/27/2012 to 3/2/2012
San Francisco
RSA

IBM Pulse Conf.
3/4/2012 to 3/7/2012
Las Vegas
IBM Tivoli

Game Developer Conf.
3/5/2012 to 3/9/2012
San Francisco
TechWeb