Print

Watch out multicore: GPUs are right behind



Alexandra Weber Morales
Email
November 1, 2010 —  (Page 1 of 6)
“A manycore processor is a device for turning a compute-bound problem into a memory-bound problem,” said Mark Murphy, a Ph.D. candidate in electrical engineering and computer science at the University of California, Berkeley, working and lecturing in the Intel-financed Parallel Computing Lab (Par Lab).

“This is a quote that I use in almost every talk I give. Kathy Yelick [director of the National Energy Research Scientific Computing Center at Lawrence Berkeley Laboratory] was the first to say it...Essentially, the amount of on-chip computation is growing much faster than the amount of memory bandwidth that you have, so we are at the point where you need at least 10 times as many floating point operations as you have memory loads," he continued.

"If you load a single cache line, you want to be sure to use all of it, and you want to be sure, if you can, to load single cache lines at a time. This is the same problem as we have with CPUs, but it’s exacerbated in GPUs because of the large amount of on-chip parallelism.”

Just a few years ago, Intel’s multicore CPU efforts were stealing headlines. C++ guru Herb Sutter first sounded the alarm to developers that Moore’s Law could no longer be counted on with a Slashdot article entitled “The Free Lunch Is Over: A Fundamental Turn Toward Concurrency in Software.” (Disclosure: I was on retainer as a contract editor to help Intel evangelize concurrent programming to software developers from 2007 to 2009.)

A funny thing happened on the way to the multicore future, however: While CPU makers and developers alike were slamming into Amdahl’s “Wall,” struggling to realize performance increases for eight or 16 cores thanks to the sequential overhead of their legacy code, GPU makers were quietly cooking up a revolution.

It’s been a few decades in the making, granted. The concept of general-purpose graphics processing units (GPGPUs) dates to the late 1970s. But a number of factors have coalesced recently:



Related Search Term(s): parallel processing

Pages 1 2 3 4 5 6 


Share this link: http://sdt.bz/34842
 
Most Read Latest News Blog Resources

Add comment


Name*
Email*  
Country     


  • Comment
Loading




close
NEXT ARTICLE
Harnessing the GPU for multicore processing
Parallel programming is becoming more commonplace, and companies are devising and revising products to meet demand Read More...
 
 
 
 
News on Monday
more>>
SharePoint Tech Report
more>>


   

 
 

Download Current Issue
MAY 2012 PDF ISSUE

Need Back Issues?
DOWNLOAD HERE

Want to subscribe?


 
blogs tab
Creation
To write better software, cultivate your ability to be creative.
05/19/2012 07:40 PM EST

Slick...but who needs it?
compilr.com is a well-designed site and the folks behind it seem to have their heart in the right place. But...who needs it?
05/16/2012 12:45 PM EST

How to be a better software developer
Want to be a better developer? You won't get there by mastering an interesting language or learning a new set of APIs.
05/14/2012 12:18 PM EST

Wooing Galatea
Do yourself a favor and check out Galatea 2.2, a wonderful book by novelist Richard Powers.
05/12/2012 07:05 PM EST

The world as story
An artificial-intelligence system at Carnegie Mellon seeks to understand the world by making statements about it.
05/10/2012 06:39 AM EST

The Rise of the Brogrammer, or the Rise of the Sexist Programmer?
Women in Silicon Valley get vocal about sexist ads and campaigns that contribute to a tense work environment.
05/09/2012 03:14 PM EST

 

Events calendar tab