Home > Community > Blogs > Functional Verification > thoughts on the dvclub talk quot is it time to declare verification war quot
 
Login with a Cadence account.
Not a member yet?
Create a permanent login account to make interactions with Cadence more conveniennt.

Register | Membership benefits
Get email delivery of the Functional Verification blog (individual posts).
 

Email

* Required Fields

Recipients email * (separate multiple addresses with commas)

Your name *

Your email *

Message *

Contact Us

* Required Fields
First Name *

Last Name *

Email *

Company / Institution *

Comments: *

Thoughts on the DVClub Talk: "Is it Time to Declare Verification War?"

Comments(1)Filed under: Functional Verification, metric driven verification (MDV), verification strategy, DVClub, MDV

As noted in a prior post, I had the pleasure of attending a DVClub talk given by Brian Bailey entitled "Is it time to declare verification war?". As suggested by the word "war" title, Brian drew many analogies between the legendary text The Art of War by the Chinese general Sun Tzu, and the strategic and tactical challenges of verifying a complex device under test (DUT), complemented by introductions of some interesting emerging technologies.

DVClub Silicon Valley 3-19-08

Brian Bailey discusses verification strategy with the DVClub Silicon Valley audience in terms Sun Tzu would recognize

 

Reflecting on Brian's remarks, there is one point Brian made that has continued to stick with me: one of Sun Tzu's overarching themes is to take care to separate strategy from tactics, and employ only those tactics that will support the chosen strategy.  In this vein, Brian correctly observed that for too many customers code & functional coverage itself equals "verification".  Furthermore, one of the problems that we [in the verification community] have is that we tend to over-rely on objective feedback (like coverage), and often fail to step back an look at the underlying issues behind the data.

Don't get me wrong: I'm a big fan of coverage and metric driven verification, but you have to concede that Brian has a great point.  As with any task that heavily leverages objective criteria -- like the selection of students for college admissions by their SAT test scores for example -- it's easy to obsess on the numbers themselves and forget to evaluate whether the way you are generating said numbers are honestly serve the desired strategic goals, and/or even serving the *current* strategy and not a prior one.

Thus, while high coverage scores generally correlate with a high quality DUT (like high SATs generally predict success in college), verification is actually about measuring the fidelity of the DUT to the spec, and even "perfect" functional coverage scores are not a fool proof guard against corner case bugs.  Hence, it's critical to use overlapping tactics to complement code & functional coverage -- checkers & assertions, scoreboards, formal analysis techniques, etc.

I'm interested to hear your take-aways from either the Silicon Valley or Boston instances of Brian's talk -- feel free to comment below or contact me offline.

Hope to see you at the next DVClub!

Joe Hupcey III

P.S. Full disclosure: The Art of War has been a favorite of mine since I first encountered it back in my own SAT prep days. I often reference the text myself, and suffice to say the urge to extend it to all sorts of cases is very powerful.  As such, I have to applaud Brian for his restraint for not overdoing the analogies between verification and Sun Tzu's marshal guidance. Bravo!

Comments(1)

By Saturday J. Schroder on June 17, 2009
Brian recently made us a video of his presentation. For all of those who haven't yet seen his presentation, I highly recommend checking it out.
www.dvclub.org/index.php

Leave a Comment


Name
E-mail (will not be published)
Comment
 I have read and agree to the Terms of use and Community Guidelines.
Community Guidelines
The Cadence Design Communities support Cadence users and technologists interacting to exchange ideas, news, technical information, and best practices to solve problems and get the most from Cadence technology. The community is open to everyone, and to provide the most value, we require participants to follow our Community Guidelines that facilitate a quality exchange of ideas and information. By accessing, contributing, using or downloading any materials from the site, you agree to be bound by the full Community Guidelines.