Welcome
Welcome to securitymetrics.org, a community website for security practitioners. Securitymetrics.org offers a community blogging service (this page) and a members-only mailing list. See the Mailing List page for more details.

Announcing Metricon 5

Metricon 5 is the fifth annual conference dedicated to security metrics. It is a forum for presenting new approaches for measuring information security effectiveness, with a bias towards practical, specific approaches. Topics and presentations will be selected for their novelty and merit, and their potential to stimulate discussion.

With five years of organized conferences in the history books, this year's theme, appropriately, is Older But Wiser. Four years ago, presenters at the first Metricon discussed software security, benchmarking, identity management, enterprise case studies and many other topics. Since then, researchers and enterprises have continued to investigate new techniques. What have we learned? Given that we are trying to measure, measuring the security metrics field (and the success or failures of our own efforts) is also our responsibility.

The program is organized along three temporal perspectives:

  • Metrics Past. Which metrics techniques from 2006 worked, and which did not? And how can knowledge of the past inform the present and future?
  • Metrics Present. What is the state of the art as practiced today' by leading corporations, consultants and researchers?
  • Metrics Future. What new strategies for measuring security will emerge in the future?

Metricon 5 will be a one-day event, Tuesday, August 10th, 2010, co-located with the 19th USENIX Security Symposium in Washington, DC (http://www.usenix.org/events/sec10/). Metricon will begin bright and early in the morning, continue through a catered lunch in meeting room, and extend into the evening with informal discussion. Attendance will be by invitation. Capacity is limited to 60 participants.

Program

TimeTrack
0800–0900hBreakfast
0900–0930hAndrew Jaquith, Forrester Research, Welcome address and ''Five Years of Security Metrics: A Look Back''(info)
0930–1000hRichard Seiersen, Kaiser Permanente, ''Practical Security Metrics in the 4th Dimension''(info)
1000–1030hRH Powell, Akamai, ''Weathering Storms in the Cloud: Analyzing Massive Distributed Denial of Service Attacks to Better Prepare for the Future''(info)
1030–1100hMorning break
1100–1130hJohn S Quarterman, Quarterman Creations/CREC at the UT Austin School of Business, ''Spam Reputation as Output Measure of Infosec''(info)
1130–1200hGina Fisk, Los Alamos National Laboratories, ''Optimizing Performance Management using Adaptive Metrics, Fitness Functions, and the Balanced Score Card''(info)
1200–1230hFabio Massacci, Universita' di Trento, ''Which is the Right Source for Vulnerability Studies? An Empirical Analysis on Mozilla Firefox''(info)
1230–1345hLunch
1345–1415hElizabeth Nichols, PlexLogic: Security Metrics, ''Security Metrics: What’s Hot and What’s Not''(info)
1415–1445hLaura Glowick, Federal Home Loan Bank of Boston, ''Enterprise Security Dashboard''(info) also: FHLB's metrics catalog(info)
1445–1515hAfternoon break
1515–1545hAlex Hutton, Verizon Security Intelligence, ''Bridging Risk Modeling, Threat Modeling, and Operational Metrics With the VERIS Framework''(info)
1545–1615hMichael Smith, Fish Catchers Heavy Industries, ''Meta-Metrics: Building a Scorecard for the Evaluation of Security Management and Control Frameworks''(info)
1615–1730Rump session: open-mic discussion of current research and topics of shared interest
1730–Beer! Sponsored by Blue Canopy

Venue

Metricon 5 will be held at the Marriott Woodman Park Hotel, 2660 Woodley Road Northwest, Washington, DC, on August 10th, 2010. It is co-located with the USENIX Security 2010 Symposium.

Event Sponsors

BlueCanopy_Logo_04032010.png

Attendance

Attendance is by invitation only. If you would like to attend, send an e-mail to metricon5 at securitymetrics dot org.

All participants will be expected to "come with findings" and be willing to contribute to group discussions. Politeness will be praised; questions, encouraged; lurkers, flushed out.

The proceedings of all past meetings are available here:

For speakers

  • Deadline for final presentation: July 30th, 2010

Conference chairs

  • Andrew Jaquith, Forrester Research
  • Khalid Kark, Forrester Research

Program committee members

  • Jennifer Bayuk, Stevens Institute of Technology
  • Dan Geer, In-Q-Tel
  • Chris Walsh, SurePayroll
  • Wade Baker, Verizon Risk Intelligence
  • Ray Kaplan, Ray Kaplan & Associates
  • Michael Smith, Akamai Technologies
  • Daniel Arista, Syracuse Research Corporation

Mini MetriCon 4.5

Mini MetriCon 4.5 was held Monday, March 1, 2010, in SanFrancisco, California, adjacent to the USA RSA 2010 Conference. The presentations are posted as embedded links in the agenda; the original CFP remains available as well.

MetriCon 4.0

MetriCon 4.0 was held Tuesday, August 11, 2009, in Montreal, Quebec, co-located with the USENIX Security Symposium. See the MetriCon 4.0 page for the details of the meeting, including its CFP, the final agenda, and the meeting's Digest.

Mini MetriCon 3.5

Mini MetriCon 3.5 was held Monday, April 20, 2009, in SanFrancisco, California, adjacent to the USA RSA 2009 Conference. The presentations are posted as embedded links in the agenda; the original CFP remains available as well. Sadly, no Digest was ever completed.

MetriCon 3.0

The MetriCon 3.0 presentations and digest are available as attachments to the final agenda

Mini MetriCon 2.5 Presentations

The MiniMetriCon 2.5 presentations are available as attachments to the final agenda.


Metrics Catalog Project:

The Metrics Catalog Project was officially launched in June 2008. A major revision has been made available as of April 2009. To see the catalog on-line you can visit:

General information about the Metrics Catalog can be found in the following documents:

BEWARE: You will need a Javascript and Java enabled browser to optimally experience the content on these sites. Due to circumstances beyond our control, we cannot support any browser on Vista.

--Elizabeth Nichols, 3-July-2009

Logged in? Add a New entry to this blog!

May 2, 2005 9:10 PM
Welcome_blogentry_260405_1
Web Services, specifically, and SOA security, in general, are indeed a security challenge. As opposed to the OO and Component based programming worlds, the server effectively has no knowledge of the client making it impossible to use widely deployed authentication techniques. Next, you have to deal with all of the web application type of attacks, and also have to deal with the persistent state (typically XML document payload) that can traverse multiple hops in a SOA transaction. Lastly, you have the integration of the transaction and identity security attributes that need to be mapped to the principal as you stated.

So while Adam Bosworth and Tim Bray may certainly be right that simplicity is a key to longevity (one reason why CORBA was superseded by J2EE), I suspect companies are not going to "run their business" over Javascript applications and HTTP Get. It is also fair to point out that the WS-* effort has produced some useful specs like WS-Security which is composeable of a number of seucrity tokens like SAML and Kerberos, and in fact are trying to put into place mechanisms that we do not have today, namely interoperable security standards.

In any case, I think the design decision centers around WS-* versus SAML/Liberty/XACML, not WS-* vs REST. In a nutshell, the WS-* spec provides security (and other services) at the framework level while the SAML path leaves the implementation of these mechanisms up to the individual development teams. At the industry level, the track record of the latter's success in building security solutions is not impressive, so it may be too early to throw WS-* under the bus at least for business transactions.

Update: Kim Cameron has posted an example of WS_MEX versus the HTTP Get approach.

By AnonymousCoward  Permalink
April 21, 2005 12:47 AM
Welcome_blogentry_210405_1
Scobleizer points out that the WS ReliableMessaging specification has been submitted to OASIS.

With all due respect to the incredibly bright folks at the WS-I, I find the world of web services standards to be rather confusing. In addition to this new spec, we also have the WS-I Basic Profile (the initial version 1.0, plus the New and Improved!!! version that features "security"), WS-Federation (apparently a substitute for a perfectly good, and elegant, solution called the Liberty Alliance), WS-Transfer, WS-Conversation, WS-Security, and about a dozen others that I can't remember. About the only thing that's missing is the WS-LittleLessConversation specification, which (as I understand it) will feature hashed messages using secret, random salts that will ensure that nobody can talk to anybody else.

I'm not a web services guy; I just dabble in these things when the mood (or lighting) makes it worthwhile. But even so, it seems fairly obvious to me that the whole edifice is in danger of collapsing under its own weight. I made this point to an XML security vendor I spoke with the other day; I asked him this: do you really want to hitch your wagon to the whole web services phenomenon, especially since folks like Google are making a mockery of the whole thing by cobbling together allegedly "inelegant" solutions that (shudder) solve real problems and look terrific? He agreed with me, and said that yes, the REST protocol makes a lot of sense because people understand what it is, and how to use it. Isn't that the point?

Adam Bosworth and Tim Bray had it right: keep it simple, and have a few laughs about the subject when you can:

I’m going to stay out of the way and watch the WS-visionaries and WS-dreamers and WS-evangelists go ahead and WS-build their WS-future. Because I’ve been wrong before, and maybe they’ll come up with something that WS-works and people want to WS-use. And if they do that, I’ll stand up and say “I was WS-wrong.”

The specs are certainly baroque enough, but from a security perspective, web services are a hard problem. The real issues boil down to mapping credentials expressed in message headers into the security regimes of the runtime environments. Put simply, you get a web services message with a header containing a Principal authorising the action. From the app's perspective it would be really nice to be able to associate that with the roles you've spent so long baking into your application. The last time I checked, neither the WebSphere stack nor the .NET stack did a good job with this; there's so many Principals floating around it's like being back in high school. So at the end of the day this means we're wading through stacks of schema, huge XML files and incredibly detailed message structures just to parse a bloody payload. The roll-your-own REST approach looks decidedly more attractive by comparison, and one hell of a lot faster.

By AnonymousCoward  Permalink
April 19, 2005 10:41 PM
Welcome_blogentry_200405_1
Greetings. This marks the inaugural blog entry for securitymetrics.org. In this space, I (and hopefully others) will be periodically writing about security measurement and metrics:
  • things that work
  • things that don't
  • discoveries and hidden gems
As someone whose day job includes looking at the security industry landscape, I'll also comment on things I see and hear that affect the metrics scene. Stay tuned.
By AnonymousCoward  Permalink


Weblog archives:
This site is not affillated with any organization, and the opinions expressed on this website are strictly those of the authors themselves.

To log in to the Securitymetrics.org website, create a profile first.

Attachments