Welcome
Welcome to securitymetrics.org, a community website for security practitioners. Securitymetrics.org offers a community blogging service (this page) and a members-only mailing list. See the Mailing List page for more details.

Announcing Metricon 5

Metricon 5 is the fifth annual conference dedicated to security metrics. It is a forum for presenting new approaches for measuring information security effectiveness, with a bias towards practical, specific approaches. Topics and presentations will be selected for their novelty and merit, and their potential to stimulate discussion.

With five years of organized conferences in the history books, this year's theme, appropriately, is Older But Wiser. Four years ago, presenters at the first Metricon discussed software security, benchmarking, identity management, enterprise case studies and many other topics. Since then, researchers and enterprises have continued to investigate new techniques. What have we learned? Given that we are trying to measure, measuring the security metrics field (and the success or failures of our own efforts) is also our responsibility.

The program is organized along three temporal perspectives:

  • Metrics Past. Which metrics techniques from 2006 worked, and which did not? And how can knowledge of the past inform the present and future?
  • Metrics Present. What is the state of the art as practiced today' by leading corporations, consultants and researchers?
  • Metrics Future. What new strategies for measuring security will emerge in the future?

Metricon 5 will be a one-day event, Tuesday, August 10th, 2010, co-located with the 19th USENIX Security Symposium in Washington, DC (http://www.usenix.org/events/sec10/). Metricon will begin bright and early in the morning, continue through a catered lunch in meeting room, and extend into the evening with informal discussion. Attendance will be by invitation. Capacity is limited to 60 participants.

Program

TimeTrack
0800–0900hBreakfast
0900–0930hAndrew Jaquith, Forrester Research, Welcome address and ''Five Years of Security Metrics: A Look Back''(info)
0930–1000hRichard Seiersen, Kaiser Permanente, ''Practical Security Metrics in the 4th Dimension''(info)
1000–1030hRH Powell, Akamai, ''Weathering Storms in the Cloud: Analyzing Massive Distributed Denial of Service Attacks to Better Prepare for the Future''(info)
1030–1100hMorning break
1100–1130hJohn S Quarterman, Quarterman Creations/CREC at the UT Austin School of Business, ''Spam Reputation as Output Measure of Infosec''(info)
1130–1200hGina Fisk, Los Alamos National Laboratories, ''Optimizing Performance Management using Adaptive Metrics, Fitness Functions, and the Balanced Score Card''(info)
1200–1230hFabio Massacci, Universita' di Trento, ''Which is the Right Source for Vulnerability Studies? An Empirical Analysis on Mozilla Firefox''(info)
1230–1345hLunch
1345–1415hElizabeth Nichols, PlexLogic: Security Metrics, ''Security Metrics: What’s Hot and What’s Not''(info)
1415–1445hLaura Glowick, Federal Home Loan Bank of Boston, ''Enterprise Security Dashboard''(info) also: FHLB's metrics catalog(info)
1445–1515hAfternoon break
1515–1545hAlex Hutton, Verizon Security Intelligence, ''Bridging Risk Modeling, Threat Modeling, and Operational Metrics With the VERIS Framework''(info)
1545–1615hMichael Smith, Fish Catchers Heavy Industries, ''Meta-Metrics: Building a Scorecard for the Evaluation of Security Management and Control Frameworks''(info)
1615–1730Rump session: open-mic discussion of current research and topics of shared interest
1730–Beer! Sponsored by Blue Canopy

Venue

Metricon 5 will be held at the Marriott Woodman Park Hotel, 2660 Woodley Road Northwest, Washington, DC, on August 10th, 2010. It is co-located with the USENIX Security 2010 Symposium.

Event Sponsors

BlueCanopy_Logo_04032010.png

Attendance

Attendance is by invitation only. If you would like to attend, send an e-mail to metricon5 at securitymetrics dot org.

All participants will be expected to "come with findings" and be willing to contribute to group discussions. Politeness will be praised; questions, encouraged; lurkers, flushed out.

The proceedings of all past meetings are available here:

For speakers

  • Deadline for final presentation: July 30th, 2010

Conference chairs

  • Andrew Jaquith, Forrester Research
  • Khalid Kark, Forrester Research

Program committee members

  • Jennifer Bayuk, Stevens Institute of Technology
  • Dan Geer, In-Q-Tel
  • Chris Walsh, SurePayroll
  • Wade Baker, Verizon Risk Intelligence
  • Ray Kaplan, Ray Kaplan & Associates
  • Michael Smith, Akamai Technologies
  • Daniel Arista, Syracuse Research Corporation

Mini MetriCon 4.5

Mini MetriCon 4.5 was held Monday, March 1, 2010, in SanFrancisco, California, adjacent to the USA RSA 2010 Conference. The presentations are posted as embedded links in the agenda; the original CFP remains available as well.

MetriCon 4.0

MetriCon 4.0 was held Tuesday, August 11, 2009, in Montreal, Quebec, co-located with the USENIX Security Symposium. See the MetriCon 4.0 page for the details of the meeting, including its CFP, the final agenda, and the meeting's Digest.

Mini MetriCon 3.5

Mini MetriCon 3.5 was held Monday, April 20, 2009, in SanFrancisco, California, adjacent to the USA RSA 2009 Conference. The presentations are posted as embedded links in the agenda; the original CFP remains available as well. Sadly, no Digest was ever completed.

MetriCon 3.0

The MetriCon 3.0 presentations and digest are available as attachments to the final agenda

Mini MetriCon 2.5 Presentations

The MiniMetriCon 2.5 presentations are available as attachments to the final agenda.


Metrics Catalog Project:

The Metrics Catalog Project was officially launched in June 2008. A major revision has been made available as of April 2009. To see the catalog on-line you can visit:

General information about the Metrics Catalog can be found in the following documents:

BEWARE: You will need a Javascript and Java enabled browser to optimally experience the content on these sites. Due to circumstances beyond our control, we cannot support any browser on Vista.

--Elizabeth Nichols, 3-July-2009

Logged in? Add a New entry to this blog!

February 14, 2007 11:21 AM
Ryan, Joe, Joanna, and the “Serious Hole” in Vista's UAC
ZDNet's Ryan Naraine blogs about Joanna Rutkowska's blog post on Vista security. Joanna pointed out that Vista's Mandatory Integrity Control feature has a few implementation flaws and seems to default to prompting for admin credentials whenever setup apps run. EWeek's Joe Wilcox asked me to comment on the imbroglio which I was happy to do. I also posted a lengthy comment on Joe's story, which for posterity I reprint here.

Reprinted from eWeek posting

One point of clarification about Joanna's comment on setup programs needing admin permission. The issue is that Vista doesn't necessarily know what permissions the files in an application might need. That's because legacy setup programs are just big executables (EXEs). InstallShield, for example, will take a developer's application and jam it into a big program. To Vista, the EXE is opaque, a blob. It can't know that the files the setup program wants to install need to go into Windows\System32, for example — which would need elevated privileges to install. Or, the files could be 100% local, and not need extra privileges to install. So, to be safe, Vista takes the position that it will need admin permissions to run.

This behavior is basically Microsoft needing to deal with how older setup applications have always worked since the early days of Windows. (Vista *does* have a newer format that allows permissions to be explicitly defined ahead of time, but few applications use this... today.) Other operating systems do things differently, which was the point of my comments to Joe.

Example: OS X has two installation methods: drag-install or via a setup package. The drag-install method is what you see in 75% of the apps out there: you mount the disk image and simply drag the application icon to where you want it. Because the icon is actually a directory, all of its contents come with it. Assuming you don't drag the application to a sensitive directory, you won't get prompted. Personally, I love this feature and think it's incredibly intuitive and natural — why "run a setup program" when you can simply move the app to where you want it?

The second OS X method involves running an actual setup program. In this case, the installer inspects what is called a Bill of Materials (BOM) that specifies exactly what files should be installed, and what privileges they require. The installer uses the BOM to determine whether it needs elevated privilges to install the app. Apple's BOM method isn't perfect, but it works quite well for the most part.

In UNIX, the prevailing installer methods are either simply file copies (like when you compile an application and type "make install") or a package format like Debian's APT or Red Hat's RPM, which have "manifests" in them enumerating what files need to be installed. In these cases, the installers either will make a determination that you need (or don't need) elevated privileges, or will simply fail to install unless you elevate.

My point with this lengthy post isn't to suggest that Linux or Mac are better, although I do believe in this case they've had the benefit of learning from the legacy Windows installer experiences. Vista's next-generation technologies for this are promising, but for now we've got a whole boatload of legacy stuff to deal with. Hence Joanna's objection.

By Andrew Jaquith  Permalink
February 5, 2007 1:39 PM
Live Blog from Mini-Metricon at RSA
Hi everybody. The redoubtable Fred Cohen has organized Mini-Metricon today, Monday February 5th at the University of San Francisco. Sponsors are the University of San Francisco and the University of New Haven.

We are here conversing about metrics. Attendees (about 26) include Fred, Betsy Nichols, Russell Thomas, Jason Zann, Mark Kadrich, Andy Sudbury, Phebe Waterfield, Jeremy Epstein, Brian Darby, Kedar Dhuru, Eddie Schwartz, Raffael Marty. Keynote speaker is John Guinasso, CISO of Business Objects. Agenda:

0900: As attendees arrive, round table discussions start on the needs for and applications of metrics.
1000: Each round table will present a briefing on the discussions held.
1015: Welcome and introduction to the conference by our hosts.
1030: Keynote: John Guinasso, CISO: “What I get today and what I wish I had for security metrics”
1045: Russell Cameron Thomas - “Total Cost of (In)security.” - 30-minute talk (+ discussions).
1130: Technology demonstrations (not products - technologies).
1145: Lunch break – proceed to the campus eateries for lunch.
1245: Round table discussions start on criteria for the acceptance and utility of metrics.
1345: Each round table will present a briefing on the discussions held.
1400: Fred Cohen - “A Fault Model ... for Metrics” 30-minute (+ discussions).
1445: Afternoon break
1500: Mini-talks and impromptu group discussions by participants AND planning for MetriCon '07
1600: Summary of the day

Full agenda is on Fred's website

By Andrew Jaquith  Permalink


Weblog archives:
This site is not affillated with any organization, and the opinions expressed on this website are strictly those of the authors themselves.

To log in to the Securitymetrics.org website, create a profile first.

Attachments