Measuring your trading application performance

I completely support the idea of collaboration when it comes to sharing and reusing resources between parties. But its not easy when the involved are competing for the top spot in the league tables. However just found out about Securities Technology Analysis Centre which provide various trading systems performance benchmarks in consultation with all the big boys(council members) on the street.  Will be interesting to see how it works. Apparently your firm needs to be a member of the council to gain access to all the information and test harnesses etc. Wonder how much it costs and how much of your secret sauce you will have to divulge before you join.