The Design of Software (CLOSED)

A public forum for discussing the design of software, from the user interface to the code architecture. Now closed.

The "Design of Software" discussion group has been merged with the main Joel on Software discussion group.

The archives will remain online indefinitely.

Tools for SQL Dumps anonymization?

We want inject "real" customer databases, typically ERP databases, into our continuous integration processes in order to extend our automated tests coverage.

Yet, since this data is highly sensitive, we can't do it with the "raw" data, we would need to anonymize the data first. For ex:
- replace all e-mails by c001@company.com, c002@company.com
- replace all user names by made-up names user001, user002 etc

The databases are large, it's going to take us forever if we do that at by hand. Does anyone knows a tool to do that?

Best regards,
Joannès
http://www.lokad.com hosted sales forecasting
Joannes Vermorel Send private email
Friday, June 01, 2007
 
 
Hi,

You could evaluate this tool.. http://www.datamasker.com.

HTH

Regards,

Raj K
Raj Kathamuthu Send private email
Friday, June 01, 2007
 
 
Probably person who is exprienced with test automation knows some text replacement tools. I used AWK-scripts for similar needs. It is not best tool, but was one i knew.
Mikko Maunu Send private email
Friday, June 01, 2007
 
 
Some products:
http://www.compuware.com/products/fileaid/ 
(expensive but adaptable)
Datavantage
http://www.datavantage.com/products/cs/dvg-2.html 
IBM Datastage. 
Princeton Relational Tools. 

Many folks just hash the names to make new ones that start with the same initial letter, and trim it to the same length.

So the name "Peter" would probably end up as "Pytkv"
Peter Send private email
Friday, June 01, 2007
 
 
Raj, thanks for the DataMasker link, this is exactly what I am looking for. Too bad, the MySQL version is not ready yet.

Best regards,
Joannès
http://www.lokad.com hosted sales forecasting
Joannes Vermorel Send private email
Friday, June 01, 2007
 
 

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics
 
Powered by FogBugz