利用P6SPY ＋SQL Profiler记录、统计web app对数据库的操作

弄JDBC,Hibernate,iBATIS时，想显示sql语句，可以设置show_sql为true来达到这个目的，但是参数值全是像PreparedStatement一样，用?来代替的。
用p6spy和SQL Profiler可以达到显示的那些参数原值的目的，可读性很强。然后可以直接把带有参数原值的sql语句拷贝到pl/sql或TOAD中跑一下，非常容易定位sql的错误在哪里。

P6spy是一个JDBC Driver的包装工具，p6spy通过对JDBC Driver的封装以达到对SQL语句的监听和分析，以达到各种目的。

需要下载两个文件：p6spy-install.zip, sqlprofiler-0.3-bin.zip
p6spy: http://www.p6spy.com
SQL Profile: http://www.jahia.net/jahia/page597.html

p6spy安装：
* 将p6spy.jar放到WEB-INF/lib目录下, 这样应用程序很容易找到;
* 修改你 原有 JDBC Driver为：com.p6spy.engine.spy.P6SpyDriver;

?? 我是这样修改我的应用程中的jdbc.properties文件的：

jdbc1.driver=com.p6spy.engine.spy.P6SpyDriver
jdbc1.url=jdbc:oracle:thin:@192.168.0.166:1521:CSPDEV
jdbc1.username=CSP
#followed password must be encrypted by das tool.
jdbc1.password=170B0B970D2B18DA
jdbc1.dbtype=oracle

jdbc2.driver=com.p6spy.engine.spy.P6SpyDriver
jdbc2.url=jdbc:oracle:thin:@192.168.0.166:1521:CSPDEV
jdbc2.user=CSP
#followed password must be encrypted by das tool.
jdbc2.password=170B0B970D2B18DA
jdbc2.dbtype=oracle
jdbc2.level=2
jdbc2.testsql=select count(*) from dual

* 修改 spy.properties 中的 realdriver 值为 原有 的JDBC Driver，比如我的是：oracle.jdbc.driver.OracleDriver;?? 在这里需要特别注意的是,将spy.properties 放到WEB-INF\classes下不一定成功，我经过多次偿试把spy.properties 分别全放在三地方才成功的：

?????????? WEB-INF\classes????????

?????????? WEB-INF\lib???????????? --即跟p6spy.jar放在一起

?????????? %TOMCAT_HOME%\bin????????--一启动tomcat就知道

我的spy.properties文件如下：

#################################################################
# P6Spy Options File??????????????????????????????????????????? #
# See documentation for detailed instructions?????????????????? #
#################################################################

#################################################################
# MODULES?????????????????????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# Modules provide the P6Spy functionality.? If a module, such?? #
# as module_log is commented out, that functionality will not?? #
# be available.? If it is not commented out (if it is active),? #
# the functionality will be active.???????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# Values set in Modules cannot be reloaded using the??????????? #
# reloadproperties variable.? Once they are loaded, they remain #
# in memory until the application is restarted.???????????????? #
#?????????????????????????????????????????????????????????????? #
#################################################################

module.log=com.p6spy.engine.logging.P6LogFactory
#module.outage=com.p6spy.engine.outage.P6OutageFactory

#################################################################
# REALDRIVER(s)???????????????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# In your application server configuration file you replace the #
# "real driver" name with com.p6spy.engine.P6SpyDriver. This is #
# where you put the name of your real driver P6Spy can find and #
# register your real driver to do the database work.??????????? #
#?????????????????????????????????????????????????????????????? #
# If your application uses several drivers specify them in????? #
# realdriver2, realdriver3.? See the documentation for more???? #
# details.????????????????????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# Values set in REALDRIVER(s) cannot be reloaded using the????? #
# reloadproperties variable.? Once they are loaded, they remain #
# in memory until the application is restarted.???????????????? #
#?????????????????????????????????????????????????????????????? #
#################################################################

# oracle driver
# realdriver=oracle.jdbc.driver.OracleDriver

# mysql Connector/J driver
# realdriver=com.mysql.jdbc.Driver

# informix driver
# realdriver=com.informix.jdbc.IfxDriver

# ibm db2 driver
# realdriver=COM.ibm.db2.jdbc.net.DB2Driver

# the mysql open source driver
realdriver=oracle.jdbc.driver.OracleDriver

#specifies another driver to use
realdriver2=
#specifies a third driver to use
realdriver3=

#the DriverManager class sequentially tries every driver that is
#registered to find the right driver.? In some instances, it's possible to
#load up the realdriver before the p6spy driver, in which case your connections
#will not get wrapped as the realdriver will "steal" the connection before
#p6spy sees it.? Set the following property to "true" to cause p6spy to
#explicitily deregister the realdrivers
deregisterdrivers=false

################################################################
# P6LOG SPECIFIC PROPERTIES??????????????????????????????????? #
################################################################
# no properties currently available

################################################################
# EXECUTION THRESHOLD PROPERTIES?????????????????????????????? #
################################################################
# This feature applies to the standard logging of P6Spy.?????? #
# While the standard logging logs out every statement????????? #
# regardless of its execution time, this feature puts a time?? #
# condition on that logging.? Only statements that have taken? #
# longer than the time specified (in milliseconds) will be???? #
# logged.? This way it is possible to see only statements that #
# have exceeded some high water mark.????????????????????????? #
# This time is reloadable.???????????????????????????????????? #
#
# executionthreshold=integer time (milliseconds)
#
executionthreshold=

################################################################
# P6OUTAGE SPECIFIC PROPERTIES???????????????????????????????? #
################################################################
# Outage Detection
#
# This feature detects long-running statements that may be indicative of
# a database outage problem. If this feature is turned on, it will log any
# statement that surpasses the configurable time boundary during its execution.
# When this feature is enabled, no other statements are logged except the long
# running statements. The interval property is the boundary time set in seconds.
# For example, if this is set to 2, then any statement requiring at least 2
# seconds will be logged. Note that the same statement will continue to be logged
# for as long as it executes. So if the interval is set to 2, and the query takes
# 11 seconds, it will be logged 5 times (at the 2, 4, 6, 8, 10 second intervals).
#
# outagedetection=true|false
# outagedetectioninterval=integer time (seconds)
#
outagedetection=false
outagedetectioninterval=

################################################################
# COMMON PROPERTIES??????????????????????????????????????????? #
################################################################

# filter what is logged
filter=false

# comma separated list of tables to include when filtering
include???? =
# comma separated list of tables to exclude when filtering
exclude???? =

# sql expression to evaluate if using regex filtering
sqlexpression =

# turn on tracing
autoflush?? = true

# sets the date format using Java's SimpleDateFormat routine
dateformat=

#list of categories to explicitly include
includecategories=

#list of categories to exclude: error, info, batch, debug, statement,
#commit, rollback and result are valid values
excludecategories=info,debug,result,batch

#allows you to use a regex engine or your own matching engine to determine
#which statements to log
#
#stringmatcher=com.p6spy.engine.common.GnuRegexMatcher
#stringmatcher=com.p6spy.engine.common.JakartaRegexMatcher
stringmatcher=

# prints a stack trace for every statement logged
stacktrace=false
# if stacktrace=true, specifies the stack trace to print
stacktraceclass=

# determines if property file should be reloaded
reloadproperties=false
# determines how often should be reloaded in seconds
reloadpropertiesinterval=60

#if=true then url must be prefixed with p6spy:
useprefix=false

#specifies the appender to use for logging
appender=com.p6spy.engine.logging.appender.Log4jLogger
#appender=com.p6spy.engine.logging.appender.StdoutLogger
#appender=com.p6spy.engine.logging.appender.FileLogger

# name of logfile to use, note Windows users should make sure to use forward slashes in their pathname (e:/test/spy.log) (used for file logger only)
#logfile???? = spy.log

# append to? the p6spy log file.? if this is set to false the
# log file is truncated every time.? (file logger only)
append=true

#The following are for log4j logging only
log4j.appender.STDOUT=org.apache.log4j.ConsoleAppender
log4j.appender.STDOUT.layout=org.apache.log4j.PatternLayout
log4j.appender.STDOUT.layout.ConversionPattern=p6spy - %m%n

log4j.appender.SQLPROFILER_CLIENT=org.apache.log4j.net.SocketAppender
log4j.appender.SQLPROFILER_CLIENT.RemoteHost=localhost
log4j.appender.SQLPROFILER_CLIENT.Port=4445
log4j.appender.SQLPROFILER_CLIENT.LocationInfo=true

#log4j.logger.p6spy=INFO,STDOUT
log4j.logger.p6spy=DEBUG, SQLPROFILER_CLIENT

#################################################################
# DataSource replacement??????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# Replace the real DataSource class in your application server? #
# configuration with the name com.p6spy.engine.spy.P6DataSource,#
# then add the JNDI name and class name of the real ??#
# DataSource here???????????? ????#
#?????????????????????????????????????????????????????????????? #
# Values set in this item cannot be reloaded using the????????? #
# reloadproperties variable.? Once it is loaded, it remains???? #
# in memory until the application is restarted.???????????????? #
#?????????????????????????????????????????????????????????????? #
#################################################################
#realdatasource=/RealMySqlDS
#realdatasourceclass=com.mysql.jdbc.jdbc2.optional.MysqlDataSource

#################################################################
# DataSource properties???????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# If you are using the DataSource support to intercept calls??? #
# to a DataSource that requires properties for proper setup,??? #
# define those properties here. Use name value pairs, separate? #
# the name and value with a semicolon, and separate the???????? #
# pairs with commas.??????????????????????????????????????????? #
# ???????????????????????????? #
# The example shown here is for mysql ???????????????????????? #
#?????????????????????????????????????????????????????????????? #
#################################################################
#realdatasourceproperties=port;3306,serverName;ibmhost,databaseName;mydb

#################################################################
# JNDI DataSource lookup??????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# If you are using the DataSource support outside of an app???? #
# server, you will probably need to define the JNDI Context???? #
# environment.????????????????????????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
# If the P6Spy code will be executing inside an app server then #
# do not use these properties, and the DataSource lookup will?? #
# use the naming context defined by the app server.???????????? #
#?????????????????????????????????????????????????????????????? #
# The two standard elements of the naming environment are?#
# jndicontextfactory and jndicontextproviderurl. If you need??? #
# additional elements, use the jndicontextcustom property.????? #
# You can define multiple properties in jndicontextcustom,????? #
# in name value pairs. Separate the name and value with a?????? #
# semicolon, and separate the pairs with commas.??????????????? #
#?????????????????????????????????????????????????????????????? #
# The example shown here is for a standalone program running on #
# a machine that is also running JBoss, so the JDNI context???? #
# is configured for JBoss (3.0.4).????????????????????????????? #
#?????????????????????????????????????????????????????????????? #
#################################################################
#jndicontextfactory=org.jnp.interfaces.NamingContextFactory
#jndicontextproviderurl=localhost:1099
#jndicontextcustom=java.naming.factory.url.pkgs;org.jboss.nameing:org.jnp.interfaces

#jndicontextfactory=com.ibm.websphere.naming.WsnInitialContextFactory
#jndicontextproviderurl=iiop://localhost:900

SQL Profiler无须安装，直接实用
* 我们先用java -jar sqlprofiler.jar 运行 sql profiler

??? 我通常的做法是在profiler.jar 的同级目录下建一个start.bat， 只有一行代码:

??? java -jar sqlprofiler.jar

????
* 然后启动tomcat,? 执行任何SQL就会被profiler截取得。为什么要用这个工具呢？她最大的好处就是把

?? insert into?? T_UCP_CATEGORY(ID,? CATEGORYNAME,? DESCRIPTION) values(?,?,?)

? 转化成真正的SQL：

?? insert into?? T_UCP_CATEGORY(ID,? CATEGORYNAME,? DESCRIPTION) values('200704022012012','公共表','公共表类型');

一切尽在眼前了吧？

sql Profiler主要有三个按钮：清空，开始，暂停。

?? 清空： 清空原有所有日志；

???开始： 在你想截取SQL时就点开始启动监听；

?? 暂停： 暂停监听，日志就不会跳了，你可以拷贝出SQL 去PL/SQL中测试

当然，p6spy 和 sql profiler 能做的不止这些，sql profiler还能根据你的query来帮你生成建立合适的index功能等等。