State of Arizona
Office
of the
Auditor General
PERFORMANCE AUDIT
Report to the Arizona Legislature
By Debra K. Davenport
Acting Auditor General
August 1999
Report No. 99-13
BOARD OF
PSYCHOLOGIST
EXAMINERS
7KH $XGLWRU *HQHUDO LV DSSRLQWHG E\ WKH -RLQW /HJLVODWLYH $XGLW &RPPLWWHH D ELSDUWLVDQ FRPPLWWHH
FRPSRVHG RI ILYH VHQDWRUV DQG ILYH UHSUHVHQWDWLYHV +LV PLVVLRQ LV WR SURYLGH LQGHSHQGHQW DQG LPSDU
WLDO LQIRUPDWLRQ DQG VSHFLILF UHFRPPHQGDWLRQV WR LPSURYH WKH RSHUDWLRQV RI VWDWH DQG ORFDO JRYHUQPHQW
HQWLWLHV 7R WKLV HQG KH SURYLGHV ILQDQFLDO DXGLWV DQG DFFRXQWLQJ VHUYLFHV WR WKH VWDWH DQG SROLWLFDO
VXEGLYLVLRQV DQG SHUIRUPDQFH DXGLWV RI VWDWH DJHQFLHV DQG WKH SURJUDPV WKH\ DGPLQLVWHU
The Joint Legislative Audit Committee
6HQDWRU 7RP 6PLWK &KDLUPDQ
5HSUHVHQWDWLYH 5REHUWD 9RVV 9LFH &KDLUPDQ
6HQDWRU .HLWK %HH 5HSUHVHQWDWLYH 5REHUW %XUQV
6HQDWRU +HUE *XHQWKHU 5HSUHVHQWDWLYH .HQ &KHXYURQW
6HQDWRU 'DUGHQ +DPLOWRQ 5HSUHVHQWDWLYH $QG\ 1LFKROV
6HQDWRU 3HWH 5LRV 5HSUHVHQWDWLYH %DUU\ :RQJ
6HQDWRU %UHQGD %XUQV 5HSUHVHQWDWLYH -HII *URVFRVW
H[ RIILFLR H[ RIILFLR
Audit Staff
0HODQLH &KHVQH\³0DQDJHU
DQG &RQWDFW 3HUVRQ
6X]DQQH 0DUHWWH³$XGLW 6HQLRU
&KDUOHV 0F7KHQ\³6WDII
&RSLHV RI WKH $XGLWRU *HQHUDO·V UHSRUWV DUH IUHH
<RX PD\ UHTXHVW WKHP E\ FRQWDFWLQJ XV DW
2IILFH RI WKH $XGLWRU *HQHUDO
1 WK 6WUHHW 6XLWH
3KRHQL[ $=
$GGLWLRQDOO\ PDQ\ RI RXU UHSRUWV FDQ EH IRXQG LQ HOHFWURQLF IRUPDW DW
ZZZ DXGLWRUJHQ VWDWH D] XV
2910 NORTH 44th STREET • SUITE 410 • PHOENIX, ARIZONA 85018 • (602) 553-0333 • FAX (602) 553-0051
DOUGLAS R. NORTON, CPA
AUDITOR GENERAL
DEBRA K. DAVENPORT, CPA
DEPUTY AUDITOR GENERAL
STATE OF ARIZONA
OFFICE OF THE
AUDITOR GENERAL
$XJXVW
0HPEHUV RI WKH $UL]RQD /HJLVODWXUH
7KH +RQRUDEOH -DQH 'HH +XOO *RYHUQRU
0V 0D[LQH 0F&DUWK\ ([HFXWLYH 'LUHFWRU
%RDUG RI 3V\FKRORJLVW ([DPLQHUV
7UDQVPLWWHG KHUHZLWK LV D UHSRUW RI WKH $XGLWRU *HQHUDO $ 3HUIRUPDQFH $XGLW RI WKH
%RDUG RI 3V\FKRORJLVW ([DPLQHUV 7KLV UHSRUW LV LQ UHVSRQVH WR D 0D\
UHVROXWLRQ RI WKH -RLQW /HJLVODWLYH $XGLW &RPPLWWHH 7KH SHUIRUPDQFH DXGLW ZDV
FRQGXFWHG DV SDUW RI WKH 6XQVHW UHYLHZ VHW IRUWK LQ $ 5 6 WKURXJK
:H IRXQG WKDW WKH %RDUG JHQHUDOO\ IXOILOOV LWV UHVSRQVLELOLWLHV HIILFLHQWO\ DQG HIIHFWLYHO\
7KH %RDUG LVVXHV OLFHQVHV LQ D WLPHO\ PDQQHU UHVROYHV FRPSODLQWV DSSURSULDWHO\ DQG
WLPHO\ DQG SURYLGHV DFFXUDWH DQG FRPSOHWH LQIRUPDWLRQ WR WKH SXEOLF +RZHYHU ZH
IRXQG SUREOHPV LQ WKH ZD\ WKH %RDUG DGPLQLVWHUHG LWV RUDO H[DP³WKH ILQDO VWHS WR
UHFHLYH D OLFHQVH 7KHUH ZHUH D QXPEHU RI H[DPLQHU HUURUV DQG ZH IRXQG WKH %RDUG GLG
QRW FRQVLVWHQWO\ IROORZ LWV SURFHGXUHV 3UREOHPV ZLWK WKH H[DPV OHG WKH %RDUG RQ
VHYHUDO RFFDVLRQV WR UHYLHZ DQG ODWHU FKDQJH WR SDVVLQJ WKH VFRUHV RI D QXPEHU RI
SHUVRQV ZKR RULJLQDOO\ IDLOHG WKH H[DPV 5HDFWLQJ WR SUREOHPV ZH LGHQWLILHG WKH %RDUG
GLVFRQWLQXHG WKH RUDO H[DP EHIRUH WKLV DXGLW UHSRUW ZDV LVVXHG
7KLV UHSRUW DOVR DGGUHVVHV WKH SRWHQWLDO EHQHILWV RI LQFUHDVLQJ SXEOLF PHPEHU
UHSUHVHQWDWLRQ RQ WKH %RDUG DQG WKH QHHG IRU WKH %RDUG WR VHHN VWDWXWRU\ DXWKRULW\ WR
NHHS LWV OLFHQVXUH FDQGLGDWHV· H[DP VFRUHV FRQILGHQWLDO
$V RXWOLQHG LQ LWV UHVSRQVH WKH %RDUG DJUHHV ZLWK DOO RI WKH UHSRUW·V ILQGLQJV DQG DOO EXW
RQH RI WKH UHFRPPHQGDWLRQV ,Q SDUWLFXODU WKH %RDUG KDV DOUHDG\ DGGUHVVHG WKH LVVXHV
UDLVHG LQ )LQGLQJ , RI WKH UHSRUW VHH SDJHV WKURXJK E\ GLVFRQWLQXLQJ LWV RUDO H[DP
LQ -XQH +RZHYHU WKH %RDUG GRHV QRW DJUHH ZLWK WKH UHFRPPHQGDWLRQ WKDW WKH
$XJXVW
3DJH
/HJLVODWXUH FRQVLGHU FKDQJLQJ WKH %RDUG·V VWDWXWRU\ FRPSRVLWLRQ WR LQFUHDVH WKH SXEOLF
PHPEHUVKLS SHUFHQWDJH RQ WKH %RDUG VR WKDW LW LV FORVHU WR SHUFHQW
0\ VWDII DQG , ZLOO EH SOHDVHG WR GLVFXVV RU FODULI\ LWHPV LQ WKH UHSRUW
7KLV UHSRUW ZLOO EH UHOHDVHG WR WKH SXEOLF RQ $XJXVW
6LQFHUHO\
'HEELH 'DYHQSRUW
$FWLQJ $XGLWRU *HQHUDO
(QFORVXUH
L
2)),&( 2) 7+( $8',725 *(1(5$/
SUMMARY
7KH 2IILFH RI WKH $XGLWRU *HQHUDO KDV FRQGXFWHG D SHUIRUPDQFH
DXGLW DQG 6XQVHW UHYLHZ RI WKH %RDUG RI 3V\FKRORJLVW ([DPLQ
HUV %RDUG SXUVXDQW WR D 0D\ UHVROXWLRQ RI WKH -RLQW
/HJLVODWLYH $XGLW &RPPLWWHH 7KH DXGLW ZDV FRQGXFWHG DV SDUW
RI WKH 6XQVHW UHYLHZ VHW IRUWK LQ $UL]RQD 5HYLVHG 6WDWXWHV
$ 5 6 WKURXJK
7KH %RDUG·V UHVSRQVLELOLWLHV LQFOXGH LVVXLQJ DQG UHQHZLQJ OL
FHQVHV WR TXDOLILHG SV\FKRORJLVWV FRQGXFWLQJ LQYHVWLJDWLRQV DQG
KHDULQJV FRQFHUQLQJ XQSURIHVVLRQDO FRQGXFW GLVFLSOLQLQJ YLR
ODWRUV DQG SURYLGLQJ FRQVXPHU LQIRUPDWLRQ WR WKH SXEOLF &XU
UHQWO\ WKH %RDUG OLFHQVHV DSSUR[LPDWHO\ SV\FKRORJLVWV
7KLV DXGLW IRXQG WKDW LQ PRVW UHVSHFWV WKH %RDUG IXOILOOV LWV UH
VSRQVLELOLWLHV HIILFLHQWO\ DQG HIIHFWLYHO\ 2Q DYHUDJH WKH %RDUG
UHFHLYHV DSSUR[LPDWHO\ FRPSODLQWV D \HDU DQG UHVROYHV WKHP
DSSURSULDWHO\ DQG LQ D WLPHO\ PDQQHU 7KH %RDUG DOVR LVVXHV
OLFHQVHV LQ D WLPHO\ PDQQHU DQG SURYLGHV DFFXUDWH FRPSOHWH
DQG DFFHVVLEOH LQIRUPDWLRQ WR FRQVXPHUV +RZHYHU WKH %RDUG
KDV H[SHULHQFHG SUREOHPV ZLWK WKH RUDO H[DPLQDWLRQ LW KDV XVHG
WR DVVHVV ZKHWKHU FDQGLGDWHV DUH TXDOLILHG WR SUDFWLFH DV SV\
FKRORJLVWV
Board Has Experienced
Problems with Oral Exam
(See pages 9 through 18)
7KLV DXGLW LGHQWLILHG QXPHURXV SUREOHPV ZLWK WKH DGPLQLVWUD
WLRQ RI WKH %RDUG·V RUDO H[DP $IWHU DXGLW UHVHDUFK ZDV FRP
SOHWHG WKH %RDUG YRWHG DW LWV -XQH PHHWLQJ WR GLVFRQWLQXH
WKH XVH RI LWV RUDO H[DP GXH WR D ODFN RI UHVRXUFHV 7KLV H[DP
ZKLFK ZDV WDNHQ DIWHU D FDQGLGDWH KDG PHW WUDLQLQJ DQG H[SHUL
HQFH UHTXLUHPHQWV DQG SDVVHG D QDWLRQDO ZULWWHQ H[DP WHVWHG
IRU UHTXLUHPHQWV WKDW ZHUH VSHFLILF WR SUDFWLFLQJ LQ $UL]RQD $V
WKH ODVW VWHS LQ WKH %RDUG·V OLFHQVLQJ SURFHVV LWV DFFXUDF\ LQ GH
WHUPLQLQJ ZKLFK FDQGLGDWHV DUH TXDOLILHG WR SUDFWLFH ZDV WKHUH
IRUH H[WUHPHO\ LPSRUWDQW 5HYLHZ RI WKH ODVW WKUHH VHWV RI H[DP
6XPPDU\
LL
2)),&( 2) 7+( $8',725 *(1(5$/
UHVXOWV VKRZHG WKDW H[DPLQHUV UHSHDWHGO\ PDGH PLVWDNHV LQ
HYDOXDWLQJ FDQGLGDWHV· UHVSRQVHV 7KH %RDUG DWWHPSWHG WR DG
GUHVV WKHVH PLVWDNHV E\ OLVWHQLQJ WR H[DP WDSH UHFRUGLQJV WR UH
VFRUH IDLOLQJ H[DPV DQG FKDQJH WKH RXWFRPH IURP IDLO WR SDVV
IRU VRPH FDQGLGDWHV +RZHYHU WKH DFWLRQV WDNHQ ZHUH LQFRQ
VLVWHQW IURP FDQGLGDWH WR FDQGLGDWH )RU H[DPSOH WKH %RDUG
UHYLHZHG WKH FRPSOHWH WDSH UHFRUGLQJV RI WKH H[DPV IRU FDQ
GLGDWHV ZKR IDLOHG EXW GLG QRW UHYLHZ WKH FRPSOHWH WDSH UH
FRUGLQJ RI WKH H[DP IRU DQRWKHU FDQGLGDWH ZKRVH ILQDO VFRUH
ZDV RQO\ SHUFHQW EHORZ SDVVLQJ
7KHVH SUREOHPV VWHP IURP WKH %RDUG·V QRW WDNLQJ WKH QHFHVVDU\
VWHSV WR GHYHORS DQG DGPLQLVWHU LWV H[DP DSSURSULDWHO\ $O
WKRXJK WKH H[DP·V FRQWHQW LV DSSURSULDWH WKH H[DP LV GHILFLHQW
LQ RWKHU UHVSHFWV VXFK DV WKH ODFN RI D FOHDU UDWLRQDOH IRU ZK\ LWV
´SDVV SRLQWµ VFRUH RI SHUFHQW LV WKH DSSURSULDWH GLYLGLQJ OLQH
EHWZHHQ SDVVLQJ DQG IDLOLQJ 7UDLQLQJ SURYLGHG WR H[DPLQHUV LV
QRW VXIILFLHQW FHUWDLQ ERDUG SROLFLHV UHJDUGLQJ WKH H[DP DUH QRW
EHLQJ IROORZHG DQG WKH %RDUG·V TXDOLW\ FRQWURO SURFHVV IDLOHG WR
LGHQWLI\ H[DPLQHU HUURU DQG HQVXUH DFFXUDWH VFRUHV
7KH %RDUG KDV VHYHUDO RSWLRQV IRU DGGUHVVLQJ WKHVH SUREOHPV
)LUVW WKH %RDUG FRXOG LQYHVW WKH DGGLWLRQDO UHVRXUFHV DQG HIIRUW
WR HQVXUH LWV RUDO H[DP LV DSSURSULDWH 6HFRQG WKH %RDUG FRXOG
UHSODFH LWV RZQ RUDO H[DP ZLWK RQH FXUUHQWO\ EHLQJ GHYHORSHG
E\ WKH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO 3V\FKRORJ\ %RDUGV
7KLUG WKH %RDUG FRXOG GLVFRQWLQXH LWV RUDO H[DP DV LW YRWHG WR
GR DW LWV -XQH PHHWLQJ )RXUWK LI WKH %RDUG ZLVKHV WR IXU
WKHU DVVHVV D FDQGLGDWH·V TXDOLILFDWLRQV EH\RQG WKH QDWLRQDO
ZULWWHQ H[DP DOUHDG\ EHLQJ XVHG LW FRXOG GHYHORS D PRUH OLP
LWHG ZULWWHQ H[DP WR WHVW RQO\ DQ DSSOLFDQW·V NQRZOHGJH UH
JDUGLQJ $UL]RQD ODZ DV RWKHU $UL]RQD UHJXODWRU\ ERDUGV GR
Other Pertinent Information
(See pages 19 through 21)
,Q DGGLWLRQ WR DVVHVVLQJ WKH %RDUG·V SHUIRUPDQFH DXGLWRUV DOVR
JDWKHUHG LQIRUPDWLRQ UHJDUGLQJ UHFLSURFLW\ RSWLRQV WKDW FRXOG
PDNH LW HDVLHU IRU DSSOLFDQWV DOUHDG\ OLFHQVHG E\ DQRWKHU VWDWH WR
JHW D OLFHQVH LQ $UL]RQD 0RVW RI WKHVH RSWLRQV ZRXOG UHTXLUH
VWDWXWRU\ FKDQJHV WR FXUUHQW OLFHQVLQJ UHTXLUHPHQWV LQ $UL]RQD
7KH %RDUG LV FXUUHQWO\ FRQVLGHULQJ D FRXSOH RI WKHVH RSWLRQV
6XPPDU\
LLL
2)),&( 2) 7+( $8',725 *(1(5$/
Sunset Factors
(See pages 23 through 29)
$V SDUW RI WKH 6XQVHW UHYLHZ SURFHVV WKLV DXGLW UHFRPPHQGV
LQFUHDVLQJ WKH QXPEHU RI SXEOLF PHPEHUV RQ WKH %RDUG 7KH
PHPEHU %RDUG FXUUHQWO\ KDV SXEOLF PHPEHUV 3DVW $XGLWRU
*HQHUDO UHSRUWV KDYH UHFRPPHQGHG WKDW UHJXODWRU\ ERDUGV
KDYH SHUFHQW SXEOLF PHPEHUVKLS WR LQFUHDVH WKH SRWHQWLDO IRU
SXEOLF DGYRFDF\ 7KH /HJLVODWXUH VKRXOG FRQVLGHU DPHQGLQJ
$ 5 6 WR LQFUHDVH WKH SXEOLF PHPEHUVKLS SHUFHQWDJH
RQ WKH %RDUG VR WKDW LW LV FORVHU WR SHUFHQW ,W LV DOVR LPSRUWDQW
WKDW WKHVH SXEOLF PHPEHUV EH VHOHFWHG DQG WUDLQHG WR LQFUHDVH
WKH SRWHQWLDO IRU WKHP WR IXOILOO WKHLU SXEOLF DGYRFDF\ UROH VXF
FHVVIXOO\
7KLV DXGLW DOVR UHFRPPHQGV WKDW WKH %RDUG PDNH FKDQJHV WR
EHWWHU FRPSO\ ZLWK 2SHQ 0HHWLQJ /DZV DQG WR EHWWHU SURWHFW
WKH FRQILGHQWLDOLW\ RI FDQGLGDWHV· H[DP VFRUHV $OWKRXJK WKH
%RDUG FRPSOLHV ZLWK PRVW UHTXLUHPHQWV RI WKH 2SHQ 0HHWLQJ
/DZV LW KDV KLVWRULFDOO\ GLVFXVVHG LVVXHV UHJDUGLQJ LWV RUDO
H[DP LQ ([HFXWLYH 6HVVLRQ +RZHYHU WKH %RDUG·V VWDWXWRU\
DXWKRULW\ IRU GLVFXVVLQJ PDWWHUV LQ ([HFXWLYH 6HVVLRQ GRHV QRW
H[WHQG WR LVVXHV UHODWHG WR WKH RUDO H[DP $V RI LWV $SULO
ERDUG PHHWLQJ WKH %RDUG KDV GLVFRQWLQXHG WKLV SUDFWLFH DQG
VKRXOG HQVXUH WKDW DOO IXWXUH GLVFXVVLRQV RQ WKLV WRSLF DUH FRQ
GXFWHG GXULQJ WKH SXEOLF VHVVLRQ RI ERDUG PHHWLQJV )XUWKHU
WKLV DXGLW UHFRPPHQGV WKDW WKH /HJLVODWXUH FRQVLGHU DPHQGLQJ
WKH %RDUG·V VWDWXWHV WR NHHS LQGLYLGXDO FDQGLGDWHV· H[DP VFRUHV
FRQILGHQWLDO LQ RUGHU WR SURWHFW WKHLU SULYDF\ 2WKHU UHJXODWRU\
ERDUGV LQ $UL]RQD KDYH WKLV DXWKRULW\
6XPPDU\
LY
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
Y
2)),&( 2) 7+( $8',725 *(1(5$/
TABLE OF CONTENTS
Page
Introduction and Background.......................... 1
Finding I: Board Has Experienced
Problems with Oral Exam............................ 9
2UDO ([DP )LQDO
6WHS IRU /LFHQVXUH
%RDUG ([SHULHQFHG
3UREOHPV ZLWK
2UDO ([DP
%RDUG 'RHV 1RW (QVXUH
([DP ,V 'HYHORSHG DQG
$GPLQLVWHUHG $SSURSULDWHO\
%RDUG +DV 2SWLRQV
WR $GGUHVV 3UREOHPV
5HFRPPHQGDWLRQV
Other Pertinent Information............................. 19
5HFLSURFLW\
2SWLRQV ([LVW
Sunset Factors.................................................. 23
Agency Response
Appendix............................................................ a-i
Table
7DEOH $UL]RQD 6WDWH %RDUG RI 3V\FKRORJLVW ([DPLQHUV·
6WDWHPHQW RI 5HYHQXHV ([SHQGLWXUHV DQG
&KDQJHV LQ )XQG %DODQFH
<HDUV (QGHG -XQH DQG
8QDXGLWHG
YL
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
2)),&( 2) 7+( $8',725 *(1(5$/
INTRODUCTION AND BACKGROUND
7KH 2IILFH RI WKH $XGLWRU *HQHUDO KDV FRQGXFWHG D SHUIRUPDQFH
DXGLW DQG 6XQVHW UHYLHZ RI WKH %RDUG RI 3V\FKRORJLVW ([DPLQ
HUV %RDUG SXUVXDQW WR D 0D\ UHVROXWLRQ RI WKH -RLQW
/HJLVODWLYH $XGLW &RPPLWWHH 7KH DXGLW ZDV FRQGXFWHG DV SDUW
RI WKH 6XQVHW UHYLHZ VHW IRUWK LQ $UL]RQD 5HYLVHG 6WDWXWHV
$ 5 6 WKURXJK
Board Responsibilities
/DZV &KDSWHU HVWDEOLVKHG WKH $UL]RQD %RDUG RI
3V\FKRORJLVW ([DPLQHUV ,QLWLDOO\ WKH %RDUG UHJXODWHG SV\
FKRORJLVWV E\ FHUWLI\LQJ WKHP ,Q WKH %RDUG·V VWDWXWHV ZHUH
DPHQGHG WR LQFUHDVH WKH OHYHO RI UHJXODWLRQ IURP FHUWLILFDWLRQ WR
OLFHQVXUH WKHUHE\ GHILQLQJ WKH SUDFWLFH RI SV\FKRORJ\ 7KH
%RDUG·V PLVVLRQ LV
7R SURWHFW WKH KHDOWK VDIHW\ DQG ZHOIDUH RI $UL]RQD FLWL
]HQV E\ UHJXODWLQJ WKH SV\FKRORJ\ SURIHVVLRQ
7KH %RDUG DFFRPSOLVKHV WKLV PLVVLRQ E\ SHUIRUPLQJ D YDULHW\ RI
IXQFWLRQV LQFOXGLQJ HQVXULQJ WKDW SHUVRQV SUDFWLFLQJ SV\FKRO
RJ\ SRVVHVV UHTXLUHG TXDOLILFDWLRQV E\ LVVXLQJ DQG UHQHZLQJ
OLFHQVHV FRQGXFWLQJ LQYHVWLJDWLRQV DQG KHDULQJV FRQFHUQLQJ
XQSURIHVVLRQDO FRQGXFW GLVFLSOLQLQJ YLRODWRUV DQG SURYLGLQJ
FRQVXPHU LQIRUPDWLRQ WR WKH SXEOLF &XUUHQWO\ WKH %RDUG OL
FHQVHV DSSUR[LPDWHO\ SV\FKRORJLVWV DQG RQ DYHUDJH UH
FHLYHV DSSUR[LPDWHO\ FRPSODLQWV D \HDU
Statutory Licensure
Requirements
7KH %RDUG·V VWDWXWHV DQG UXOHV FRQWDLQ WKH IROORZLQJ JHQHUDO
HGXFDWLRQ H[SHULHQFH DQG H[DPLQDWLRQ UHTXLUHPHQWV IRU SV\
FKRORJLVW OLFHQVXUH
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
n $ GRFWRUDO GHJUHH LQ FOLQLFDO HGXFDWLRQDO RU DSSOLHG SV\
FKRORJ\ IURP DQ DFFUHGLWHG SV\FKRORJ\ SURJUDP LQFOXGLQJ
VSHFLILF FRXUVHZRUN KRXU UHTXLUHPHQWV LQ VXEMHFWV VXFK DV
HWKLFV DQG WUHDWPHQW
n &RPSOHWLRQ RI D KRXU LQWHUQVKLS VXSHUYLVHG E\ D OL
FHQVHG SV\FKRORJLVW WKDW LQFOXGHV UHTXLUHPHQWV IRU VSHFLILF
KRXUV RI FOLHQW FRQWDFW DQG VXSHUYLVLRQ
n &RPSOHWLRQ RI D KRXU SRVW GRFWRUDO VXSHUYLVHG H[SH
ULHQFH RYHUVHHQ E\ D OLFHQVHG SV\FKRORJLVW ZKR KDV OHJDO
UHVSRQVLELOLW\ IRU WKH LQWHUQ·V DFWLRQV DQG
n 3DVVDJH RI WKH QDWLRQDO ZULWWHQ H[DPLQDWLRQ ZLWK D SHU
FHQW SRLQW VFRUH
$ 5 6 UHTXLUHV D ZULWWHQ H[DP DQG DOORZV WKH %RDUG WR
LPSOHPHQW DQ DGGLWLRQDO H[DPLQDWLRQ WR FRYHU DUHDV VXFK DV
HWKLFV DQG RWKHU DUHDV WKH %RDUG GHWHUPLQHV DUH VXLWDEOH )URP
XQWLO LWV -XQH PHHWLQJ WKH %RDUG FKRVH WR LPSOHPHQW
DQ RUDO H[DP )LQGLQJ , RI WKLV UHSRUW VHH SDJHV WKURXJK
FRQWDLQV LQIRUPDWLRQ UHJDUGLQJ SUREOHPV WKH %RDUG H[SHUL
HQFHG ZLWK LWV RUDO H[DP
Organization and Staffing
7KH %RDUG FRQVLVWV RI QLQH JRYHUQRU DSSRLQWHG PHPEHUV ZKR
VHUYH ILYH \HDU WHUPV 6HYHQ RI WKH PHPEHUV PXVW EH OLFHQVHG
SV\FKRORJLVWV $W OHDVW WZR RI WKH SV\FKRORJLVW PHPEHUV PXVW
EH IXOO WLPH IDFXOW\ PHPEHUV IURP WKH VWDWH XQLYHUVLWLHV DQG DW
OHDVW WKUHH PXVW EH LQ SURIHVVLRQDO SUDFWLFH %RDUG VWDWXWH DOVR
UHTXLUHV WZR SXEOLF PHPEHUV %RDUG PHPEHUV DOVR VHUYH RQ
FRPPLWWHHV ZLWK LQGLYLGXDO UHVSRQVLELOLWLHV VXFK DV RUDO H[DPV
RIILFH RSHUDWLRQV DQG OLFHQVH DSSOLFDWLRQV
7KH %RDUG LV DXWKRUL]HG IRXU )7(V ZKR SURYLGH DVVLVWDQFH DQG
VXSSRUW WR WKH %RDUG DQG LWV FRPPLWWHHV $Q H[HFXWLYH GLUHFWRU
PRQLWRUV FRPSOLDQFH ZLWK %RDUG RUGHUV DQG RYHUVHHV WKH VWDII
ZKR DUH UHVSRQVLEOH IRU FROOHFWLQJ DSSOLFDWLRQ UHQHZDO DQG
RWKHU IHHV SURFHVVLQJ DSSOLFDWLRQ ILOHV LQYHVWLJDWLQJ FRP
SODLQWV DQG SURYLGLQJ LQIRUPDWLRQ WR WKH SXEOLF
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
Budget
7KH /HJLVODWXUH DSSURSULDWHV PRQLHV WR WKH %RDUG IURP WKH
%RDUG RI 3V\FKRORJLVW ([DPLQHUV· )XQG 7KLV IXQG FRQWDLQV
UHYHQXHV GHULYHG SULQFLSDOO\ IURP WKH %RDUG·V FROOHFWLRQ RI OL
FHQVXUH DSSOLFDWLRQ DQG UHQHZDO IHHV 7KH %RDUG GHSRVLWV
SHUFHQW RI LWV UHYHQXHV LQWR WKH %RDUG RI 3V\FKRORJLVW ([DPLQ
HUV· )XQG DQG UHPLWV WKH UHPDLQLQJ SHUFHQW WR WKH 6WDWH *HQ
HUDO )XQG 7DEOH VHH SDJH LOOXVWUDWHV WKH %RDUG·V DFWXDO DQG
HVWLPDWHG UHYHQXHV DQG H[SHQGLWXUHV IRU ILVFDO \HDUV
WKURXJK
Generally Board Is
Efficient and Effective
7KH %RDUG JHQHUDOO\ DSSHDUV WR IXOILOO LWV UHVSRQVLELOLWLHV HIIL
FLHQWO\ DQG HIIHFWLYHO\ +RZHYHU WKH %RDUG KDV H[SHULHQFHG
SUREOHPV UHODWHG WR LWV RUDO H[DP VHH )LQGLQJ , SDJHV
WKURXJK
%RDUG LVVXHV OLFHQVHV LQ D WLPHO\ PDQQHU³2QFH DQ DSSOLFDQW
PHHWV DOO OLFHQVXUH UHTXLUHPHQWV WKH %RDUG LVVXHV D OLFHQVH LQ D
WLPHO\ PDQQHU 8QWLO -XQH WKH %RDUG·V DSSOLFDWLRQ SURFHVV
UHTXLUHG DSSOLFDQWV WR VXEPLW D FRPSOHWH DSSOLFDWLRQ DQG EH
GHHPHG TXDOLILHG E\ WKH %RDUG SULRU WR WDNLQJ WKH WZR UHTXLUHG
H[DPV WKDW ZHUH RIIHUHG WZLFH D \HDU $V D UHVXOW WKH %RDUG
LVVXHG OLFHQVHV RQO\ WZR WLPHV D \HDU DIWHU WKH RUDO H[DPV 7R
DVVHVV WKH WLPHOLQHVV RI WKH %RDUG·V OLFHQVXUH DSSOLFDWLRQ SURF
HVV DXGLWRUV FDOFXODWHG WKH GD\V EHWZHHQ WKH DSSOLFDQW·V RUDO
H[DP GDWH DQG WKH GDWH WKH %RDUG LVVXHG WKH DSSOLFDQW·V OLFHQVH
)RU WKH SDVW WZR ILVFDO \HDUV RQ DYHUDJH WKH %RDUG WRRN GD\V
WR LVVXH D OLFHQVH 7KLV WLPH LQFOXGHV VFRULQJ WKH H[DP DQG
ZDLWLQJ XQWLO DFWLRQ FDQ EH WDNHQ DW WKH QH[W ELPRQWKO\ ERDUG
PHHWLQJ
&RPSODLQWV DUH UHVROYHG LQ D WLPHO\ PDQQHU DQG DSSURSUL
DWHO\³7KH %RDUG·V FRPSODLQW KDQGOLQJ LV WLPHO\ DQG UHVROXWLRQV
DSSHDU DSSURSULDWH $QDO\VLV RI WKH %RDUG·V FRPSODLQWV IRU WKH
SDVW WKUHH ILVFDO \HDUV IRXQG WKH PHGLDQ WLPH IUDPH IURP UHFHLSW
WR UHVROXWLRQ ZDV GD\V ZHOO EHORZ WKH GD\ VWDQGDUG
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
Table 1
Arizona State Board of Psychologist Examiners’
Statement of Revenues, Expenditures, and Changes in Fund Balance
Years Ended June 30, 1997, 1998, and 1999
(Unaudited)
1997 1998 1999
(Actual) (Actual) (Estimated)
5HYHQXHV
/LFHQVHV IHHV DQG SHUPLWV
)LQHV DQG IRUIHLWV
&KDUJHV IRU JRRGV DQG VHUYLFHV
2WKHU
7RWDO UHYHQXHV
([SHQGLWXUHV
3HUVRQDO VHUYLFHV
(PSOR\HH UHODWHG
3URIHVVLRQDO DQG RXWVLGH VHUYLFHV
7UDYHO LQ VWDWH
7UDYHO RXW RI VWDWH
2WKHU RSHUDWLQJ
&DSLWDO RXWOD\
7RWDO H[SHQGLWXUHV
([FHVV RI UHYHQXHV RYHU XQGHU H[SHQGLWXUHV
2WKHU ILQDQFLQJ XVHV
1HW RSHUDWLQJ WUDQVIHUV RXW
5HPLWWDQFHV WR WKH 6WDWH *HQHUDO )XQG
7RWDO RWKHU ILQDQFLQJ XVHV
([FHVV RI UHYHQXHV RYHU XQGHU H[SHQGLWXUHV DQG RWKHU
ILQDQFLQJ XVHV
)XQG EDODQFH EHJLQQLQJ RI \HDU
)XQG EDODQFH HQG RI \HDU
/LFHQVHV DQG IHHV UHYHQXH IOXFWXDWHV \HDUO\ EHFDXVH PRVW SV\FKRORJLVWV UHQHZ WKHLU OLFHQVHV LQ RGG
QXPEHUHG ILVFDO \HDUV
([SHQGLWXUHV IRU SURIHVVLRQDO DQG RXWVLGH VHUYLFHV GHFUHDVHG E\ DSSUR[LPDWHO\ LQ EHFDXVH WKH
%RDUG UHORFDWHG DQG QR ORQJHU LQFXUUHG VKDUHG FRVWV IRU DFFRXQWLQJ VHUYLFHV UHFHSWLRQLVWV HWF +RZHYHU WKH
%RDUG H[SHFWV WR LQFXU DGGLWLRQDO H[SHQGLWXUHV IRU H[WHUQDO DFFRXQWLQJ VHUYLFHV ODZ FOHUNV FRXUW UHSRUWLQJ
LQYHVWLJDWLRQV UXOH ZULWHUV DQG FRPSXWHU FRQVXOWDQWV LQ WKHUHIRUH WKH HVWLPDWH LQFOXGHV WKH FRVW RI
WKHVH VHUYLFHV
7KH %RDUG HVWLPDWHG DQ LQFUHDVH LQ RWKHU RSHUDWLQJ H[SHQVHV EHWZHHQ DQG RI IRU SULQWLQJ
DQG SRVWDJH FRVWV DVVRFLDWHG ZLWK SURYLGLQJ QHZVOHWWHUV DQG UHYLVHG VWDWXWHV DQG UXOHV WR LWV OLFHQVHHV
LQIRUPDWLRQ WHFKQRORJ\ UHQW LQFUHDVH UHSDLU DQG PDLQWHQDQFH VXSSOLHV DQG FRQIHUHQFHV DQG WUDLQLQJ
$V D DJHQF\ WKH %RDUG UHPLWV SHUFHQW RI LWV JURVV UHYHQXHV WR WKH 6WDWH *HQHUDO )XQG
)XQG EDODQFH LV XQUHVHUYHG DQG XQGHVLJQDWHG KRZHYHU WKH DPRXQW LV VXEMHFW WR OHJLVODWLYH DSSURSULDWLRQ
6RXUFH 7KH $UL]RQD )LQDQFLDO ,QIRUPDWLRQ 6\VWHP 5HYHQXHV DQG ([SHQGLWXUHV E\ )XQG 3URJUDP 2UJDQL]DWLRQ DQG
2EMHFW DQG 7ULDO %DODQFH E\ )XQG UHSRUWV IRU WKH \HDUV HQGHG -XQH DQG DQG %RDUG HVWLPDWHG
ILQDQFLDO DFWLYLW\ IRU WKH \HDU HQGHG -XQH DFWXDO DPRXQWV QRW DYDLODEOH DW WKH WLPH RI WKLV UHSRUW
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
XVHG LQ SUHYLRXV $XGLWRU *HQHUDO UHJXODWRU\ ERDUG UHSRUWV
)XUWKHU E\ UHFHQWO\ KLULQJ D IXOO WLPH LQYHVWLJDWRU WKH %RDUG KDV
UHGXFHG WKH QXPEHU RI FRPSODLQWV WKDW H[FHHG WKH GD\ VWDQ
GDUG $QRWKHU VWHS WKDW KDV KHOSHG LQ WKLV UHJDUG LV WKDW WKH
%RDUG GLVFXVVHV WKH VWDWXV RI HYHU\ RSHQ FRPSODLQW DW HDFK
%RDUG PHHWLQJ LQ SDUW WR HQVXUH LWV WLPHO\ UHVROXWLRQ
$XGLW ZRUN LQGLFDWHV WKDW WKH %RDUG DOVR DGMXGLFDWHV FRP
SODLQWV DSSURSULDWHO\ 2SWLRQV RSHQ WR WKH %RDUG LQFOXGH GLV
PLVVLQJ D FRPSODLQW ILOLQJ D OHWWHU RI FRQFHUQ RU LPSRVLQJ GLV
FLSOLQDU\ SHQDOWLHV WKDW UDQJH IURP D GHFUHH RI FHQVXUH WR OLFHQVH
UHYRFDWLRQ 7KH %RDUG KDV DGRSWHG D 6XEVWDQWLYH 3ROLF\ 6WDWH
PHQW WKDW SURYLGHV FULWHULD IRU UHVROYLQJ FRPSODLQWV )RU H[DP
SOH DFFRUGLQJ WR SROLF\ VWDWXWRU\ YLRODWLRQV VKRXOG UHFHLYH
JUHDWHU VDQFWLRQ WKDQ D OHWWHU RI FRQFHUQ 2EVHUYDWLRQV RI WZR
ERDUG PHHWLQJV DQG UHYLHZ RI ERDUG PLQXWHV IRU WKH SDVW WKUHH
\HDUV LQGLFDWH WKDW WKH %RDUG·V GHFLVLRQV PHHW WKHVH FULWHULD
)XUWKHU UHFHQW ERDUG DFWLRQV DQG UHYLHZ RI ERDUG ILOHV LQGLFDWH
WKDW WKH %RDUG FRQVFLHQWLRXVO\ PRQLWRUV GLVFLSOLQHG SV\FKROR
JLVWV WR HQVXUH FRPSOLDQFH ZLWK ERDUG RUGHUV
7KH %RDUG DOVR LQYROYHV WKH FRPSODLQDQW DQG WKH DFFXVHG SV\
FKRORJLVW DSSURSULDWHO\ LQ WKH FRPSODLQW SURFHVV )RU H[DPSOH
ERDUG SROLF\ UHTXLUHV WKDW FRPSODLQDQWV DQG DFFXVHG SV\FKROR
JLVWV EH LQWHUYLHZHG GXULQJ WKH LQYHVWLJDWLRQ DQG D UHYLHZ RI
ERDUG ILOHV FRQILUPV WKLV SROLF\ ZDV EHLQJ IROORZHG )XUWKHU WKH
%RDUG SURYLGHV FRPSODLQDQWV DQG DFFXVHG SV\FKRORJLVWV ZLWK
RSSRUWXQLWLHV WR DGGUHVV WKH %RDUG DQG VHQGV VXUYH\V WR WKHP
WR REWDLQ IHHGEDFN DERXW KRZ WKH FRPSODLQW ZDV KDQGOHG 6XU
YH\ UHVXOWV VKRZHG WKDW WKH PDMRULW\ RI FRPSODLQDQWV DQG DF
FXVHG SV\FKRORJLVWV H[SUHVVHG VDWLVIDFWLRQ ZLWK FRPSODLQW LQ
YHVWLJDWLRQV DQG WKH RSSRUWXQLW\ WR SURYLGH FRPPHQW
3XEOLF LQIRUPDWLRQ DFFHVVLEOH DQG DSSURSULDWH³7KH %RDUG DOVR
DSSURSULDWHO\ SURYLGHV LQIRUPDWLRQ WR FRQVXPHUV UHJDUGLQJ
$UL]RQD OLFHQVHG SV\FKRORJLVWV 7KH %RDUG·V SXEOLF LQIRUPDWLRQ
SROLFLHV UHTXLUH WKDW VWDII SURYLGH WKH SXEOLF ZLWK LQIRUPDWLRQ
UHJDUGLQJ WKH QXPEHU DQG W\SH RI ERWK FORVHG DQG SHQGLQJ
FRPSODLQWV DQG UHVROXWLRQ RI FORVHG FRPSODLQWV $XGLWRU WHVW
FDOOV WR WKH %RDUG FRQILUPHG WKDW WKHVH SROLFLHV ZHUH FRUUHFWO\
LPSOHPHQWHG )XUWKHU ERDUG VWDII ZHUH WLPHO\ DQG FRXUWHRXV LQ
SURYLGLQJ LQIRUPDWLRQ LQ RQH LQVWDQFH DVVLVWLQJ WKH FDOOHU LQ
LGHQWLI\LQJ SV\FKRORJLVWV LQ D UHPRWH ORFDWLRQ 7KH %RDUG·V
%RDUG SURSHUO\ DGMXGLFDWHV
FRPSODLQWV DQG PRQLWRUV
GLVFLSOLQHG SV\FKRORJLVWV
%RDUG SURYLGHV DFFXUDWH DQG
FRPSOHWH LQIRUPDWLRQ WR WKH
SXEOLF
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
SROLFLHV DQG DFWLRQV DOVR HQVXUH WKDW FRQILGHQWLDO LQIRUPDWLRQ LV
QRW LQDSSURSULDWHO\ UHOHDVHG )LQDOO\ D UHYLHZ RI WKH %RDUG·V
FRPSODLQW GDWDEDVH DQG ILOHV LQGLFDWH WKDW WKH LQIRUPDWLRQ SUR
YLGHG WR WKH SXEOLF LV DOVR DFFXUDWH DQG FRPSOHWH
7KH %RDUG PDNHV LQIRUPDWLRQ DYDLODEOH WR WKH SXEOLF LQ RWKHU
IRUPDWV DV ZHOO 7KH %RDUG UHFHQWO\ GHYHORSHG DQ ,QWHUQHW :HE
VLWH WKDW LQFOXGHV WKH %RDUG·V DQQXDO PHHWLQJ VFKHGXOH QHZV
OHWWHU DQG FRQVXPHU JXLGH 7KH QHZVOHWWHU FRQWDLQV LQIRUPD
WLRQ DERXW WKH %RDUG·V GLVFLSOLQDU\ DFWLRQV IRU WKH SDVW WZR
\HDUV LQFOXGLQJ WKH QDPH RI WKH GLVFLSOLQHG SV\FKRORJLVW DQG
WKH GLVFLSOLQDU\ DFWLRQ WDNHQ DV ZHOO DV DUWLFOHV WR DVVLVW OLFHQ
VHHV LQ XQGHUVWDQGLQJ UHJXODWRU\ LVVXHV
Audit Scope
and Methodology
$XGLW ZRUN IRFXVHG RQ KRZ ZHOO WKH %RDUG SHUIRUPV LWV UH
VSRQVLELOLWLHV 6SHFLILFDOO\ UHVHDUFK IRFXVHG RQ ZKHWKHU WKH
%RDUG KDV PHW QDWLRQDO VWDQGDUGV IRU LWV RUDO H[DP DQG FRQVLG
HUDWLRQ RI UHFLSURFLW\ RSWLRQV WKDW FRXOG VLPSOLI\ WKH OLFHQVXUH
SURFHVV IRU DSSOLFDQWV DOUHDG\ OLFHQVHG E\ DQRWKHU VWDWH $GGL
WLRQDO DXGLW ZRUN DVVHVVHG WKH HIILFLHQF\ DQG HIIHFWLYHQHVV RI
ERDUG SURFHVVHV LQFOXGLQJ OLFHQVLQJ FRPSODLQW KDQGOLQJ DQG
SURYLGLQJ SXEOLF LQIRUPDWLRQ
7KLV SHUIRUPDQFH DXGLW DQG 6XQVHW UHYLHZ LQFOXGHV RQH ILQGLQJ
DQG UHFRPPHQGDWLRQV LQ WKUHH DUHDV
n 7KH QHHG IRU WKH %RDUG WR LPSURYH LWV RUDO H[DP RU GLVFRQ
WLQXH LWV XVH
n 7KH QHHG IRU DGGLWLRQDO SXEOLF UHSUHVHQWDWLRQ RQ WKH %RDUG
DQG
n 7KH QHHG IRU WKH %RDUG WR FRPSO\ ZLWK 2SHQ 0HHWLQJ /DZ
UHTXLUHPHQWV
7R HYDOXDWH WKH %RDUG·V RUDO H[DP DXGLWRUV LGHQWLILHG QDWLRQ
DOO\ DFFHSWHG VWDQGDUGV IRU OLFHQVXUH RUDO H[DPV DQG FRPSDUHG
WKHVH VWDQGDUGV ZLWK %RDUG SROLFLHV DQG SURFHGXUHV 7KH
GRFXPHQWV UHYLHZHG WR LGHQWLI\ QDWLRQDO RUDO H[DP VWDQGDUGV
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
DUH OLVWHG LQ WKH $SSHQGL[ VHH SDJH D L 6SHFLILF DXGLW ZRUN
LQFOXGHG
n 2EVHUYDWLRQ DQG UHYLHZ RI DOO SURFHGXUDO DVSHFWV RI WKH
%RDUG·V )HEUXDU\ RUDO H[DP LQFOXGLQJ H[DPLQHU
WUDLQLQJ DQG RI WKH H[DP VHVVLRQV UHYLHZ RI DOO FDQ
GLGDWHV· H[DPLQHU UDWLQJ IRUPV UHYLHZ RI %RDUG VFRUH
FKDQJH GRFXPHQWDWLRQ DQG UHYLHZ RI FDQGLGDWH DQG H[
DPLQHU IHHGEDFN VXUYH\V
n 5HYLHZ RI WKH RULJLQDOO\ IDLOLQJ FDQGLGDWHV· H[DPLQHU UDW
LQJ IRUPV IRU WKH -XO\ H[DP GRFXPHQWV VXEPLWWHG E\
FDQGLGDWHV SURWHVWLQJ WKH -XO\ DQG )HEUXDU\ RUDO
H[DPV UHVXOWV DQG %RDUG VWDWLVWLFDO DQDO\VHV RI DOO RUDO H[
DPV KHOG EHWZHHQ -XQH DQG )HEUXDU\ DQG SHUWL
QHQW %RDUG SROLFLHV VWDWXWHV DQG UXOHV
n ,QWHUYLHZV ZLWK QDWLRQDO DQG ORFDO H[SHUWV LQ RUDO H[DPV DQG
WHVW VFRULQJ DQG ZLWK RIILFLDOV IURP IRXU VWDWH SV\FKRORJ\
ERDUGV ZLWK VLPLODU RUDO H[DP VWUXFWXUHV
7R HYDOXDWH ZKHWKHU UHFLSURFLW\ RSWLRQV ZHUH DYDLODEOH WKDW
FRXOG VLPSOLI\ WKH OLFHQVXUH SURFHVV IRU DSSOLFDQWV DOUHDG\ OL
FHQVHG E\ DQRWKHU VWDWH DXGLWRUV FRPSDUHG $UL]RQD·V JHQHUDO
SV\FKRORJLVW OLFHQVXUH UHTXLUHPHQWV WR WKH RWKHU VWDWHV· OLFHQ
VXUH UHTXLUHPHQWV DQG WKH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO
3V\FKRORJ\ %RDUG·V 0RGHO /LFHQVXUH $FW DQG LGHQWLILHG FXU
UHQWO\ DYDLODEOH UHFLSURFLW\ SURJUDPV
$XGLWRUV XVHG D QXPEHU RI DSSURDFKHV WR JDWKHU LQIRUPDWLRQ
DERXW KRZ WKH %RDUG KDQGOHV OLFHQVLQJ FRPSODLQWV SXEOLF LQ
IRUPDWLRQ DQG RWKHU UHODWHG PDWWHUV 6SHFLILFDOO\ DXGLWRUV UH
YLHZHG D UDQGRP VDPSOH RI FRPSODLQW ILOHV IURP WKH SDVW
ILVFDO \HDUV WR GHWHUPLQH ZKHWKHU WKH %RDUG IROORZHG LQYHVWLJD
WLRQ DQG GLVFLSOLQH SROLFLHV PRQLWRUHG GLVFLSOLQHG SV\FKROR
JLVWV DQG PDLQWDLQHG DQ DFFXUDWH FRPSODLQW GDWDEDVH ,Q DGGL
WLRQ D UDQGRP VDPSOH RI QHZ OLFHQVXUH ILOHV IURP WKH SDVW
ILVFDO \HDUV ZDV UHYLHZHG WR DVVHVV WKH %RDUG·V GRFXPHQWDWLRQ
RI DSSOLFDQWV· FUHGHQWLDOV DQG WKH DFFXUDF\ RI WKH %RDUG·V OLFHQ
VXUH GDWDEDVH $XGLWRUV DOVR XVHG WKH %RDUG·V FRPSODLQW DQG
$XGLWRUV LQWHUYLHZHG RIILFLDOV IURP &DOLIRUQLD &RORUDGR 1HZ 0H[LFR
DQG 1HYDGD
,QWURGXFWLRQ DQG %DFNJURXQG
2)),&( 2) 7+( $8',725 *(1(5$/
OLFHQVXUH GDWDEDVHV WR YHULI\ WKH WLPHOLQHVV RI FRPSODLQW UHVROX
WLRQ IRU WKH SDVW WKUHH ILVFDO \HDUV DQG WKH OLFHQVXUH DSSOLFDWLRQ
SURFHVVLQJ IRU WKH SDVW WZR ILVFDO \HDUV )XUWKHU DXGLWRUV UH
YLHZHG %RDUG SXEOLF LQIRUPDWLRQ SROLFLHV DQG SURFHGXUHV DQG
PDGH WHVW FDOOV WR GHWHUPLQH FRPSOLDQFH $XGLWRUV DOVR UH
YLHZHG UHFHQW OLWHUDWXUH UHJDUGLQJ SXEOLF PHPEHUVKLS RQ
UHJXODWRU\ ERDUGV DV ZHOO DV RWKHU VWDWH SV\FKRORJ\ ERDUGV·
SXEOLF PHPEHU UHSUHVHQWDWLRQ )LQDOO\ DXGLWRUV UHYLHZHG
2SHQ 0HHWLQJ /DZ VWDWXWHV DQG UHODWHG %RDUG VWDWXWHV DQG
PHHWLQJ PLQXWHV
7KLV DXGLW ZDV FRQGXFWHG LQ DFFRUGDQFH ZLWK JRYHUQPHQW
DXGLWLQJ VWDQGDUGV
7KH $XGLWRU *HQHUDO DQG VWDII H[SUHVV DSSUHFLDWLRQ WR WKH
%RDUG RI 3V\FKRORJLVW ([DPLQHUV ([HFXWLYH 'LUHFWRU DQG VWDII
IRU WKHLU FRRSHUDWLRQ DQG DVVLVWDQFH WKURXJKRXW WKH DXGLW
2)),&( 2) 7+( $8',725 *(1(5$/
FINDING I BOARD HAS EXPERIENCED
PROBLEMS WITH ORAL EXAM
3UREOHPV ZLWK KRZ WKH %RDUG RI 3V\FKRORJLVW ([DPLQHUV· RUDO
H[DP ZDV DGPLQLVWHUHG FDOO LQWR TXHVWLRQ WKH UHOLDELOLW\ RI WKH
WHVWLQJ SURFHVV DV D EDVLV IRU PDNLQJ OLFHQVLQJ GHFLVLRQV $XGL
WRUV· H[DPLQDWLRQ RI UHFHQW WHVW UHVXOWV VKRZHG WKDW VFRULQJ HU
URUV ZHUH FRPPRQ DQG WKDW DWWHPSWV WR DGGUHVV WKHVH HUURUV
ZHUH LQFRQVLVWHQWO\ DSSOLHG 7KH %RDUG·V RZQ DQDO\VHV DOVR
LQGLFDWH WKDW SUREOHPV H[LVWHG LQ HYDOXDWLQJ FDQGLGDWHV· UH
VSRQVHV IRU SUHYLRXV H[DPV 7KH %RDUG KDV VHYHUDO RSWLRQV IRU
UHVROYLQJ WKH SUREOHP LQFOXGLQJ LPSURYLQJ WKH DGPLQLVWUDWLRQ
RI WKH H[DP DGRSWLQJ D QDWLRQDO RUDO H[DP FXUUHQWO\ XQGHU GH
YHORSPHQW RU UHSODFLQJ WKH RUDO H[DP ZLWK D ZULWWHQ RQH
Oral Exam Final
Step for Licensure
8QWLO -XQH WKH %RDUG·V RUDO H[DP ZDV WKH ILQDO VWHS LQ LWV
OLFHQVXUH SURFHVV ([DP FDQGLGDWHV DOUHDG\ SRVVHVVHG D GRFWRU
DWH LQ SV\FKRORJ\ KDG FRPSOHWHG KRXUV RI VXSHUYLVHG
H[SHULHQFH DQG KDG SDVVHG WKH QDWLRQDO ZULWWHQ H[DP 7KH
%RDUG FKRVH WR DGGLWLRQDOO\ UHTXLUH LWV RUDO H[DP LQ RUGHU WR
DVVHVV FDQGLGDWHV· FRPSHWHQFH WR SUDFWLFH RU ´DELOLW\ WR FRQ
FHSWXDOO\ LQWHJUDWH DQG DSSO\ WKHLU NQRZOHGJHµ RI SV\FKRORJ\
DV ZHOO DV $UL]RQD VSHFLILF ODZV 7KH H[DP FRQVLVWV RI D FDVH
H[DPSOH DQG TXHVWLRQV 9ROXQWHHU OLFHQVHG SV\FKRORJLVWV
VHOHFWHG E\ WKH %RDUG VHUYH DV H[DPLQHUV $ SDLU RI H[DPLQHUV
XVHV VWDQGDUGL]HG FULWHULD WR DVVLJQ RI UDWLQJV VXSHULRU DF
FHSWDEOH TXHVWLRQDEOH DQG XQDFFHSWDEOH WR HDFK FDQGLGDWH·V
UHVSRQVHV IRU HDFK TXHVWLRQ 7KH %RDUG WKHQ FRQYHUWHG WKHVH
UDWLQJV LQWR D QXPHULFDO VFRUH E\ DOORFDWLQJ D VHW QXPEHU RI
SRLQWV SHU UDWLQJ )LQDOO\ WKH %RDUG YRWHG WR SDVV RU IDLO FDQGL
GDWHV EDVHG RQ WKH QXPHULFDO VFRUH $ FDQGLGDWH PXVW VFRUH D
PLQLPXP RI SHUFHQW WR SDVV )DLOLQJ FDQGLGDWHV PXVW ZDLW
DSSUR[LPDWHO\ PRQWKV WR UH WDNH WKH WHVW DQG SD\ DQ DGGL
WLRQDO H[DP IHH $IWHU DXGLW UHVHDUFK UHJDUGLQJ WKH H[DP
ZDV FRPSOHWHG WKH %RDUG YRWHG WR GLVFRQWLQXH XVLQJ WKH RUDO
H[DP DW LWV -XQH PHHWLQJ
&DQGLGDWHV KDG WR SDVV WKH
RUDO H[DP DV WKH ILQDO VWHS WR
UHFHLYH D OLFHQVH
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
Board Experienced
Problems with
Oral Exam
7KH %RDUG KDV H[SHULHQFHG D QXPEHU RI SUREOHPV ZLWK WKH DG
PLQLVWUDWLRQ RI LWV RUDO H[DP WKDW FDOO LQWR TXHVWLRQ WKH DFFXUDF\
RI H[DP UHVXOWV ([DPLQHUV UHSHDWHGO\ PDGH PLVWDNHV LQ HYDOX
DWLQJ FDQGLGDWHV· UHVSRQVHV DQG ZKHQ WKH %RDUG DWWHPSWHG WR
DGGUHVV WKHVH PLVWDNHV WKH DFWLRQV WDNHQ ZHUH LQFRQVLVWHQW
IURP FDQGLGDWH WR FDQGLGDWH 7KH %RDUG·V RZQ VWDWLVWLFDO
DQDO\VHV OHQG DGGLWLRQDO VXSSRUW WR WKH QHHG WR PDNH LP
SURYHPHQWV 6XFK SUREOHPV FDQ UHVXOW LQ %RDUG GHFLVLRQV WKDW
DUH EDVHG RQ LQIRUPDWLRQ WKDW LV QRW IXOO\ DFFXUDWH RU FRPSOHWH
([DPLQHU HUURU DQG %RDUG UHYLHZ LPSDFWHG H[DP UHVXOWV³([
DPLQHU HUURU DQG WKH %RDUG·V LQFRQVLVWHQW UHVSRQVHV WR WKDW HU
URU FUHDWHG SUREOHPV WKDW LPSDFWHG WKH UHVXOWV RI WKH SDVW WKUHH
VHWV RI RUDO H[DPV )RU H[DPV DGPLQLVWHUHG LQ )HEUXDU\
LQLWLDO H[DPLQHU UDWLQJV LQGLFDWHG WKDW RI WKH FDQGLGDWHV
IDLOHG 3ULRU WR DGRSWLQJ ILQDO VFRUHV FRQFHUQV DERXW WKH LQLWLDO
UHVXOWV SURPSWHG ERDUG PHPEHUV WR OLVWHQ WR H[DP VHVVLRQ WDSH
UHFRUGLQJV DQG UH VFRUH WKH H[DPV XVLQJ WKH VDPH FULWHULD XVHG
E\ WKH RULJLQDO H[DPLQHUV 7KH %RDUG UHYLHZHG RI WKH LQLWLDO
IDLOLQJ H[DPV DQG FKDQJHG WKH RXWFRPH IURP IDLO WR SDVV IRU
EHFDXVH %RDUG PHPEHUV WKRXJKW FHUWDLQ UHVSRQVHV GHVHUYHG
KLJKHU PDUNV $ VHYHQWK IDLOLQJ FDQGLGDWH DOVR SDVVHG EHFDXVH
RI WKH %RDUG·V GHFLVLRQ WR JLYH DOO FDQGLGDWHV FUHGLW IRU RQH RI
WKH WHQ H[DP TXHVWLRQV 7KH %RDUG DGRSWHG WKH UHYLVHG VFRUHV
DV LWV ILQDO VFRUHV DW LWV $SULO PHHWLQJ WKHUHE\ SDVVLQJ RI
FDQGLGDWHV
+RZHYHU WKH %RDUG·V HIIRUWV WR DGGUHVV H[DPLQHU HUURUV IRU WKH
)HEUXDU\ H[DP ZHUH LQFRQVLVWHQW )RU H[DPSOH
n 7KH %RDUG GLG QRW UHYLHZ WKH IXOO H[DP WDSH UHFRUGLQJ RI
RQH FDQGLGDWH ZKR IDLOHG DOWKRXJK DOO RWKHU IDLOLQJ FDQGL
GDWHV· IXOO H[DPV ZHUH UHYLHZHG 7KLV FDQGLGDWH·V ILQDO VFRUH
ZDV SHUFHQW EHORZ SDVVLQJ $IWHU WKH FDQGLGDWH IRU
PDOO\ UHTXHVWHG UHFRQVLGHUDWLRQ WKH %RDUG UHYLHZHG WKLV
FDQGLGDWH·V H[DP DQG XSKHOG WKH SHUFHQW VFRUH
,W PD\ DSSHDU WKH JRDO ZDV WR
SDVV FDQGLGDWHV
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
n 7KH %RDUG GLG QRW UHYLHZ WKH H[DP WDSH UHFRUGLQJV RI DQ\
FDQGLGDWHV ZKR UHFHLYHG SDVVLQJ VFRUHV IURP WKH H[DPLQHUV
WR GHWHUPLQH ZKHWKHU FDQGLGDWHV KDG EHHQ SDVVHG LQ HUURU
$OVR ZKHQ %RDUG PHPEHUV UHYLHZHG IDLOLQJ FDQGLGDWHV·
H[DPV DQG GHFLGHG WKDW H[DPLQHUV KDG VFRUHG VRPH DQ
VZHUV WRR KLJK WKH %RDUG GLG QRW GHFUHDVH DQ\ VFRUHV $V D
UHVXOW LW PD\ DSSHDU WKDW WKH %RDUG·V SXUSRVH ZDV WR SDVV
FDQGLGDWHV
6LPLODU H[DPLQHU HUURUV DQG ERDUG LQFRQVLVWHQFLHV RFFXUUHG
ZLWK WKH -XO\ H[DP 7KH %RDUG DGRSWHG ILQDO VFRUHV IDLOLQJ
RI WKH FDQGLGDWHV $IWHU PRVW RI WKH FDQGLGDWHV ZKR IDLOHG
UHTXHVWHG D UHYLHZ WKH %RDUG UHYLHZHG DOO IDLOLQJ H[DPV DQG
IRXQG HUURUV WKDW ZKHQ FRUUHFWHG UHVXOWHG LQ SDVVLQJ VFRUHV IRU
RI WKH FDQGLGDWHV ([DPLQHU HUURUV LQFOXGHG QRW RQO\ IDLOXUH
WR FRUUHFWO\ FUHGLW FDQGLGDWH UHVSRQVHV EXW DOVR DGPLQLVWUDWLYH
W\SH HUURUV VXFK DV H[DPLQHUV DVVLJQLQJ WZR GLIIHUHQW UDWLQJV WR
WKH VDPH TXHVWLRQ 7KH FDQGLGDWHV ZKR ZHUH QRW SDVVHG DIWHU
WKLV UHYLHZ IXUWKHU DSSHDOHG WKH H[DP UHVXOWV $IWHU UHFHLYLQJ
OHJDO DGYLFH LQ H[HFXWLYH VHVVLRQ WKH %RDUG HYHQWXDOO\ SDVVHG
DOO FDQGLGDWHV ZLWK D VFRUH RI SHUFHQW
3UREOHPV DOVR DIIHFWHG WKH %RDUG·V )HEUXDU\ H[DP :KHQ
RI WKH IDLOLQJ FDQGLGDWHV UHTXHVWHG UHFRQVLGHUDWLRQ RI KHU
SHUFHQW VFRUH ERDUG UHYLHZ LGHQWLILHG HUURUV WKDW ZKHQ FRU
UHFWHG UDLVHG WKH FDQGLGDWH·V VFRUH IURP WR SHUFHQW VWLOO
QRW KLJK HQRXJK WR SDVV (UURUV LQFOXGHG IDLOXUH WR SURSHUO\
GRFXPHQW UDWLQJV DQG WR IROORZ TXHVWLRQ UDWLQJ FULWHULD
6WDWLVWLFDO DQDO\VHV DOVR LQGLFDWHG SUREOHPV RQ SDVW H[DPV³
7KH %RDUG·V RZQ VWDWLVWLFDO UHOLDELOLW\ DQDO\VHV KDYH LQGLFDWHG
SUREOHPV ZLWK SDVW RUDO H[DPV 1DWLRQDO VWDQGDUGV LQGLFDWH
WKDW IRU OLFHQVXUH H[DPV H[DPLQHUV VKRXOG DJUHH RQ D FDQGL
GDWH·V UDWLQJ RQ D TXHVWLRQ RU RYHUDOO VFRUH DW OHDVW SHUFHQW RI
WKH WLPH 7KH %RDUG·V DQDO\VLV RI DOO H[DPV SULRU WR )HEUXDU\
%RDUG·V RZQ VWDWLVWLFDO UHVXOWV
GLG QRW PHHW QDWLRQDO VWDQGDUGV
IRU SDVW H[DPV
%RDUG IDLOHG FDQGLGDWHV LQ
-XO\ LQ HUURU
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
VKRZHG WKDW H[DPLQHU FRUUHODWLRQ UDQJHG IURP SHUFHQW
DJUHHPHQW WR SHUFHQW
/LFHQVXUH GHFLVLRQV LPSDFWHG E\ H[DP SUREOHPV³3UREOHPV
ZLWK WKH RUDO H[DP PD\ KDYH OHG WR LQFRUUHFW OLFHQVXUH GHFL
VLRQV 7KH %RDUG KDV UHOLHG RQ WKH RUDO H[DP WR GHWHUPLQH
ZKHWKHU LWV DSSOLFDQWV DUH TXDOLILHG WR SUDFWLFH SV\FKRORJ\ ,I
VFRUHV DUH QRW DFFXUDWH TXDOLILHG FDQGLGDWHV PD\ QRW EH OL
FHQVHG DQG XQTXDOLILHG FDQGLGDWHV PD\ EH OLFHQVHG )XUWKHU
FDQGLGDWHV DUH SHUVRQDOO\ ILQDQFLDOO\ DQG SURIHVVLRQDOO\ LP
SDFWHG E\ WKH RUDO H[DP VFRUHV 7KHUHIRUH LW LV WKH %RDUG·V UH
VSRQVLELOLW\ WR HQVXUH WKDW WKH H[DP LV VFRUHG DV DFFXUDWHO\ DQG
HTXLWDEO\ DV SRVVLEOH
Board Does Not Ensure
Exam Is Developed and
Administered Appropriately
7KH %RDUG KDV QRW WDNHQ WKH QHFHVVDU\ VWHSV WR GHYHORS DQG
DGPLQLVWHU LWV H[DP DSSURSULDWHO\ $OWKRXJK WKH H[DP·V FRQ
WHQW LV DSSURSULDWH LW LV GHILFLHQW LQ RWKHU UHVSHFWV VXFK DV WKH
ODFN RI D FOHDU UDWLRQDOH IRU ZK\ SHUFHQW LV WKH DSSURSULDWH
GLYLGLQJ OLQH EHWZHHQ SDVVLQJ DQG IDLOLQJ 7UDLQLQJ SURYLGHG WR
H[DPLQHUV LV QRW VXIILFLHQW ERDUG SROLFLHV DUH QRW EHLQJ IRO
ORZHG DQG WKH %RDUG·V TXDOLW\ FRQWURO SURFHVV IDLOHG WR LGHQWLI\
H[DPLQHU HUURU DQG HQVXUH DFFXUDWH VFRUHV
2UDO H[DP KDV EHHQ SRRUO\ GHYHORSHG³$OWKRXJK WKH RUDO
H[DP·V FRQWHQW LV YDOLG VRPH RWKHU DVSHFWV RI WKH H[DP KDYH
QRW EHHQ DGHTXDWHO\ GHYHORSHG 7KH %RDUG KDV HQVXUHG WKH
DSSURSULDWHQHVV RI LWV H[DP·V FRQWHQW E\ XVLQJ WKH MRE DQDO\VLV
FRQGXFWHG E\ WKH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO 3V\FKRO
RJ\ %RDUGV DQG VSHFLI\LQJ WKH VSHFLILF VNLOO WKDW HDFK TXHVWLRQ
7KH %RDUG GLG QRW KDYH H[DPLQHU FRUUHODWLRQ VWDWLVWLFV FRPSXWHG IRU
WKH )HEUXDU\ DQG -XO\ H[DPV $OWKRXJK WKH %RDUG·V H[DPLQHU
FRUUHODWLRQ VWDWLVWLF IRU WKH )HEUXDU\ H[DP ZDV JUHDWHU WKDQ
SHUFHQW WKLV UHVXOW ZDV LQIOXHQFHG E\ RWKHU VFRUH FKDQJHV GLVFXVVHG
ODWHU LQ )LQGLQJ , VHH SDJHV WKURXJK
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
WHVWV +RZHYHU DXGLWRUV· UHYLHZ RI WKH WHVWV VKRZHG GHYHORS
PHQW ZDV LQFRPSOHWH LQ WKH IROORZLQJ ZD\V
n Rationale for 75 as the “pass point”³7KH %RDUG KDV QRW
GRFXPHQWHG D UDWLRQDOH IRU D VFRUH RI SHUFHQW DV D PHDV
XUH RI FRPSHWHQFH $FFRUGLQJ WR QDWLRQDO WHVWLQJ VWDQGDUGV
LW LV HVVHQWLDO WR GHPRQVWUDWH KRZ FDQGLGDWHV VFRULQJ EHORZ
WKH SDVV SRLQW DUH QRW FRPSHWHQW DQG FDQGLGDWHV VFRULQJ DW
RU DERYH WKH SDVV SRLQW DUH FRPSHWHQW
n Standards for developing test questions³1DWLRQDO
VWDQGDUGV VWDWH WKDW RQH H[DP TXHVWLRQ VKRXOG QRW SURYLGH
WKH DQVZHU WR DQRWKHU TXHVWLRQ +RZHYHU LQ WKH )HEUXDU\
H[DP RQH RI WKH TXHVWLRQV SURYLGHG WKH DQVZHU WR DQ
RWKHU TXHVWLRQ
n Criteria for ratings³,Q DGGLWLRQ XQWLO WKH )HEUXDU\
H[DP WKH %RDUG SURYLGHG VSHFLILF FULWHULD IRU RQO\ RQH RI
IRXU SRVVLEOH UDWLQJV H[DPLQHUV FRXOG JLYH WR FDQGLGDWHV· UH
VSRQVHV +RZHYHU HYHQ ZLWK WKLV LPSURYHPHQW H[DPLQHUV
H[SUHVVHG FRQFHUQV DERXW WKH FULWHULD·V FODULW\ 1DWLRQDO
VWDQGDUGV UHTXLUH ERWK TXHVWLRQV DQG FULWHULD WR EH FOHDU DQG
H[SOLFLW WR UHGXFH WKH SRWHQWLDO IRU H[DPLQHU HUURU
([DPLQHU WUDLQLQJ LQVXIILFLHQW³7KH %RDUG KDV QRW WUDLQHG LWV
H[DPLQHUV VXIILFLHQWO\ WR SUHYHQW HUURU 1DWLRQDO VWDQGDUGV VWDWH
WKDW H[DPLQHU WUDLQLQJ LV HVVHQWLDO WR KHOS HQVXUH WHVWV DUH DG
PLQLVWHUHG DQG VFRUHG DFFXUDWHO\ 7KH %RDUG SURYLGHV H[DPLQ
HUV ZLWK ZULWWHQ JXLGHOLQHV DQG D WZR KRXU SUH H[DP WUDLQLQJ
VHVVLRQ +RZHYHU DFFRUGLQJ WR WHVWLQJ H[SHUWV LQWHUYLHZHG DV
SDUW RI WKH DXGLW WKH QXPEHU RI H[DPLQHU HUURUV LGHQWLILHG LQ
UHFHQW H[DPV DQG UHOLDELOLW\ DQDO\VHV LQ SUHYLRXV H[DPV LQGLFDWH
WKDW WKH %RDUG·V H[DPLQHU WUDLQLQJ PLJKW QRW EH VXIILFLHQW ,Q
IDFW VRPH H[DPLQHUV UHSHDWHG VLPLODU HUURUV IURP RQH RUDO
H[DP LPSOHPHQWDWLRQ WR WKH QH[W
%RDUG GLG QRW IROORZ LWV RZQ SROLFLHV³7KH %RDUG GLG QRW IRO
ORZ LWV RZQ SROLFLHV GXULQJ LWV )HEUXDU\ H[DP 7KH
%RDUG·V H[DPLQHU KDQGERRN FOHDUO\ VWDWHV ´2QFH UDWLQJV KDYH
EHHQ PDGH QR FKDQJHV DUH WR EH PDGH µ 7KLV LV FRQVLVWHQW ZLWK
UHIHUHQFHV UHYLHZHG IRU WKLV DXGLW ZKLFK VWDWH WKDW H[DPLQHUV
VKRXOG PDNH LQGHSHQGHQW VFRULQJ GHFLVLRQV +RZHYHU GXULQJ
([DPLQHU WUDLQLQJ GLG QRW
VXIILFLHQWO\ SUHYHQW HUURU
%RDUG IDLOHG WR IROORZ LWV SROL
FLHV
%RDUG GLG QRW GHPRQVWUDWH
KRZ ´SDVV SRLQWµ GLIIHUHQWL
DWHG EHWZHHQ TXDOLILHG DQG
XQTXDOLILHG FDQGLGDWHV
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
WKH )HEUXDU\ H[DP D ERDUG PHPEHU TXHVWLRQHG H[DPLQHU
SDLUV UHJDUGLQJ GLIIHUHQFHV LQ WKHLU UDWLQJV RI WKH VDPH FDQGL
GDWH·V SHUIRUPDQFH DQG DOORZHG H[DPLQHUV WR FKDQJH WKHLU UDW
LQJV WR PRUH FORVHO\ PDWFK WKHLU SDUWQHU·V UDWLQJV ([DPLQHUV
FKDQJHG WKHLU UDWLQJV LQ FORVH WR SHUFHQW RI DXGLWRUV· REVHU
YDWLRQV :KLOH WKH FKDQJHV LQFUHDVH WKH FRUUHODWLRQ EHWZHHQ
H[DPLQHUV· UDWLQJV WKH\ DOVR UDLVH WKH SRWHQWLDO IRU RWKHU GLIIL
FXOWLHV )RU H[DPSOH WKH SRWHQWLDO H[LVWV WKDW VRPH H[DPLQHUV
PD\ EH PRUH HDVLO\ LQIOXHQFHG WR FKDQJH WKHLU UDWLQJV WKDQ RWK
HUV ZLWKRXW EHLQJ VXUH WKH FKDQJH LV DSSURSULDWH 1HYDGD·V
SV\FKRORJ\ ERDUG DOORZV H[DPLQHUV WR FKDQJH UDWLQJV RQO\
ZKHQ WKH FKDQJH LV VXSSRUWHG E\ WKH H[DP WDSH UHFRUGLQJ RU
GRFXPHQWDWLRQ LQ H[DPLQHU QRWHV 7KLV KHOSV HQVXUH WKDW WKH
FKDQJH LV DSSURSULDWH
'XULQJ WKH VDPH H[DP DIWHU WKH ILUVW FDQGLGDWHV KDG EHHQ
WHVWHG %RDUG PHPEHUV FKDQJHG H[DP SROLF\ WR JLYH FDQGLGDWHV
FUHGLW IRU VXEVHTXHQWO\ SURYLGLQJ DGGLWLRQDO LQIRUPDWLRQ RQ
TXHVWLRQV WKDW KDG DOUHDG\ EHHQ FRYHUHG $XGLWRUV REVHUYHG
VRPH RI WKH UHPDLQLQJ FDQGLGDWHV VXSSOHPHQWLQJ WKHLU DQ
VZHUV WR SUHYLRXV TXHVWLRQV SRWHQWLDOO\ LQFUHDVLQJ WKHLU UDWLQJV
6HYHUDO RI WKH ILUVW FDQGLGDWHV H[SUHVVHG FRQFHUQ WKDW WKH\
ZHUH QRW JLYHQ WKH RSSRUWXQLW\ WR VXSSOHPHQW WKHLU DQVZHUV
DOWKRXJK WKH\ ZHUH QRW DZDUH WKDW WKH FDQGLGDWHV ZKR IRO
ORZHG WKHP KDG WKDW DGYDQWDJH
%RDUG·V TXDOLW\ FRQWURO SURFHVV LV LQVXIILFLHQW³)RU LWV )HEUX
DU\ H[DP WKH %RDUG LPSOHPHQWHG D TXDOLW\ FRQWURO SURF
HVV WR HQVXUH H[DP SURFHGXUHV ZHUH IROORZHG EXW LW ZDV QRW
HIIHFWLYH LQ LGHQWLI\LQJ DOO H[DPLQHU HUURU 1DWLRQDO VWDQGDUGV
UHFRPPHQG WKDW OLFHQVLQJ DJHQFLHV GHYHORS DQG GRFXPHQW
TXDOLW\ FRQWUROV 'XULQJ WKH )HEUXDU\ H[DP %RDUG PHP
EHUV FKHFNHG ZKHWKHU WKH H[DPLQHU DVVLJQHG UDWLQJV RI VXSH
ULRU DFFHSWDEOH TXHVWLRQDEOH RU XQDFFHSWDEOH PDWFKHG WKH FUL
WHULD SURYLGHG DQG ZKHWKHU DOO UDWLQJV ZHUH GRFXPHQWHG $O
WKRXJK WKH %RDUG LGHQWLILHG VRPH LQVWDQFHV ZKHUH SURFHGXUHV
ZHUH QRW IROORZHG WKH UHYLHZ IDLOHG WR FDWFK PDQ\ RWKHU HUURUV
6SHFLILFDOO\
n $XGLWRU UHYLHZ RI H[DPLQHU UDWLQJ IRUPV DQG ILQDO VFRUHV
IRXQG WKDW WKH %RDUG IDLOHG WR LGHQWLI\ LQVWDQFHV RXW RI WKH
WRWDO UDWLQJV RU SHUFHQW ZKHUH WKH H[DPLQHU VHOHFWHG
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
WKH ZURQJ UDWLQJ )RU H[DPSOH RQH H[DPLQHU UDWHG D FDQGL
GDWH·V UHVSRQVH ´4XHVWLRQDEOH µ EXW WKH FULWHULD LQGLFDWHG
WKDW WKH FDQGLGDWH DFWXDOO\ HDUQHG DQ ´$FFHSWDEOHµ UDWLQJ
$OWKRXJK WKHVH HUURUV GLG QRW LPSDFW DQ\ FDQGLGDWH·V
SDVV IDLO UHVXOW EHFDXVH UDWLQJV DUH FRQYHUWHG LQWR VFRUHV
RI WKH ILQDO H[DP VFRUHV RU SHUFHQW WKH %RDUG YRWHG WR
DGRSW ZHUH LQFRUUHFW
n $XGLWRUV DOVR LGHQWLILHG H[DPLQHU UDWLQJ IRUP ZKHUH WKH
%RDUG IDLOHG WR QRWH WKDW WKH H[DPLQHU ODFNHG SURSHU GRFX
PHQWDWLRQ IRU WKH UDWLQJ VKH DVVLJQHG IRU RI WKH FDQGL
GDWH UHVSRQVHV
,Q DGGLWLRQ WKH %RDUG ODFNV SROLFLHV DQG SURFHGXUHV WR URX
WLQHO\ PRQLWRU RUDO H[DP VHVVLRQV WR GHWHUPLQH ZKHWKHU H[DP
LQHUV DUH DSSURSULDWHO\ DGPLQLVWHULQJ WKH H[DP 1HZ 0H[LFR·V
SV\FKRORJ\ ERDUG SODFHV REVHUYHUV LQ HYHU\ H[DP VHVVLRQ WR
HQVXUH H[DP SURFHGXUHV DUH IROORZHG DQG WR DVVLVW LQ VLWXDWLRQV
ZKHUH H[DPLQHUV KDYH TXHVWLRQV RU QHHG FODULILFDWLRQ )XUWKHU
RWKHU VWDWHV VXFK DV &DOLIRUQLD UDQGRPO\ VHOHFW H[DPV IRU UH
YLHZ WR HQVXUH DFFXUDF\
Board Has Options
to Address Problems
7KH %RDUG KDV D QXPEHU RI RSWLRQV DYDLODEOH WR DGGUHVV SURE
OHPV ZLWK LWV RUDO H[DP )LUVW WKH %RDUG FRXOG UHYLVH WKH H[DP
WDNLQJ VWHSV WR PHHW QDWLRQDO WHVWLQJ VWDQGDUGV 6HFRQG WKH
%RDUG FRXOG UHSODFH LWV RUDO H[DP ZLWK D QDWLRQDO RUDO H[DP
FXUUHQWO\ XQGHU GHYHORSPHQW RQFH WKH QDWLRQDO H[DP EHFRPHV
DYDLODEOH 7KLUG WKH %RDUG FRXOG VWRS XVLQJ WKH RUDO H[DP DQG
XVH WKH QDWLRQDO ZULWWHQ H[DP DV WKH ILQDO VWHS LQ LWV OLFHQVXUH
SURFHVV DV LW UHFHQWO\ YRWHG WR GR )RXUWK WKH %RDUG FRXOG UH
SODFH WKH RUDO H[DP ZLWK D PRUH OLPLWHG ZULWWHQ H[DP WHVWLQJ
RQO\ WKH DSSOLFDQWV· NQRZOHGJH RI $UL]RQD ODZ
n The Board could take steps to meet national standards
for its oral exam³,I WKH %RDUG FRQWLQXHV WR XVH LWV H[DP LW
VKRXOG WDNH VHYHUDO VWHSV WR EHWWHU HQVXUH LWV RUDO H[DP
PHHWV QDWLRQDO H[DP VWDQGDUGV )LUVW WKH %RDUG VKRXOG GH
YHORS DQG GRFXPHQW D PHDQLQJIXO UDWLRQDOH IRU LWV SDVV
7R FRQWLQXH XVLQJ LWV H[DP
%RDUG PXVW LQYHVW DGGLWLRQDO
WLPH H[SHUWLVH DQG UHVRXUFHV
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
SRLQW 6HFRQG WKH %RDUG VKRXOG ZRUN ZLWK H[SHUWV WR LP
SURYH H[DP TXHVWLRQV DQG FULWHULD IRU MXGJLQJ FDQGLGDWHV·
DQVZHUV &RORUDGR GRHV D PRGLILHG SUHWHVW RI LWV RUDO H[DP
XVLQJ OLFHQVHG SV\FKRORJLVWV WR LGHQWLI\ WHVW GHYHORSPHQW
SUREOHPV 7KLUG WKH %RDUG VKRXOG EHWWHU WUDLQ H[DPLQHUV WR
KHOS HQVXUH H[DP SURFHGXUHV DUH IROORZHG )RXUWK WKH
%RDUG VKRXOG IROORZ HVWDEOLVKHG SROLFLHV WR KHOS HQVXUH LWV
H[DP LV DSSURSULDWHO\ DQG HTXLWDEO\ VFRUHG )LQDOO\ WKH
%RDUG VKRXOG HVWDEOLVK DQG SURSHUO\ LPSOHPHQW TXDOLW\
FRQWURO DQG PRQLWRULQJ SURFHGXUHV $OWKRXJK WKHVH LP
SURYHPHQWV ZRXOG EHWWHU HQVXUH DFFXUDWH OLFHQVXUH GHFL
VLRQV WKH\ ZRXOG UHTXLUH DGGLWLRQDO HIIRUW DQG UHVRXUFHV
IURP WKH %RDUG DQG WKH YROXQWHHU H[DPLQHUV WKDW PD\ QRW
EH SUDFWLFDOO\ SRVVLEOH
n The Board could use a national oral exam when it be-comes
available—,I WKH %RDUG GHWHUPLQHV LW ODFNV WKH UH
VRXUFHV WR UHYLVH LWV RUDO H[DP DSSURSULDWHO\ WKH %RDUG
FRXOG UHSODFH LW ZLWK WKH QDWLRQDO RUDO H[DP FXUUHQWO\ EHLQJ
GHYHORSHG E\ WKH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO 3V\
FKRORJ\ %RDUGV $VVRFLDWLRQ DV SDUW RI LWV HIIRUWV WR HQFRXU
DJH UHFLSURFLW\ +RZHYHU WKH QDWLRQDO RUDO H[DP LV VWLOO LQ
WKH GHYHORSPHQW VWDJH DQG VHYHUDO LVVXHV UHPDLQ RXWVWDQG
LQJ )RU H[DPSOH WKH LVVXHV RI FRVW VHOHFWLQJ DQG WUDLQLQJ
H[DPLQHUV DQG HVWDEOLVKLQJ UHOLDELOLW\ KDYH QRW EHHQ UH
VROYHG )XUWKHU LI WKH %RDUG FKRRVHV WR XVH DQ H[DP GHYHO
RSHG E\ DQ RXWVLGH DJHQF\ QDWLRQDO WHVWLQJ VWDQGDUGV VWDWH
WKDW WKH %RDUG QHHGV WR ILUVW HQVXUH WKH H[DP·V DSSURSULDWH
QHVV $OWKRXJK WKH $VVRFLDWLRQ DQWLFLSDWHV WKH H[DP ZLOO EH
DYDLODEOH LQ ODWH WKH %RDUG VKRXOG ZDLW XQWLO WKH QD
WLRQDO H[DP KDV EHHQ SURYHQ UHOLDEOH EHIRUH DGRSWLQJ LW IRU
$UL]RQD·V XVH
n The Board could discontinue the oral exam³7KH %RDUG
FRXOG PDNH WKH QDWLRQDO ZULWWHQ H[DP WKH ILQDO VWHS LQ LWV OL
FHQVXUH SURFHVV 7KH %RDUG YRWHG WR GLVFRQWLQXH XVLQJ LWV
H[DP DW LWV -XQH PHHWLQJ EHFDXVH LW ODFNV WKH UHVRXUFHV
WR FRQWLQXH FRQGXFWLQJ DQG LPSURYLQJ WKH H[DP &XUUHQWO\
VWDWH SV\FKRORJ\ ERDUGV UHO\ VROHO\ RQ WKH QDWLRQDO ZULWWHQ
$IWHU DXGLW UHVHDUFK ZDV
FRPSOHWHG WKH %RDUG YRWHG WR
GLVFRQWLQXH LWV RUDO H[DP DW
LWV -XQH PHHWLQJ
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
H[DP DV WKH ILQDO WHVW RI DSSOLFDQWV· VNLOOV ,I $UL]RQD FRQWLQ
XHV ZLWK WKLV RSWLRQ DSSOLFDQWV ZRXOG EH OLFHQVHG ZKHQ WKH\
SDVV WKH QDWLRQDO ZULWWHQ H[DP
n The Board could replace oral exam with written exam³
$OWHUQDWLYHO\ LI WKH %RDUG ZDQWV WR IXUWKHU DVVHVV DSSOLFDQWV·
TXDOLILFDWLRQV WR SUDFWLFH LQ $UL]RQD LW FRXOG XVH D PRUH OLP
LWHG ZULWWHQ H[DP WHVWLQJ RQO\ WKH DSSOLFDQWV· NQRZOHGJH RI
$UL]RQD ODZ &XUUHQWO\ VWDWH SV\FKRORJ\ ERDUGV XVH VRPH
IRUP RI ZULWWHQ H[DP WHVWLQJ DSSOLFDQWV· NQRZOHGJH RI VWDWH
ODZ DV WKHLU ILQDO OLFHQVXUH VWHS DIWHU WKH DSSOLFDQW SDVVHV WKH
QDWLRQDO ZULWWHQ H[DP 2WKHU $UL]RQD KHDOWK UHJXODWRU\
ERDUGV VXFK DV WKH 6WDWH %RDUG RI 'HQWDO ([DPLQHUV DOVR XVH
D ZULWWHQ H[DP WHVWLQJ NQRZOHGJH RI $UL]RQD ODZ DV SDUW RI
WKHLU OLFHQVXUH SURFHVV )XUWKHU ZULWWHQ H[DPV UHTXLUH IHZHU
UHVRXUFHV WR GHYHORS DQG LPSOHPHQW WKDQ RUDO H[DPV
$V RI -DQXDU\ WKH VWDWHV WKDW UHO\ RQ WKH QDWLRQDO ZULWWHQ H[DP DV
WKH ODVW VWHS LQ WKHLU OLFHQVXUH SURFHVV DUH 'HODZDUH ,GDKR ,OOLQRLV .DQ
VDV 0LFKLJDQ 1HEUDVND 1HZ +DPSVKLUH 1HZ <RUN 3HQQV\OYDQLD
9HUPRQW DQG :\RPLQJ
$V RI -DQXDU\ WKH VWDWHV WKDW XVH VRPH IRUP RI ZULWWHQ H[DP WHVWLQJ
NQRZOHGJH RI VWDWH ODZ LQ DGGLWLRQ WR WKH QDWLRQDO ZULWWHQ H[DP DUH $OD
EDPD $ODVND &RQQHFWLFXW )ORULGD +DZDLL 0DU\ODQG 0DVVDFKXVHWWV
0LQQHVRWD 1RUWK &DUROLQD 8WDK DQG 9LUJLQLD
)LQGLQJ ,
2)),&( 2) 7+( $8',725 *(1(5$/
Recommendations
7KH %RDUG PXVW DGGUHVV SUREOHPV ZLWK LWV RUDO H[DP WR HQ
VXUH LWV OLFHQVXUH GHFLVLRQV DUH DSSURSULDWH 7KH %RDUG
VKRXOG FRQVLGHU WKH IROORZLQJ RSWLRQV
D 'HWHUPLQLQJ DQG REWDLQLQJ WKH QHFHVVDU\ UHVRXUFHV WR
LPSURYH WKH %RDUG·V RUDO H[DP E\ HVWDEOLVKLQJ D UDWLRQ
DOH IRU LWV SDVV SRLQW LPSURYLQJ TXHVWLRQ DQG FULWHULD
GHYHORSPHQW VXIILFLHQWO\ WUDLQLQJ H[DPLQHUV IROORZLQJ
HVWDEOLVKHG SROLFLHV DQG GHYHORSLQJ DQG LPSOHPHQWLQJ
TXDOLW\ FRQWUROV
E $GRSWLQJ WKH QDWLRQDO RUDO H[DP RQFH LW EHFRPHV DYDLO
DEOH DQG WKH %RDUG GHWHUPLQHV LWV DSSURSULDWHQHVV RU
F 'LVFRQWLQXLQJ WKH RUDO H[DP DQG UHO\LQJ VROHO\ RQ WKH
QDWLRQDO ZULWWHQ H[DP RU
G 5HSODFLQJ WKH RUDO H[DP ZLWK D PRUH OLPLWHG ZULWWHQ
H[DP UHJDUGLQJ RQO\ $UL]RQD ODZ
2)),&( 2) 7+( $8',725 *(1(5$/
OTHER PERTINENT INFORMATION
'XULQJ WKH DXGLW RWKHU SHUWLQHQW LQIRUPDWLRQ ZDV JDWKHUHG
UHJDUGLQJ WKH LVVXH RI JUDQWLQJ UHFLSURFLW\ WR OLFHQVXUH DSSOL
FDQWV ZKR SRVVHVV D SV\FKRORJLVW OLFHQVH IURP DQRWKHU VWDWH
Reciprocity
Options Exist
&XUUHQWO\ $UL]RQD GRHV QRW JUDQW UHFLSURFLW\ WR SV\FKRORJLVWV
OLFHQVHG E\ RWKHU VWDWHV 7KHUHIRUH PRVW RSWLRQV IRU JUDQWLQJ
OLFHQVLQJ UHFLSURFLW\ WR $UL]RQD DSSOLFDQWV OLFHQVHG E\ RWKHU
VWDWHV ZRXOG LQYROYH VRPH IRUP RI VWDWXWRU\ FKDQJH $OWKRXJK
PRVW RI $UL]RQD·V OLFHQVLQJ VWDQGDUGV IROORZ QDWLRQDO VWDQ
GDUGV WKH OLFHQVLQJ VWDWXWHV LQFOXGH VRPH VSHFLILF SURYLVLRQV
WKDW RWKHU VWDWHV GR QRW UHTXLUH 3DUWLFLSDWLRQ LQ QDWLRQDO UHFL
SURFLW\ SURJUDPV VXFK DV WKRVH SURSRVHG E\ WKH $VVRFLDWLRQ RI
6WDWH DQG 3URYLQFLDO 3V\FKRORJ\ %RDUGV ZRXOG UHTXLUH HOLPL
QDWLQJ WKHVH DGGLWLRQDO UHTXLUHPHQWV $ PRUH OLPLWHG DSSURDFK
LQ ZKLFK $UL]RQD JUDQWHG UHFLSURFLW\ RQO\ WR WKRVH VWDWHV WKDW
PHHW RU H[FHHG $UL]RQD UHTXLUHPHQWV ZRXOG QRW UHTXLUH
FKDQJHV WR FXUUHQW OLFHQVXUH VWDQGDUGV EXW PLJKW H[WHQG WR
UHODWLYHO\ IHZ VWDWHV 7KH %RDUG RI 3V\FKRORJLVW ([DPLQHUV KDV
VHYHUDO RSWLRQV DYDLODEOH IRU IXUWKHU UHYLHZ
5HFLSURFLW\ FRXOG VLPSOLI\ OLFHQVXUH SURFHVV³,I SV\FKRORJLVWV
OLFHQVHG LQ JRRG VWDQGLQJ LQ RWKHU VWDWHV ZLVK WR SUDFWLFH LQ $UL
]RQD WKH\ PXVW SURYLGH HYLGHQFH WKDW WKH\ PHHW $UL]RQD OL
FHQVLQJ UHTXLUHPHQWV 5HFLSURFLW\ FRXOG VLPSOLI\ WKH OLFHQVXUH
SURFHVV IRU VXFK SHUVRQV LQ WKDW LW ZRXOG DOORZ OLFHQVHG SUDFWL
WLRQHUV ZKR DOUHDG\ PHHW FXUUHQW $UL]RQD VWDQGDUGV WR E\SDVV
FUHGHQWLDO YHULILFDWLRQ UHTXLUHPHQWV
9HULILFDWLRQ UHTXLUHPHQWV FDQ SRVH SUREOHPV IRU FDQGLGDWHV
ZKR FRPSOHWHG WKHVH UHTXLUHPHQWV PDQ\ \HDUV DJR $SSOLFDQWV
IRU OLFHQVXUH DUH UHTXLUHG WR SURYLGH RULJLQDO GRFXPHQWDWLRQ RI
VXFK WKLQJV DV HGXFDWLRQDO WUDQVFULSWV DQG VXSHUYLVHG H[SHUL
HQFH ZKLFK FRXOG EH D GLIILFXOW SURFHVV IRU FDQGLGDWHV ZKR
FRPSOHWHG WKHLU LQWHUQVKLSV \HDUV DJR DQG DUH XQDEOH WR SUR
5HFLSURFLW\ DVVLVWV FDQGLGDWHV
ZKR PD\ ILQG YHULILFDWLRQ
UHTXLUHPHQWV SUREOHPDWLF
2WKHU 3HUWLQHQW ,QIRUPDWLRQ
2)),&( 2) 7+( $8',725 *(1(5$/
YLGH YHULILFDWLRQ 5HFLSURFLW\ ZRXOG PHDQ QRW KDYLQJ WR SUR
YLGH VXFK GRFXPHQWV
$UL]RQD·V OLFHQVXUH UHTXLUHPHQWV JHQHUDOO\ IROORZ QDWLRQDO
VWDQGDUGV EXW LQFOXGH VRPH DGGLWLRQDO UHTXLUHPHQWV DV ZHOO³
$UL]RQD·V JHQHUDO OLFHQVXUH UHTXLUHPHQWV DUH EDVHG RQ WKH
0RGHO /LFHQVXUH $FW RI WKH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO
3V\FKRORJ\ %RDUGV 7R LOOXVWUDWH $UL]RQD IROORZV WKH PRGHO E\
UHTXLULQJ D GRFWRUDO GHJUHH LQ SV\FKRORJ\ IURP DQ DFFUHGLWHG
SURJUDP KRXUV RI VXSHUYLVHG H[SHULHQFH DQG D VFRUH RI
SHUFHQW RQ WKH QDWLRQDO ZULWWHQ H[DP /LNH DOO RWKHU VWDWHV
$UL]RQD DOVR XVHV WKH $VVRFLDWLRQ·V QDWLRQDO ZULWWHQ H[DP
+RZHYHU $UL]RQD·V VWDWXWHV DOVR LQFOXGH VSHFLILF SURYLVLRQV
VXFK DV FRXUVHZRUN LQ HWKLFV DVVHVVPHQW DQG WUHDWPHQW WKDW
DUH QRW LQFOXGHG LQ WKH PRGHO DFW 7KH DFW SHUPLWV VXFK SURYL
VLRQV EXW WKH VSHFLILF SURYLVLRQV $UL]RQD KDV DGGHG PD\ GLIIHU
IURP RWKHU VWDWHV· VSHFLILF UHTXLUHPHQWV 7KHVH GLIIHUHQFHV FUH
DWH VRPH SUREOHPV IRU HVWDEOLVKLQJ UHFLSURFLW\ DJUHHPHQWV
8VLQJ H[LVWLQJ QDWLRQDO UHFLSURFLW\ SURJUDPV ZRXOG UHTXLUH
VWDWXWRU\ FKDQJH³7KH $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO 3V\
FKRORJ\ %RDUGV LV SURPRWLQJ WZR UHFLSURFLW\ RULHQWHG SUR
JUDPV 7KH ILUVW FDOOHG WKH $JUHHPHQW RI 5HFLSURFLW\ UHTXLUHV
SDUWLFLSDWLQJ VWDWHV WR UHFRJQL]H WKH SV\FKRORJ\ OLFHQVHV LVVXHG
E\ RWKHU SDUWLFLSDWLQJ VWDWHV 7KH VHFRQG WKH &HUWLILFDWH RI 3UR
IHVVLRQDO 4XDOLILFDWLRQ LQ 3V\FKRORJ\ &34 UHTXLUHV SDUWLFL
SDWLQJ VWDWHV WR OLFHQVH SV\FKRORJLVWV ZKR KDYH PHW WKH $VVR
FLDWLRQ·V FUHGHQWLDO UHTXLUHPHQWV &XUUHQWO\ VWDWHV SDUWLFLSDWH
LQ WKH $JUHHPHQW RI 5HFLSURFLW\ DQG VWDWHV UHFRJQL]H SV\
FKRORJLVWV· &34 FHUWLILFDWLRQ
7R SDUWLFLSDWH LQ HLWKHU SURJUDP DQG WUHDW DOO DSSOLFDQWV HTXDOO\
$UL]RQD ZRXOG KDYH WR HOLPLQDWH DQ\ VSHFLILF VWDWXWRU\ UH
TXLUHPHQWV QRW LQFOXGHG LQ WKH UHFLSURFLW\ SURJUDP·V UHTXLUH
PHQWV )RU H[DPSOH $UL]RQD UHTXLUHV LWV OLFHQVHHV WR KDYH D
GRFWRUDO GHJUHH IURP D GHVLJQDWHG SV\FKRORJ\ SURJUDP ,Q
FRQWUDVW &34 DOORZV D GRFWRUDO GHJUHH IURP D QRQ SV\FKRORJ\
$V RI $SULO WKH IROORZLQJ VWDWHV SDUWLFLSDWH LQ WKH $JUHHPHQW RI
5HFLSURFLW\ ,RZD .HQWXFN\ 0LVVLVVLSSL 0LVVRXUL 1HYDGD 2NODKRPD
DQG 7H[DV 7KH IROORZLQJ VWDWHV UHFRJQL]H &34 FHUWLILFDWLRQ &DOLIRUQLD
.HQWXFN\ 0LVVLVVLSSL 2KLR DQG 2NODKRPD
$UL]RQD OLFHQVXUH VWDQGDUGV
JHQHUDOO\ IROORZ 0RGHO /LFHQ
VXUH $FW
2WKHU 3HUWLQHQW ,QIRUPDWLRQ
2)),&( 2) 7+( $8',725 *(1(5$/
GHVLJQDWHG SURJUDP *LYHQ WKLV GLIIHUHQFH $UL]RQD ZRXOG EH
GHQ\LQJ LWV UHVLGHQW DSSOLFDQWV HTXDO WUHDWPHQW E\ KROGLQJ
WKHP WR D GLIIHUHQW VWDQGDUG WKDQ RXW RI VWDWH DSSOLFDQWV VHHN
LQJ OLFHQVXUH WKURXJK &34 UHFLSURFLW\
7R IXOO\ SDUWLFLSDWH LQ HLWKHU SURJUDP WKH 6WDWH ZRXOG HVVHQ
WLDOO\ FHGH OHJLVODWLYH DXWKRULW\ RYHU SV\FKRORJLVW OLFHQVXUH UH
TXLUHPHQWV WR WKH $VVRFLDWLRQ·V %RDUG %RWK WKH $JUHHPHQW RI
5HFLSURFLW\ DQG &34 UHTXLUH PHPEHU MXULVGLFWLRQV WR DFFHSW WKH
PLQLPXP VWDQGDUGV HVWDEOLVKHG LQ WKH SURJUDP·V FRQWUDFWV
)XUWKHU IXOO SDUWLFLSDWLRQ LQ HLWKHU SURJUDP UHTXLUHV PHPEHU
VWDWHV WR DFFHSW FKDQJHV WR FUHGHQWLDO VWDQGDUGV PDGH E\ WKH
$VVRFLDWLRQ·V %RDUG RI 'LUHFWRUV $V D UHVXOW $UL]RQD·V OLFHQ
VXUH VWDQGDUGV ZRXOG EH GHWHUPLQHG E\ WKH $VVRFLDWLRQ·V
%RDUG )RU WKLV UHDVRQ DQG RWKHU FRQFHUQV WKH $UL]RQD 3V\
FKRORJLFDO $VVRFLDWLRQ YRWHG WR RSSRVH $UL]RQD·V SDUWLFLSDWLRQ
LQ HLWKHU UHFLSURFLW\ SURJUDP
%RDUG KDV UHFLSURFLW\ RSWLRQV IRU UHYLHZ³$ QXPEHU RI UHFL
SURFLW\ RSWLRQV DUH DYDLODEOH IRU %RDUG UHYLHZ 2QH LV SDUWLFL
SDWLRQ LQ &34 ZKLFK WKH %RDUG LV FXUUHQWO\ HYDOXDWLQJ :KLOH
WKH $JUHHPHQW RI 5HFLSURFLW\ UHSUHVHQWV D VHFRQG RSWLRQ WKHUH
LV DQRWKHU YDULDWLRQ WKDW FRXOG DOORZ WKH 6WDWH WR NHHS LWV XQLTXH
UHTXLUHPHQWV DQG VWLOO SDUWLFLSDWH LQ UHFLSURFLW\ WKRXJK WR D
PRUH OLPLWHG GHJUHH 7KLV YDULDWLRQ ZRXOG EH WR HVWDEOLVK OLP
LWHG UHFLSURFLW\ ZLWK VWDWHV WKDW PHHW RU H[FHHG FXUUHQW $UL]RQD
OLFHQVXUH UHTXLUHPHQWV &XUUHQWO\ DW OHDVW VWDWHV DOORZ OLFHQ
VXUH E\ HQGRUVHPHQW IRU SV\FKRORJLVWV OLFHQVHG E\ VWDWHV ZLWK
VLPLODUO\ VWULQJHQW UHTXLUHPHQWV +RZHYHU EHFDXVH VXFK
DJUHHPHQWV ZRXOG EH OLPLWHG RQO\ WR WKRVH VWDWHV ZKRVH UHJX
ODWRU\ UHTXLUHPHQWV PDWFKHG $UL]RQD·V WKH QXPEHU RI VWDWHV
FRXOG EH VPDOO $ WKLUG RSWLRQ ZRXOG EH IRU WKH %RDUG WR UHYLHZ
LWV VWDWXWRU\ UHTXLUHPHQWV DQG GHWHUPLQH LI SRVVLELOLWLHV H[LVW WR
PDNH WKHP PRUH FRPSDUDEOH WR RWKHU VWDWHV· UHTXLUHPHQWV )RU
H[DPSOH WKH %RDUG DOUHDG\ SODQV WR VHHN D VWDWXWRU\ FKDQJH WR
LWV VXSHUYLVHG H[SHULHQFH UHTXLUHPHQWV WR PDNH WKHP PRUH
VLPLODU WR RWKHU VWDWHV· OLFHQVXUH SURYLVLRQV
7KH VWDWHV WKDW DOORZ OLFHQVXUH E\ HQGRUVHPHQW IRU DSSOLFDQWV OLFHQVHG E\
VWDWHV ZLWK VLPLODU RU PRUH VWULQJHQW UHTXLUHPHQWV LQFOXGH &RORUDGR
)ORULGD ,OOLQRLV ,QGLDQD 0LVVRXUL 9HUPRQW DQG :\RPLQJ
6RPH UHFLSURFLW\ SURJUDPV
FRXOG OLPLW /HJLVODWXUH·V
DXWKRULW\ RYHU OLFHQVXUH VWDQ
GDUGV
2WKHU 3HUWLQHQW ,QIRUPDWLRQ
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
2)),&( 2) 7+( $8',725 *(1(5$/
SUNSET FACTORS
,Q DFFRUGDQFH ZLWK $ 5 6 WKH /HJLVODWXUH VKRXOG FRQ
VLGHU WKH IROORZLQJ IDFWRUV LQ GHWHUPLQLQJ ZKHWKHU WKH $UL
]RQD %RDUG RI 3V\FKRORJLVW ([DPLQHUV %RDUG VKRXOG EH FRQ
WLQXHG RU WHUPLQDWHG
1. The objective and purpose in establishing the
Board.
7KH %RDUG ZDV HVWDEOLVKHG LQ WR FHUWLI\ SV\FKROR
JLVWV LQ $UL]RQD ,Q WKH %RDUG·V VWDWXWHV ZHUH
DPHQGHG WR LQFUHDVH WKH OHYHO RI UHJXODWLRQ IURP FHUWLIL
FDWLRQ WR OLFHQVXUH 7KH %RDUG·V PLVVLRQ LV ´7R SURWHFW
WKH KHDOWK VDIHW\ DQG ZHOIDUH RI $UL]RQD·V FLWL]HQV E\
UHJXODWLQJ WKH SV\FKRORJ\ SURIHVVLRQ µ
7KH %RDUG KDV HVWDEOLVKHG JRDOV WR PHHW LWV PLVVLRQ
7KHVH JRDOV LQFOXGH HIILFLHQWO\ SURFHVVLQJ OLFHQVXUH
DSSOLFDWLRQV FRPSOHWLQJ LQYHVWLJDWLRQ DQG DGMXGLFD
WLRQ RI FRPSODLQWV LQ D WLPHO\ PDQQHU DQG SURWHFWLQJ
WKH SXEOLF WKURXJK LPSOHPHQWDWLRQ RI D SURJUDP RI FRQ
WLQXLQJ HGXFDWLRQ WR DVVXUH WKDW OLFHQVHHV PDLQWDLQ DQG
FRQWLQXH WR LPSURYH WKHLU FRPSHWHQFH LQ SURYLGLQJ SV\
FKRORJLFDO VHUYLFHV
2. The effectiveness with which the Board has met its
objective and purpose and the efficiency with which
it has operated.
7KLV DXGLW LGHQWLILHG SUREOHPV ZLWK WKH %RDUG·V RUDO
H[DP WKDW LPSDFW WKH DSSURSULDWHQHVV RI %RDUG OLFHQVXUH
GHFLVLRQV 7KH %RDUG KDV H[SHULHQFHG SUREOHPV ZLWK WKH
RUDO H[DP WKDW PDNH LW DQ LQDSSURSULDWH WRRO WR DVVHVV
FDQGLGDWHV· TXDOLILFDWLRQV 3UREOHPV UHVXOW IURP WKH
%RDUG QRW WDNLQJ WKH QHFHVVDU\ VWHSV WR SURSHUO\ DG
PLQLVWHU LWV H[DP 7KH %RDUG KDV RSWLRQV WR LPSURYH WKH
H[DP RU GLVFRQWLQXH LWV XVH VHH )LQGLQJ , SDJHV
WKURXJK
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
+RZHYHU WKH %RDUG LV JHQHUDOO\ HIILFLHQW DQG HIIHFWLYH LQ
LPSOHPHQWLQJ LWV PLVVLRQ DQG REMHFWLYHV VHH ,QWURGXF
WLRQ DQG %DFNJURXQG SDJHV WKURXJK 7KH %RDUG·V
HIIHFWLYHQHVV LQFOXGHV
n ,VVXLQJ OLFHQVHV LQ D WLPHO\ PDQQHU
n 5HVROYLQJ FRPSODLQWV DSSURSULDWHO\ DQG LQ D WLPHO\
PDQQHU
n 5HVSRQGLQJ WR SXEOLF LQIRUPDWLRQ UHTXHVWV WKRU
RXJKO\ DFFXUDWHO\ DQG LQ D WLPHO\ PDQQHU DQG
n 0DLQWDLQLQJ LWV GDWDEDVH FRPSOHWHO\ DQG DFFXUDWHO\
3. The extent to which the Board has operated within
the public interest.
$OWKRXJK WKH %RDUG RSHUDWHV LQ WKH SXEOLF LQWHUHVW E\
WLPHO\ DQG DSSURSULDWHO\ GLVFLSOLQLQJ SV\FKRORJLVWV WKH
%RDUG·V RUDO H[DP LV QRW DQ DSSURSULDWH WRRO WR HQVXUH
WKDW SV\FKRORJLVWV DUH FRPSHWHQW WR SUDFWLFH LQ $UL]RQD
VHH )LQGLQJ , SDJHV WKURXJK
7KH %RDUG FRXOG SRWHQWLDOO\ GR PRUH WR RSHUDWH LQ WKH
SXEOLF LQWHUHVW LI LWV SXEOLF PHPEHUVKLS ZDV LQFUHDVHG
FORVHU WR SHUFHQW 3UHYLRXV $XGLWRU *HQHUDO UHSRUWV
UHFRPPHQG WKDW SXEOLF PHPEHUVKLS RI UHJXODWRU\
ERDUGV EH SHUFHQW &XUUHQWO\ WKH %RDUG·V VWDWXWHV UH
TXLUH VHYHQ PHPEHUV WR EH OLFHQVHG SV\FKRORJLVWV DQG
RQO\ WZR RU DSSUR[LPDWHO\ SHUFHQW WR EH SXEOLF
PHPEHUV 7R LQFUHDVH SXEOLF PHPEHUVKLS FORVHU WR
SHUFHQW WKH /HJLVODWXUH ZRXOG QHHG WR DPHQG $ 5 6
$XGLWRUV LGHQWLILHG RWKHU VWDWHV ZLWK SV\FKRO
RJ\ ERDUGV WKDW KDG D KLJKHU SHUFHQWDJH RI SXEOLF UHSUH
VHQWDWLRQ )RU H[DPSOH LQ &DOLIRUQLD·V /HJLVODWXUH
DGGHG DQRWKHU SXEOLF PHPEHU WR WKH &DOLIRUQLD %RDUG RI
3V\FKRORJ\ &DOLIRUQLD·V %RDUG QRZ FRQVLVWV RI QLQH
PHPEHUV IRXU RI ZKRP DUH SXEOLF PHPEHUV $Q LQ
FUHDVH LQ SXEOLF PHPEHUVKLS FRXOG SRWHQWLDOO\ LQFUHDVH
FRQVXPHU DGYRFDF\ RQ WKH %RDUG
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
,Q RUGHU WR LQFUHDVH WKH SRWHQWLDO IRU SXEOLF PHPEHUV WR
EH HIIHFWLYH DGYRFDWHV IRU WKH SXEOLF WKH\ PXVW EH VH
OHFWHG DQG WUDLQHG IRU WKDW SXUSRVH $V GLVFXVVHG LQ D
SUHYLRXV $XGLWRU *HQHUDO UHSRUW RQ WKH KHDOWK UHJXOD
WRU\ V\VWHP VHH 5HSRUW 1R SXEOLF PHPEHUV
VKRXOG UHFHLYH WUDLQLQJ RQ WKH LPSRUWDQFH RI WKHLU SXEOLF
SURWHFWLRQ UROH 7KH *RYHUQRU·V 2IILFH IRU ([FHOOHQFH LQ
*RYHUQPHQW RIIHUV WUDLQLQJ IRU ERDUG PHPEHUV KRZ
HYHU WKH WUDLQLQJ GRHV QRW LQFOXGH LQIRUPDWLRQ RQ WKH
LPSRUWDQFH RI WKHLU SXEOLF SURWHFWLRQ UROH
4. The extent to which rules adopted by the Board are
consistent with the legislative mandate.
7KH %RDUG SURPXOJDWHV UXOHV SXUVXDQW WR $ 5 6
$ $W WKH 2IILFH RI WKH $XGLWRU *HQHUDO·V UH
TXHVW WKH *RYHUQRU·V 5HJXODWRU\ 5HYLHZ &RXQFLO UH
YLHZHG WKH %RDUG·V VWDWXWHV DQG GHWHUPLQHG WKDW WKH
%RDUG KDV GHYHORSHG DOO WKH UXOHV WKDW DUH UHTXLUHG E\
VWDWXWH
5. The extent to which the Board has encouraged input
from the public before adopting its rules, and the ex-tent
to which it has informed the public as to its ac-tions
and their expected impact on the public.
7KH %RDUG HQFRXUDJHV SXEOLF LQSXW EHIRUH DGRSWLQJ LWV
UXOHV DQG LQ PRVW UHVSHFWV LW FRPSOLHV ZLWK 2SHQ
0HHWLQJ /DZV 7KH %RDUG KDV FRPSOLHG ZLWK SXEOLF QR
WLILFDWLRQ UHTXLUHPHQWV IRU DGRSWLQJ UXOHV DQG LQYLWHV WKH
SXEOLF WR GLVFXVV DQ\ PDWWHU DW WKH EHJLQQLQJ RI HYHU\
%RDUG PHHWLQJ 7KH %RDUG FRPSOLHV ZLWK 2SHQ 0HHWLQJ
/DZV UHJDUGLQJ SRVWLQJ SXEOLF PHHWLQJ QRWLFHV DQG
PHHWLQJ DJHQGDV DW OHDVW KRXUV LQ DGYDQFH DV ZHOO DV
UHTXLUHPHQWV IRU NHHSLQJ PLQXWHV RI PHHWLQJV )LQDOO\
WKH %RDUG VHQGV FXVWRPHU VDWLVIDFWLRQ VXUYH\V WR FRP
SODLQDQWV DFFXVHG SV\FKRORJLVWV DQG OLFHQVXUH DSSOL
FDQWV WR VROLFLW IHHGEDFN RQ LWV SURFHVVHV
,Q RQH UHVSHFW KRZHYHU WKH %RDUG GLG QRW FRPSO\ ZLWK
2SHQ 0HHWLQJ /DZ UHTXLUHPHQWV 2SHQ 0HHWLQJ /DZV
VWDWH WKDW DQ ([HFXWLYH 6HVVLRQ FDQ RQO\ EH XVHG IRU OHJDO
DGYLFH HPSOR\HH UHODWHG LVVXHV FRQVLGHUDWLRQ RI UHF
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
RUGV H[HPSW E\ ODZ IURP SXEOLF LQVSHFWLRQ DQG VSHFLILF
QHJRWLDWLRQ WRSLFV +RZHYHU WKH %RDUG KLVWRULFDOO\ GLV
FXVVHG RUDO H[DP LVVXHV LQ ([HFXWLYH 6HVVLRQ RQ WKH DG
YLFH RI LWV IRUPHU $WWRUQH\ *HQHUDO UHSUHVHQWDWLYH 7KH
%RDUG KDV QR VWDWXWRU\ DXWKRULW\ WKDW PDNHV RUDO H[DPV
H[HPSW IURP SXEOLF GLVFORVXUH RU WKDW SHUPLWV WKH %RDUG
WR GLVFXVV DQ\ LVVXHV UHJDUGLQJ WKH RUDO H[DP LQ ([HFX
WLYH 6HVVLRQ %\ GLVFXVVLQJ DOO DVSHFWV RI WKH RUDO H[DP LQ
([HFXWLYH 6HVVLRQ WKH %RDUG GHQLHG H[DP FDQGLGDWHV LQ
IRUPDWLRQ UHJDUGLQJ WKH RUDO H[DP·V DSSURSULDWHQHVV $V
RI LWV $SULO ERDUG PHHWLQJ WKH %RDUG KDV GLVFRQ
WLQXHG GLVFXVVLQJ WKH RUDO H[DP LQ ([HFXWLYH 6HVVLRQ
7KH %RDUG VKRXOG HQVXUH WKDW IXWXUH GLVFXVVLRQV UH
JDUGLQJ WKH RUDO H[DP WDNH SODFH GXULQJ WKH SXEOLF VHV
VLRQ RI ERDUG PHHWLQJV XQOHVV LWV VWDWXWHV DUH PRGLILHG
6. The extent to which the Board has been able to in-vestigate
and resolve complaints that are within its
jurisdiction.
7KH %RDUG LV JUDQWHG WKH DXWKRULW\ WR SHUIRUP LQYHVWLJD
WLRQV DQG UHVROYH FRPSODLQWV SXUVXDQW WR $ 5 6
$ DQG $ 5 6 7KLV DXGLW FRQFOXGHV
WKDW WKH %RDUG LQYHVWLJDWHV DQG UHVROYHV FRPSODLQWV LQ DQ
DSSURSULDWH DQG WLPHO\ PDQQHU
7KH %RDUG·V GLVFLSOLQDU\ SURFHVV DSSHDUV DGHTXDWH 7R
UHVROYH FRPSODLQWV WKH %RDUG KDV YDULRXV RSWLRQV DYDLO
DEOH WR LW UDQJLQJ IURP GLVPLVVDO WR OLFHQVH UHYRFDWLRQ
7KH %RDUG KDV H[SDQGHG LWV FRPSODLQW UHVROXWLRQ RS
WLRQV DV UHFRPPHQGHG E\ WKH $XGLWRU *HQHUDO·V 2IILFH
LQ WKH %RDUG·V 6XQVHW UHYLHZ 5HSRUW 1R 7KH
%RDUG KDV DGGHG WKH XVH RI OHWWHUV RI FRQFHUQ DQG GH
FUHHV RI FHQVXUHV WR LWV FRPSODLQW UHVROXWLRQ RSWLRQV
)XUWKHU WKH %RDUG KDV HVWDEOLVKHG DQG LPSOHPHQWHG
JXLGHOLQHV IRU GLVFLSOLQLQJ YLRODWRUV ,Q WKH %RDUG
FUHDWHG D VWDII LQYHVWLJDWRU SRVLWLRQ 3ULRU WR HVWDEOLVKLQJ
WKLV SRVLWLRQ WKH %RDUG FRQWUDFWHG IRU LQYHVWLJDWLRQV RU
WKH %RDUG PHPEHUV WKHPVHOYHV SHUIRUPHG WKH LQYHVWL
JDWLRQV )LQDOO\ RQFH GLVFLSOLQDU\ DFWLRQ LV WDNHQ WKH
%RDUG HQVXUHV FRPSOLDQFH E\ PRQLWRULQJ WKH GLVFLSOLQHG
SV\FKRORJLVW
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
7. The extent to which the Attorney General or any
other applicable agency of state government has the
authority to prosecute actions under the enabling
legislation.
3XUVXDQW WR $ 5 6 WKH $WWRUQH\ *HQHUDO KDV WKH
DXWKRULW\ WR SURVHFXWH DFWLRQV DQG UHSUHVHQW WKH %RDUG
$ 5 6 DQG GHILQH YLRODWLRQV DQG HVWDE
OLVK SHQDOWLHV 7KH %RDUG UHFHQWO\ UHIHUUHG RQH FRP
SODLQW WKDW LQYROYHG LQVXUDQFH IUDXG WR WKH $WWRUQH\
*HQHUDO·V 2IILFH IRU FULPLQDO SURVHFXWLRQ 3XUVXDQW WR
$ 5 6 WKH %RDUG PD\ DOVR SHWLWLRQ WKH 6XSH
ULRU &RXUW WR SUHYHQW DQ XQOLFHQVHG SHUVRQ IURP SUDF
WLFLQJ SV\FKRORJ\ RU WR VWRS WKH DFWLYLWLHV RI D OLFHQVHH
WKDW DUH DQ LPPHGLDWH WKUHDW WR WKH SXEOLF
8. The extent to which the Board has addressed defi-ciencies
in its enabling statutes which prevent it
from fulfilling its statutory mandate.
7KH %RDUG KDV VRXJKW D QXPEHU RI VWDWXWRU\ FKDQJHV UH
FHQWO\ WR DGGUHVV GHILFLHQFLHV LQ LWV VWDWXWHV ,Q WKH
%RDUG VRXJKW DQG OHJLVODWLRQ ZDV SDVVHG WR LQFUHDVH OL
FHQVXUH DQG H[DP IHH FDSV IRU WKH ILUVW WLPH VLQFH
$GGLWLRQDOO\ LQ WKH %RDUG SURSRVHG DQG WKH /HJ
LVODWXUH SDVVHG VWDWXWRU\ FKDQJHV UHJDUGLQJ WKH UHOHDVH
RI UHFRUGV QRW LVVXLQJ DQ DQQXDO UHSRUW DQG RWKHU FODUL
ILFDWLRQV )LQDOO\ LQ OHJLVODWLRQ SDVVHG WR DPHQG WKH
%RDUG·V VWDWXWHV WR LQFOXGH VH[XDO LQWHUFRXUVH ZLWK D FXU
UHQW RU IRUPHU FOLHQW ZLWKLQ WZR \HDUV DIWHU WKH HQG RI
WUHDWPHQW DV XQSURIHVVLRQDO FRQGXFW WR DOORZ WKH
%RDUG·V H[HFXWLYH GLUHFWRU WR LVVXH VXESRHQDV WR LQ
FUHDVH ERDUG PHPEHU FRPSHQVDWLRQ DQG RWKHU FODULILFD
WLRQV
9. The extent to which changes are necessary in the
laws of the Board to adequately comply with the fac-tors
listed in the Sunset review statute.
7KH /HJLVODWXUH VKRXOG FRQVLGHU PRGLI\LQJ $ 5 6
WR LQFUHDVH WKH QXPEHU RI SXEOLF PHPEHUV RQ WKH
%RDUG FORVHU WR SHUFHQW VHH IXUWKHU GLVFXVVLRQ XQGHU
6XQVHW )DFWRU SDJH
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
$GGLWLRQDOO\ WKH /HJLVODWXUH VKRXOG FRQVLGHU PRGLI\LQJ
WKH %RDUG·V VWDWXWHV WR NHHS D FDQGLGDWH·V H[DP VFRUHV
FRQILGHQWLDO 2WKHU $UL]RQD UHJXODWRU\ ERDUGV LQFOXGLQJ
WKH 9HWHULQDU\ 0HGLFDO ([DPLQLQJ %RDUG KDYH WKH
VWDWXWRU\ DXWKRULW\ WR NHHS WKH FDQGLGDWHV· H[DP VFRUHV
FRQILGHQWLDO
10. The extent to which the termination of the Board
would significantly harm the public health, safety, or
welfare.
7HUPLQDWLQJ WKH %RDUG ZRXOG KDUP WKH SXEOLF KHDOWK
VDIHW\ DQG ZHOIDUH EHFDXVH ZLWKRXW LW WKH SUDFWLFH RI
SV\FKRORJ\ ZRXOG QRW EH UHJXODWHG :LWKRXW UHJXODWLRQ
FRQVXPHUV RI SV\FKRORJLFDO WUHDWPHQW ZRXOG ODFN SUR
WHFWLRQ IURP XQSURIHVVLRQDO FRQGXFW DQG WKH DVVXUDQFH
WKDW WKHLU SV\FKRORJLVWV PHHW DSSURSULDWH VWDQGDUGV
$GGLWLRQDOO\ SV\FKRORJLVWV PXVW EH OLFHQVHG LQ RUGHU WR
UHFHLYH PHGLFDO LQVXUDQFH DQG JRYHUQPHQWDO UHLP
EXUVHPHQW IRU SV\FKRORJLFDO VHUYLFHV )LQDOO\ QR RWKHU
VWDWH DJHQF\ SHUIRUPV D VLPLODU IXQFWLRQ RI OLFHQVLQJ
SV\FKRORJLVWV
11. The extent to which the level of regulation exercised
by the Board is appropriate and whether less or
more stringent levels of regulation would be appro-priate.
3ULRU WR WKH %RDUG FHUWLILHG SV\FKRORJLVWV UDWKHU
WKDQ OLFHQVHG WKHP 7KLV OHYHO RI UHJXODWLRQ LV VRPHZKDW
OHVV VWULQJHQW LQ WKDW LW GRHV QRW UHTXLUH WKH VFRSH RI
SUDFWLFH WR EH GHILQHG 7KH $XGLWRU *HQHUDO·V 2IILFH FRQ
FOXGHG LQ LWV UHSRUW 5HSRUW 1R WKDW FHUWLILFD
WLRQ ZDV DQ DGHTXDWH OHYHO RI UHJXODWLRQ +RZHYHU LQ
WKH /HJLVODWXUH GHFLGHG WR HPSOR\ D KLJKHU OHYHO RI
UHJXODWLRQ DQG DPHQGHG WKH %RDUG·V VWDWXWHV IURP SV\
FKRORJLVW FHUWLILFDWLRQ WR SV\FKRORJLVW OLFHQVXUH &XU
UHQWO\ DOO EXW WKUHH VWDWHV $UNDQVDV 0RQWDQD DQG
:DVKLQJWRQ OLFHQVH UDWKHU WKDQ FHUWLI\ SV\FKRORJLVWV
6XQVHW )DFWRUV
2)),&( 2) 7+( $8',725 *(1(5$/
12. The extent to which the Board has used private con-tractors
in the performance of its duties and how ef-fective
use of private contractors could be accom-plished.
7KH %RDUG FXUUHQWO\ XVHV SULYDWH FRQWUDFWRUV IRU VXFK
VHUYLFHV DV FRXUW UHSRUWLQJ DQG RFFDVLRQDOO\ IRU UXOH
ZULWLQJ DQG FRPSODLQW LQYHVWLJDWLRQV 7KH %RDUG KDV
DOVR XVHG SULYDWH FRQWUDFWRUV IRU RUDO H[DP VWDWLVWLFDO
DQDO\VLV )XUWKHU WKH %RDUG DOVR XVHV OLFHQVHG SV\FKROR
JLVW YROXQWHHUV WR GHYHORS DQG DGPLQLVWHU WKH %RDUG·V
RUDO H[DP 7KHVH YROXQWHHUV HDUQHG FRQWLQXLQJ HGXFD
WLRQ FUHGLWV IRU WKHLU VHUYLFHV
7KHUH DUH SRWHQWLDOO\ IXUWKHU RSSRUWXQLWLHV IRU WKH %RDUG
WR XVH SULYDWH FRQWUDFWRUV 7KH $VVRFLDWLRQ RI 6WDWH DQG
3URYLQFLDO 3V\FKRORJ\ %RDUGV $VVRFLDWLRQ LV FXUUHQWO\
GHYHORSLQJ D QDWLRQDO RUDO H[DP 7KH %RDUG FRXOG FRQ
WUDFW ZLWK WKH $VVRFLDWLRQ WR XVH WKH QDWLRQDO RUDO H[DP
DV D UHSODFHPHQW IRU LWV RUDO H[DP RQFH LW LV DYDLODEOH DQG
GHHPHG DSSURSULDWH ,I WKH %RDUG GHFLGHV WR FRQWLQXH WR
XVH LWV RZQ RUDO H[DP LW PD\ ZDQW WR FRQVLGHU FRQ
WUDFWLQJ ZLWK H[SHUWV WR KHOS GHYHORS DQG UHYLHZ WKH RUDO
H[DP VHH )LQGLQJ , SDJHV WKURXJK
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
2)),&( 2) 7+( $8',725 *(1(5$/
Agency Response
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
State of Arizona
Board of Psychologist Examiners
Board Members Staff
T.H. Guerin, Jr., J.D. Maxine McCarthy
Chair Executive Director
Maureen K. Lassen, Ph.D.
Vice-Chair
Gary D. Lovejoy, Ph.D. Wendy Sticht
Secretary Projects Specialist
Denise M. Bainton, J.D.
Janice K. Brundage, Ph.D. Diane Lucas
Wil R. Counts, Ph.D. 1400 West Washington, Suite 235 Administrative Secretary
Eugene R. Moan, Ed.D. Phoenix, Arizona 85007
Maryann Santos de Barona, Ph.D. Phone: 602-542-8162 Fax: 602-542-8279 David S. Shapiro
David P. Yandell, Ph.D. E Mail: azbpe@goodnet.com www.goodnet.com/~azbpe Investigator
July 26, 1999
Mr. Douglas R. Norton
Office of the Auditor General
2910 N 44th Street, Suite 410
Phoenix AZ 85018
Dear Mr. Norton:
Enclosed is the Final Response of the Arizona Board of Psychologist Examiners to the
Performance Audit conducted in response to a May 27, 1997, resolution of the Joint
Legislative Audit Committee.
The Board of Psychologist Examiners wishes to compliment your staff on the thoroughness
of your investigation, the comprehensiveness of your final report and your sensitivity to the
Board and consumers of psychological services. Most importantly, the Board appreciates
the fact that the audit report reflects a high degree of confidence in the Board’s
performance by stating that the Board is generally efficient and effective in fulfilling its
responsibilities.
If the Board or its staff may be of further assistance, we would be pleased to accommodate
you.
Sincerely,
T.H. Guerin, Jr.
Chairman of the Board
Public Member
admin/norton.doc
FINAL RESPONSE TO PERFORMANCE AUDIT
CONDUCTED BY THE OFFICE OF THE AUDITOR GENERAL
INTRODUCTION AND BACKGROUND
General – Board Is Efficient And Effective
The Board concurs with the Auditors’ findings that it fulfills its responsibilities efficiently and
effectively in the following areas:
· Issuing licenses in a timely manner
· Resolving complaints in a timely and appropriate manner
· Providing accurate and complete public information in an appropriate manner
FINDING 1 – Problems with Oral Exam
The Auditors performed a very thorough review of the Board’s oral examination process. The
Board acknowledges certain problems identified by the auditors in several areas.
OPTIONS TO ADDRESS ORAL EXAM PROBLEMS
The finding of the Auditor General is agreed to and the recommendation to discontinue the oral
examination has already been implemented as the Board had been reviewing this issue for a
number of months.
The Board, at its meeting of June 4, 1999, voted to discontinue its use of the oral examination
due to lack of resources to continue to conduct and improve the examination procedures, and to
eliminate the oral examination requirement for all applications filed after June 4, 1999.
OTHER PERTINENT INFORMATION
During the audit, other pertinent information was gathered regarding the issue of granting
reciprocity to licensure applicants who possess a psychologist license from another state.
Several of the options outlined by the Auditors have merit.
The Board has formed a committee to study the topic of reciprocity and mobility and will
continue to explore strategies to address these issues to ensure protection of the citizens of
Arizona.
SUNSET FACTORS
· Increasing Public Membership on Board (Sunset Factor No. 3)
The Board respectfully disagrees with this recommendation.
The Board is operating effectively and efficiently with the current makeup of the Board. The
Board’s seven professional members are the best qualified to judge their peers due to their
education and diverse technical expertise in dealing with complex psychological issues. As
stated in a report published by the Auditor General’s Office in December of 1995, (Report
BOARD OF PSYCHOLOGIST EXAMINERS
2
No. 95-13), most studies conclude that adding public members made no significant
difference in Board performance.
Expanding the number of public members on the Board would possibly have an adverse
impact on the Board’s budget, resulting in increases in per diem, travel, and lodging
expenses.
· Open Meeting Law Compliance (Sunset Factor No. 5)
The finding of the Auditor General is agreed to and the recommendation has already been
implemented.
The Board complies with the Open Meeting laws; however, the Board was historically
unaware that it could not discuss oral examination issues in Executive Session. It was the
policy of the Board over the years, based upon advice from representatives of the Attorney
General’s Office, to discuss both oral and written examination scores in Executive Session
on the belief that the scores were confidential. Once the Board received legal advice from
its Assistant Attorney General, the Board followed the legal advice and discussed oral
examination issues only in public sessions.
· Revisions to Board’s Statutes (Sunset Factor No. 9)
The Board agrees with the finding regarding modifying the Board’s statutes to keep a
candidate’s examination score confidential and the recommendation will be implemented.
The recommendation to revise Board statutes to keep examination scores confidential has
merit. The Board will review the statutory language of other Arizona regulatory Boards,
such as the Veterinary Medical Examining Board, for assistance in drafting statutory
language.
2)),&( 2) 7+( $8',725 *(1(5$/
Appendix
2)),&( 2) 7+( $8',725 *(1(5$/
7KLV 3DJH ,QWHQWLRQDOO\ /HIW %ODQN
D L
2)),&( 2) 7+( $8',725 *(1(5$/
Appendix
n +LOO 'LDQH $Q $VVHVVPHQW 7RRO LQ &UHGHQWLDOLQJ 7KH
2UDO ([DPLQDWLRQ IRU /LFHQVXUH &RPSUHKHQVLYH &OLQLFDO
3V\FKRORJ\ 9ROXPH
n 1RY\ ' 0 .RSHO . ) DQG 6ZDQN 3 5 3V\FKRPHW
ULFV RI 2UDO ([DPLQDWLRQV IRU 3V\FKRORJ\ /LFHQVXUH 7KH
7H[DV ([DPLQDWLRQ DV DQ ([DPSOH 3URIHVVLRQDO 3V\FKRO
RJ\ 5HVHDUFK DQG 3UDFWLFH 9ROXPH
n &RXQFLO RQ /LFHQVXUH (QIRUFHPHQW DQG 5HJXODWLRQ
&/($5 'HYHORSPHQW $GPLQLVWUDWLRQ 6FRULQJ DQG 5H
SRUWLQJ RI &UHGHQWLDOLQJ ([DPLQDWLRQV 5HFRPPHQGDWLRQV IRU
%RDUG 0HPEHUV VW HG &RXQFLO RQ /LFHQVXUH (QIRUFHPHQW
DQG 5HJXODWLRQ &/($5
n +LOO ' 6 (GZDUGV + 3 &UDZIRUG : :DUQHU - 2UDO
([DPLQDWLRQV IRU /LFHQVLQJ RU &HUWLILFDWLRQ $ 0DQXDO IRU
3V\FKRORJ\ %RDUGV $VVRFLDWLRQ RI 6WDWH DQG 3URYLQFLDO
3V\FKRORJ\ %RDUGV
n 7KH $PHULFDQ 3V\FKRORJLFDO $VVRFLDWLRQ (GXFDWLRQDO 5H
VHDUFK $VVRFLDWLRQ DQG 1DWLRQDO &RXQFLO RQ 0HDVXUHPHQW
LQ (GXFDWLRQ 6WDQGDUGV IRU (GXFDWLRQDO DQG 3V\FKRORJLFDO
7HVWLQJ 7KH $PHULFDQ (GXFDWLRQDO 5HVHDUFK $VVRFLDWLRQ
$PHULFDQ 3V\FKRORJLFDO $VVRFLDWLRQ DQG 1DWLRQDO &RXQFLO
RQ 0HDVXUHPHQW LQ (GXFDWLRQ
n )RUWXQH -LP DQG $VVRFLDWHV 8QGHUVWDQGLQJ 7HVWLQJ LQ 2FFX
SDWLRQDO /LFHQVLQJ 6DQ )UDQFLVFR -RVVH\ %DVV 3XEOLVKHUV
n .DQH 0LFKDHO 7KH 9DOLGLW\ RI /LFHQVXUH ([DPLQDWLRQV
$PHULFDQ 3V\FKRORJLVW 9ROXPH $XJXVW
Other Performance Audit Reports Issued Within
the Last 12 Months
$UL]RQD 8QLYHUVLWLHV· (QUROOPHQW
3ULYDWH (QWHUSULVH 5HYLHZ %RDUG
$GXOW 6HUYLFHV
3RGLDWU\ %RDUG
%RDUG RI 0HGLFDO ([DPLQHUV
'HSDUWPHQW RI +HDOWK 6HUYLFHV³
'LYLVLRQ RI $VVXUDQFH DQG /LFHQVXUH
*RYHUQRU·V &RXQFLO RQ 'HYHORS
PHQWDO 'LVDELOLWLHV
3HUVRQQHO %RDUG
'HSDUWPHQW RI /LTXRU
'HSDUWPHQW RI ,QVXUDQFH
6WDWH &RPSHQVDWLRQ )XQG
'HSDUWPHQW RI $GPLQLVWUDWLRQ
+XPDQ 5HVRXUFHV 'LYLVLRQ
$UL]RQD $LU 3ROOXWLRQ &RQWURO
&RPPLVVLRQ
+RPH +HDOWK &DUH 5HJXODWLRQ
$GXOW 3UREDWLRQ
'HSDUWPHQW RI *DPLQJ
'HSDUWPHQW RI +HDOWK 6HUYLFHV³
(PHUJHQF\ 0HGLFDO 6HUYLFHV
$UL]RQD 'UXJ DQG *DQJ 3ROLF\
&RXQFLO
'HSDUWPHQW RI :DWHU 5HVRXUFHV
'HSDUWPHQW RI +HDOWK 6HUYLFHV³
$UL]RQD 6WDWH +RVSLWDO
5HVLGHQWLDO 8WLOLW\ &RQVXPHU
2IILFH 5HVLGHQWLDO 8WLOLW\
&RQVXPHU %RDUG
'HSDUWPHQW RI (FRQRPLF 6HFXULW\³
&KLOG 6XSSRUW (QIRUFHPHQW
'HSDUWPHQW RI +HDOWK 6HUYLFHV
'LYLVLRQ RI %HKDYLRUDO +HDOWK
6HUYLFHV
Future Performance Audit Reports
$UL]RQD &RXQFLO IRU WKH +HDULQJ ,PSDLUHG
'HSDUWPHQW RI %XLOGLQJ DQG )LUH 6DIHW\
%RDUG RI 'HQWDO ([DPLQHUV
