Report of the RSA Task Force on vocational evaluation

              REPORT OF THE
RSA TASK FORCE ON VOCATIONAL EVALUATION
TABLE OF CONTENTS
I. Introduation
A. Statement of Purpose
B. Partiaipants
C. ConsuZtants and/or PubZiaations Used
II. Review of RehabiZitation Aat and Pertinent FederaZ/State
ReguZations Pertaining to VoaationaZ EvaZuations
III. Present MethodoZogy and PhiZosophy of VoaationaZ EvaZuations in
Arizona
IV. AnaZysis of VoaationaZ EvaZuation Case Studies and Review of
Pertinent Literature
V. Findings and Reaommendations e VI. Summary
Appendiaes
A. Report of PsyahoZogy and RehabiZitation Assoaiates 3
Tuason 3 Arizona3 8/80
B. Report of VoaationaZ DeveZopment Program 3 N.A,U' 3
FZagstaff3 Arizona3 10/80
C. Report of Program Effeativeness 3 an anaZysis of ATizona
VR Program by University of Miahigan 3 9/80
D. DoatoraZ Dissertation by CZayton Boyer regarding
RehabiZitation CounseZor VoaationaZ Decisions
and Diagnostia Report Reaommendations 3 U. of A' 3 1970
E. Report of a foZZow-up study on the reZationships between
work evaZuator's reaommendations and aZient pZaaement
by Diane WiZZiams 3 12/75.
-2-
Appendices (cont'd)
F. FederaZ Register
G. RSA Manual (Federal)
H. Memo from Doyle Cool~ Evaluator-Supervisor~
regarding financial analysis~ 2/81
I. Summary of Case Review findings by Mary Shane~
Blind Services~ 2/81
J. PreZiminary Data Report on Case Reviews3 District I~
by Lenore Drake, 2/81
K. Report of l? closed cases in Tucson by Santiago
Lebron~ 3/8l.
L. Follow-up study of RSA referrals to u. of A.
vocational Evaluation unit by Jim Organist~ 4/8l
REPORT OF RSA TASK FORCE ON EVALUATION e l. INTRODUCTION
A. STATEMENT OF PURPOSE
The RSA Task Foroe on Evaluation was formed to respond to the Zero Based
Funding Report of January 23, 1980 that stated, '~rizona 's Usage of
Evaluation Servioes is exoessiv~." The report oonoluded that the major
faotor in the alleged exoessive usage was the over-use of pre-vooational
evaluations. The report stated that (a) pre-vooational evaluations
were not mandated by law or regulation; (b) pre-vooational evaluations
are expensive.
To respond to the major oharge that Arizona's usage of evaluations were
exoessive and to present a report whioh would have a positive impaot on
vooational rehabilitation, the following questions were addressed:
a. Are we buying more evaluation servioes than we need to make
rehabilitation deoisions?
b. Are we getting our money's worth.
o. Are we following the evaluation reoommendations?
d. What are results of evaluations?
e. How does issue of olient rights effeot use of evaluations?
f. If vocational is readily available (suoh as state-operated
faoility or level funded oontraot), is it used more than
needed?
B. PARTICIPANTS
Barbara Sinon, SSDI!SSI Coordinator, RSA
Doyle Cool, PVE Unit Supervisor, VR Distriot I
Alioe Neuwirth, Unit Supervisor, VR Distriot I
Lenore Drake Counselor, VR Distriot I
Mary Shane, Counselor, SBS-Phoenix
Brandon Arterbury, Counselor, VR Distriot III
Santiago Lebron, Counselor, VR Distriot II
Riohard Dunoan, Counselor, VR Distriot V --- (Unfortunately, Mr. Dunoan
was only able to attend one meeting prior to resigning and leaving the state.)
-2-
C. CONSULTANTS AND/OR PUBLICATIONS USED
Report of Comprehensive Evaluation of Severely Disabled Persons~ u. of A.~
Rehabilitation Department~ ?-80
Report of Psychology and Rehabilitation Associates~ Tucson~ 8-8Q (Appendix A)
Report of vocational Development Program~ N.A.U.~ lO-80 (Appendix B)
Report of Program Effectiveness~ an analysis of Arizona VR Program by
University of Michigan~ 9-80 (Appendix C)
Doctoral dissertation by Clayton Boyer regarding Rehabilitation Counselor
Vocational Decisions and Diagnostic Report Recommendations~ u. of A.~
19?0 (Appendix D)
Report of a follow-up study on the relationship between work evaluators'
recommendations and client placement by Dianne Williams l2-?5 (Appendix E)
Interview with u. of A. staff by Mr. Lebron
Presentation by evaluator Roberta Rea of Arizona Industries for the Blind.
Federal Register - Rehabilitation Act (Appendix F)
Federal RSA Manual (Appendix G)
eState RSA Counselor Manual
Zero based report
Printouts regarding PVE usuage District I Clients
Report of Vocational Evaluation StudY - District I PVE Unit~ 19?8
National and Local Financial Data Reports regarding VR
II. REVIEW OF REHABILITATION ACT AND PERTINENT FEDERAL/STATE REGULATIONS
PERTAINING TO EVALUA'TIONS
The Zero Based Report stated that the counselor usage of vocational evaluations
is excessive and that vocational evaluation is an optional service; no Federal
or State requirements exist which require a client to receive the service.
The Task Force has reviewed the Federa l Register and found several parts which
appear to substantiate the need for vocational evaluation service. SpecificaUy~
the references are as foUows:
lJ6l.Jl Order of Selection for Services (b) in establishing the
order of Selection of Servioes~ the State Plan shall provide for
selecting the most severely handicapped individuals for the
-3-
provision of VooationaZ RehabiZitation servioes prior to any other
handioapped individuaZs. (45% of Arizona's ourrent oaseZoad is
oertified as severeZy disabZed~ per O.I.S. Report 4/30/8Z.)
Z36Z.34 EvaZuation of rehabiZitation potentiaZ: P1'eZiminary Diagnostio
Study (b) the State PZan shaZZ provide that and~ in aZZ oases~
wiU plaoe primary emphasis upon the determination of the individuaZ's
potentiaZ for aohieving a vooational goaZ. The State Plan shalZ
further provide that in aU oases of mentaZ or emotionaZ disorder~
an examination wiU be provided by physioian (psyohiatrist) or
lioensed psyohologist.
Z36l.35 EvaZuation of rehabiZitation potentiaZ: Jhorough Diagnostio
Study (a) the State PZan shaZZ provide that~ as appropriate in eaoh
oase~ there wiZZ be a thorough Diagnostio Study whioh wiZZ determine
the nature and soope of servioes needed by the individuaZ~ and whioh
shaZZ oonsist of a Comprehensive Evaluation of pertinent medioal~
psyohoZogioaZ~ vooationaZ~ eduoationaZ~ and other reZated faotors
whioh bear on the individuaZ's handicap to empZoyment and rehabiZitation
needs. (f) The State Plan shaZZ provide that the thorough Diagnostio
Study wiU inoZude~ in aU oases to the degree needed~ an appraisal of
the individual's personaZity~ inteZZigenoe Zevels~ eduoationaZ
aohievments~ work experienoe~ personaZ~ vooationaZ~ and sooial
adjustment~ empZoyment opportu:nities~ and other data helpfuZ in
determining the nature and scope of the servioe needed. The State PZan
shaZZ further provide that the thorough diagnostio wiZZ inoZude~ as
appropriate for eaoh individuaZ~ an appraisaZ of the individuaZ's
pattern of work behavior~ his abiZity to aoquire oooupationaZ skiZZ and
his oapaoity for suooessfuZ job performanoe~ inoZuding the utiZization
of work~ simulated or reaZ~ to assess the individuaZ's oapabiZities to
perform adequate Zy in a work environment.
The FederaZ RehabiZitation Servioes ManuaZ~ Chapter Z505.0Z-Z505.03 further
expands on the need for oomprehensive diagnostio servioes~ partiouZarZy with
the severeZy disabZed olient~ as foZZows:
Z505.03C The state agenoy should estabZish prooedures whioh wiZZ
assure individuaZ appraisaZs to meet the varying needs of appZioants.
The extent of the preZiminary evaZuation may vary greatZy from one
individuaZ to another~ depending on the nature and severity of the
probZem.
The Task Foroe feels very strongZy that the intent of the FederaZ Regulations is
a oZear mandate for oomprehensive diagnostios and evaluation partiouZarZy with
the severeZy disabZed. WhiZe the reguZations do not 'speoifioaZZy require
VooationaZ EvaZuation servioe~ they do require the information that can best
be provided by a formaZized vooationaZ evaZuation. Further~ the reguZations
speoifioaZZy require a psyohiatrio or psyohoZogioal examination in alZ oases
invoZving mentaZ or emotionaZ probZems.
-4-
III. PRESENT METHODOLOGY AND PHILOSOPHY OF EVALUATION IN ARIZONA (STATISTICS3 ETC.) e Considerable time and effort was expended by the members of the Task Force in
analyzing financial and statistical data regarding evaluation in Arizona. It
was eventually concluded that there were so many variables between states and
the way in which data was reported that to pursue this avenue was an exercise
in futility. (Report attached Doyle Cool, Supervisor, PVE Unit (Appendix H).)
Information available indicates that only about 20% of clients received
vocational evaluation in the largest district. Data is not available for the
smaller districts, but it is believed that their usage is considerably less
than that. The only exception to that would be the Section for Blind Services
which secured vocational evaluation services for 75-90% of their clients.
It was agreed to concentrate the efforts of the Task Force on analyzing the
effectiveness of vocational evaluations and explore possible streamlining
methods or other viable alternatives.
IV. ANALYSIS OF VOCATIONAL EVALUATION CASE STUDIES AND REPORTS FROM FACILITIES
REGARDING FOLLOW-UP STUDIES
The Task Force reviewed several reports concerning the use and effectiveness
of vocational evaluations with vocational rehabilitation clients. A summary
of the findings of the reports is as follows:
A. Rehabilitation Counselor vocational decisions and Diagnostic Report
recommendations by Clayton Boyer, a doctoral dissertation at the University
of Arizona, 1970. The findings were that (l) vocational rehabilitation
counselors tended to act in accordance with the vocational recommendations,
and (2) when the counselor did follow the report he was significantly
more likely to close the case as rehabilitated. He concluded that the
findings supported the expenditure of money to provide diagnostic
evaluations for rehabilitation clients and that psychological and pre­vocational
evaluations were meaningful aids to placement. An abstract
of this report is attached (Appendix D).
B. Psychology and Rehabilitation Associates, Tucson, Arizona, a self­evaluation
studY of Vocational Rehabilitation clients referred for
testing from 9/78-2/79. The report was issued 8/80. In general, they
found a significant disparity between their recommendations and counselor's
actions. They tended to recommend direct job placement in many cases
where the referring counselor did not find that course of action feasible
or practical; and referring counselors use work adjustment services in
many cases where the vocational evaluators recommended either direct
placement, job training, a trade or business school. possible
explanations are: (a) In some cases evaluators overestimate the potential
or the job readiness of the clients tested or (b) The rehabilitation
process is made easier though costlier by enrolling clients in longer
termed programs. The report is attached (Appendix A).
-5-
I
D. Comprehensive Evaluation of Severely Disabled Persons, a project report
by the Rehabilitation Department, University of Arizona, July 19BO. The
Task Force reviewed this most comprehensive report of the 'process" of
evaluation for severely disabled. Since it was primarily devoted to process
rather than outcome, we did not include it in this report.
C. Northern Arizona University, a program evaluation report of the Vocational
Development Program lO/BO. Their results indicated a high correlation
between recommendations and counselor actions and that a high percentage
of the clients evaluated were in "positive" VR status codes. The report
is attached (Appendix B).
E. A follow-up study on the relationship between work evaluator's recommendations
and Client Placement, Diane M. Williams, l2/75, (Vocational Development
Center, Menomonie, Wisconsin). This report concluded that a positive and
significant relationship exists between the following of evaluator's
recommendations and the successful placement of Vocational Rehabilitation
clients. The report is attached (Appendix E).
F. The Task Force members undertook to do their own study of cases which had
been provided Vocational Evaluation Services. A lO% random sample was
taken from closed cases for the calendar year 1979. The number of cases
reviewed was 73. The percent of successful closwoes was 3B%. Of
significance was the high degree (4B%) of DB closures (closures before
the initiation of a Rehabilitation Plan, unfeasible, moved, unable to
locate, etc.). In general, it was found that with the successful
closures there was a high correlation between the vocational recommendations
and the eventual case outcome. The vocational evaluations at the Arizona
Industries for the Blind are lengthier and more individualizedJ and their
positive results are much higher than the other units studied.
It was found among the unsuccessful closures (DB) a high percentage of
severely disabled with emotional illness as the major disabling condition.
In general, the reviewers found that the vocational evaluations were of
excellent quality and were an excellent tool, but that certain 6hanges in
the selection of clients and procedures could be considered. This will be
discussed in the next section of the report. The three reports from the
Task Force are attached (Appendices I, J, K).
V. FINDINGS AND RECOMMENDATIONS
After reviewing pertinent reports and client files,
A. FINDING
The Task Force finds that Vocational Evaluation servioe is a valuable
service in the rehabilitation ofdisabled persons. Vocational evaZuation
is a unique servioe that requires speciaZized persons to perform this
function along with specialized equipment. For the severely disabled
-6-
client this type of service cannot be replicated by paper and pencil tests
administered by the counselor, nor can it be replaced by the G.A.T.B. The
type of information received from these evaluations is well justified by
pertinent Federal Regulations pertaining to the severely disabled and the
use of the thorough Diagnostic StudY.
RECOMMENDATION
That vocational evaluations continue to be secured on an individual basis,
when needed.
B. FINDING
The Task Force finds that, while the Vocational Evaluation service is
valuable, it may be in some cases somewhat improperly used as a screenout
or motivational test rather than for the purpose intended. This is
evidenced by the almost 50% 08 closure rate following evaluations and
by the high 'no show" Pate (l5%) reported by the evaluation facilities.
RECOMMENDATION
1. That full vocational evaluations may be ordered in selected cases
after there is some tangible evidence of the client's motivation for
rehabilitation. They should not be ordered routinely or as a test
of the client's motivational level.
2. That counselors be given tPaining in certain paper and pencil tests;
such as, interest inventories, personality tests and general ability
tests; i.e., Wide Range Aohievement Test (WRAT). The Task Force
recognized the worth of the G.A.T.B. Test. The G.A.T.B. is a wo.lZ­known,
well-standardized test and very useful in a clinical setting.
The Task Force feels that the administration of the G.A.T.B. by
rehabilitation counselors would be highly impractical because of
the very nature of the test. The G.A.T.B. is a group designed test
which takes approximately 2t - 3 hours to administer and requires a
significant amount of equipment which requires extra security measures
and special training.
3. That there be more use of short-term and specialized evaluations,
where indicated. We note that this practice has alreadY commenced
in Phoenix and Tucson U. of A., and preliminary data is encouraging.
Psychology and Rehabilitation Associates, Tucson, is also encouPaging
this practice.
4. That in cases of severe emotional disability, the required psychological
evaluation be done prior to considering the scheduling of a full
vocational evaluation.
C. FINDING
That oonsiderable effort has already been commenced during the past several
years by both the state and private evaluators to track clients through the
system and provide data for improving the effectiveness of vocational
-7-
evaluations. That documentation of how vocational evaluations used
was not always clear in th~ case file. In many cases, the reasons why
vocational evaluations were not followed was not well documented.
RECOMMENDATION
1. That this self-evaluation system be continued and the results
utilized for the benefit of concer-ned.
2. The Task Force would encourage more standardized methods of
documentation as to why or why not counselors ordered vocational
evaluations, and did or did not follow recommendations.
VI. SUMMARY
This Task Force has studied the usage and effectiveness of vocational evaluations
in Arizona. We have found that vocational evaluations are a valuable tool and,
where the recommendations are foUowed, there is a high degree of success. We
have also found some misuse of these evaluations and recommend several alternatives
and shortcuts, many of which have already been implemented.
APPENDIX A pra
PSYCHOLOGY & REHABILITATION ASSOCIATES RECEIVED'
Accredited by the Commission on Accreditation of Rehabilitation Facilities AU
19 North Norris G28 1980
• Tucson, Arizona 85719
792·3070 l1enab Svce Admin
In January of 1980 Psychology and Rehabilitation Associates sent out follow-up
questionnaires to counselors who had referred clients to this facility from September
of 1978 through FebruaJ:Y of 1979. These questionnaires requested information on the
present status of each client and also on the services they had received up to that
point. The following is a report of those results.
Of seventy-nine questionnaires sent out, fifty-six were returned. This repre­sents
a 71% response rate. Those clients whose questionnaires' were not returned
were referred by counselors who had either retired, resigned, or transferred. Of the
fifty-six clients on whom we received information, the statuses were as follows:
STATUS
02
06
16
20
22
28
18
26
08
NUMBER OF CLIENTS
4
9
2
5
3
1
15
6
11
% OF TOTAL
06
16
04
09
05
02
27
11
20
The clients still undergoing training were enrolled in the following training:
TRAINING AREA
1. G.E.D. Training
2. Junior College
Teacher's Aide
Registered Nurse
General Studies
3. Auto Mechanics
4. Work Adjustment
5. University
Fine Arts
6. veterinary Assistant
7. Electronics Assembly
8. Medical Transcriber, Receptionist
9. Real Estate
10. Carpentry Apprenticeship
NUMBER OF CLIENTS
1
1
1
1
2
3
1
1
1
1
1
1
The clients closed at twenty-six were placed in the following areas:
OCCUPATIONAL AREA
1. Auto Body Repair
2. Conservation (Park Service Worker)
3. Physical Therapy Aide
4. IBM Worker at Goodwill
5. Secretary, Clerical Worker
6. Sheet Metal Worker
NUMBER OF CLIENTS
1
1
1
1
1
1
2
The eight clients in status twenty or twenty-two had received training or were
employed in the following areas:
OCCUPATIONAL AREA
1. Cashiering
2. Finished Work Adjustment, no specified field
3. Dishwashing
4. Medical Receptionist
5. Clerical
6. Roofing Apprenticeship
7. Restaurant Bus-Girl, Telephone Soliciting
8. No Specified Training or Work Area
NUMBER OF CLIENTS
I
I
I
I
I
I
I
1
The following chart compares the recommendations made by Psychology and Rehabi­litation
Associates to the actual services provided by counselors:
SERVICE
1. Direct placement
NUMBER OF RECOMMENDATIONS
MADE FOR THIS SERVICE
17
NUMBER OF CLIENTS
RECEIVING THIS SERVICE
4
2.
3.
4.
5.
6.
7. e
8.
Job Training or
Trade School
Junior College
University
Work Adjustment
Psychological
Counseling
VocationalCouns­eling
or Career
Exploration
Question of Feasi­bility
a. lack of interest
or cooperation
b. no reasonable
expectation for
success
c. other
9. Question of Eli­gibility
10. Further Medical
Services
11. Academic Remediation
or G.E.D.
12. Training in Activities
of Daily Living
27
2
2
8
32
12
3
1
1
o
13
17
4
16
6
2
15
8
25
9
1
3
2
10
6
o
A check of the fifteen clients receiving training reveals that nine are in
training programs recommended by Psychology and Rehabilitation Associates and six are
in programs other than those recommended by Psychology and Rehabilitation Associates.
A similar check of the six clients successfully placed and closed reveals that three
were placed in areas recommended by PRA while three were placed in areas other than
those recommended by PRA. Of tfie eight clients ready for employment or placed on the
joB But not yet closed, four were in areas recommended byPRA while four were in
~areas other than those recommended by PRA. Of the twelve clients who either received
training or were placed in areas other than those recommended by PRA, five were in
areas involving higher skills, wages, or status than those recommended, four were in
areas involving lower skills, wages, or status than those recommended, and three were
...- .
3
in parallel programs or positions.
Of the forty-three clients who received direct work related services (either
direct placement or training ranging from the university to work adjustment), twentY­three
received the general service which was recommended for them (i.e. job training,
junior college, etc.), while twenty received general services in areas other than
those which were recommended for them. The following chart breaks down the five
direct workrelat~d services, and shows how the recommendations compare to the services
provided.
NUMBER OF CLIENTS WHO NUMBER OF CLIENTS RECEIVING THIS
SERVICE RECEIVED THIS SERVICE SERVICE WHO WERE RECOMMENDED FOR IT
1. Direct
Placement 4 3 (75%)
2. Job Training
or Business
School :~ 16 12 (75%)
3. Junior College 6 3 (50%)
4. University 2 0 (00%)
5. Work Adjust-ment
£ 5 (33%)
TOTAL 43 23 (53%)
The'one client who was placed directly but had not received a recommendation
for this service was an individual who, at the time of her evaluation, did not show
an interest returning to work in an area feasible for her. At that time it was recom­mended
that no services be extended to her.
The recommendations offerred for the four clients who received job training or
trade or business school instruction, although it was not recommended for them, were
as follows:
RECOMMENDATION
1. Junior College
2. Direct Placement
3. Direct Placement
4. Direct Placement
STATUS
26
06
lS
20
The recommendations offerred for the three clients who were enrolled in a junior
college program, although it was not recommended for them, were as follows:
1. Business School Training
2. Further Psychological Counseling
and Career Exploration
3. Direct Placement
STATUS'
06
06
18
The recommendations offerred for the two clients who were enrolled in a univer­sity
program, although it was not recommended for them, were as follows:
1. Direct Placement
2. Direct Placement
STATUS
18
26
4
The recommendations offerred for the ten clients who were referred for work
adjustment, although it was not recommended for them, were as follows:
1. Job Training
2. Direct Placement
3. Trade School
4. Direct Placement
5. Direct Placement
6. Job Training
7. Direct Placement
8. Direct Placement
9. Business College
10. Business College
STATUS
26
20
18
18
22
22
18
26
18
06
As was mentioned before, a total of seventeen clients on whom feedback was pro­vided
were recommended for direct placement (this might include Job Readiness Train­ing,
Psychological Counseling, Further Medical Services, or some similar service,
but would exclude formal job training, trade or business school, college or university
work, or work adjustment). Four clients were actually placed without other formal
training or education, and of those four, three were of the original seventeen re­commended
for this. The other fourteen clients received the following training or
educational services or were otherwise served:
13.
14.
9.
10.
ll.
12.
SERVICE
1. Work Adjustment
2. Closed, 08
3. Trade School
4. Work Adjustment
5.·No Further Services Offered .' .-.....
6~ Work Adjustment.
7 • Work Adjustment
8. Psychological Counseling
(no training or education)
University
Trade School
No Further Services Offered
Psychological Counseling
(no training or education)
Psychological Counseling
(no training or education)
Work Adjustment
Conclusion
PRESENT STATUS
20
08
06
26
28
18
22
08
18
18
02
06
20
06
Of the many conclusions which might be drawn from these findings, two seem to
be of the most significance: 1) the vocational evaluators at Psychology and Rehabi­litation
Associates tend to recommend direct job placement in many cases where the
referring counselor does not find that course of action feasible or practical; and
2) referring counselors use work adjustInent services in many cases where the voca­tional
evaluators recommendec:i eitner direct placeI\lent, job training, a trade or busi­ness
seneol. It appears tnat counselors generally find that some clients require
~re extensive services than are believed necessary by ~~e evaluators. Possible
explanations for these incongruities are that: a) in some cases evaluators over­estimate
the potential or the job readiness of clients tested; or b) the rehabilita­tion
proceSs is made easier, though perhaps costlier, for the rehabilitation coun­selor
by enrolling clients in longer term programs which either provide certificates
DATE:, _/_/~i_,\~... APPEN_DIX B
.I~~~ l) ~~ ~ SENT TO '" '..'.~: C<'!, ",' .. (~, ://•. 'j.'", £..' ~~H'~I I.~~ ~' -~ : ..~.t:::_;;!,~ . ,," ..._. '--<~-" {.; ,'I
(i" ~~'~.\ \. ..... ,
~I.. ~" ;..,,') ;! :t~ \..""" , ,,,: / .. 'IL /. (i~,.,
~ ~~~. ,,-. t,.' _._..__..~ _.... .. __ _.-
~~,_c.-..~~ ". .
-~ d.~_.- By:._. ·_/..i...;;,0.:"'_"_"'_'-- ... , DISTRICT "' ,-,
eXorthe~rizanruniversi!Y'FLAGSTAFF, ARIZONA 86011
INSTITUTE FOR IIUMAN DEVELOPMENT
rOLLEGEOF EDlJ('ATION Oct. 24, 1980
VOCATIONAL DEVELOPMENT PROGRAM
Program Evaluation Report
For 1979-80 Contract Year
C. U. BOX 5630
(602) 774-2) 8)
(602)523-4791
I. Internal Evaluation System
A. Objective 1: Evaluate an average of 16 clients per month.
During the 1979-80 contract year, 186 clients were
evaluated, which is an average of 16 clients per month. Most
clients received comprehensive evaluations, including both
psychological and vocational assessments. There were 171 psycho­logical
and 182 vocational evaluations performed.
During the six-month period of April 1, 19aO to Septem­ber
30, 1980 there were a total of 151 clients referred and
93 evaluated. Of the 58 referred clients who were not evaluated,
37 were cancellations and 21 were "no-shows".
Since the required number of clients were evaluated,
Objective 1 was achieved during the 79-80 dontract year.
B. Objective 2: Provide appropriate and useful recommen­dations
regarding evaluated clients to referring counselors.
Meaures of this objective are obtained by reviewing the feed­back
forms returned to I.H.D. by the V.R. counselors.
Counselors rate the IHD report on the following
criteria: "Report answers referral questions; provides useful
information and practical recommendations; gives the counselor
a clear idea of how to proceed with the client; and the report
is clearly written and internally consistent .'\
The counselors returned feedback forms for 87 of the
~ clients evaluated at IHD (47%). As a group, the counselors said
the IHD reports meet all the criteria 94% of the time and partial­ly
61 of the time.
Page 2
Pro9ram Evaluation Report
~ Objective 2 is also measured by comparing the IHD
report recommendations to the counselors' plans for the client
at 2 weeks after the client completes the evaluation. For the
1979-80 contract year, Table 1 shows the number and percent of
cases in each level of agreement.
Level
Total agreement
SUbstantial agreement
Partial agreement
No agreement
Other (moved, etc.)
Table 1
Number of Cases
15
21
14
14
1
65
Percent of Cases
23] 55%
32
22
22
1
100%
Data was available on this measure for only 65 of the
clients. Substantial agreement is defined as more than half
of the report recommendations being implemented by the counselor,
and partial agreement means fewer than half of the recommendations
are being implemented.
As can be seen from the table, there was substantial
or total agreement Between IHD report recommendations and the
counselors' plans in 55% of the cases, with 22% more in partial
agreement. This suggests that typically the counselors agree
with and plan to implement the recommendations made in IHD
reports.
C. Objective 3: Provide written evaluation reports within
10 days of client termination.
During the first half of the contract year, 48% of
reports were submitted on time, and 52% were late. During the
second half of the year, 66% of reports were submitted on time,
and 34% were late. This shows improvement over the course of
the year, but the goal of 80% of reports submitted on time was
not achieved.
Some lateness of reports was due to uneveness of
~ client flow. In months with substantially more than 16 clients,
staff would get behind and stay behind for weeks. In addition,
· Page 3
Program Evaluation Report
many clients take tests \'1hich can only be scored by computer.
Often, the 10 day time limit does not allow sufficient time for
the test protocols to be mailed, scored, and returned.
o. Objective 4: Provide 4,000 hours of student training.
Table 2 shows the number of hours of student training
provided in the contract year.
Table 2
Psychology interns
Field work students
Work-study students
II. External Evaluation System
2680
1173
691
4544 hours
The external evaluation system is designed to show what
happens to persons who at one time were IHO clients. Data on
client status at six months follow-up is obtained from VR
counselors. The number and percent of clients in each of the
relevant VR status codes' is shown in the following table for
the six-moni:h period of October 79 - March 80.:
Table 3
Number of Clients in V.R. Status Codes
at SixlMonths Follow-up
Status
02 Diagnostics being done
06 Extended evaluation
08 Closed from referral
10 Accepted "eligible"
12 Plan being developed
14 Psychological restoration
16 Medical restoration
18 Client in training
20 Ready for employment
22 Client employed
Number
25
13
10
6
4
1
33
3
·Page 4
Program Evaluation Report
24 Interrupted
26 Closed successfully - client employed
28 Closed unsuccessfully
30 Closed before plan started
3
Table 4 shows the number and percent of clients in
each of the codes used as objectives in the external evaluation
system.
Table 4
Outcome on External Evaluation Objectives
at six Months Follow-up
(N=lOO)
~bjective 1 Code 22
Code 26
Client employed
Case closed successfully;
client employed
:} 5%
33} 33%
Recommended diagnostics being done 25 138%
Extended evaluation 13]
/79% Totu)
Client in training
Psychological restoration
Me,dical restoration
Code 18
Code 14
Code 16
Code 02
Code 06
As can
Objective 2
Objective 3
Objective 4
be seen from the table, 79% of the clients
at follow-up were in positive status codes, suggesting that the I
IHD evaluation they received was beneficial to them.
Objective 5 in the external evaluation system is to minimize
the cost per client. During the 1979-80 contract year, 186
clients were evaluated. According to the contract IHD was al­located
$29,024 for vocational evaluations and $19,910 for
psychological evaluations, for a total of $48,934. When this
figure is divided by 186, the cost per client comes out at
$263, which is just $9 over the per-client cost allowed for in
the contract ($254).
l'age :>
. Program Evaluation Report
Objective: IHO will provide four comprehensive
evaluations per week (psychological and vocational) given
the referral of four clients per week from RSA.
Total cost of vocational evaluations $29,024
Total cost of psychological evaluations 19,910
$48,934
4 clients per week x 4 weeks per month x 12 months=192
clients per year
$48,934 of 192 clients = $254 estimated by RSA as cost
per client
SUMMARY
Of the four objectives in the internal evaluation system,
the set goals were met for three of the objectives and hot met
for one of them.
The required number of clients were evaluated (an average
of 16 per month). This was in spite of the fact that an estimated
30% of referred clients were either cancelled or did not show
for the scheduled evaluation. Based on the data accumulated,
the referring counselors rated the quality of rED evaluation
reports as meeting all criteria in 94% of the cases. lED
report recommendations were followed atleast partially in 77%
of the cases for which the counselors gave feedback. In addition,
lover 4500 hours of training were provided to students working
in the program.·
The only objective not met was in regard to the timeliness
of reports being submitted to VR after client termination.
There has been a steady positive trend since the summer of
1980, and timeliness of reports should not be a problem in the
new contract year.
The results on the external evaluation system are quite
positive, indicating that the majority of lHD clients are in
positive VR status codes, receiving services recommended in
IHD reports. In addition, the cost per client is at the very
reasonable figure of $263 for a 4-day comprehensive psycholo­gical
and vocational evaluation.
II V\..l~ 1 ..lUI.Hl,LJ .lJJ:.V J:..lAJ.t-'Nt.NT .t-'.I{LA:;!<.flJ"l
Internal Program Evaluation
i
80% 1 90% 30 ,,
iI I
I, --I
I
I
80% : 100% I 20 !
t
60%
70%
Eleven working
days af~er client
termination.
--Expectancies" .--. _
!Minimum. r--GoaL Optim Weighl
Eleven working , ! i
days. aft~r clientl 80% 90% i 100% 30
term~nat~on. I
Measure Time of Measure
Number and percent of
reports completed on
time.
Number and percent of
clients referred who
complete evaluation.
3 .
Evaluate referred clients
who are present for
1. 'I required length of time.
Average of 16 per month.
. ..--- ---rProvide appropriate and i 1. Counselors' evalua- Fifteen days
. '"I Iuseful recommendations ! tions of reports. after report exit ..
2. . regarding evaluated client! 2. Correspondence between
to referring counselor. report recommendations
I
· and counselors' plans
for clie.n_ts....... ...
I
Provide written evaluatioh
reports within 10 days ofl
client termination.
r--r'-- -----------...-.... "
Rank i Objective
---4
. ,--------------_..... _----
Provide training to
4. I students.
Number of trainee hours
provided.
End of eacb
semester. 3000
hours
. ----..---~-- ._--
!
I,,I
4000 :5000
- .....
20
• L . . 1 .______ • ._ .. -----.0. _
r e e e
vuCNrrONAL DEVELOPHENT PROGRAM
External Program Evaluation System
lRank
1.
2.
3.
4.
5.
Objective
Clients obtain employ­ment,
on-the-job
training, or non­shelt€
red work.
Clients obtain skill
training.or academic
preparation for a job.
Clients obtain recommend­ed
medical or psychologi­cal
restorative services.
Clients obtain further
evaluations as
recommended.
Minimize cost per client.
e
Measure .,
Number and percent of former
IHD clients in VR status codes
22 (employed) and 26 (case
closed successfully; client
emploved1
Number and percent of clients
in VR status code 18 (client
in tra ining) .
Number and percent of clients
in VR status codes 14
(psychological restoration)
and code 16 (medical
restoration) .
Number and percent of clients
in VR status codes 02 and 06
(diagnostics or extended
evaluation in progress) .
Divide contract dollar amount
by number of cl~ents evaluated
to arrive at cost per client.
e
Time of
Measure
Monthly
Monthly
Monthly
Monthly
Yearly
, tr".~. -~""'
Weight
..
APPENDIX C
?roGRAM EFFECTIVENESS:
AN ANALYSIS OF THE ARIZONA VOCATIONAL REHABILITATION PROGRAM
AS REPORTED BY THE
REHABILITATION RESEARCH UlSTITUTE
UNIVERSITY OF MICHIGAN
FY 7% 14'2 3~% (J/~/ea>"es were .;?t~
Halt tJ~l~ ;16~
C()l"faf;'fJ~e $YJ1f/?f'm~ I/z. 4/f' 93,7,%-/dl!A1~;'1j;
Department of Economic Security
Rehabilitation Services Administration
September 1980
mTBODUCl'ION
The source document for the information contained in this paper
is "Analysis of FY 1978 Data on the Vocational Rehabilitation Standards"
published by the Rehabilitation Research Institute, School of Education,
University of Michigan (OM-RRI). The report, published in June 1980,
contains an analysis of the data subIll.i.tted by state rehabilitation agencies
in response to the mandated evaluation standards of the state/federal re­habilitation
program. The pu;rpose of the Standards, which are required
by the Rehabilitation Act of 1973 and published in the Federal Register
on December ,19, 1975, is to (a) establish criteria to evaluate program ef­fectiveness,
(b) increase program accountability, and (c) encourage state
vocational rehabilitation agencies to conduct more comprehensive self­evaluations.
An analysis of the information contained in the previously cited pub­lication
regarding the effectiveness of th,e Arizona Vocational Rehabilitation
) Program is presented in this paper.
PROGRAM EFFECTIVENESS:
AN ANALYSIS OF TEE ARIZONA VOCAXIONAL REHABILITATION PEOGRAM
AS REPORTED BY THE
REHABILITATION RESEARCH INSTITUTE
ONIVERSI'I'Y OF MICHIGAN
Client participation in employm~t is a basic index of achievement for the
Vocational Rehabilitation program which is explicitly directed toward the goal of
re.h.abUitating handicapped individuals. The final test of program effectiveness
focuses on the number- of successful rehabilitations, the quality of those place-menu,
the material benefit to clients, and the durability of results over time.
Number of Successful Rehabilitations
The number of individuals who wer.e successfully rehabilitated by the Arizona
Vocational Rehabilitation program in FY 1978 was 2,126. This figure reflects a
69;4\ increase over FY 1975. (See Data Element 1.4, page III-19, from the UM-RRI
report which is attached.)
While it is important to know how a state vocational rehabilitation .program' s
productivity compares with its prior year's perfo~ce, it is also desirable to
contrast the state's performance with the national average. One way to accomplish
this is to determine what proportion of the total accepted clients served were
closed rehabilitated.
Comparison of the number of cases closed
rehabilitated to ~~e accepted clients
served for FY 1978.
National
26\
Arizona
30\
(See Data Element 1.4b, page III-20, from UM-RRI report which is attached.)
Quality of Placements
JUdgments regarding the quality of successful closures may be based on data
which reflect the proportion of clients placed in competitive emplol'Illent as com-pared
with those clients placed in non-competitive employment (work in sheltered
- 3 -
workshops, homemakinq, and family work). Arizona's Vocational Rehabilitation
proqram accomplishments in the area of quality of successful closures contrasted
with the national figures are as follows:
(See Data Element 2..1, pages· III-29- through III-32, from RRJ: report which
is attached.)
Percent of individuals who were
successfully rehabilitated who
were placed in competitive em­ployment.
National
Average
81•.9\
Arizona's
Average
93.9\
Percentile
Level
100
Material Benefits to Clients
Having a job in a competitive field for which one has been trained is only
a part of the story of successful rehabilitation. It is also important to be able
to demonstrate that rehabilitated clients are able to command earnings which re-fleet
an increase in their independence through acquisition of gainful employment.
Arizona's Vocational Rehabilitation program's accomplishments with regard to
material. benefits to clients are as follows:
Average weekly earnings at
closure of all rehabilitated
clients, including clients
with zero earnings at the time.
Regional
Average
$114.43
Arizona's
Average
$129.63
Percentile
Level
71 I
(See Data Element 2.8, pages III-73 through III-76 from UM-RRI report which
is attached.)
Durability of Results Over Time
The final basis for gauging the program's effectiveness is the maintenance
e of job-related rehabilitation benefits over time. Unfortunately, there is a lac..1<.
- 4 -
of unifo~ty in reporting from state-to-state with respect to this area of the
evaJ.l,lation standards maJd.ng any comparison of Arizona IS perfonnance to the national
or regional perfoDnance level impossible.
In the area of retention of financial benefits at the time of the one-year
follow-up, the mean weekly earnings. for individuals rehabilitated by the Arizona
Vocational Rehabilitation program was $133.00 per week.
••
NiImber o£ ases e.la.sed:. nbabi 1i-a:r:ed. dm::fmt. t.he
ye:sa: (Sta.=.5 25) •
·f
ntiS AGENCY'S VALU:£ FQ':1r FY 1ST&-
t.125· J
T1I1:$ Aa£1fc::Y~$ Y:A:L1!ES FO'sr FY'S 19·15", 1.$1&:, tS:17 ~. 19-7$
number.o+; 19i15- 197$=
cases c:l ased ,-----.,.---......---..,.-----"
Z·,5QO
_e
·AcrUll. VALur 1,255 1 .494 1 .736 2,126
191!·16
I:: 19:a ~
PERCEHTAG E CHAN GE B£1WE£N
191&·11 1911'13 1975·78
16.2 ~ ] 22.5 ~ l 69.4 .~
III.. 19
-
~
~: 1:h~. ~'te¢ ~lltme3'. serreci (Settuse$.· lO-.30) br dris astencr
far FY" ~_
Namber a:E <::a..se$ c:I~ecf.
(St:ttns 2!r) op; I.~
Number of. G.CeePred..
ca.ses ,erred; DE 1.2:
. Numl:::er of cases.
clcsed (Status- 26)
N1JI11ber of accepted
cases served
~IO~ S'IPaIS'I'ICS*'
26%
The percent of accepted
294,398 D· clients served who were
c~osed rehabi~itated.
1,~43,823 (Status. 26)
*Sou.rce: Fact Sheet Booklet - E'iacal Year 1978
III-ZO
~,~~.,~~~. .,".~,;~
--.
Dau Element: 2.1: Per cem: o£ 'those placed in ccmpet:::t'tive emplcym~
(wage- and. sa.la:ry ea:::ne= and seJ.f-emplcymen-c) •
TH'IS AG'ENCY'$ VALUE FO~R· FY 1978
93.9% l
THIS AG:EHCY'S VALUES, FO~R FY'S: 1975,19:16,1971& 1973
!e
per cent 1915··
lao.
90
80
70
60
SO
40
30
20
10
1"976, 191'1 19'18
.ACTUAL VALUE 94% 93.6% 90.9% 93.9%
PER C£NT CHAN GE B£TWEE N
1975·7&
I. -0.4%
1976·77
-2.7%
III-29
1977·78
3.0% l 1975·78
-0.1%
Oau Elemerrt 2.1: Per cent: of thos&o p1ac-=d. in·. ccmpeti"tive- e:!tploymen.t:
(wage: ami sala..-y earners and. sell-employment") . -. ...- --.
RSA Lowe:r
Pe:rfoJ:mance- Na.tional
Level Average
Agency
V,alue ....
81.1 86.0 90.3
83.9 88.2
13.2 71.S
15.:5 79.6
64.6 68.9
66.1 11.0
DESCRIPTIVE STATISTICS
NATIONAL STATE
NAT 10M A1. AV£ RAaE_ 81. 9%
RS" PERFORMANCE LEVE1.
IIpp.r_
low·. r-74. 5%
MOST COMMON VALUE(S) (MO.D£)_ 83.9%
MEDIAM VALUE_ 83.1'& rII-30
THIS AGENCY'S
THIS AQEHCY'S
L£VEL_ 100
VA L. UE_ 93. 9%
PERC£MTIL£
DESCRIPTIVE STATISTI CS c-ollt'd.
Da1:a. Elemen1: 2.1: Per cen1: of 'thos& placed ilL competi'tiv& employment:
(wage and. sala:ry ea.:men and. sel£-employmen1:) ..
. .
1977 1978
NATI GNAL.
NAOTJO H·A 1. A·VE R.AG E .78.70 % 8l.9 ~
R'SI\- PEIf, F'O RMAHC, LEVEL
UPPER
LOWER 68.72 ., 74.5 11II
~ A
MO'ST C IlMMO·N· VA·L UEtS) 85.0 ~ 83.• 9 1.1.II
(MODE)
M:E DIAKe VA-1. UE 83.7 '".e-o
STATE
TH I S· AGEN.CY'S VALU E 90.89 ~ 93.9 %
THIS AGElley'S
PERCENTILE LEVEl. 98 100
.
III-31
e D'ATA. ANALYSES; coltt'd.,
Da1:a E1 emen1: 2.1: Per cem: of UlOSC' placed.. in compatiti.ve- employmen1:
(wage and salary ea.:mer3 and self-emplo.ymen1:).
ll.
10
9
8
7
6
S
4:
2
1
100-09' 206-2:19· SOQ-5.l(1. 532-534;·
~IIfI: 4.2 3'.0 9.3 4.3' 2.2
. 2.0 2.5 6.3 2.0 1.6
RSA DIS ABI1.1 TY CODES·
100-12.9 _ VISUALLY U1PAUi=ED
200-219 _ HEARING IMPAIRED
500-510 _ MENTAL.. DISORDERS (SEVERE)
532-534 _ M£HTAL RETAROATlOH
318 338
35a~ 373;398 _ QRTHOPEDIC FUNCTIONAL IMPAIRMENTS
clients closed in statuses
26, 28, and 30 who were in
706 the selected disability [rOuos = 23.0%
3,069 Total caseload (c~1ents closed
in statuses 26, 28, and 30)
clients from the selected dis­ability
groups placed in com-petitive
employment = 14.4%
442 Total caseload (clients closed
3,069 in statuses 26, 28, and 30)
III-32
per cent of clients (closed in
statuses 26, 28, and 30)
agency· represented by the above
selected disability groups
per cent of clients who were
in the selected disability
groups and were placed in com­petitive
employment
JtA.TA1. AN,,tLYSES.
O&1:a Elemen1:, 2.8: AveragE!' weekly earnings- at: closure- o£ all reha.bili1:3;ted
. c:lienu~. including. c1ien1:S with. zero earninlls_
'TRIS AGEHCY:'$ VALU.£ FOR' FY I9,18i'
ST29.63 [
TH'I'S 4GE1tCY·"S· VA:LUES· FOIt: F'Y'S 1115'-,.19,16-, 1917 & 1915
I~1$ l~TS [.11 1~1a dolla.J:3'
200
TaO
-......-' 1T46-00 '
120 .
100
80
60
40
20
ACTltAL VAL.UE' $109 S114 S117.42 $129,53
1975·7&
4.6 %
P'ER;CEHTAGE CHAN'GE BETWEEN
1916"·11 1.917·78 1915-78
3.0 : J 10.4 S l 18.9 ~
!II-73
e
itA-TN. AH·ALYSES cont'd·.
Data: Element Z. a: Average weekly ea:ming:r a:e c..105Ur& of all rehabili'ta'ted
c:lien1:S•. including. clients: wd.th- zeJ;"O earnings. (Regi~,
Z.. S~ 5~ 9' General) •
MURIEl' OF STlIT£S
VA I.IJ E_ $129.63
PERC'EMr-1 I.E
Agency
Value
-ofi(.
STA·T E
TillS AG EHCY'S
T1I IS- A,Q.E>I C:Y 's
I.i:V£l._ 77
Regional
Averag.e
$116.60, $128.14
rtI-74
~ESCRrPTIV£ STAT~STICS
92•.31 104.45 116.60 128.74 140.88
86.24 98.38 110.52 122.67 134.81 146.95
RSA tower
Perlomance
Lavel
R£G:IONA I. AV EIi A (1.[_ $114.43
liSA· PER.FORM.A-HCE. LEVEl.
IIp:p.·r_
10••:'_ $91.93
.OST COMMON VALUE(S) (MOD£)_
~. E!) Il N VALUE_ S114. 78
DI;SCRI?TIVE STATrSTI CS cont'd ..
Dan Elemen-e: 2.8: Mean weekly earnings at closure of all rehabilita.t:ed
clien'tS p including. clients with zero ea..."'"U:ings.
,.,'
REGIOH:AL.
as,\. PER'FORM-AHCE LEVEL
U:~PEft
LOW,E.it
STA·T'E
THIS A~£MCY'S VALUE
Ttl is AGENCY'S
PER CE.N TI L.£ L E'l E1.
III-7S·
1.9·77
$107.B1
$' 7!i.OO
$100.17
$117.42
11
1978
$ 91 .93
$116.60,
$1Z8.7~
$114.78
$129,53
77
ie
Data aIemen't" Z.8:
DOu..A<RS:
D'ATJt ANALYSES cCllt'd'.
Average- weekly- earn.i.ngs. at:. closu:re of all rehabilita.'ted.
c:lien1:3r including clien't.S'. with" :::v euning:s·.
liSA D·IS·A·B:I LrTY CGO ES,
lOO~1.Z9· _ V·l S.UA:llY IM'P~'I R.Ell
200-2:19 _ II EA·it'S H·G: IMPAIREO'
500-5:10 _ MENIT1'l D1S0R'DERS (S£VERE)
532:-534. _ MEN-TAL. RET-'IUJATIOM.
3.18 333 .
3Sa~ 318;398 _ (utTHOPEOIC FUNCTION·Al.IMPA1RMEHTS
220
200
180
160
140
120
100
80
60
40
20
•
~:
~ I §~.
~; ~' I I § §:
lQ:a,..1291 200:-2:19- 500-5'10 53Z.534- 1.18" 338,
358,118.,
101.4 120.6 129.9 79.3 165.2
III-76
REHABILITATION COUNSELOR VOCATIONAL DECISIONS
AND DIAGNOSTIC REPORT RECOMMENDATIONS
by
Clayton Leon Boyer, II
A Dissertation Submitted to the Faculty of the
COLLEGE OF EDUCATION
In Partial Fulfillment of the Requirements
For the Degree of
DOCTOR OF EDUCATION
In the Graduate College
THE UNIVERSITY OF ARIZONA
1 9 7 0
APPENDIX D
..........
referral population and the one year limitation, was considered not
applicable. It is not known, however, if job tenure would be a more
realistic criterion over a longer period of time.
~alsu~a;:;
During the past two decades the public vocational rehabilita-tion
program has experienced continual growth and development. With
this growth has .come a strong emphasis upon comprehensive diagnostic
evaluation to determine the disabled individual's readiness and poten-tial
for rehabilitation. A review of the literature indicated little
or no research specifically related to determining the quality of
evaluations that were being provided to state rehabilitation agencies
and the use of the report information by the counselor in vocational
.
planning. This rapid growth and lack of research pointed up the need
to examine the client-study evaluations provided by rehabilitation
facilities in order to determine if the reports were used by the coun-selor
in providing case services as well as in determining suitable
vocational plans.
The Problem
vocational rehabilitation agencies refer large numbers of
clients and spend vast sums of money for psychological and prevocational
evaluations. These services are purchased in order to increase coun-selor
judgment in the development of a realistic plan for his client.
The question remains, however, as to just how useful these assessments
are to the counselor. The problem, then, was one of determining.
70
whether those rehabilitation counselors who followed the diagnostic
report recommendations were better able to close their clients in em­ployment
than counselors who did not follow the recommendations.
Research Design
This study was developed in three section: (1) general de-scription
of the type of client referred for psychological and prevo­cational
diagnostic evaluations, (2) evaluation of counselor use of
the report recommendations, and (3) assessment of the overall psycho­logical
and prevocational evaluation recommendations as measured by
length of employment during the year following closure.
In order to obtain a description of the referral population,
general demographic information was recorded for each case referred for
psychological and prevocational evaluations between January 1, 1961,
and December 31, 1967: Means, percentages and standard deviations were
computed.
In order to evaluate counselor use of the diagnostic report
recommendations, the job family in which the client was closed, to­gether
with the diagnostic report vocational recommendations were iden­tified
according to the ~ code system. These were then compared to
determine if the counselor followed or did not follow the report recom­mendations.
A total of 86 cases were included in this section. The
Significance of Difference between Percentages Test was computed for
the two groups. The following null hypotheses were tested:
1. There is no significa~t difference between percentage of cases
in which the counselors follow·ed the diagnostic report
to-'tt en s- "tt f " S t « Ott ·0.
71
"
vocational recommendations and the percentage of cases in
which the counselors did not follow the report recommendations.
2. There is no significant difference between the percentage of
cases closed rehabilitated in which the counselors followed
the diagnostic report vocational recommendations and the per­centage
of cases in which the counselors did not follow the
report recommendations.
3. There is no significant difference between the percentage of
cases closed not rehabilitated in which the counselors followed
the diagnostic report vocational recommendations and the per­centage
of cases in which the counselors did not follow the
report recommendations.
The final section of the study was an assessment of the psycho­logical
and prevocational report recommendations as measured by length
of employment in the year following closure. A follow-up study of 71
cases closed employed was conducted. Two groups were determined and
the Standard Error of the Difference between Means Test was computed.
The following null hypothesis was tested:
4. There is no significant difference in the length of employment
in the first year after closure in the number of cases whose
placement was. consistent with the diagnostic report vocational
recommendations and the number of cases whose placement was
not consistent with the report recommendations.
-.....:;-,...... -,,;.~
of
•
JI!
l
.\
72
Results
This study obtained information regarding the type of client
being referred for psychological and prevocational evaluations, coun-selor
behavior regarding the vocational recommendations made in the
client-study evaluations, and the effect of the recommendations as
determined by job tenure in the year following closure.
The study was limited by the fact that the referral population
was primarily in-school youth with disabilities in two categories,
visual and hearing impairment. In addition, some 43.9% of the cases
were th~ clients of one counselor which further affected the study.
For those DVR referral cases from the Arizona State School for
the Deaf and the Blind the professionals charged with evaluating the
client used a team-conference approach. The reason for this was the
recognition that deaf and blind clients have more difficulty in the
labor market. It was an experimental program designed to assist the
counselor in making realistic vocational decisions with his client.
The first two hypotheses tested by this study were significant
at or beyond the .05 level and indicated that: (1) vocational reha-bilitation
counselors tended to act in accordance with the vocational
recommendations, and (2) when the counselor did follow the report
,recommendations he was significantly more likely to close the case as
rehabilitated.
The third and fourth hypotheses yielded no significant differ-ences.
These results suggested 'that: (1) for those cases closed not
rehabilitated there was no definite behavior pattern of the counselor
,,'·-------~~
•
73
following or not following the recommendations, and (2) job tenure for
the first year following closure was not significantly greater for
either the followed or not followed groups. In order to more fully
understand the latter finding, several factors were considered which
might have had bearing on the results.
In general, the results of this study tended to agree with
Sindberg, Roberts and Pfeifer (1968). Both studies indicated that
rehabilitation counselors tended to follow the recommendations of psy-chologists
and evaluators. In addition, it showed that when the coun-selor
followed the report- recommendations, he was significantly more
likely to close the client as rehabilitated. This indicated that psy-chological
and prevocational diagnostic evaluations were valuable
sources of information to the counselor and could assist him in the
total rehabilitation process.
Conclusions
The findings of the study seem to support the expenditure of money
to provide diagnostic evaluations for rehabilitation clients.
2. The typical client referred for psychological and prevocational
evaluation was characterized as:
(a) single at time of referral,
(b) Caucasian,
(c) male,
(d) hearing impaired,
(e) little or no work history prior to refe;ral,
(f) twenty-two years of age,
\
74
(g) had completed the tenth grade, and
(h) had average intelligence.
3. Psychological and prevocational evaluations were meaningful aids
to placement.
4. Regardless of case outcome, evaluation information was considered
important by the vocational rehabilitation counselors, and they
tended to act in accordance with the vocational recommendations.
5. vocational rehabilitation counselors who followed the recommenda-tions
of evaluators and psychologists significantly more often
closed their clients in employment than counselors who did not
follow the recommendations.
6. In those cases closed not rehabilitated there was no definite be-havior
pattern of th~ counselor following or not following diag-nostic
report vocational recommendations.
Recommendations for Further Research
1. A study should be conducted which uses a cross-section of cases
which would receive vocational and psychological evaluation and a
cross-section of those which would not receive such services in a
prevocational evaluation unit.
2. A rather atypical population was used in this study. It is recom-mended
that a research study be conducted on a more typical referral
population and comparison made of the findings.
3. The employment follow-up section of this study obtained only factual
.
information regarding the type of job, length of employment and jo~
duties. Future research efforts should involve a more extensive
!.1I
r
75
follow-up in order to determine how the client felt about the job,
why he left his initial job, and how the first employer felt about
the client's performance.
4. Future research efforts should consider a replication of this
study design employed on a concurrent basis in which evaluators,
psychologists and counselors could be more involved in the re-search.
•
A Follow-Up Study on the Relationship
Between Work Evaluators'
Recommendations and
Client Placement
Dianne M. Williams
December 1975
APPENDIX E
TABLE OF CONTENTS
Chapter
I. IN'I'lWDUCTION . .... . . .
Page
• • • • • • • • • • • • • 1
II.
Statement of the Problem
Purpose
~ypothesis
Definition of Terms
Limita.tions of the Study
A REVIEW OF RELATED LITERATURE • • • • • • • 6
•
Follow-up of Work Evaluation Clients
Follow-up of Vocational Rehabilitation Clients
Summary
III. PROCEDURES · . . . . . . . . . . . . 11
Population and Subjects
Methods and Instruments
Definition of Terms
Analysis of Data
~ Statistical Hypothesis
IV.
V.
RESULTS •.
Results of the Study
Discussion
CONCLUSIONS.
Conclusions from Results
Summary of the Study
Recommendations
• • 0 • 14
· . . . . . . .. . . . . 16
REF'EltENCES . . • • . • . e • • • • • • CI • • .• • • 13
iii
CHAPTER I
IN'I'RODUCTION
Statement of Problem
An area of rather recent and fairly major concern in the field
of vocational rehabilitation is that of follow-up. This concern ap­pears
to be two-fold. Fir~t, it relates directly to the actual fol­lowing
up of clients involved in rehabilitation programs to determine
how they as individual clients have progressed toward their unique
rehabilitation goals. This. portion of follow-up attempts to deter­mine
the extent to which clients have become "rehabilitated" as a
result of the rehabilitation process. Successfully rehabilitated
clients have traditionally been viewed as those for whom the reha­bilitation
process has resulted to placement on a job.
Secondly, there is concern surrounding program evaluation much
of which comes as a direct result of feedback from those clients
who have been followed up and from their respective DVR counselors.
This feedback, or follow-up information as it is often called, aids
a facility in ferreting out its st~engths and limitations in programs
through which its clients are served. For this reason, program eval­uation
is vital to the very survival of the rehabilitation facility.
There exists, then, a very close and interdependent relationship
between client follow-up and program evaluation in the field of vo­cational
rehabilitation. Because of this interdependency, it becomes
virtually impossible to consider the first aspect of follow-up as dis­cussed
here without considering the second aspect as ~ell.
Both portions of follow-up are equally and mutually important to
the field of vocational rehabilitation today. In their survey of fol­low-
up procedures in rehabilitation facilities, Mason, Andrew & Dunn
(1975) view follow-up studies as being extremely important. They
further regard them as the best way of evaluating the effectiveness of
services provided by facilities in general and rehabilitation facili­ties
in particular.
In their monograph on Program Evaluation in Rehabilitation Faci­lities,
Menz, Andrew, Currie, Dunn & Scheinkman (1974) stress the im­portance
of knOWing what is and what is not working within a facility.
They cite a need for program evaluation to be done on a continuous
and timely basis. Without meaningful and continuous feedback infor­mation
regarding their effectiveness, facilities cannot continually
improve their services in a realistic manner no matter how hard they
strive to do so.
Feedback on client outcome is a vital tool in determining the
effectiveness of recommendations as well as checking client progress
in rehabilitation. Follow-up information is essential for accurate
planning and development of more effective client services. Many
facilities provide only follow-along services to clients and neglect
'the area of program evaluation. It is an area that facilities gen­erally
tend to overlook and its importance is usually under-estimated.
The study previously cited (Mason et al., 1975) also found that fa­cilities
tended to overlook the importance of seeking follow-up in­formation
from the purchasers of services.
The Commission on Accreditation of Rehabilitation Facilities
(CARE) was established to upgrade and improve the quality of service,
identify to the public competent facilities, to develop and maintain
standards, provide objective review of organizations, offer a mech­anism
for program accountability, provide feedback information, and
a forum for all involved to contribute to the standards-setting.
The Standards Manual for Rehabilitation Facilities was designed
by CARF to fulfill a variety of functions one of which is to serve as
a means of self-evaluation. Section 9: Program Evaluation reads, "The
facility shall have an evaluation system to identify the results of
facility services and the effect of the program on individuals served
in such a way that program performance can be improved and community
support can be enhanced."
The manual allows a great deal of room for interpretation by
each rehabilitation facility. Program evaluation has certainly not
been a priority or even a very reali~tic concern of rehabilitation
facilities until quite recently with the advent of CARr standards and
acc~editation. There is presently a growing concern for accountability
in the field which has probably contributed, along with the concern
over CARP stand~rds, to the increasing interest in program evaluation
and client follow-up.
This follow-up study focuses on activities that occur after clients
have. been evaluated and recommendations have been made to the referral
source... The study is concerned with the relationship between work
evaluators~ recommendations and their utility for DVR counselors in
placing their clients ..
Purpose
A primary purpose of this study is to determine to what extent
a relationship exists between work evaluators' recommendations and the
successful placement of clients by DVR counselors. The study includes
case studies or 56 clients, all of whom were evaluated at the Vocational
Development Center (VDC) in Menomonie, Wisconsin at Some time between
August 1974 and July 31, 1975.
This is a cohort study which concerns itself with all the clients
referred by the DVR counselors from the La Crosse, Rhinelander, and Su­perior
districts during the year beginning August 1, 1974 and ending
July 31, 1975. Comparisons were made between recommendations by the
work evaluators at the VDC and actual placement of the clients by their
respective Division of Vocational Rehabilitation DVR counselors as re­ported
by the counselors in telephone or personal interviews conducted
with them.
Successful client placement is based on the DVR counselors' judge­ment
as to whether or not the placement may be considered successful at
2
3
the time of the interview. The OVR counselor appears to be the most
appropriate person to make this judgement as he is the one who has
contact with the client, his employer, and/or supervisor(s) in com­bination
with the experience and other pertinent information that
would qualify him to make this type of determination.
Clients are referred to the VDC. for evaluation by many agencies..
including the State Division of Vocational Rehabilitation. This
study .concernsitself with only those clients who have been referred
by the counselors employed through the Rhinelander, Superior, and
La Crosse district offices of OVR. Clients are evaluated primarily
through the use of work samples for periods of one, two or three
weeks by the advanced graduate work evaluation students supervised
by trained evaluators.
Throughout this brief period of time, clients and evaluators
work closely with one another in order to determine the vocational
potential (strengths and limitations) of the client. Following the
evaluation period, recommendations regarding the future possibilities
for the client's placement in a job, training or adjustment program
are then directed, in· a written rep~rt, to the referring agency.
The evaluation process may certainly be affected by many variables,
some of which are discussed below. The client's state of physical and
mental well-bei~g at the time may have an effect on the evaluation pro­cess.
This in turn will affect the recommendations made by the work
evaluator. The cliene's self-concept is an important aspect of his
total well-being. It is important whether the client sees himself
as a worker. Has he ever been employed? Do his friends or members
of his family work? His attitudes toward work are crucial as well.
The ability of the work evaluator and the client to work together
may greatly affect the evaluation. The experience of the evaluator
and the severity of the client's disability may influence the evaluation
_ process. The client may have new or multiple disabilities to contend
with. Hopefully all these variables and the ones not mentioned will
be taken into consideration when recommendations are drawn up.
The extent to which the OVR counselor employs or utilizes the woC'k
evaluator's recommendations in developing a case plan and in actual
placement efforts is also dependent upon many things, some of which will
be discussed at this time. The OVR counselor may not have access to
the facilities and other community resources essential to the imple­mentation
of these recommendations ~ith a particular client due to his
geographic location. 'The recommendations may be too vague or unrealistic
to be helpful. The counselor may have his own preconceived ideas about
the client's abilities and be unable or unwilling to alter them. He
may underestimate or overestimate his client's abilities. He may par­ticularly
like or dislike a certain client. Perhaps the client has failed
before and the counselor is now overly .cautious in the present endeavor.
the client may sustain an additional injury making the recommended plan
impossible to implement at the present time. These are but a few of ere
variables which might be encountered with regard to the relationship OE-
4
tween work evaluators' recommendations and successful placement of
clients by their respectiv.e DVR counselors.
Another purpose of this study is to determine the effectiveness
of work evaluators' recommendations with DVR clientele. This is very
important because it may be assumed the counselor has questions re­garding
his client or he would not refer the client for evaluation.
It is important for the purposes of imp,roving the evaluation process
through feedback information to know how well the refer~al questions
posed by the counselor are being satisfied. It is also important for
feedback purposes to learn to what extent the evaluators' recommenda­tions
assist the counselor in ac~tual rehabilitation planning for and
placement of the client. This information is invaluable in planning
and improving programs so as to better serve and meet the needs of
clients.
Still another very real concern is the longevity with which the
c11ent retains his job or continues in training and adjustment pro­grams
after placement by the DVR counselor, as based on work evaluators'
recommendations. This, however, is beyond the scope of this study.
This type of information may often'be available only after several
years following placement.
Hypothesis
It is hypothezised that there is a positive and significant relation­ship:
1. Between work evaluators' recommendations being followed and the
successful placement of DVR clients by their respective counselors.
2. Between the helpfulness of work evaluators' recommendations and
successful DVR. client placement.
Definition of Terms
The folloWing terms are defined according to their use in this study:
Outcome: Placement of a client in a work, training, or adjustment
situation or program or the closure of the case and termination of the
client by the DVR. counselor.
Recommendations: Suggestions included within the written report to
the referral agency in regard to future vocational placement or training
based on the evaluation of and discussion with a client.
Work evaluation: A systematic process of using work (real or sim­ulated)
as the medium for the estimate of work potential and work behavior.
Work evaluator: A vocational rehabilitation professional specialis~
whose primary responsibility is the systematic evaluation of client work
potential and work behavior.
Work sample: A generic term used to describe all samples of both
real and simulated work, irrespective of the purpose or use made of these
work samples.
..
5
Limitations
In studies chat are concerned ~ith program evaluation, it 1. v4rl
difficult to identify specific causes of success or failure. These
causes may be identified most readily within controlled experimental
settings which, of course, is not the situation with this study or with
similar studies concerned with progI:dm evaluation and follow-up. The
outcome of this study may be altered by both known and unknown factors
over which this researcher has no control.
Important limitations might be the inability to control variations
in evaluator characteristics, counselor preferences, and client traits.
Interpersonal relationships and personal biases playa major part in
all aspects of life and the evaluation process is probably no different •
It is extremely difficult to measure successful placement of clients
without che assistance of the DVR counselor's judgement of the situation.
This involvement might introduce an element of bias into the study and
one should certainly be aware of this problec.
Other influencing factors for ~hich there is really no control are
the attitudes and knowledge and experiences the client brings with him
to the evaluation. It would probably also make some difference if he
were forced to participate in the evaluation process against his will.
The client~s self concept and attitude toward his disability can
greatly influence the evaluation process as well as the total rehabili­tation
process. Attitude is certainly a variable that cannot easily
be controlled in a free country!
It appears that these factors ca~ and probably do have some effect
on this type of research. It further appears virtually impossible to
eliminate these factors.
..
6
CHAPTER II
REVIEW OF RELATED LITERATURE
The meager amount of literature regarding follow-up information
on the relation~hip between work evaluators' recommendations and suc­cessful
client placement is bewildering at bestl There are many rea­sons
~or the existence of this situation. In a review of programs
of evaluation and work adjustment Dunn (1969) noted that although
many of these programs have been in existence for a number of years,
the results of their work have been scattered in a multitude of final
reports with diverse styles of reporting outcome data and an amazing
number which fail to provide follow-up data or full reporting.
It has only recently become "officially" important for facilities
to establish, utilize and maintain self-evaluation systems. The ad­vent
of the Commission on Accreditation of Rehabilitation Facilities
(CARF) has been the primary factor in bringing about genuine concern
in this area.
Gordon (1969) in a review of eXperiences of MOTA experimental
and demonstracion projects also appears to be in agreement with Dunn '·s
observation. He suggested that because of local initiative in project
design and goals that a comprehensive evaluation, even within a system,
is precluded. He further implied that, for the same reasons, objective
evaluation between projects is all but impossible.
Mason (1974) in her paper regarding follow-up procedures as they
relate to rehabilitation facilities, indicated that the lack of follow­up
programs and information within facilities was possibly due to the
lack of pressure being placed on facilities thus far to be accountable·
and provide program evaluation data.
In his article entitled "Evaluating Vocational Evaluation", Barad
(1972) noted that the literature of vocational evaluation reveals a
"striking" absence of sound experimentation or interest in "evaluating
vocational evaluation." He posed the question: "Does vocational eval­uation
work?" In Barad' s opinion, based on limited amounts 0 f research
thus far, vocational evaluation offers significant help to individuals
seeking competitive and sheltered employment. He maintained that the
need to initiate controlled descriptive, validation and evaluative re­search
along the lines of .survey, correlational and experimental stra­tegies
is of ucmost priority.
Follow-up of Work Evaluacion Clients
Distefano (1970) studied the relationship between the rated per­formance
in a vocational evaluation program and the successful job
placement of 58 emotionally disturbed adults in a vocational rehabi:i­tation
program. His results lend substantial support to the predictive
validity of evaluation ratings in vocationally relevant activities.
The determination of actual vocational success of a group of
126 cerebral palsy patients adds considerably to the significance
of any predictive index.
Yue and Moed (1960) conducted their study involving the eval­uation
and follow-up of this group over a period of three years.
At the conclusion of the study they praised vocational evaluation
saying, "the high degree of correlation found bet"'een employment
success and vocational evaluation is encouraging and supporting to
the validity of careful. practical vocational evaluation."
i
•
In their follow-up study on occupational choice and job adjust­ment
of 81 clients who had completed evaluation at the Curative
Workshop of Milwaukee. Overs and Day (1968) reported that the work
evaluation program was "doing the job it's supposed to be doing"
and "the relatively high percentage of success justifies the cost."
They found that 6 to 18 months after their evaluations, 60 percent
of the clients continued to be employed.
A common question in the field of vocational rehabilitation
concerns the type of clients referred for vocational evaluation.
Other frequently occurring questions along this same line involve
the use OVR counselors make of evaluation facilities~ Currie (1974)
administered a reasonable open-ended 16 l::t=m "Rehabilitation Counse­lor
Facility Ut~lization Questiornairc"to ten ova rehabilitation
counselors. On his question concerning difficulty of case load,
Currie found the overwhelming majority referred difficult to very
difficult cases for vocational evaluation.
On the question concerning the characteristics of the clients
being referred to facilities for vOcational evaluation, the folLowing
were rank-ordered as being the most predominant:
1. Sketchy or poor work history
2. Mental retardation
3. Emotional disturbance or mental illness
4. Social inadequacy due to the lack of basic living skills
5. Multiple or severe disabilities
According to Baker and Sawyer (1971) there are five broad areas
of recommendations that follow as a result of vocational evaluation:
1. Direct placement
2. Vocational training
3. Permanent sheltered employment
4. Adjustment services
5. Not feaSible for ·.;ocational rehabilitation services
~ The work evaluator should clearly state his rationale for each
of his recommendations so that the OVR,counselor can gain an under­standing
of and an appreciation for the logic behind chose recommenda­tions.
This "freedom through understanding" is especially cogent when
the "not feasible" recommendation is made.
•
In her Survey of DVR Counselors' Requirements for Work Eval­uation
Reports, Oonk (1972) stated that 78 percent of the counse­lors
surveyed felt that recommendations comprised one of the most
essential sections of the report, the other two sections being
vocational appraisal and work behavior and needs.
A study showing a correlation between evaluators' recommenda­tions
and client placement was conducted by Tacoma Goodwill Indus­tries
(Bashey &Silverton, 1966) with 92 emotionally disturbed
clients. These clients were involved in a two month work evalua­tion
program with provisions for a three month extension if neces­sary.
The study disclosed that the evaluations saved DVR counse­lors
considerable amounts of time in providing case services to
these clients •
In regard to the effectiveness of evaluators' recommendations
in the placement of clients by DVR counselors, Allison (1970) found
that 77 percent of the decisions made by counselors were based on
information gleaned from evaluation recommendations.
Tharbs (1971) in a follow-up study regarding client attitudes
toward the Vocational Development Center (at that time known as the
Evaluation and Training Center), found that former clients regarded
their experience as a total and well rounded e-..cperience. The major­ity
viewed it as having been effective in facilitating employment
for a large number of them. Of the total sample, 76 percent indi­cated
a willingness to recommend another person with a problem simi­la:
to their own to the vue for evaluation.
·Follow-up of VOcational Rehahilitation Clients
In addition to the valid and predictive nature of vocational
evaluation, much of the literature cited below reveals another ex­citing
characteristic of vocational rehabilitation as a whole--that
is, it pays high dividends on taxpayers' investments.
The ''Wood County Project" in Wood County, Wisconsin, found that
for every dollar spent in the rehabilitation of the culturally handi­capped,
67 dollars was earned in increased income alone (Wright, Rea­gles,
&Butler, 1969).
In another follow-up study examining the vocational status of
50 mentally retarded clients who had received vocational rehabilita­tion
services, Greco (1974) found 18 to 48 months after the cases
had been closed that the mentally retarded were a vocationally stable
group since they remained in an occupation once employment had been
obtained. He also concluded that, if given the opportunity, the men­tally
retarded can pay their own way in the world. In general, the
typical mentally retarded vocational rehabilitation client who has
been employed in excess of 18 months will pay more monies into the
government than was expended in order to rehabilitate him. Greco also
stated that without the Division of Vocational Rehabilitation or a si­milar
agency many of the 50 individuals involved in his study would
8
e"
')
either be on welfare, receiving social security, or .in a tax sup­ported
institution at a great cost to society.
The Minnesota Division of Vocational Rehabilitation asked the
University of Minnesota's Work Adjustment Project (1969) to conduct
a follow-up survey of former DVR clients ..Among the questions for
which the DVR sought answers were these:
1. Do clients who are rehabilitated stay employed?
2. Do they become self-supporting?
At the time of the follow-up (which for some was as long as 5
years) the major findings revealed that of the nearly 5,000 respon­dents,
81 percent of these rehabilitated clients were employed. At
acceptance one fourth of the total group of rehabilitated DVR clients
were on public assistance. At follow-up, only 1 in 7 were receiving
public assistance. At acceptance, the typical rehabilitated client
had no income; at closure, his average monthly income was approxima-tely
275 dollars and at follow-up, monthly earnings averaged 345 dollars.
In a study developed to obtain precise infoLmation on the outcome
of the 1956-57 Vocational Adjustment Center (VAC) "graduates" Wright
&Trotter (1968) referred to long-term follow-up as "often one of the
weakest aspects of rehabilitation programs." They argued that maintain­ing
employment should merit as much concern as does securing emplovment.
They found that predictions by VAC staff regarding future placability
and employability were generally upheld by the follow-up study, ie.
clients rated as more employable tended to have been employed for a
longer period of time. Of the clients who had been placed on jobs
after leaving VAC, the study also found family attitude (supporting or
impeding) was an important fac tor in the client's vocational adjustment.
Successful rehabilitation is certainly more than merely placing
people on jobs in most cases. It is also more than altering undesirahle
behavior; however, both may be very important aspects of the tQtal re­habilitation
process. Gendel, Glaser, Friedmen & Neff (957) revealed
at the close of their follow-up study of a project which assisced handi­capped
persons to adjust to productive work, "the i'hief chan~l!s which
appear co have taken place in successfully rehabilitaced ~lients appe~red
to be in the realm of attitude and feeling, rather than in actu;Jl behavior."
Summary
In reviewing the literature as it relates to follow-up studies in
vocacional r-ehabilitacion in general and work ~vall1ation in particular,
one cannot help but b~ impressed wich the trem~ndolls and positive stridE'S
the field has made in a relatively short: p~riod uf time. It is c.~rtairly
gratif"lin~ to rtOr.~ the scores or peopLe '..Jhn~e livE'S h;lVl' tak"!1 (In nC'w
meani.ng and va.luechruugh vClcatiofuL rehabilitatlvn..-\t the ~'-lml.:! time vne
is also made aware of che vaSC:1ess of tht:! cask chat lies ahead.
!he literature tends to descr:be work eV;Jl.uatitln ;JS an eff('~ cive, valid
and predictive tool in che fieLd 0:: vocacional r~bahi.lit<lti(m. It" further
sUli:gests that work evaLuation is lweftll r~ DVR (:ounselurs, saving them con­si.
derable time and aiding them in ::h~ dt:!cLsi.on 'nakin~ process. It app~ars
that although long-term follow-up seems to be one of the weaker as­pects
of vocational rehabilitation, the rehabilitation process has
been shown to be one that pays returning many tax dollars for those
invested. Also implied in the literature was that many things in­fluence
the rehabilitation of individuals including their own atti­tudes
and feelings and those of the people around them.
This investigator feels that based on reviews of available li­terature
relating to follow-up studies of work evaluation and in
light of thepau~ity of this literature, there appears to be definite
need for further follow-up research as it relates to vocational e­valuation.
10 .
11
CHAPTER III
PROCEDURES
Population and Subjects
The Vocational Development Center (VDC) provides vocational
evalua~ion and job placement training services to people with wide-ly
varying vocational handicaps including the mentally retarded, phy­sically
disabled, mentally ill, public offenders and high school youth
who need vocational direction. These people, comprising the client
population of the VUC, are referred by many public and private agencies
including the Division of Vocational Rehabilitation, Division of Cor­rections,
mental health clinics, and various school systems. The VDC
serves both male and female clients with numerous age groups and a var­iety
of geographic locations being represented.
The sample of subjects for this research was selected from the
total population of clients referred to the VUC for one, two, or three
weeks of vocational evaluation bet·",een August 1, 1974, and July 31, 197,.
Only those clients referred by DVR counselors from the Rhinelander, Su­perior,
and La Crosse district offices of the State of \~isconsin Division
of Vocational Rehabilitation during that particular period of time were
selected as subjects for this study. It was felt that these agencies were
representative of DVR agencies througnout Wisconsin and clients they re­ferred
to the VUC were representative of clients served by the VDC.
The client population consisted of a total of 56 OVR clients, with
42 males and 14 females, ranging in age from 14 to 53 years. Their mean
age was 27.75 years and their modal age was 19 years.
Methods and Instruments
The instruments used in this r~search were Infot"'mut"ion She-:ts, per­sonal
interviews and telephone surveys. The district" supervisors of the
La Crosse, Rhinelander and Superior DVR offlces \o(~r~ cC'ntilcted t.n order to
enlist their support and obtain the cooperation vI:: tlleir staff mt::mbers in
this research. District supervisors, DVR cOl~~elor~ and uther ~taff mem­bers
were extremely cooperative in providing the t"eqlle~tcd information.
An Information Sheet was designed in ord~r to gather the fullowing
information for each client: client's name, age, address, sex, DVR cou~se­lor,
district office, period of evaluation, evaluator and recommendations.
This information was extracted from VDC client files and recorded on the
upper portion of each client Information Sheet. On each sheet were also
listed the follOWing questions for '....hich answers w~ re !'lI.lUl.!.ht thr:1ugh tele­phone
surveys or personal intervie.....s wir:h rWR ,;Ullll::'li:l"'·,,:
1. Has your client been placed in a work, training or a~justment
situation or program?
2. In what specific program or type of worlc ",;,]!'l tw placed: Or,
why was he not placed':
3. Were the reconunendations of the 'Jork evaluator helpful? Whv
or why not?
11
4. Were the recommendations followed? If not, why not?
5. If the client was placed, in your opinion how successful
or beneficial is the placement for this client?
a) very good b) moderate c) minimal d) not at all
6. How long has the client been on his present job, training
or adjustment situation?
7. What is the present DVR status of the client?
At the time of follow-up it had been between 90 days and 15 months
since the clients had been evaluated at the VDC. All information was tak­en
from VDC files and discussions with DVR counselors. At no time was any
contact made with clients.
Definition of Terms
• Successful client placement was based on the judgement of the DVR
counselor as to how successful or beneficial the placement appeared to be
at the time of follow-up. The DVR counselor appeared to be the most ap­propriate
person to make this judgement in the light of his advantageous
position of having access to, and contact with, several key people: the
client, his employer and/or supervisor and others., This and other per­tinent
information combined with valuable experience would qualify the
counselor to 'make that judgement.
"
"Unsuccessful" client placement included the following:
1. The client had been placed but had quit the job, training or
adjus tme.nt program.
2. The client had disappeared. could not be located and the file
was closed.
3. The client refused to cooperate or follow through and was not
placed.
The client was institutionalized or hospitalized and placement
was delayed indefinitely.
The client was awaiting placement in recommended areas.
The client was determined "not feasible" for rehabilitation
services in agreement with evaluation recommendations and the
case was closed.
2.
3.
Several exceptions to the "unsuccessful" placement outcome were
allowed:
1.
The client population was broken down into groups in order to inspect
the data according to "successful" and "unsuccessfulll client placement out­come.
Both of these groups were further scrutinized in order to reveal the
number of cases in which the work evaluators' recommendations were followed
and the number of cases in which recommendations were not followed in each
of the two groups. Th~ relationship between the helpfulness of evaluators'
recommendations. as indicated by DVR counselors, and "success ful" or "un­successful"
clien.t placement effort::> W<J,S also explored. The number of a.c.tive
cases was compared to the number of closed cases and this information was ex­amined
in relation to the "successful" and "unsuccessful" placement: or t'eha­bilitation
outcome of clients involved in this research.
13
Analysis of Data
The statistical test used to test out the hypothesis was the
chi-square. !t was selected because the research design would pro­bably
violate the assumptions underlying parametric statistical tests.
The chi-square test for two independent samples was chosen be­cause
each of the two groups (recommendations helpful/recommendations
not helpful) are independent, and because the "scores" under study are
frequencies indiscrete categories (successful placement and unsuccess­ful
placement.) A two-tailed test of significance was used with the
confidence level of .05 selected for the rejection of the null hypo­Fheses.
The data were analyzed in 2 X 2 contingency tables with the fol­lowing
categories:
Table 1
A. evaluators' recotmnendations followed (RF) with successful
placement (SP)
B. evaluators' recommendations not followed (RNF) with succes­ful
placement (SP)
C. evaluators' recommendations followed (RF) with unsuccessful
placement (UP)
D. evaluators' recommendations not followed (RNF) with unsuc­cessful
placement (UP)
Table 2
A. evaluators' recommendations helpful (RH) with successful
placement (SP)
B. evaluators' recommendations not helpful (RNH) with successful
placement (SP)
C. evaluators' recommendations helpful (RR) with unsuccessful
placement (UP)
D. evaluators' recommendations not helpful (RNH) with unsuccess­ful
placement (UP)
Statistical Hypothesis
!t
rate of
1.
2.
is hypothesized that there is no statistical difference in the
successful placements between:
That group of clients for whom work evaluators' recommendations
were follo~ed (RF) by DVR counselors and that group of clients
for whom evaluators' recommendations were not followed (&~F)
That group for which evaluators' recommendations were helpful
(RR) and that group for which work evaluators' recommendations
were not helpful (~~).
14
CHAPTER IV
RESULTS
Results of the Study
This study has attempted to determine the relationship between
work evaluators' recommendations and the successful placement of
client~ by their respective DVR counselors. The subjects for this
research were all DVR clients referred to the Vocational Development
Center from August 1, 1974 through July 31, 1975 by DVR counselors
from the La Crosse, Rhinelander and Superior district offices of the
S~ate of Wisconsin Division of Vocational Rehabilitation.
The data were analyzed in 2 X 2 contingency tables and compared
successful placement (SF) and unsuccessful placement (up) efforts with
work evaluators' recommendations being followed (RF) and recommenda­tions
not being followed (RNF). Successful placement (SP) and unsuc­cessful
placement (UP) categories were compared with work evaluators'
recommendations viewed as helpful (RR) and not helpful (RNH) in the
opinions of DVR counselors surveyed.
Each group was compared using the chi-square analysis. The re­sults
of this statistical test permit rejection of' the null hypotheses
and require acceptance of the alternative hypotheses:
1. There'is a pOSitive and significant relationship between
work evaluators' recommendations being followed and successful place­ment
of DVR clients by their respective counselors2 The chi-square
statistical test for this comparison resulted in 'X • 21.71 which is
a sufficiently large value to reject the null hypothesis at the .05
confidence level.
2. There is a pOSitive and significant relationship between the
helpfulness of work evaluators' recommendations and successful client
placement by DVR counselors. Res~15s of the chi-square statistical
test for this comparison revealed~ • 7.92 which is a sufficiently
- large value to reject the null hypothesis at the .05 level of confi­nence.
Discussion
With the rejection of the null hypothesis and the acceptance of
the alternative hypothesis, the results of this study indicate a po­sitive
and significant relationship between successful placement of
clients and the following work evaluators' recommendations o.f: DVR
counselors. The study further indicates a positive and significant
relationship between the helpfulness of evaluators' recommendations
and successful DVR client placement.
It was found that 68 percent of the DVR counselors surveyed had
followed the work evaluators' recommendations and had placed their
clients accordingly. Of this group, 92 percent were successfully ?lac­ed.
Evaluators' recommendations were not followed for 32 percent of the
clients and of those only 28 percent had been placed successfully.
15
The reasons given by DVR counselors for not following the re­commendations
of work evaluators tended to fall into four basic
categories:
1. lack of client cooperation in following through on the plan
2. recommendations were unrealistic for the geographic area
3. client changed his mind .
4. additional physical or emotional problems made recommenda­tions
impossible to implement
At the time of follow-up, 55 percent of the cases were classified
as active and 81 percent of these clients had been successfully placed.
Of the 45 percent whose cases had been closed, 60 percent of the clients •were successfully placed.
recommendations
The counselors
helpful for the
3.
2.
4.
5.
Of the DVR counselors surveyed, 82 percent felt the
were helpful in planning for and placing their clients.
tended to indicate that evaluators' recommendations were
following reasons:
1. recommendations supported or documented the tentative plan
the counselor had made
they provided new or additional information about the client
and his abilities
they located appropriate job and/or training areas for the
client
they were "useful"
they w~re "realistic"
Reasons were also given as to why the counselors felt the recom­mendations
were not helpful in planning for and placing their clients.
The most common reason was that the recommendations were "unrealistic"
or impossible to implement in a given geographic area (particularly
more sparsely populated rural areas) especially in view of the current
economic situation.
16
CHAPTER V
CONCLUSIONS
Conclusions from Results
It may be concluded, based on the results of this research,
that a positive and significant relationship exists between the
following of evaluators' recommendations and the successful place­ment
of DVRclients. It was apparent that the rate of successful
placement was considerably higher when work evaluators' recommend­ations
were followed. Conclusions may also be drawn as to the
positive and significant relationship between the helpfulness of
work evaluators' recommendations and the rate of successful client
placement by DVR counselors. The majority of Dv~ counselors indi­cated
that work evaluators' recommendations were useful to them in
planning for and placing their clients.
Summary of the Study
The central purpose of this study was to detennine the relation­ship
oetween work evaluators' recommendations and the placement of
clients by their respective DVR counselors. Another purpose was to
determine the helpfulness of work evaluators' recommendations 'With
the successful placement of DVR clientele.
In reviewing the literature as it relates to vocational reha­bilitation,
work evaluation is described as an effective, valid, and
predictive tool in the field. It further sugge~s that work evalua­tion
is useful to DVR counselors, saving them considerable time and
aiding them in the decision making process. Although long-term fol­low-
up appears to be one of the weaker aspects of vocational rehabi­litation
to date, the rehabilitation process has been shown to be one
that pays, returning many tax dollars for those invested.
Also noted was that many things· can and do influence the rehabi­litation
of individuals, including their own attitudes and feelings as
well as those of people around them. The attitudes of clients' families,
whether supporting or impeding, were shown to be particularly important
factors in the clients' total vocational adjustment. In light of the
information gleaned from the literature, a need for additional follow­up
was apparent.
The population for this research consisted of 56 OVR clients who
were referred to the Vocational Development Center for one, two or three
weeks of vocational (work) evaluation between August 1, 1974 and July 31,
1975 by DVR counselors from the Rhinelander, La Crosse and Superior dis­trict
offices of the State of Wisconsin Division of Vocational Rehabili­tatiOn.
The instruments and methods used in the research were Information
Sheets, personal interviews and telephone surveys. All information was
taken from VDC files and discussions with OVR counselors. No contact
.was made with clients.
17
The data were analyzed in 2 X 2 contingency tables and the chi­square
statistical test was used to test the hypotheses. A two-tailed
test of significance was used with the confidence level of .05 selected
for the rejection of the null hypothesis.
Results of the statistical analysis required acceptance of the al­ternative
hypotheses with sufficiently large chi-square values to reje~~
the null hypotheses at the .05 level. -
The alternative hypotheses state that there is a positive and
significant relationship oetween:
1. work evaluators' recommendations being followed and successful
Pla.cement of OVR clients by their res?ective.cou~s~lors. (The chi-square
statistical test for this comparison resulted in~- • 21.71.)
2. the helpfulness of work evaluators' recommendations and suc­cessful
client placement by OVR counselors (Re~9Its for the chi-square
statistical test for this comparison revealed ~ • 7.92.)
Results of the study emphasized the utility of work evaluators'
recommendations with ova clients indicating that 82 percent of the ova
counselors surveyed felt the recommendations were helpful to them in
planning for their clients. It was 'found that 68 percent of the OVR
counselors surveyed followed work evaluators' recommepdations in placing
their clients. Of those clients whose counselors followed the recommend­ations.
92 percent were successfully placed. The counsalors who placed
their clients outside of the evaluators' recommendations comprised 32
percent of those surveyed. A 28 percent successful placement rate was
shown by this group.
Recommendations
Based on the results and conclusions drawn from this research, it
would appear useful to follow-up on these clients again in three to five
years. This would help to determine the long term effect of placement
efforts. Many of the clients includ~d in this study were still in train­ing
at the time of the follow-up and a lacer study would probably reveal
more complete information es to their rate of successful placement.
Additional long-term follow-up research might well be utilized co
compara the rate of succassful placement between that group of clients
placed in accordance with work evaluators' recommendations and that group
for whicn placement recommendations were not followed. Information gath­ered
in such a study would contribute to our knowledge of long term place­ment.
It might also provide more information regarding the long term
ramifications of work. evaluators' recommendations as they relate to
placement areas.
It was interesting to note that only 68 percent of the OVR counselors
surveyed followed the recommendations of the work evaluators with a 92
percent rate of successful placement. Further study would seem beneficial
in order to determine why 32 percent of the OVR counselors did not follow
work evaluators' recommendations. particularly in view of the high success
rate for those who did. Information of this nature might assist in locating
the limitations in any part of the rehabilitation process. Only as rehabili­tation
services are improved will ultimate client-centered goals be met.
18
REFERENCES
Allison, K.G. A follow-up study to determine the significance of
evaluators' recommendations against client rehabilitation out­come.
Unpublished masters' thesis, University of Wisconsin­Stout,
1970.
)aker, R.J., & Sawyer, H.W. Guidelines for the development of ad­Justment:
services in rehabilitation. Auburn, Ala.: Auburn
University, 1971. (Republished: Adjustment services in re­habilitation-
emphasis on human change. Materials Development
Center, University of Wisconsin-Stout.)
Barad, C.B. Evaluation vocational evaluation. Journal of Rehabili­tation,
1972, 38 (3), 36.
Bashey, H., & Silverton, G.
emotionally disturbed.
dustries, 1966.
Evaluation and adjustment center for the
Tacoma, Washington: Tacoma Good~i1l In-
Distefano, M.,
placement
program.
24, (3),
Procedures of follow-up programs in rehabilitation facili­Unpublished
masters' thesis, Univ,~rsity of Wisconsin-Stout,
\
Currie, L.E. Rehabilitation counselor utilization of vocational e­valuation
and work adjustment services: prelude to a more de­tailed
study. Consumer Brief, 1974, 2 (2).
~r., &Pryer, M. Vocational evaluation and successful
of psychiatric clients in a vocational rehabilitation
The American Journal of Occupational Therapy, 1970,
1-3.
Dunn, D. The effectiveness of work evaluation and work adjuscment
programs. Unpublished paper, University of Wisconsin-Stout, 1969.
Gellman, W., Gendel, H., Glaser, N.M., Friedman, S.B. & Neff, W.S.
Adjusting people to work. (2nd ed.) Chicago: Jewish Vocational
Service Monograph No.1, 1957 .. (Republished: Materials Develop­ment
Center, University of Wisconsin-Stout.)
Gordon, J. Testing, counseling, and supportive services for disadvan­taged
youth. Ann Arbor, Michigan: Institute of Labor and Indus­rial
Relations, 1969.
Greco, L. A follow-up study of fifty mentally retarded clients. Voca­tional
Evaluation and Work Adjustment Bulletin, 1974, 7 (2), 10-19.
Mason, V.A.
ties.
1974.
~ Mason, V.A., Andrew, J., & Dunn, D. Follow-up procedures in rehabili­tation
facilities: a survey. Consumer Brie f, 1975, 3 (l).
19
Menz, F.E., Andrew, J., Currie, L., Dunn, D. &Scheinkman, N. Program
evaluation in rehabilitation facilities. University of Wisconsin­Stout,
Research and Training Center, 1974.
Minnesota studies in vocational rehabilitation: XXVI. A follow-up sur­vey
of former clients of the Minnesota Division of Vocational Re­habilitation.
tlork Adjustment Project Industrial Relations, 1969.
Oonk,'D. A survey of Northern Wisconsin Division of Vocational Reha­bilitation
counselors' requirements for work evaluation reports.
Unpublished masters' thesis, University of Wisconsin-Stout, 1972.
Overs, R., &Day, V. Follow-up 81. Milwaukee Media for Rehabilitation
Research Reports, Number 6, 1968, Curative Workshop of Milwaukee.
Pruitt, W.A.
versity
Introduction to work evaluation.
of Wisconsin-Stout, 1974.
Unpublished paper, Uni-
Standards manual for rehabilitation facilities. Chicago: Commission
on Accreditation of Rehabilitation Facilities, Suppl., 1975.
Standards manual for rehabilitation facilities. Chicago: Commission
on Accreditation of Rehabilitation Facilities, 1973.
~ Tharbs, E.W., J~. A follow-up study to see if client attitudes toward
the Evaluation and Training Center are related to vocational ad­justment.
Unpublished masters' thesis, University or Wisconsin­5tout,
1971.
Wright, G.N., Reagles, K.W., &Butler, A.J. The Wood County project:
an expanded program of vocational rehabilitation. Final Report,
R DNa. 1629, 1969, University of Wisconsin Regional Rehabilitation
Research Institute.
Wright, C.N., &Trotter, A.B.
Rehabilitation research.
consin, 1968.
A long~term follow-up of workshop clients.
Madison: Regents, University of Wis-
Yue, 5., &Moed, M. Medical and vocational evaluation of young adult
cerebral palsied: experience and follow-up, 157 cases. Archives
of Physical Medicine and Rehabilitation, 1960, 41, 136-142.
-, APPENDIX F
RULES AND, REGULAnONS
I
/
rehabllltatlon poten
to make such a detcrmlnaUoIt
The state plan shaJl provide that
prel1m1nary diagnost.1c study win In-, c'
Clude such examlnatlons and diagnostlo
{stUdies as &re necessary to make the de­termino.
tions apecJ1ied in paragraph (a)
-of. thla' section, "and. in an easea, win
(place prlmtU7 emphasis upon the deter­-
FmmatIon 'of.t.1le.individul\J.'s potential
;; for" achJevtnr': a ., vocational goal. The
t ""State plan shaIlprovide that the p
11minary diagnostic study will
an appraIsal ot the curre
alth status of the
with such provisions as he m.a.y.1lnd nee- provide for selecttni tho moat severely § 1361.34 Evalualion or r,·hnhililalinn
esaary to aasuro the correctness a.nd vert- lhandicapped individuals for the pro-- pOlentinl: Prelirninnry dingno!Cli..
11cat1oD of such reports.', " ' "•. :...·~-:,~ ... v1slonot vocational rehabUltation serv· slndy.
• ' . ,..", . ~ ". ices prior to any other handicapped Indl- (a) The State pla.n shall provide that.
~ 1361.22 . Nondisc:rlm.lnalloa In emploT·~ viduals who have applied tor such in order to determine whether any Indi-menl
under conatructloD contracts. ~.,' services: .:''. vidual Is ellg\,ble for vocationIII rehabl1l-
The State plan shall provide that the ' (c) The state plan shall further pro- tatlon services. there shall be 1\ preliml­State
agency will 1J;lcorporate. or cause vide for special consideration in the nnry diagnostic study which shall be suf.
to be incorporated, into construction selection for vocational rehab111tatlo~ ftclent to determine:
contracta (including constroctlon con- services and the provIsion ot such serv·" (1) Whether the Individual hM a phys­tracta
related to the establIs~ent or . Ices to ,those handicapped Individuals leal or mental disability which for such
construction at rehab111tatlon fa.cUlties) whose handIcapping condition arIses Individual constitutes or results In l\ sub.
paid tor In whole or In part with tunds trom a dlsabUlty sustaIned In the line ot stantinl handicap to employment; and
obtaIned Crom the Federal Government duty whlle such Individual was perCorm- (2) Whether vocn!JQDnl rehabilitation
under the vocational rehabUltatlon pro~ Ing as a publ1c safety" omcer and the services may re ted to
gram'-such provisions on nondlscrlmlna~ proximate cause of such disability was a benefit the
tJon in employment. as ar~, required by c:rlminal act, apparent. crimInal act.. or ployablU,
and pursuant to Executive Order. No. ' a hazardous condition resulting directly e "
11246 and will otherwise comply with from the oMcer's perCormance ot duties
requl;ementa preSertb~by and pursuant, in, direct connection with the enforce
to such order. \' ment. execution. and administration "
d I I I" d' law or ftre prevention, ftreftght.1ng
. § 1361.23 General a m n .trllt Yo ,an related pUblic satety activities. .
fucal requirement&. ." Cd) The State plan shall Curther
(a) The State agency' shall adop\ vide that vocational rehab1l1tatIon
policies and methoda pertinent to the - ices being provided to any handic
Oscal adm1n1stration and cOntl-ol of tho individual under the terms and c
vocational rehabWtatlon program, in- tloDs or the Vocational Rehablll .
eluding sOurces ot funds, inCUl'l"enco and Act shall not be dlsrupted 80S a reeuI
payment of obllptions,' dlsbursementa, tho approval at a State plan under
a.ceounting, and auditing. The State plan part.
shan provide for the maintenance- by ••
the State agency of such accounta an4 § 1361.32 Servlee. to Clyll employees of
supporting documenta as W1ll serve to \ ,.' the United Slale.. , .
permit an accurate and expeditious de-' 'The state plan shan provide that
terminat.ion to be mAde at any time of .vocational rehabll1tation services w1ll be
the statws or the Federal g-ranta,,1nclud- made avaUable to eivU emploYee4 of the
lug the dIsposition of a1f montes received. U.S. Government who are d14abled in
and the nature and amount or an chargea. line at duty, under the same terms and
.clalmed agairust sueh grants. " conditions as are appUed to other handi-
• (b) The prov1slorus ot Part 74 or this capped individuals. '
title, esta.bUshingunlform eAmlnlstratlve § 1361.33, EUgibillty.
reqUlrementa and. cost. prlnciples" shall "
apply to all 'grants made under tb.1.s part (a) General provislo1\..!. (1) The State
except tor the requirement concern1ng plan shall provide that el1g1b1l1ty require­in-
kind contributions Under SUbpart 0 ments W1ll be appUed by the State
ot Part 74 at tb1I title. . .' agency without regard to sex. race, age.
. creed. color, or national orlgin of the
STAn: PLAN CoK'n:n: P1tO~OH. AND . individual\ applying tor serv1ce. Th
SCOPS or Sane:. . State plan'shall turther provide that n
§ 1361.30 Proceealnr reCerrllh and lip" group ot individuals will be exclUded
plication&. : - " . ' tound ineligible' solely on the ba.sls
The State plan shan provide that the type a! dlsabWty. With respect to ag
wU1 estahl1sh in WT1t1nlr the State plan sba.11 specl!Y that
State agency upper or lower age llm.1t will be estab­and
mainta.1n standarda, and procedures llshed which w1l1 in and ot Itself result
to MBU1"8 expeditious anclequitab1e ' .' ,
hand.1lnr ot referrals and appllcatiotll in a nnd.lng at inetlg1bUlty tor any
for vocational rehabUitatlon services. handicapped individual who otherwise
meets the basic ellg1bOlty requirement:!
§ 1361.31 OTder or .elcedon lor'servo
' specUled in paragraph (b) ot th.l.s
lees. • ' '. \ section.
(1\) The State plan shall set Carth the ,(2) The State plan shall provide trot
order to be Collowed in select.ing hand1- no residence requirement., durationeJ or
capped individuals to be provided voca- other, w1l1 be imposed which excludes
Uonal rehablUtation services when such from services under' the plan any indl­aerv1ces
cannot be provided to a11POrsons vidual who 1s present in the state.
who apply, and who hive been deter- (b) Basic condltlo1\..!. The State plan
mined to be el1g1ble or who have been ahnll provide that eligibility shall be
determined to be in need at an extended .based only upon : .
evaluatIon of rehabll1tatlon potential to (1) Tho presence ot a physical or
determJne ellgtbUlty. The State plan' ~~~ c:S~~~;:8·~;U~su;~ I~a ~~:
&haI1 detl.n.e priority categories ot hand!- stantial ha.ndicap to employment; and
capped Individuals tor the provision at (2) A reasonable expect.atlon thAt.
.. auch services. , . . ' .• vocational rehabilitation serYlces ma,y
,. • (b) Inestabl1sh1ng the order ot selee- benefit the individual In terms ot
1:.1on tor services, the State plan shaJl, employabUlty.
~ II; •..'
,~_~"~;r-.~r""---'-".""""''"';'~--:-:'_~:'''''_~'''''''''.-,,-~",<"-~~ ," .. ·..... _'_"._'r_ •__.• _
!f!DIW UGISTER,VOL40, NO. 22I-TUESDAY, NOVEMBER 25; 1975
,~.....~,._...._.-". ....~. ,--",_.•".'" .,<
RULES AND REGULAnONS 54707
(d) The state plan shall provide tbat . Vided that the eoDdltlona In ps.rairaph . a phyalcal·« mental dlaabilitJ whIch
In ul cases ot hearing lmpalrment.. an (a) 01 t.hJ.ssectlon are met. . constitutes a substanUAl hand1c&p to em­evaluation
ot the auditory system will be (2)· VocatJonal rehabllltation services, ployment, or becatUle It ho.s been deter­:.
ra obtained trom a physician skilled In the authot1zed alter the expiration o! the mined beyond any reesonablc doubt that
..... di.'leascs ot the eltr. and based upon such extended evaluation period will be pro- he cannot be expected to benet1t In terma
physician's findings. a hearing evalua- vlded only It the certLncatlon ot el1ilbU- ot emploYlI.bUlty trom voeatlonal rehnbll­tion
mny be provided by such a phy- Ity required in 11361.37 (a) haa been ez- Ita110n aerrloes. there shall be a - cer·­siclnn
or by an audiologist licensed or ecuted b1 an appropriate State alleocy ,tlftcation, dated and signed by 1\n appro·
certir.ed In lI.Ccordnnce with State laws or stall member. . prlateBtate aiency stan' member. The
reltulatloru. (d) Rev'ew. The State plan shall pro-; State plan shall turther provide that
leI The State plan shall provide that vldc tor a thorough a.s.ses.sment o( the In- ·such certl.t1cat1on or 1r.c!!g1bU1ty wUl In­ill
1111 cnses o( mental retardatIon, a psy- dlvldual's proirea., aa frequently aa nec- clude the specl.t\cat1ons ot reasons (or the
chologlcal evaluation wUl be obtained essary but at least once In every 90-day determination o( Ineligibility and will be '
whldl will inc ntel- period during the period 1n which sen- made only after tull consultation with
lit,:cllce - Ices are being' provided l::1der an ex· the individual or. u appropriate, hls
tion nd tended evaluaUon ot rehabllltation 1>0- parent, guardian. or other representne
vemel entia!, Includlni periodic reports from tive. or alter a1'l'ordlng a clear opportu-
.It> ,Th ' te plan aha1l provide ·.tha e institution, (ac1lJty, or person pro- nlty tor such consultation. In such ca.~es,
the thor. 11 dlagnosUcatud1,w1ll:U:l~ g the serVices. to determine the re- the State agency shall nollfy the In-
: clude.1n,all~io the degree ri~ee;1 ( the provision o( such services and dlvldual In writing ot the action taken
t.dn appralsaJ ol the1ndlviclual'.peraon;.l 0 d rmlne whethet" such Ind1v1dual and shall Inform the indlv1dual o( hls
'allty{:;·1nte1l1gence;level.oi~educatIonal may" determined to be el1ilble or rights and the means by which he may
'llCh1evementa.worlt experlence,peraonaIl Inellgl expresa and seek remedy tor nny dlaAatls.
',vocatioha1.:i&odllOC1aU'clJustment,,:ern~ (e) 7f tMtt<m. The state plan shAll factions, inclUding the State agency's
'ployment opportunities. andotherpert1.;;; provide~: at at any time p110r to the procedures tor a.dmlnlstratlve revtew and
nent'data;'helptul 'In. determ1nJng· th. explrat·' otan IS-month extended (air hes.rtngs under I 1361.46. When ap-'
nature and scopeot llemeea needed. Th¢ evalull ...",. period. the extended evalua- P1'01'1111.te. the Individual shall be pro-
State plan shall further provide that ~, tlon ( e detcrmlnatJon ot rehabUlta- vlded a detaUed ,.explana tlon or the
,thorough d1agnOstIc !ltudy will Include;~ tion tlal shall be terminated when: avaUabUltyoC the rellOurces withIn l\
tapproprlate tor each lndlv1dual.&n' apf (1 e indlV1dual fa round ellglblo client usl.qtance project establl8hed un.
pralsal'.ot. the'Jncl1vldwU" patterna.o! (or tlonal rehabllltatlon, services der Part 1362 o( thl8 chapter and referral
work.' behaVtor.~~h1I'abWty .to 'acquire s " ere la a reaaonable assurance shall be made to other agencIes and
OccupAt1oria1: lk1U.and hIa capa.ctty!or Qf' e can be expected to benet!.t In fae1lltles. The State plan shall further
sueccsstul".Job.,perfonnance,lnclud1ng:" ot emploY1\.bUlty trom vocational proVide tha.t when an applicant tor
the utU1%.&tion ot work,llmulated or ' abll1tat1an serVices; or vocational rehabUltatlon servlcCll has
to. assess the Ind1vtdual'.capabWUes ;'. (2), The Individual is found IneUgible been determIned on the basis o( the
Pettorm ade<lU&tel11na,.worlt for any addltlonal vocational rebablllta- prellmmary diagnostic study to be In-ent.,:
J'i·;,_;;..;.;.;:::t;~:,,,,,,,,.,..,"· tion services sinee It has been determined· ellll1ble tor lUeh services because of a
'd beyond any re&SOnable, doubt. that he 11ndlng that he cannot be expected
~a § f entl..:~ e- cannot be exPeCted to bene1'U In terms ot beyond any reasonable doubt to achIeve
.,.., employabUlty trom voca:t1onal rehabtll- . a vooatlonal goal. such determination oC
~ (a) Dasic COnditlOlU. The sta~ plan taUon services. In each such ·case. the. tnellg1blllty will be revIewed not later
shall provide that the furnl.Shlng ot voca- procedUres dC$c:r1bedm1 1341.39(e) &han than 12 months after ·sueh determlna-tlono.
l rehabilitation services under an be tollowed. tIon hu been made. Sueh review need
extended evaluation to detenn1ne reha- § 1361.37 CertHiut10nl eligibility;. ex- not be conducted In sItuatl0 ns.-.he",e .w..,e
bWtatJon potential shaUbe based onl1 . tended evaluation to determine I"~ indIvIdual hu reCused such review. the
upon: habilitat10n potential; Indiglhility. '. IndiVidual Is no longer present in the
(1) The presence of a. physcal or men- . State. his whereabouts are unknown. or
tal disability which tor the indl- (a) Cert(fl.catfon 0/ ellgibtl£tJf. The· hl3 medical condItion I.s rapidly progres-vidual
constitutes or· results 1n a sub- State plan shall pt'oYlde th8.t. prlor to. or slve or terminal.
stantlal handicap to employment; and slmultaneously with· acceptance ot a' .
(2) An Inability to make a determlna- handicapped indlvtdual' tor vocational § 1361.38 The ca'e record {or the in,li.
t10n that vocational rehabll1tatlon serv- rehabUltation servleea. there will be a vidual.
lecs might benent the IncUvldualln terms certU1catlon that the tncUvtdual has met The State plan shl\ll provide tllat the
ot employability unless there Is an ex- the basic eligibility requirements specl- State agency wili maintain for ea¢h ap­tended
evaluation to detennine rehab\}1- ned In § 1361.33 (b). The State plan shall pllcant tor voCational rehabllltation
tatlon potential. . further proVide that the certltled state- services a case record which wlll Include,
(b) DuraWm and scope 01 serviccs. Vo- ment ot ellglbfllty will be dated and to the extent pertinent, the following
catlo1111l rehabllltation services neces- signed by an approprIate State agency in(ormatlon:
Gary tor the detennlnatlon ot rehabillta- stat! member. . . (a). Documentation as to the prellml­tlon
potential, including tllose provided (b) Certtl1catfon lor extended evalua- nary dlag1lostlc study arid, l\,g appro­within
a thorough diagnostic study. may tloll to detcrmInc rehabllttatton J)Oten- Prllltc, the thorough diagnostic study,
be provided to n handicapped Individual . tial. The State plan shall provide that, supportlng the derennlnlltlon of ellglbll­[
or n total period not In excess or 13 prior to. and as a· bo.sls (or providing. Ity. or the detennlnatlon that .. an
months. an extended evaluation to determine extended eva.1\latlon o( rehnb1l1tatJon
(cl Other COllditlons. (D 'l1,e ex- rehllbHltatlon porentlnl, there wJl1 b~ a potential Is necessary to makc such de­tended
evnluatJ()n period shall begin with certification that the lnd!vldua1 hM met· termination, and the nature and scope or
the date ot the certification (or extended therequlremel,t3spc<:l.11edin § 1361.36(11.). vocational rehabUltation servlccs to be
cvaluatlon to detennlne rehnb111tntlon The State, plan shall further provide provided;
potrotlnl required In § 1361.37(b). Only that the certltled statement will be dated . (b) In the case of Individuals who have
one period not In excess ot 13 months and signed by an approprIate State. applled (or vocatIonal rehabllltatlon
.~h:111 be prrmJtted during the period thnt agency stat! member. services and have been determJ':1ed to be
the case Is open. It a case has been closed (c) Certtftcatton OJ 11l.eltl11b1lttll: The' Ineligible. documentation as to the pre­as
a result o( a determination that the state plan shall proVide that whenever l1mlnary diagnostic studY spec1!ylng the
•
' ndleapped indIvidUal's needs have It has been determined beyond any . . .
angcd, such ca.~e mny be re-opened reMonable doubt that an Indlvldunl ls reasons. for such determination. and
'. ,lfld a sUbsequent evaluation ot rehnb1l1- Inellglble tor vocational rehabUltatlon documentation o( a review o( the In-
., tatton potrntlal may be carried out pro- scrvIces, either because he does not have ellgiblllt-Y determtnatJon carried out not
\~~1- 1/1'\~'1)
)I:\('('r for matters .tin~ Lo \'ocaliohd
dlabili ta lion. 1'h(- Sta [{. director may
l{, designated the Executh'c Officer for
nalters rein ling to \'ocational rehabili­,
alion.
: 101.7 .\I,·,li,·.. I'·IIII,,,II,,I;"II.
The Sta Le plan shall provide for and
lescribe the arrangements made to se­;
ure adequate medical consultation and
.0 assure the availability of medical con­;
ultative services of high Qua.lity on all
nedical aspects of the vocational re­labilitation
program, as needed in all
State, district, or local otfices of the
1gency.
~ "to 1.8· Staff dHelopmenl.
The State plan shall provide for a pro­gram
of stafI development for vocational
rehabilitation personnel. This program
shall pro\1de for the In-service training
of personnel for the purpose of providing
a high Quality of vocational rehabilita­tion
services to handicapped persons. If
the stafI development program includes
leaves of absence for institutional or
other organized training for professional
personnel, the State plan shall specify
the policies governing such educational
leave.
§ 401.9 Politicalacti-·ilY.
The State plan shall contain provisions
prohibiting employees engaged in the
:lay-to-day administration and opera­~
ion of the program from engaging in po­litical
activity. Such an employee shall,
of course, have the right to express his
views as a citizen and to cast his vote.
§ 401.10 Fiscal administration.
The State plan shall set forth the poll­cies
and methods pertinent to the fiscal
administration and control of the vo­cational
rehabUltation program, includ­Ing
sources of funds, Incurrence and pay­ment
of obUgations, disbursements. ac­counting,
and auditing. The State plan
shall provide for the maintenance by the
State agency (or, where appllcable, by
the local rehabUltation agency) of such
accounts and supporting documents as
will serve to permit an accurate and ex~
pedltious determination to be made at
any time of the status of the Federal
grants, InclUding the disposition otall
moneys received and the nature and
amount ot all charges claimed to 11e
against the respective Federal authoriza­tion.
§ 40 1.11 Cl1"tod~' of fUllds.
The State plan shall designate the
State otlicial who will receive and pro­vide
for the custody of all tunds paid to
i "'-' ,""',,,",- "vi
the State undpr the act, subject t(J ll-qui­sillon
or dislmrsement by thE: State
agency.
5 lOLl:! H",H>rb.
The State plan shall provide thatl;'"'
State agency will make such report.
such form and containing such infor /
tion as the Commissioner may reasonably
require. and will comply with such pro­VISIOns
as he may find necessary to as­sure
the correctness and verification of
such reports. This provision applies to
reports in all areas of program operation
and administration and to various meth­ods
of reporting. including written and
oral reports. and inspection and review of
fiscal, statistical. casework, and other
records and operations.
§ ·101.13 Coo per a I i 0 II ,,"'ilh olher
agencit·s.
(a) The State plan shall provide
that the State a(l'ency will establish and
maintain cooperative working relation~
ships with the State workmen's compen~
sation agency. the Bureau of Employees'
Compensation of the Department of La­bor,
the State agency administering the
State's public assistance program. the
Social Security Administration of the
Department of Health, Education. and
Welfare, and the system of public em­ployment
offices In the State. The basis
for the cooperative working arrangement
with the system of public employment
otfices shall be a written agreement
which shall provide, among other things,
for reciprocal referral services, exchange
of reports of service. joint service pro­grams,
continuous Uaisoo, and max.!­mum.
utilization of the job place~i'
and employment counseUng servlces~
other services and facilities of the pub­Uc
emplo~'lJ1ent offices.
(b) The State plan shall further pro~
vide that the State i\gency wUl establish
and maintain working relationships with
other pubUc and private agencies. such
as tuberculosis sanatoria, crippled
chUdreo's agencies, Veterans' Adminis­tration
faciUtles, hospitals, health de­partments.
and voluntary social and
health agencies turnlshing services re­lating
to vocational rehabilitation, so as
to i\ssure maximum utll1zatlon on a co­ordinated
basis ot the services which all
agencies In the State have to otIer for
the vocational rehabllltation ot handi­capped
persons.
(c) \Vhere there Is a separate State
agency for the blind. the State plan shall
also provide that the two State agencies
will establish reciprocal referral services.
utilize each other's services and facilities
e
to the extent practicable and feasible.
jomtly pian actiVities which will improve
sen-ices to handicapped individuals in
the Sta teo and otherwise eoopemte in the
~erest of providing more effective
'" ~'lces,
STAn: PL~.:' CONTENT: CASEWORK PRACTICE
§ ·10 L11 E1iJ:iJ.ilil~".
la) General provisions, III The Stat
plan shalJ describe the policies an
methods which the Sta te agency will fo
low In determining eligibility for voc:
tional rehablllta tion services In ea~
case. '
(2) The State plan shall provide th
eligibility requirements for vocation
rehabilitation will be applied by the Sta
agency or local rehabilitation agency',
without, regard to sex, race, creed, color. ~
or national origin of the individual.
(b) Basic conditions. The State plan
shall provide that eligibility for voca­tional
rehabilitation services shall be
based upon: (1) The presence of a physi­calor
mental disability and the resulting
functional limitations or limitations In
activities; (2) the existence of a substan­tial
handicap to employment caused by
the limitations resulting trom such dls­abil1ty;
and (3) a reasonable expectation
that vocational rehabUitatlon services
may render the Individual fit to engage
in a remunerative occupation.
(c) Certification 0/ eligibilitll. (1)
The State plan shall provide that, prior
to or simultaneously with acceptance ot
the handicapped individual for vocation­al
rehabilitation services. there will be a
[
UiCatiOn that the individual has met
"basic eligibility requirements. The
. :te plan shall further provide that the
certified statement of eligibility will be
dated and signed by ar, appropriate
agency stafI member to whom such re­sponsibility
has been assigned.
(2) The State plan shall provide that
a similar statement will be executed for
each case determined to be Ineligible for
vocational rehabilitation services.
§ 401.15 Case study and diagnosis.
(a) The State plan shall provide that.
prior to and as a basis for formulating
the individual's plan of vocational reha­bilitation.
there will be a thorough diag­nostic
study, Which will consist of a
comprehensive evaluation of pertinent
medical. social. psychological, and voca­tional
factors in the case. The State
plan shall provide that In each case the
diagnostic study shall be adequate to
provide the basis for (1) establishing
that a physical or mental condition is
e mdl\'idual can puform; '2. appraising
the current general health status of the
i:~dl\'idual 111 order to determine his Iimi­tatlons
and capacities; '3' determil1lng
hu\\' and the disabling
cund' s may be e to be re-
11' ed. corrected. or mini . physi-
I restoration services; and i tQ cting
n employment objective comn' ate
with the individual's capacili d
limitations.
'bl The State plan shall provide
the diagnostic study will inclUde. in
cases to the degree needed. an evaluatl
ot the individual's personallty. ~.l
gence level. educational achleveI1!~1
work experience, vocational aptl
and interests. personal and social a
ment, employment opportunities,
other pertinent data helpful In dete
'ng the nature and scope of services
ovided for accomplishing the ind
's vocational rehabilitation obJ
) The State plan shall turthe
hat the medical diagnostic
clude (1) a complete
medica amlnation,