Journal of Extension

April 2003
Volume 41 Number 2

joe home
contents
search
archive
subscribe
info

Features


Transformative Learning in Extension Staff Partnerships: Facilitating Personal, Joint, and Organizational Change

Nancy K. Franz
Associate Director
University of New Hampshire Cooperative Extension
Internet Address: nancy.franz@unh.edu

Partnerships can enhance individual and organizational success through more effective problem solving and improved adaptation to change. Working in partnership is difficult and often requires learning for successful collaboration. This learning sometimes transforms or changes the partners in a collaboration. This change may stem from transformative learning--a type of learning resulting in a different frame of reference rather than technical, skill-based, or practical learning (Kreber & Cranton, 2000). Therefore, it is important to understand how successful Extension staff partnerships use learning in ways that transform the individual, the partnership, and organizations.

Researchers and practitioners increasingly express interest in understanding the role of partnerships in adapting to or embracing change (Bennis & Biederman, 1997). It has been shown that people working together often deal with change more successfully than when they work alone. By taking on tasks and learning together, individuals gain more integrated and balanced views of themselves and their work (Anderson, 1992).

What is the role of transformative learning in successful Extension staff partnerships between campus academics and county practitioners? The answers to this question are important because Extension leaders need to know how partnerships can facilitate adaptation to internal and external forces. This includes how to align individual transformation with larger organizational change. Without this information, change is slow, thwarted, or never fully realized. The study discussed here explored change in individuals by observing and analyzing successful partnerships between Cornell Cooperative Extension (CCE) campus faculty and county Extension educators to determine the role of transformative learning in these cross-profession partnerships.

Review of the Literature

Although a great deal of literature focuses on successful partnerships, few researchers have studied cross-profession partnerships, intraorganization partnerships, or learning in partnerships. Cross-profession partnerships made up of researchers and practitioners strengthen research (Amabile, Patterson, Mueller, & Wojcik, 2001) but require the breaking down of ideological and political boundaries between professions (Tourse & Mooney, 1999). Rosabeth Moss Kanter (1994) claims that successful partnerships are learning oriented and result in partners who are open to new ideas and see across boundaries (Hesselbein, Goldsmith, & Beckhard, 1996).

One field of research in education focuses on transformative learning theory. Jack Mezirow (1991), the founding father of this theory, suggests individual transformation includes a change in a frame of reference or way of seeing the world. Mezirow and others in the field less often explore this theory in groups or organizations and rarely look at its presence in a partnership context. For transformative learning to take place in educational settings, the educator needs to provide a safe environment for the learner to nurture critical reflection (Mezirow, 2000). With these thoughts in mind, this article explores the role of transformative learning in successful Extension partnerships between campus researchers and county practitioners.

Methodology

The study was exploratory in nature; therefore, a constructivist approach including grounded theory (to build theory from emerging patterns and themes) and case studies (to deeply explore the phenomenon of transformative learning) informed the research. The study included 10 successful Extension staff partnerships made up of one campus researcher and one county educator. Campus and county Extension administrators and peers nominated successful partnerships for the study through e-mail and face-to-face inquiries from the researcher.

An advisory committee of campus and county Extension staff selected the final slate of partnerships for the research. This group through consensus identified a series of preferred characteristics for the partnerships to be studied and then selected nominees who fit the characteristics (e.g., program area, geographic location, gender). This advisory committee also helped shape the study and provided feedback on the research findings.

Each partner in the study participated in a semi-structured interview about their history with Extension, the work of their partnership, and learning and success in their partnership. The interviews were transcribed and coded for common themes. Partner profiles were also created from the interviews with each partner. The profiles describe the individual's views of success and learning within their partnership. In addition, partners interacted multiple times with the researcher while editing and preparing their profiles for public use and in reacting to the findings from the study.

Additional data on successful CCE campus-county staff partnerships was collected through document review, observations of partners at work, feedback about the partnerships from the partners and their peers, and feedback on the findings from the partners and other Extension staff. These data were analyzed using Eisenhardt's (1989) comparative case study method. This method analyzes emerging patterns and themes within each case and then across each case to build theory. Adhering to this process revealed variation and commonalties of success and learning across the partnerships.

Results

Successful Partnerships

All 10 partnerships studied had reputations for being successful. Several common factors contributing to that success surfaced across cases. First, the partners made a commitment to a bigger picture or fit with the environment outside the partnership. This commitment was illustrated by:

  • Strong communication,
  • Promotion of partnership outcomes,
  • Stakeholder involvement, and
  • Integration of the partnership work into the overall organization.

Second, the partners identified specific drivers of learning. These included:

  • Mutual respect among partners;
  • Stretching, challenging, or pushing each other's thinking and capacities;
  • Trust;
  • A supportive environment, and
  • Successful outcomes that supported learning in the partnership.

Third, partners indicated that challenges in partnership work existed but that they found that education of themselves and others, as well as persistence, helped overcome these barriers. Challenges did not prevent these partnerships from working towards their goals.

Finally, personal attributes of the partners promoted success in the partnership. Partners often had similar motivations for entering into and staying in a partnership. One commonly valued attribute of partners included providing personal support that resulted in raised or affirmed self-esteem. Partners indicated this support was a key to the success of personal and partnership success.

Learning and Transformation in Partnerships

Three types of learning surfaced in successful campus-county Extension staff partnerships: instrumental, communicative, and transformative learning (Mezirow, 1991). Instrumental learning focuses on improving performance through task-oriented problem solving and leads to learning how to control people and the environment. This type of learning includes empirical testing in search of the truth. In the study, all of the partnerships experienced instrumental learning, e.g., learning how to improve group facilitation skills and how to navigate campus and local environments, and increasing knowledge about the theory and practice of Extension work.

Communicative learning emphasizes learning for interpersonal understanding. A key part of this learning includes reflective discourse with others about the meanings that people communicate. In the research, communicative learning had a strong presence in all but one partnership. Partners learned how to work effectively with each other across differing work, communication, and learning styles; personalities; and worldviews. By better understanding each other's professions, they learned how to give more appropriate feedback and advice. Partners mentioned that over time they came to see the partnership from the other person's perspective.

Transformative learning results in a major change in thinking or perspective where individuals become more responsible for their actions and more autonomous, and use clearer thinking when making decisions. In the study, transformative learning existed in 6 of the 10 partnerships and included 9 of the 12 partners. The research revealed eight types of transformative learning based on the partner's awareness of their transformation, whether or not the transformed partners took personal action based on their change, and to what degree the partners attempted to initiate change in others related to their own transformation.

Partners who were transformed from their partnership experience indicated:

  1. Gaining a more holistic view of their work,
  2. The ability to better understand processes around them,
  3. Personal development, and
  4. Alleviation of professional isolation.

Transformed partnerships experienced:

  1. A deepened commitment to their goals,
  2. Enhanced action,
  3. Enhanced learning, and
  4. Increased use of shared leadership styles.

These partnerships indicated that the organization transformed because they provided models for others in the organization to emulate, their success created additional success, and organizational learning was heightened.

Conditions for Transformative Learning in Partnerships

Transformative learning is considered important for more integrated and inclusive thinking and decision making in individuals. This study found five common conditions that promote this type of learning in Extension staff campus-county partnerships.

The first included strong partner facilitation. Partners in partnerships where transformative learning took place were strong facilitators of reflective discourse. They also used a variety of methods to facilitate learning.

The second condition, critical reflection in transforming partnerships, included the practice of thinking critically about individual, work, or process assumptions. Partners articulated the original assumptions they used in their work and the new assumptions they constructed from the change process that occurred. The new assumptions they arrived at through critical reflection often resulted in broader views of their work.

The third condition for transformative learning in partnerships included the presence of critical events that set the foundation for change or enhanced transformation. The events sometimes served as disorienting dilemmas resulting in partner reflection about the associated discomfort.

The fourth condition focused on a fundamental difference between partners bridged by a common purpose. In transforming partnerships, partners differed in personality, work styles, and/or worldviews.

Finally, transformative learning was enhanced by a condition some partners called "independence with interdependence." This included the process of retaining personal autonomy yet depending on the other partner to enhance the success of the work at hand. Through this process, campus and county Extension staff sought out each other to alleviate professional isolation and to better meet the needs of local residents. Partners indicated that the partnership mission and their leadership roles in statewide Extension program work teams guided interdependence.

Conclusions

Several main themes arise from the study discussed here. The first includes the significance of a fundamental difference between partners that promotes transformative learning. This suggests that diversity management encompasses more than creating a physically diverse workforce. Diversity efforts must bring together people with diverse perspectives to enhance each other's learning under a common purpose that bridges this difference.

According to the results of this study, transformed individuals can contribute to more quickly adapting to environmental change. Personal change may happen without organizational change and vice versa, but joint transformation can result in individuals and organizations more quickly adapting to environmental change. A fragmented approach to change may impede or slow the transformation process. Individual and organizational change strategically aligned can produce a hastened response to change.

Leadership in partnerships greatly affects the transformative learning process. Joint leadership that facilitates reflective discourse around personal and shared assumptions promotes transformative learning. A deep developmental view of facilitation rather than a simple process approach results in deep change in one or both partners.

Transformative learning has many faces. Frequently, people don't realize or acknowledge how they have changed through their work together. Some of them, in this unknowing stance affect change in others. Other people who are aware of their own transformation consciously choose to change themselves and/or work towards change in others and/or the organization. It cannot be assumed that the transformation process occurs in the same way for everyone and every partnership.

Recommendations for the Cooperative Extension System

If the Cooperative Extension System truly promotes organizational learning and serves as a catalyst for individual and community change through education, it must also change to better encourage and sustain transformative learning in its staff. This requires:

  • Fostering partnerships,
  • Dealing with barriers to effective partnerships,
  • Promoting critical reflection to encourage transformative learning,
  • Helping staff gain strong facilitation skills, and
  • Promoting diversity.

State and county Extension administrators need to create and support environments that facilitate cross-profession relationship building and partnership formation. This includes opportunities for staff to meet each other, engage in discourse, to solve problems together, and share their work with others. One specific approach includes an accessible database of staff interests so people with similar interests can quickly locate each other. A statewide Extension e-newsletter could also support the location of potential partners and the sharing of partnership work and processes.

Models of successful staff partnerships should be identified and lauded across the organization. This could be enhanced by creating an innovative grant program or orchestrating organizational events that foster, explore, and recognize campus-county staff partnerships. Administrators should also attempt to align organizational transformation that parallels and/or enhances transformative learning in partnerships. Finally, leaders need to communicate the value of cross-profession partnerships in legitimizing county staff as full partners with campus faculty in Extension research and programming. These strategies would promote partnership formation and sustainability but not force staff interaction.

To help partnerships flourish, barriers preventing partnership success should be dealt with. Specifically, barriers related to university departments and county Extension units, such as the reward system for staff, should be reviewed. Incentives should recognize partnership work that creates change rather than furthers the status quo.

Administrators and staff supervisors on campus and in counties must also articulate the local and system-wide value of partnerships. In addition, professional associations can provide resources, support, and recognition to help partnerships overcome institutional barriers and support innovations that go beyond the usual institutional expectations. Organizational systems need to be "partnership friendly." This includes creating more convenient mechanisms for transferring resources between Extension partners and their units.

Staff may also find it difficult to form partnerships with each other due to multiple program responsibilities and generic titles that do not accurately reflect their work. Administrators should therefore combat this fragmentation of staff duties and implement consistent, descriptive job titles. 

Extension must find a way to promote critical reflection as a medium for promoting transformative learning in staff. In the active world of Extension work, this remains a challenge. Administrators, supervisors, and influential staff must model deep reflection about their assumptions on an ongoing basis through their work. This comes from generating thought-provoking questions, raising and testing propositions, showing curiosity, and being conscious about the ethics of their work (Brookfield, 2000).

Professional development opportunities, staff meetings, committee meetings, work teams, and other staff gatherings should consistently include critical thinking and reflection activities such as action learning, scenario building, and the use of metaphors (Deshler & Kiely, 1995). Technology should also be used to help staff record their reflections and to promote critical dialogue with others throughout the organization.

Supporting transformative learning in Extension staff requires that they become competent facilitators of learning for each other. The presence of a strong facilitator often helps Extension staff survive the stress of transformation. Therefore, staff should be hired who exhibit successful educational facilitation skills or have the potential to do so.

Regional and campus-based workshops should also focus on developing facilitation for learning in staff. To ensure that facilitators do in fact support a transformative learning environment, training, practice, and support for leading reflective discourse is critical. A mentoring system could also match experienced facilitators with those new to the process to share facilitation skills that help guide others on their learning path, such as creating a learning environment, asking probing questions, making connections, and synthesizing information.

Developmental facilitators must also be learner more than content centered, create transforming learning environments, use a variety of facilitation methods, be flexible, and able to critically reflect on their own learning. A professional development certificate program based on acquiring these skills could enhance strong facilitation of learning in Extension staff. 

Finally, diversity should be promoted more broadly within Cooperative Extension. Traditionally, diversity efforts have honored physical differences in employees. To encourage transformative learning in staff, diversity management should expand to consciously ensure that staff work together with others who have differing personalities, work styles, and worldviews. The organization also needs to create, support, and recognize safe environments that promote change and value diversity to help transforming partnerships flourish. This includes fostering dialogue that defines diversity, listening for and recognizing wisdom in each other, connecting with individuals as a whole person not just their interests and skills, and seeing difference as critical to reaching a common purpose and addressing complex problems.

References

Amabile, T., Patterson, C., Mueller, J., & Wojcik, T. (2001). Academic-practitioner collaboration in management research : A case of cross-profession collaboration. Academy of Management Journal, 44(2), 418-431.

Anderson, T. (1992). Transforming leadership: new skills for an extraordinary future. Amherst, MA: Human Resource Development Press, Inc.

Bennis, W. & Biederman, P. W. (1997). Organizing genius: The secrets of creative collaboration. New York: Addison-Westley.

Brookfield, S. (2000). The concept of critically reflective practice. In A.L. Wilson & H. R. Hayes (Eds.), Handbook of adult and continuing education. San Francisco: Jossey-Bass.

Deshler, D., & Kiely, E. (1995). Facilitating adult learning: Sourcebook and leaders guide. Ithaca: Cornell University.

Eisenhardt, K. (1989). Building theories from case study research. Academy of Management Review, 14(4), 532-550.

Hesselbein, F., Goldsmith, M., & Beckhard, R. (1996). The leader of the future: New visions, strategies, and practices for the next era. San Francisco: Jossey-Bass.

Kanter, R. M. (1994). Collaborative advantage: The art of alliances. Harvard Business Review, 72(4), 96-108.

Kreber, C., & Cranton, P. (2000). Exploring the scholarship of teaching. The Journal of Higher Education, 71(4), 476-495.

Mezirow, J. (1991). Transformational dimensions of learning. San Francisco: Jossey-Bass.

Mezirow, J. (Ed.). (2000). Learning as transformation: critical perspectives on a theory in progress. San Francisco-Jossey Bass.

Tourse, R., & Mooney, J. (Eds.). (1999). Collaborative practice: School and human service partnerships. London: Praeger.

 


Multi-Tiered, Multi-Disciplinary Work Teams--The CSU CAFO Work Group Tackles Controversial Public Issues

Andrew Seidl
Public Policy Specialist and Assistant Professor
Department of Agricultural and Resource Economics
Colorado State University
Ft. Collins, Colorado
Internet Address: Andrew.Seidl@colostate.edu

Introduction

Livestock operations have a long tradition in rural Colorado's agricultural economy. Beef and dairy cattle, sheep, and the crops to feed them are an essential part of the Colorado landscape. Recent poor corn, wheat, and beef prices have created a tense atmosphere in many rural Colorado towns. The number of agricultural operations is in decline statewide. However, overall livestock inventories are stable or increasing. Colorado livestock operations (and agricultural operations in general) are getting larger, more specialized, and more integrated, and small, diversified farms are becoming increasingly scarce.

Growth in the Colorado livestock industry can be attributed to a close to 100%-increase in hog numbers since 1993 to about 800,000 (United States Department of Agriculture, 1999). This growth is almost exclusively spread among 17 large integrated and, largely, corporately owned farrowing and nursery operations. Rural Colorado communities are struggling to understand and evaluate the social, natural resource, environmental, and economic challenges and opportunities that hog operations create as a potential engine of community economic development.

Colorado is also among the fastest growing states in the country (U.S. Department of Commerce, 2002). Agricultural land is being converted to residential development at a rapid rate (Obermann, Carlson, & Batchelder, 2000). Rural demographics are changing as retiring urbanites and telecommuters choose to homestead in traditionally agriculturally driven communities (McGranahan, 1999). Three-fourths of Coloradoans now live in urban or suburban communities in the North-South corridor within about 30 miles of the Rocky Mountains (U.S. Department of Commerce, 2002). New urbanites are attracted to Colorado for its abundant outdoor recreational opportunities and natural amenities among other things (McGranahan, 1999).

It can be expected that state legislative action will increasingly represent and respond to this progressively more urban majority, which may or may not coincide with traditional Colorado priorities and values. Increasingly, rural residents feel left out of state-level politics and recognize that the "I-25 Corridor" is where state-level policy is made (Carlson, personal communication, 1999).

Justification

In the spring of 1998, several rural counties contacted Colorado State University Cooperative Extension (CSUCE) requesting information and assistance in strategic planning and in evaluating economic development alternatives through livestock operations, particularly dairy and hogs. At the same time, Colorado Counties Incorporated (CCI), a nongovernmental organization comprised of 61 of the 63 Colorado county commissions, requested CSUCE's assistance in evaluating the policy environment, community economics, natural resources, and odor issues surrounding livestock operations, hog operations particularly.

By early summer, two state level ballot initiatives (Amendments 13 and 14) and their advertising campaigns aiming to regulate livestock operations, but particularly hog farms, were initiated, and the popular press began running "pro" and "con" corporate hog operation columns, articles and op-ed pieces. A detailed comparison of the Colorado livestock policy environment with the provisions of Amendments 13 and 14 is provided in Seidl and Grannis, 1998.

Dozens of requests were made of Extension agents and specialists for the "facts" from many different perspectives on the issue. Responding to these immediate concerns, in anticipation of greater public demands for information, and the opportunity to be "proactive" on an important public policy issue drove the CSU Confined Animal Feeding Operation (CAFO) Work Group to form. A "teachable moment" on a public issue of statewide importance was at hand.

The CSU CAFO Work Group

At the urging of a small number of state and regional specialists and county agents, the administration of CSUCE decided to form a multi-disciplinary and multi-level working group to address the present and upcoming debate over large confined animal feeding operations, particularly hogs. The work group structure included campus-based Extension personnel, regional specialists, and at least one county agent from each of Colorado's five Extension regions (names, titles and affiliations acknowledged below). Individuals were invited to join the work group based upon professional interest, responsibility, and expertise.

The group created a listserve in order to keep one another apprised of breaking issues in the state and around the nation, to share questions and responses to queries, and to attend to requests for presentations, interviews and written information. Limited and unspecified regular operating funds leveraged with a $13,000 contract from CCI and a $4,500 contract from a county economic development authority were allocated toward these activities.

Objectives

As a result of the CAFO Work Group's formation, a public policy education Web site was created, and a mission statement was drafted and posted there. "Cooperative Extension's role in public policy education is to: 1) raise the important questions that should be addressed; 2) provide the best possible information based on current science; and 3) facilitate discussions so that policy makers and citizens can make wise decisions. Cooperative Extension does not advocate for a particular strategy or point of view, but rather assists the public in understanding the implications of potential courses of action."

The CAFO Work Group took these as its guiding principles in providing current, objective, and salient information to both rural and urban voters regarding the multiple aspects of CAFOs in a variety of educational formats.

Programmatic Response

  1. In August 1998, a 2-day training session was held for CAFO Work Group members and the leaders of the major interest groups in the state (e.g., Farmers Union, Colorado Counties Inc [CCI], Farm Bureau, Colorado Water Quality Control Commission [WQCC], NRCS). Some trainers were internal (e.g., Seidl [Policy and Community Economic Impacts], Waskom and Davis [Water Quality Issues and Manure Management Best Management Practices]). In addition, recognized experts from around the nation (Iowa State University, University of Missouri, and North Carolina State University) were invited to "train-the-trainers." Attendees were provided a notebook of materials entitled "CAFO Info" that briefly covered the broad issues to be addressed.

  2. A brochure detailing the two ballot initiatives was generated from within the group. Of the 10,000 produced, 8,500 were distributed at public meetings, in press packets, and through individual requests. The brochure and other documents were posted to the public policy education home page. This home page will remain as repository for Public Issues Education (PIE) & Public Policy Education (PPE) materials.

  3. Fact sheets were created covering economic issues, policy issues, community development issues, and effluent management issues <http://dare.agsci.colostate.edu/extension/pubs.html>, APR98-01 to 05 and APR99-01 to 04).

  4. An edition of the CSUCE Agronomy Newsletter, From the Ground Up, was dedicated to the ballot initiatives <http://www.colostate.edu/Depts/SoilCrop/extension/ Newsletters/news.html/1998/1998/sept98gu.pdf>.

  5. Stories using Work Group information or interviews ran in the Colorado Tribune (Pueblo), the High Plains Journal (Kansas), the Pagosa Springs Sun, the Julesburg Advocate, the Greeley Tribune, the Pueblo Chieftain, the Yuma Pioneer, the Ft. Collins Coloradoan, and Pork98 printed media. Television interviews were conducted for the Salida, Ft. Collins, and Grand Junction television stations.

  6. In addition to a number of classroom presentations and fielding hundreds of phone calls and drop-ins, more than 1,000 participants attended public presentations by Work Group members on Colorado CAFOs and the Ballot Initiatives.

  7. Work Group members collaborated with CCI to produce a 32-page document and executive summary for county commissioners covering odor technology, model local ordinances, community costs and benefits, and national policy trends (Seidl & Davis, 1999).

  8. Several members (Davis, McPhail-Gray, Seidl, Walker, and Waskom) were involved with the rule-making process after Amendment 14 was passed. (Amendment 13 was defeated). Their activities included serving as an expert witness panel on behalf of the Colorado Water Quality Control Commission (WQCC). In the hearings, CSU personnel were recognized by both sides as fair and objective providers of the scientific information needed to craft necessary and sufficient legislation.

  9. Several members (Davis, Waskom, Seidl, and Tranel) continue involvement in regional and national CAFO policy efforts. This allows the CSUCE CAFO Work Group to keep abreast of regional and national initiatives and for Work Group members to relate policy issues in Colorado to regional and national experts.

Evaluation

An evaluation was conducted of the CSUCE CAFO Work Group in July 1999, approximately 1 year after its formation. The return rate for the e-mail administered evaluation was 60% (12/20). Respondents were evenly distributed between on and off campus personnel and were considered "core" Work Group members.

Respondents provided their opinions on aspects of the structure, activities, content, and impact of the Work Group. Group members were asked to rank their relative agreement with statements about these aspects of the Work Group on a seven-point Likert scale (1=strongly disagree; 7=strongly agree). A summary of the responses of campus and off-campus personnel is found in Table 1.

Overall responses were supportive of the structure, content, and activities of the group. No overall mean responses were neutral or negative. The impact of the Work Group was considered fair to good, meeting some expectations but requiring improvement in areas. All respondents who gave an opinion thought that the Work Group was a useful model for public policy and public issues education, although many indicated there were weak points to the Work Group as a model. Both positive and critical comments are highlighted below.

Table 1.
Responses to CSU CAFO Work Group Evaluation, by Location

Question

Off-Campus
n=6

Campus
n=6

Overall
n=12

The Structure of the group was

effective

5.33

4.33

4.83

efficient

5.50

4.17

4.83

fair

6.00

5.33

5.64

inclusive

5.17

5.50

5.33

The Activities of the group were

appropriate

5.67

5.17

5.42

effective

5.83

3.83

4.83

efficient

5.67

4.33

5.00

inclusive

5.00

5.17

5.08

The Content of the materials was

objective

6.17

5.33

5.75

comprehensive

6.17

5.00

5.58

the best science available

6.17

5.17

5.67

effectively communicated

5.67

3.83

4.75

The Impact of the group was (4=Outstanding, 3=Good, 2=Fair, 1=Poor)

2.83

2.17

2.50

The group is a good PIE model (1=yes, 0=no)

1.00

1.00

1.00

Note: Except for the last two rows, responses are to a 7-point Likert scale where 1= Strongly disagree, 4=Neither agree nor disagree, and 7=Strongly agree. PIE is Public Issues Education.

Generally speaking, off-campus personnel were more positive about the CSU CAFO Work Group than were on-campus personnel. The range of mean responses to questions for off-campus respondents was 5.00-6.17, whereas on-campus personnel mean responses were 3.83-5.50. On- and off-campus responses differed statistically on four questions, with off campus providing higher ratings in each case:

  • Effectiveness of work group activities (p<0.01);
  • Effectiveness of the communication of the content of work group materials (p<0.01);
  • Efficiency of work group activities (p<0.05); and
  • Impact of the Work Group (p<0.05).

On- and off-campus personnel also differed with regard to their ranking of questions. Table 2 illustrates the range and rank of mean responses from on- and off-campus personnel. Potentially most notable is that off-campus personnel ranked the inclusiveness of the structure and activities of the Work Group lowest, whereas the inclusive structure gained the highest ranking of campus-based personnel.

Structural aspects (efficiency, effectiveness, and inclusiveness) of the Work Group garnered three of the four lowest rankings among off-campus personnel, while content features gained their three highest rankings. Effectiveness and efficiency in communication, structure, and activities were of greatest concern to campus-based personnel. In spite of the relatively low ranking of the efficiency of the work group, all evaluators providing a response indicated that the CSUCE CAFO Work Group provided a useful model for public issues and public policy education.

Table 2.
Rank of Responses to CSU CAFO Work Group Evaluation, by Location

Off Campus

Campus

Overall

Objective Content

6.17

Inclusive Structure

5.50

Objective Content

5.75

Comprehensive Content

6.17

Fair Structure

5.33

Content Best Science

5.67

Content Best Science

6.17

Objective Content

5.33

Fair Structure

5.64

Fair Structure

6.00

Appropriate Activities

5.17

Comprehensive Content

5.58

Effective Activities

5.83

Inclusive Activities

5.17

Appropriate Activities

5.42

Appropriate Activities

5.67

Content Best Science

5.17

Inclusive Structure

5.33

Efficient Activities

5.67

Comprehensive Content

5.00

Inclusive Activities

5.08

Content Effectively Communicated

5.67

Effective Structure

4.33

Efficient Activities

5.00

Efficient Structure

5.50

Efficient Activities

4.33

Effective Structure

4.83

Effective Structure

5.33

Efficient Structure

4.17

Efficient Structure

4.83

Inclusive Structure

5.17

Effective Activities

3.83

Effective Activities

4.83

Inclusive Activities

5.00

Content Effectively Communicated

3.83

Content Effectively Communicated

4.75

Note: Responses are to a 7-point Likert scale where 1= Strongly disagree, 4=Neither agree nor disagree, and 7=Strongly agree.

Concluding and Retrospective Remarks

The Colorado State University CAFO Working Group was formed as an interdisciplinary group to address an important and timely issue of public policy. While activities can be listed easily, it is less simple to evaluate the Working Group's effectiveness due to its role in education rather than advocacy.

The CAFO Working Group may not have effectively overridden the expensive onslaught of emotion-driven advertising and lobbying efforts surrounding the Initiatives with its low-budget, objective information. Yet the Working Group generally thought that it was the Group's responsibility to address these important public issues to its best abilities despite limitations in having the message heard. Moreover, the Group may have benefited from the inclusion of producers, environmental activists, and expertise from other public agencies (e.g., NRCS, FSA) in the group.

Overall, based upon experiences with the CSUCE CAFO Working Group, issues teams designed in this manner can provide an effective means of providing timely, appropriate, and accurate cross-disciplinary information to Extension audiences on complex issues of public concern and interest.

Acknowledgements

The comments of the anonymous reviewers improved this article and are appreciated. The CSUCE CAFO Working Group members, whose time, effort, and expertise were illustrated in this article are also appreciated and acknowledged. Colorado State University Cooperative Extension and Agricultural Experiment Station provided financial support for this work. All errors are unintentional and the responsibility of the author.

References

McGranahan, D. A. (1999). Natural amenities drive population change. United States Department of Agriculture, Economic Research Service. Agricultural Economics Report No. 781. 24 pp.

Obermann, W., Carlson, D., & Batchelder, J., eds. (2000). Tracking agricultural land conversion in Colorado: An interagency summary by the Colorado Department of Agriculture, Natural Resources Conservation Service, and Colorado Agricultural Statistics Service. September 2000.

Seidl, A., & Davis, J. (1999). Report on animal feeding operations and rural Colorado communities. Agricultural and Resource Policy Report, Department of Agricultural and Resource Economics, Colorado State University. APR99-02. February 1999. 32pp. Available at: http://dare.agsci.colostate.edu/extension/feeding.pdf

Seidl, A., & Grannis, J. (1998). Common components of swine policies. Agricultural and Resource Policy Report, Department of Agricultural and Resource Economics, Colorado State University. APR 98-02, October 1998. 6 pp. Available at: http://dare.agsci.colostate.edu/extension/apr98-02.pdf

United States Department of Agriculture, National Agricultural Statistics Service (USDA/NASS). (1999). 1997 census of agriculture, Volume 1: National, state, and county tables. Available at: http://www.nass.usda.gov/census/census97/volume1/vol1pubs.htm

United States Department of Commerce, Bureau of the Census, Census 2000. (2002). United States Census Bureau: state and county quickfacts. Available at: http://quickfacts.census.gov/qfd/states/08000.html

 


An Organizational Culture Assessment Using the Competing Values Framework: A Profile of Ohio State University Extension

Angel A. Berrio
Researcher II
National Institute for Agricultural Research (INIA)
Maracay, Venezuela
Internet Address: berrio1@mail.com

Introduction

The contemporary definition of organizational culture (OC) includes what is valued, the dominant leadership style, the language and symbols, the procedures and routines, and the definitions of success that characterizes an organization. OC represents the values, underlying assumptions, expectations, collective memories, and definitions present in an organization (Schein, 1992; Cameron & Quinn, 1999).

Cameron and Quinn (1999) have developed an organizational culture framework built upon a theoretical model called the "Competing Values Framework." This framework refers to whether an organization has a predominant internal or external focus and whether it strives for flexibility and individuality or stability and control. The framework is also based on six organizational culture dimensions and four dominant culture types (i.e., clan, adhocracy, market, and hierarchy). In addition the framework authors generated an "Organizational Culture Assessment Instrument (OCAI)" which is used to identify the organizational culture profile based on the core values, assumptions, interpretations, and approaches that characterize organizations (Cameron & Quinn, 1999).

The central issue associated with organizational culture is its linkage with organizational performance. Connections between OC and performance have been established. An increasing body of evidence supports a linkage between an organization's culture and its business performance. In the business arena, evidence has confirmed that companies which put emphasis in key managerial components, such as customers, stakeholders and employees, and leadership, outperform those that do not have these cultural characteristics (Kotter & Heskett,1992; Wagner & Spencer, 1996).

The competing values framework can be used in constructing an organizational culture profile. Through the use of the OCAI, an organizational culture profile can be drawn by establishing the organization's dominant culture type characteristics. In this respect the overall culture profile of an organization can be identified as:

  • Clan: an organization that concentrates on internal maintenance with flexibility, concern for people, and sensitivity for customers.
  • Hierarchy: an organization that focuses on internal maintenance with a need for stability and control.
  • Adhocracy: an organization that concentrates on external positioning with a high degree of flexibility and individuality.
  • Market: an organization that focuses on external maintenance with a need for stability and control.

The culture of Ohio State University Extension plays an important role in the way Extension personnel plan, implement, and evaluate educational programs. OSU Extension is perceived by its personnel to be an institution devoted to satisfying the needs and wants of its clients through programs that are clearly defined, sensible to public needs, constantly monitored for success, and pro-actively implemented (Berrio & Henderson, 1998).

Purpose and Objectives

The purpose of the study discussed here was to describe the dominant culture type of Ohio State University Extension (OSUE). The research study was designed as an evaluation survey with the purpose of exploring and describing Ohio State University Extension's organizational culture. It is also an organizational survey because its results were used as part of a larger change effort to diagnose issues related to leadership, teamwork, and management behavior and to determine the impact of these issues on employee outcomes (Wagner & Spencer, 1996). The researcher was also interested in studying factors that may account for variation among the organizational culture profile.

The current and preferred dominant culture types and selected demographic characteristics were analyzed in order to establish a profile of Ohio State University Extension. The study was guided by the following objectives:

  1. Describe the dominant culture type of OSUE as perceived by their personnel. This objective was subdivided into:
    1. Describe the dominant culture type in both current and preferred situations;
    2. Describe the strength of the culture type;
    3. Describe the culture profile findings among groups of individuals at OSUE.
  2. Describe OSUE personnel by demographic characteristics of job title, major program area, sex, age, and length of employment.

Methodology

The study was classified as descriptive-correlational. The target and accessible populations were Ohio State University Extension personnel distributed in 5 districts and 88 counties (N=965). A sample was drawn from the population (N=434), composed of the following three personnel categories: professionals (n=357), paraprofessionals (n=347), and support staff (n=261).

The questionnaire used to gather data from the sample consisted of a modified version of the "Organizational Culture Assessment Instrument" developed by Cameron and Quinn (1999). The OCAI instrument was adapted and used to describe the organizational culture profile of Ohio State University Extension.

For the purpose of the study, instrument validity and reliability were established. In assessing the reliability of scales used in the questionnaire a coefficient of internal consistency was calculated using Cronbach's alpha methodology (Santos, 1999). The results for the statements contained in the OCAI for both current and preferred situations are shown in Table 1.

Data were collected by a mail questionnaire using a modification of the procedures recommended by Salant and Dillman (1994). The first mailing and follow-up postcard resulted in a 53% response rate. After the second mailing, an overall response rate of 74% was established, with a 68% usable return rate for the study.

Table 1.
Coefficients of Internal Consistency Using Crombach's Alpha Methodology

Culture Type

Reliability Coefficients for Current Situation

Reliability Coefficients for Preferred Situation

Comparison Reliability Coefficients*

Clan

.80

.77

.82

Adhocracy

.75

.72

.83

Market

.90

.84

.67

Hierarchy

.62

.79

.78

* Reliability coefficients reported by Cameron & Quinn (1999).

Results

Dominant Culture Type-Current Situation

Table 2 illustrates the perceived current dominant culture type of OSU Extension personnel by demographic groups. An analysis of the highest mean scores obtained (Mean= 28.44) shows that the dominant culture type for OSU Extension personnel in the current situation is the Clan culture.

Table 2.
Dominant Culture Type of OSU Extension Personnel in the Actual Situation

 

Current Situation

Category

n

Mean

S.D.

Dominant
Culture

df

F

p

Total Group (Extension)

297

28.44

9.33

Clan

     

Sex

       

1

.017

.897

Male

96

28.51

9.94

Clan

     

Female

198

28.36

9.11

Clan

     

Location

       

2

2.907

.056

County

182

28.85

8.99

Clan

     

District

48

30.03

8.72

Clan

     

State

67

29.09

12.05

Hierarchy

     

Program Area

       

4

1.002

.407

Ag.& Nat. Res.

79

29.45

8.28

Clan

     

Comm. Dev.

21

30.82

14.14

Hierarchy

     

Fam. & Con. Sci.

69

29.23

9.49

Clan

     

4-H Youth Dev.

74

27.45

8.72

Clan

     

More than one

51

28.56

11.41

Clan

     

Job Title

       

2

1.774

.172

Profes./Admin.

147

27.51

9.86

Clan

     

Paraprofes.

64

28.62

8.76

Clan

     

Support Staff

86

29.88

8.69

Clan

     

Age

       

2

.699

.498

20-40 years

93

29.18

9.89

Clan

     

41-50 years

114

28.46

10.02

Clan

     

51 + years

87

27.53

7.82

Clan

     

Length Employment

       

2

1.078

.342

01-05 years

105

29.46

9.42

Clan

     

06-13 years

92

28.05

8.01

Clan

     

14 + years

97

27.62

10.45

Clan

     

* p < .05
Note: Mean scores could range from 0 to 100. Representing a percentage out of 100.

The dominant culture type exhibited by OSU Extension personnel in the group categories labeled as sex, job title, age, and length of employment was the Clan culture. Only the group categories labeled as location and program area had a different dominant culture type for the current situation. For the group category labeled as location, the state personnel had a Hierarchical dominant culture type, different from county and district personnel, who had a dominant Clan culture. For the group category labeled as program area, the Community Development personnel had a Hierarchical dominant culture type, different from the Agriculture & Natural Resources, Family & Consumer Sciences, 4-H Youth Development, and more than one program area, who had a dominant Clan culture.

Dominant Culture Type--Preferred Situation

Table 3 illustrates the dominant culture type of OSU Extension personnel by demographic groups in the preferred situation. An analysis of the highest mean scores obtained (Mean= 32.14) shows that the dominant culture type for OSU Extension personnel in the preferred situation is the Clan culture.

Table 3.
Dominant Culture Type of OSU Extension Personnel in the Preferred Situation

 

Preferred Situation

Category

n

Mean

S.D.

Dominant Culture

df

F

p

Total Group (Extension)

297

32.14

7.82

Clan

     

Sex

       

1

4.39

.508

Male

96

31.72

8.09

Clan

     

Female

198

32.37

7.74

Clan

     

Location

       

2

1.976

.140

County

182

32.17

7.68

Clan

     

District

48

33.79

6.96

Clan

     

State

67

30.86

8.65

Clan

     

Program Area

       

4

1.333

.258

Agr.& Nat. Res.

79

31.35

8.21

Clan

     

Comm. Dev.

21

31.45

7.76

Clan

     

Fam. & Con. Sci.

69

31.54

7.30

Clan

     

4-H Youth Dev.

74

32.23

7.13

Clan

     

More than one

51

34.33

8.94

Clan

     

Job Title

       

2

3.125

.045*

Profes./Admin.

147

31.53

7.53

Clan

     

Paraprofes.

64

31.17

7.75

Clan

     

Support Staff

86

33.89

8.18

Clan

     

Age

       

2

1.052

.351

20-40 years

93

32.94

8.42

Clan

     

41-50 years

114

31.38

8.16

Clan

     

51 + years

87

32.35

6.71

Clan

     

Length Employment

       

2

.1367

.257

01-05 years

105

31.46

7.78

Clan

     

06-13 years

92

31.86

7.32

Clan

     

14 + years

97

33.21

8.36

Clan

     

* p < .05
Note: Mean scores could range from 0 to 100. Representing a percentage out of 100.

The dominant culture type exhibited by OSU Extension personnel in the group categories labeled as sex, location, program area, job title, age, and length of employment was the Clan culture. A statistically significant difference was found among job title categories. The post hoc pairwise multiple comparison analysis using the Tukey method revealed that there were not significant differences between pairs of groups, meaning that the significant difference could be between one group and a combination of two other groups.

Figure 1 shows a graphical representation of the mean scores obtained in each of the four culture types for both the current and preferred situations of OSU Extension personnel using the competing values framework axis and quadrants. Figure 2 shows that the mean scores are diminishing in the Hierarchy and Market culture quadrants (current), and the mean scores in the Clan and Adhocracy quadrants are increasing (preferred).

Figure 1.
Graphical Representation of the Highest Mean Scores in the Four Culture Types for Both Actual and Preferred Situations of OSU Extension Personnel

The four culture types are depicted graphically by two axes--the X-axis represent internal focus versus external focus and the Y-axis represents flexibility and individuality versus stability and control.

Dominant Culture Type Strength

The strength of the dominant culture type exhibited by OSU Extension personnel is related to the number of points assigned to a specific culture type. In the current situation, the Clan culture type exhibited by OSU Extension is slightly strong, while in the preferred situation the Clan culture type is considered moderately strong. In the case of the dominant Clan culture type exhibited by OSU Extension personnel in the current situation, a mean score of 28.44 was considered less strong than a mean score of 32.14 in the preferred situation (Smart & St. John, 1996; Cameron & Quinn, 1999).

When the mean scores of the culture types Adhocracy, Market, and Hierarchy, are compared with the mean score of the dominant Clan culture exhibited by OSU Extension personnel, statistically significant differences are found between the dominant Clan culture and the Market and Hierarchy culture types in both current and preferred situations. This finding suggests the presence of characteristics of both Clan and Adhocracy culture types in the organization. Table 4 shows the mean scores by culture type for OSU Extension personnel in both current and preferred situations.

Table 4.
Mean Scores by Culture Type for OSU Extension Personnel in Both Current and Preferred Situations

 

Current Situation

Preferred Situation

Culture Type

Mean

S.D.

df

F

p

Mean

S.D.

df

F

p

Clan

28.44

9.33

     

32.14

7.82

     

Adhocracy

23.44

6.93

83

1.173

.182

27.93

6.14

79

1.134

.238

Market

22.09

8.74

83

5.310

.000*

18.52

6.64

79

6.595

.000*

Hierarchy

25.63

8.56

83

2.003

.000*

21.31

5.74

79

1.943

.000*

* p < .05
Note: Mean scores could range from 0 to 100. Representing a percentage out of 100.

Dimensions of Organizational Culture

Six dimensions were analyzed by the organizational culture assessment instrument using the competing values framework. The highest mean score for each of the culture types in both current and preferred situations for OSU Extension personnel are shown in Table 5. In the current situation, the highest mean score exhibited by OSU Extension personnel was in the criteria for success dimension (Mean= 34.07), while the lowest mean score recorded was in the organizational glue dimension (Mean= 26.90).

Table 5.
Highest Mean Scores on the Organizational Culture Dimensions for OSU Extension Personnel

 

Current Situation

Preferred Situation

Dimension

Mean

S.D.

Culture Type

Mean

S.D.

Culture Type

Dominant Characteristics

27.49

14.62

Clan

28.83

11.61

Adhocracy

Organizational Leadership

30.05

14.55

Hierarchy

30.07

11.39

Clan

Management

30.64

13.84

Clan

35.19

12.71

Clan

Organizational Glue

26.90

15.07

Clan

31.98

12.63

Clan

Strategic Emphases

28.90

11.85

Adhocracy

32.08

9.82

Adhocracy

Criteria for Success

34.07

17.60

Clan

37.19

14.33

Clan

Mean scores could range from 0 to 100. Representing a percentage out of 100.

In the preferred situation, the highest mean score exhibited by OSU Extension personnel was in the criteria for success dimension (Mean= 37.19), while the lowest mean score recorded was in the dominant characteristics dimension (Mean= 28.83). Two dimensional profiles demonstrated to be different from the overall Clan culture profile in the current situation, organizational leadership (Hierarchy) and strategic emphases (Adhocracy). Two dimensional profiles demonstrated to be different from the overall Clan culture profile in the preferred situation, dominant characteristics (Adhocracy) and strategic emphases (Adhocracy).

Conclusions and Recommendations

The findings of this study are in agreement with the fact that almost two thirds of the colleges and universities in a nationwide study currently have a Clan culture type. In the same study, trustees, administrators, and department chairpersons perceive the Clan culture as the most effective culture type for colleges and universities (Smart & Hamm, 1993; Smart & St. John, 1996).

The Clan culture classification applied to Extension portrays the institution as an organization that concentrates on internal maintenance with flexibility, concern for people, and sensitivity for customers. The Clan culture is characterized as a family type of organization and represents a friendly place to work, where people share a lot of themselves. The Clan culture views its leaders as having the role of mentors or facilitators. The glue that maintains the organization together is loyalty and tradition, with a high level of commitment among its members. Clan organizations emphasize individual development, morale, teamwork, participation, and consensus (Cameron & Quinn, 1999).

The strength of the culture is determined by the number of points conceded to a specific culture type. In the current situation, the Clan culture type exhibited by OSU Extension is slightly strong, while in the preferred situation the Clan culture type is considered moderately strong. OSU Extension personnel desire a stronger (moderately) Clan culture in the future. This finding is in agreement with what research has revealed about organizations that possess strong cultures; they are associated with having homogeneity of effort, clear focus, and higher performance in environments where unity and common vision are required (Cameron & Quinn, 1999).

Three dimensions of organizational culture displayed a distinctive profile from the overall culture profile exhibited by OSU Extension in current and preferred situations. The dimension labeled as "Dominant Characteristics" is concerned with what the overall organization is like. The Adhocracy classification in the preferred situation is not in agreement with the overall culture profile of OSU Extension (Clan), but it is in agreement with the finding that no statistically significant difference was found between the mean scores of the Clan and Adhocracy cultures in the preferred situation. This finding suggests that OSU Extension possesses a combination of the core characteristics of the dominant Clan culture with those of the less dominant Adhocracy culture type.

The dimension labeled as "Organizational Leadership" is related to the dominant leadership style and approaches used by leaders and administrators in the organization. The Hierarchy classification in the current situation of this dimension is not in agreement with the overall culture profile of OSU Extension (Clan). In terms of the leadership style, OSU Extension personnel perceives its leaders and administrators as currently having a Hierarchical type of culture, wanting them to change to a preferred Clan culture type.

The dimension labeled as "Strategic emphases" is concerned with the definition of areas of emphasis that drive the organization's strategy. The Adhocracy classification in both the current and preferred situations are not in agreement with the overall Clan culture exhibited by OSU Extension personnel, but they are in agreement with the finding that no statistically significant difference was found between the mean scores of the Clan and Adhocracy cultures in both current and preferred situation. This finding suggest that OSU Extension possesses a combination of the core characteristics of the dominant Clan culture with those of the less dominant Adhocracy culture type when it comes to areas of emphasis and strategy in the current situation and that OSU Extension personnel want this condition to become stronger in the future.

Some demographic groups considered in this study displayed a different culture type from the overall dominant Clan culture of Extension. The demographic groups comprised of OSU Extension employees at the state level and in the Community Development program area exhibited a Hierarchical type of culture in the current situation. Evidence supports the fact that the culture type considered most effective in a college or university setting is the Clan culture. In addition, organizational success is said to depend on matching the culture type with the demands of the external environment (Smart & St. John, 1996; Cameron & Quinn, 1999). In the case of OSU Extension, where characteristics of the Clan and Adhocracy culture coexist, the strengths of both culture types should be used to conform to the external environment.

Although the study applies to Ohio State University Extension, it has implications for Extension on a national level. The research results might provide some thoughts on the way to embrace some of the issues facing Extension nowadays. In this regard, one of the strategic issues identified by the Cooperative Extension System (CES) in Framing the Future: Strategic Framework for a System of Partnerships report was: "Extension must embrace multiple organizational models to be visionary and responsible" (p. 6). On the other hand, one of the actions for success recommended was: "... to challenge and rethink assumptions about organizations, methods, and processes" (p. 6). The CES report also recommends addressing issues and challenges, and making changes in Extension's complex internal environment in order to secure the evolution of the Cooperative Extension System.

This could only be done by means of identifying critical internal factors, and it has been suggested that Organizational Culture is one of those factors compromising the CES effectiveness  (ECOP-CSREES; 1995). The researcher recommends that other states perform similar studies in order to have a better understanding of the current organizational culture type, which could help Extension make the necessary changes in pursuing enhanced effectiveness of its programs.

Acknowledgments

The author would like to acknowledge the cooperation of Ohio State University Extension personnel at the county, district, and state levels in answering the survey questionnaire. The author would also like to acknowledge the collaboration of OSU Extension Associate Vice-President & Director, Keith Smith; OSU Extension Organizational Learning Officer, Nikki Conklin; and OSU Extension Organizational Learning Team, Jo Jones and coworkers. A special recognition is extended to the author's advisor, Janet Henderson, Associate Professor of the Human and Community Resource Development Department at The Ohio State University, for her continuous guidance and support during the research process.

References

Berrio, A. A., & Henderson, J. L. (1998). Assessing customer orientation in public, non-profit organizations: A profile of Ohio State University Extension. Journal of Agricultural Education, 39(4), 11-17.

Cameron, K. S., & Quinn, R. E. (1999). Diagnosing and changing organizational culture. Reading: Addison-Wesley.

ECOP-CSREES. (1995). Framing the future: Strategic framework for a system of partnerships (p. 25).

Kotter, J. P., & Heskett, J. L. (1992). Corporate culture and performance. New York: The Free Press.

Salant, P., & Dillman, D. A. (1994). How to conduct your own survey. New York: John Wiley & Sons, Inc.

Santos, J. R. (1999). Cronbach's Alpha: A tool for assessing the reliability of scales. Journal of Extension [On-line], 37(2). Available at: http://www.joe.org/joe/1999april/tt3.html

Schein, E. H. (1992). Organizational culture and leadership (2nd Ed.). San Francisco: Jossey- Bass.

Smart, J. C., & Hamm, R. E. (1993). Organizational effectiveness and mission orientations of two-year colleges. Research in Higher Education, 34(4), 489-502.

Smart, J. C., & St. John, E. P. (1996). Organizational culture and effectiveness in higher education: A test of the "Culture Type" and "Strong Culture" hypotheses. Educational Evaluation and Policy Analysis, 16(3), 219-241.

Wagner, D. B., & Spencer J. L. (1996). The role of surveys in transforming culture: Data, knowledge, and action. In Kraut, A. I. (Eds.), Organizational surveys: Tools for assessment and change. (pp.67-87). San Francisco: Jossey-Bass.

 


Outcomes of Individual vs. Group Instruction in EFNEP

Jamie Dollahite
Associate Professor
Internet Address: jsd13@cornell.edu

Michelle Scott-Pierce
Extension Support Specialist
Internet Address: mls63@cornell.edu

Division of Nutritional Sciences
Cornell University
Ithaca, New York

Introduction

The focus of the Cooperative State Research, Education, and Extension Service (CSREES) is "to advance a global system of research, extension and higher education in the food and agricultural sciences and related environmental and human sciences to benefit people, communities, and the Nation." In Cooperative Extension, this is achieved through educational programs in many disciplines, including food safety, nutrition, and health.

Evaluation is recognized as an essential element in quality programming (Hamilton, Verma, & Burnett, 1996), particularly in the present economic climate as we strive to maintain, even improve, the outcomes of our work with shrinking resources. In order to improve, we must continually and critically assess the effectiveness of the education we are providing (both content and process), reflect on how these results can inform our programming, and adjust our methodologies to improve the impact.

The goal of the Expanded Food and Nutrition Education Program (EFNEP) is "to assist limited resource audiences in acquiring the knowledge, skills, attitudes, and changed behavior necessary for nutritionally sound diets, and to contribute to their personal development and the improvement of the total family diet and nutritional well-being (EFNEP, 2002). During the early years of EFNEP, nutrition education of participants was carried out one-on-one, primarily in the home.

Front-line educators were paraprofessionals, indigenous to the community in which they were working. When hired, front-line educators were not required to have had formal training in either nutrition or educational methodology. However, supervising Extension agents with training in both content and methodology were responsible for providing on-the-job training for their staff. This model of hiring paraprofessionals from the community who receive on-the-job training remains the norm.

In 1979, a Federal EFNEP evaluation was carried out (Chipman & Kendell,1989). The resulting report emphasized the costliness of the one-on-one delivery method and recommended that staff move toward a small group format to improve the cost effectiveness of the program. Given this report, an increased concern for staff safety in individual home environments, and, more recently, the advent of welfare reform and its impact on participant lifestyles, small classes became the preferred educational method, particularly in urban areas.

In the late 1970s and early 1980s, studies were done to investigate the use of more efficient program delivery methods. Reports of pilot projects developing the small-group delivery method cite challenges similar to those encountered in present situations, such as:

  • The need for increased training of paraprofessionals in group facilitation skills,
  • Language barriers,
  • Follow-up for participants missing a class, and
  • The difficulty in obtaining evaluation data in a group setting (Neilan, 1985).

In 1981, studies were conducted in 10 state EFNEPs that compared the outcomes of different program delivery methods, including structured one-on-one, small group, and small-group-plus-phone (Experimental Evaluation, 1984). No significant differences were observed when delivery methods were compared. However, in all methods, the first two lessons were delivered one-on-one, so that individual contact was made with each participant. Currently, most participants, at least in New York State (NYS), are educated using either the one-on-one method or the group method, with only about 6% involved in both group and individual lessons.

EFNEP has an on-going evaluation system built into the program, with behavioral outcome data collected on all participants. In NYS we have observed that behavioral outcomes vary by mode of program delivery. This article reports a comparison of behavioral outcome indicators of participants educated individually in their homes vs. those educated in small groups within the community. We suggest possible explanations that should be explored in order to make decisions about programmatic modifications necessary to keep the Program relevant to the target population (Taylor-Powell, Steele, Douglah, 1996). This process could be valuable to other Extension programs seeking to maximize impact with limited resources.

Methods

Data used in the present study represent responses from graduates of the NYS EFNEP for Federal Fiscal Years (FY)1999-2001, which were gleaned from the evaluation instrument that is federally mandated in EFNEP. In NYS, graduation from EFNEP is defined by completion of six or more lessons, completion of both pre- and post-assessment, and the participant's and the front-line educator's assessment that the participant has met goals established upon entry into the Program.

Demographic information, program delivery method (group, individual, both, or other), and responses to 10 self-reported behavior checklist items were used. The checklist items represented four constructs:

  • Food safety (2 items),
  • Diet quality (5 items),
  • Management of food resources (4 items), and
  • Food security (1 item), with some items representing more than one construct.

Responses to the checklist items were Likert scales with 5 choices ranging from "almost always" to "do not do." Numeric scores of 1 to 5 were assigned, with "almost always" being 5. Responses to individual items were summed across domains to produce scores and were analyzed as continuous data.

The 3-year data set included a total of 17,160 participants. Of these, 7636 were excluded from the analyses presented here because they did not respond to one or more checklist items or chose "not applicable." There were no differences in this group as compared to the group analyzed (n=9524) based on age, gender, race, income, household size, education, size of home community, or percentage receiving individual vs. group education.

County EFNEPs chose the program delivery method or methods that best suited the local situation. Typically, urban areas chose to deliver education in groups, while rural areas chose both one-on-one and groups, and were more likely to make this choice on the needs of the individual participant.

Front-line educators collected outcome data from participants. Data collection forms were available in English and Spanish. Because many participants have difficulty reading the forms, either because of low literacy skills or they speak and read a language other than English or Spanish, the items on the evaluation instrument were routinely read to participants, and assistance was provided to facilitate the completion of the forms. Local staff then entered the data into the Evaluation Reporting System (ERS4), the software package designed for EFNEP. The data were compiled electronically and submitted to the State EFNEP office, where data from all counties were compiled to represent the statewide evaluation.

Initial comparisons between outcomes from participants taught in groups and those taught individually were made using data for the entire state. A number of urban sites exclusively use groups for program delivery, and some rural sites primarily use individual education. Demographics differ between the urban and rural populations, and outcome data may be influenced by differing experience and skill levels of the front-line educators working with a given delivery method.

We therefore performed a second set of analyses of outcomes from sites providing a balance of programming using the two different delivery methods. Counties were selected from which at least 40% of graduated participants were taught individually and at least 40% were taught in groups. A total of 14 different counties were included in this second analysis; some counties met the inclusion criteria for two or three years, some for only one, such that there were 8, 6, and 8 counties represented, respectively, in each year.

Independent t-tests were used to compare those receiving group education with those receiving individual education (pre-education, post-education, and change) and dependent t-tests were used to compare pre- and post-education scores in the same individual. Changes in scores from pre- to post-education assessment were also calculated and compared.

Results

Table 1 reports results from the analyses of 3 years' data for graduates across the NYS EFNEP. On entry into the program (pre-education), self-reported behavior scores were slightly but significantly better in participants taught individually than in those taught in groups. There was also significantly greater improvement from pre- to post-education among those taught individually. Statistically significant improvement was seen in scores for each of the four constructs. There was no difference in number of lessons provided to those receiving individual (8.3+0.06) as compared to those receiving group (8.4+0.02) education.

The participants in the group receiving individual education were different demographically from those involved in group education. Place of residence, race, income, education level, and ratio of men to women were all significantly different (p<0.0001). Over 79% of participants receiving individual education were white, while 48% of those in groups were Hispanic and 29% were black. These differences reflect the dissimilarity between the Upstate New York population (primarily farms and towns), which is 86% white, and the NYC population which is only 45% white (U.S. Census Bureau, 2001).

Over 86% of those receiving individual instruction lived on farms or in towns of <50,000 population, with only 9% living in cities or suburbs. Alternatively, most participating in groups lived in cities (76%) or suburbs (4.5%), with slightly over 20% living in more rural areas. Self-reported family income was higher among those taught individually ($955+10) as compared to those taught in groups ($765+12). Household size was slightly but significantly larger among those taught in groups (4.3+0.02 vs. 4.1+ 0.03, p<0.02). Education level was slightly but significantly higher (p<0.0001) among those taught individually (last grade completed 10.6+0.07) vs. those taught in groups (10.1 +0.04).

Table 1.
Self-Reported Behavior (Mean +/- SEM) According to Program Delivery Method for New York State EFNEP over a 3-Year Period

Delivery Method

Summary Score*
(10 items)

Change*

Group (n = 7185)

Pre

34.0 +/- 0.1a

 

Post

39.7 +/- 0.1b

5.7 +/- 0.1a

Individual (n = 2339)

Pre

35.3 +/- 0.1c

 

Post

42.5 +/- 0.1d

6.9 +/- 0.1b

* Different superscripts in the same column indicate statistically significant differences at the p < 0.0001 level in a given column.

Based on potential differences by county as well as the demographic differences in those involved in group as compared to individual education, we then completed a second set of analyses. These included behavior change among a sub-set of participants in 14 counties with approximately equal portions of participants involved in each of the two educational delivery methods (Table 2).

Scores were not different at entry into the program (pre-education) either by individual construct or overall summary score. All participants reported improved behavior post-education, but the change among those taught individually was greater than among those taught in groups. It is interesting to note that the mean number of lessons provided to individuals was greater than the number provided to groups, 8.1+0.1 vs. 6.9+0.1, respectively (p<0.0001). This is attributable to the increased flexibility inherent in deciding when an individual is ready for graduation as compared to a group for which nutrition education is occurring as a part of another agency's program.

Demographics were more similar between those participants taught in groups and those taught individually than was true for the statewide data, but there were still some differences. Place of residence, age, education, household size, and income were not significantly different. However, there were more white participants involved in individual education and more black participants in group education (p<0.0001). Thirteen percent of those educated in groups were men as compared to 6% of those educated individually (p<0.001).

Table 2.
Self-Reported Behavior (Mean +/- SEM) According to Program Delivery Method for 14 Selected Counties in the New York State EFNEP over a 3-year Period

Delivery Method

Summary Score*
(10 items)

Change*

Group (n = 480)

Pre

35.3 +/- 0.3a

 

Post

39.1 +/- 0.3b

3.8 +/- 0.2a

Individual (n = 444)

Pre

35.2 +/- 0.3a

 

Post

41.1 +/- 0.3c

5.9 +/- 0.3b

* Different superscripts in the same column indicate statistically significant differences at the p<0.0001 for level in a given column.

Discussion

Across the United States in FY2000, 73,663 adults participated in a series of EFNEP lessons with completion of pre- and post-education behavioral outcome data, including a food behavior checklist and a 24-hour dietary recall (EFNEP FY00). Of these, 73% were taught in a group setting, usually in a community or agency center; 20% were taught individually, usually in the participant's home; 6% in a combination of small group and individual instruction; and 1% using "other" delivery methods (Montgomery, S., personal communication, 2001).

In NYS, the percentage of participants reached in groups has shown a steady increase, with 50% participating in group education in FY1998, 61% in FY1999, 67% in FY2000, and 70% in FY2001. Is this shift consistent with maintaining quality programming and expected outcomes?

The data reported here indicate that, as currently delivered, programmatic impact is suffering as a result of this shift. Previous EFNEP data indicating that outcomes were similar among participants taught individually and in groups were based on a methodology in which the groups were recruited and educated individually for two lessons, followed by a series of group lessons. This is not the current method in most venues.

EFNEP is normally delivered by paraprofessionals who are recruited to be indigenous to the communities being served and hence able to easily relate to the participants  (Brink, 2000). Intensive on-the-job-training is then conducted to provide staff with the skills necessary for program delivery. This model has been used since the inception of the program. However, political and social changes have resulted in a very different environment in many sites where the program is delivered, increasing the challenges both of recruitment of participants and of program delivery.

Participants in the EFNEP have historically been recruited in two primary ways, referral from other agencies providing services to the target population, such as WIC and Head Start, and word-of-mouth referral from previous participants or others in the community.

Reasons Education Has Shifted from Primarily One-on-One to Group

First, group education has been thought to be a more cost-effective method of program delivery in an era of sharply declining resources (Chipman & Kendall, 1989).

Second, safety of front-line workers became a consideration, particularly in urban areas. For example, in the early 1980's the Program in NYC moved to providing all education in group settings to ensure staff safety.

Third, recruitment of individual participants has become increasingly difficult in the last 5 years, since the advent of welfare reform, because adults are now in the work force or in work preparation rather than being available for program delivery in homes or in small groups organized specifically for EFNEP.

Instead, participants are most often found by recruiting agencies working with groups of the target population, and the program is delivered to a group that exists for another purpose, such as Welfare-to-Work programs, Head Start parent groups, groups in half-way houses for drug and alcohol rehabilitation, etc. The number of lessons provided, the number of participants per group, and the specific composition of the group are often dictated by the agency with varying degrees of negotiation possible.

Advantages to Reaching Participants Through Pre-Existing Groups

  • Ease in recruiting participants who are not readily available otherwise,
  • Decreased cost per participant because a larger number can be reached, and
  • Reliable attendance in the case of programs such as Welfare-to-Work or halfway houses.

Challenges to Group Education

  • It is more likely that the number of lessons to be provided will be dictated by the agency rather than by a needs assessment of the group coupled with on-going evaluation of goal achievement.
  • The number of participants may be larger than ideal, particularly for paraprofessional staff with limited training in group facilitation methods.
  • The composition of the group may provide special challenges, for example participants who need individual attention because of limited reading skills or language barriers.
  • Group dynamics may be a problem because of the different languages and cultures represented in a group.

For example, in New York City, EFNEP groups average 12 participants, with two to four different languages spoken in a given group and few individuals speaking more than one language. One recent example occurred in a group of 12 in which 8 languages were spoken, including English, Spanish, Russian, French, Haitian Creole, Korean, Chinese, and an African dialect.

Participants in such groups are often new immigrants who desperately need the material taught in EFNEP and are grateful for the work done as a part of the program, but the paraprofessional, even if bilingual, will only speak English and Spanish or English and Haitian Creole. She cannot come close to being indigenous to this population; no one person can. She may also not have the skills necessary to facilitate a group of this complexity.

Decreased cost per participant does not necessarily translate into increased cost-effectiveness, and the data reported here question the cost-effectiveness of group education as compared to one-on-one education. However, the current political and community climate does not support reversal of the trend toward more groups.

If the increase in groups is inevitable, what changes are necessary to assure excellence in programming? Program leaders and educators need to carefully consider:

  • Training needs of staff working with groups and, where needed, with culturally and linguistically diverse groups;
  • Choice of collaborating agencies and agreements with these agencies that allow sizes of groups, programming flexibility, and individualization to meet participant needs that are in line with adult learning theory (Cantor, 2001); and
  • Educational strategies that allow for individualization within the context of a group, such as telephone contact or, where possible, one or two individual sessions.

Conclusions

Cooperative Extension programs are delivered in a very different environment today than in the past. On-going evaluation is critical to assure that programs adjust with the changing times and continue to be effective in meeting the needs of participants.

EFNEP provides exa