Summative Evaluation of the National Training Program in the Film and Video Sector (NTPFVS)

Office of the Chief Audit and Evaluation Executive

Evaluation Services Directorate

February 2008

• Executive Summary
• 1. NTPFVS Program Description
  • 1.1 Program Background
  • 1.2 Objectives, Intended Outcomes and Funding Criteria
    • 1.2.1 Objectives and Intended Outcomes
    • 1.2.2 Program Objectives
    • 1.2.3 Use of Program Resources
    • 1.2.4 Funded Institutions
  • 1.3 Evaluation Issues and Objectives
  • 1.4 Organization of the Report
• 2. Evaluation Issues and Methods
  • 2.1 Review of Program Documentation
  • 2.2 Review of Files and Databases
  • 2.3 Literature Review and Secondary Data Analysis
  • 2.4 Key Informant and Expert Interviews
  • 2.5 Survey of Graduates
• 3. Key Findings
  • 3.1 Rationale and Relevance
    • 3.1.1 Factors Influencing Training Needs
    • 3.1.2 Adequacy of Program to Address Training Needs
    • 3.1.3 Rationale for the Program
  • 3.2 Role for the Federal Government and Other Key Players
  • 3.3 Contribution of the Program to Departmental Strategic Objectives
• 4. Success and Impacts
  • 4.1 Success/Impact of the Program
    • 4.1.1 Financial Stability of Funded Institutions
    • 4.1.2 Increased Financial Capacity
    • 4.1.3 Practical versus Theoretical Content Delivery
    • 4.1.4 Improved Curricula/Higher Quality Training
    • 4.1.5 Diversity of Graduates and Outreach
  • 4.2 Intermediate Outcomes
    • 4.2.1 Film and Video Training Institutions in Canada
    • 4.2.2 Graduates Who Work in Their Field
  • 4.3 Ultimate or Long-term Outcomes
    • 4.3.1 Film and Video Products Produced by Graduates
    • 4.3.2 Film and Video Products for Canadian Market
  • 4.4 Unintended Outcomes
• 5. Cost-Effectiveness and Alternatives
  • 5.1 Resource Allocation
    • 5.1.1 Cost per Graduate to the Program
    • 5.1.2 Cost of Comparable Programs
    • 5.1.3 Adequacy of Funding
    • 5.1.4 Opportunities for Partnership
  • 5.2 Alternatives
    • 5.2.1 Improved Cost-Effectiveness
    • 5.2.2 Practices in Other Jurisdictions
      
• 6. Conclusions and Recommendations
  • 6.1 Rationale and Relevance
  • 6.2 Success and Impacts – Success/Impact of the Program
  • 6.3 Cost-effectiveness/Alternatives
  • 6.4 Recommendations, Management Response and Action Plan
• Appendix A - NTPFVS Logic Model
• Appendix B - Eligibility, Assessment Criteria and Application Process
• Appendix C - Training Curricula at Funded Institutions (2006-07)
• Appendix D - Evaluation Matrix
• Appendix E - List of Documents Reviewed
• Appendix F - List of Key Informants
• Appendix H - Demographic Profile of Survey Respondents
• Appendix I - Comparison of NATCP and NTPFVS

List of Acronyms

APTN                          Aboriginal Peoples Television Network
BNMI                          Banff New Media Institute
CBC                            Canadian Broadcasting Corporation
CFC                            Canadian Film Centre
CHRC                         Cultural Human Resources Council
CIFVF                         Canadian Independent Film and Video Fund
CPTC                          Canadian Film or Video Production Tax Credit
CQRHC                      Conseil québécois des ressources humaines en culture
CSTC                          Canadian Screen Training Centre
CTF                             Canadian Television Fund
CFFF                           Canadian Feature Film Fund
FTEs                            Full-time Equivalents
HRDC                         Human Resources Development Canada
IATSE                         International Alliance of Theatrical Stage Employees
INIS                            Institut national de l'image et du son
LMDA                         Labour Market Development Agreement
NATCP                       National Arts Training Contribution Program
NFB                            National Film Board
NSI                              National Screen Institute – Canada
NTPFVS                     National Training Program in the Film and Video Sector
PCH                            Department of Canadian Heritage
RBAF                          Risk-based Audit Framework
RMAF                         Results-based Management and Accountability Framework