Academic literature on the topic 'Effective teaching Victoria Melbourne Evaluation'

ABSTRACTBackground: In the next decades of the twenty-first century, the global aging of populations will challenge every nation's ability to provide leadership by qualified health professionals to reshape and improve health care delivery systems. The challenge for educators is to design and deliver courses that will give students the knowledge and skills they need to fill that leadership role confidently in dementia care services. This paper explores the ways in which a curriculum can develop graduates who are ready to become leaders in shaping their industry.Method: The Master of Health Science – Aged Services (MHSAS) program at Victoria University, Melbourne, Australia is applied as a case study to describe the process by which the concept of leadership is applied as the key driver in curriculum development, teaching practices and learning outcomes.Results: Evaluation instruments employed in a variety of purposes including teaching, curriculum planning and unit appraisal are discussed. Challenges for the future are proposed including the need for postgraduate programs in dementia to seek stronger national and international benchmarks and associations with other educational institutions to promote leadership and a vision of what is possible and desirable in dementia care provision.Conclusions: In the twenty-first century, effective service provision in the aged health care sector will require postgraduate curricula that equip students for dementia care leadership. The MHSAS program provides an established template for such curricula.

This paper aims to observe how the Australian COVID-19 restrictions influenced higher education, teachers’ and students’ lives. Before the pandemic, the higher education sector was the largest serviced based sector in Australia and overly depended on international students’ fee income. The academic year of 2020 started as usual with 141703 higher education enrolments of overseas students, mainly students from Asia. However, they did not arrive due to the strict border closure. Travel restrictions were put in place from China from 1 February 2020, later from other countries worldwide. That significantly affected international students' travel from Asia directly before the start of the new academic year. Consequently, many institutions have transitioned from campus-based courses to online delivery. Besides, numerous academic lecturers and professional staff have been invited to the expression of interest in a voluntary and, of course, involuntary redundancy program. Most vacant positions have been frozen, and various saving programs have been implied. Owing to the toughest rules and strictest restrictions, Australian borders remained closed for over 600 days. Melbourne was under six lockdowns totalling 265 days since March 2020, which resulted in the author’s experience of three semester-long remote teaching at one of the biggest and most prominent universities in Melbourne without any personal contact with international students. The author lived and worked in Melbourne during the COVID-19 era, so this study is based on her perspectives and experiences extended with a wide empirical evaluation of secondary data about the Australian academic sector between 2020 and 2021.

Student Evaluation of Teaching (SET) results play an important role in academic staff performance evaluation, but also in promotion processes. However, there is much evidence to suggest that the SET used in most universities across the Anglosphere has traditionally penalised female academics. As universities manage the recovery phase of the COVID-19 pandemic, they will also need to take into account the effect of remote teaching on the validity of student evaluation data. Given SET are critical to promotion success, it is important to then understand the gendered effect of remote teaching on student evaluations. We aimed to evaluate how intrusions of family life, academics’ home environment and competence with remote teaching technology of female academics were viewed by students and if there were noticeable differences in SET data. We analysed 22,485 SET data over 2019 (pre-COVID, face-to-face teaching) and 2020 (COVID-lockdowns, remote teaching) for female and male academics, matched with student gender, in the multidisciplinary First Year College at Victoria University, Melbourne Australia. Our results showed that there were no differences in the score ratings for teacher gender. However, the qualitative data showed that whilst overall there were overwhelmingly positive comments for both male and female teachers, there was an increase in the negative comments on teaching style by male students toward their female teachers during remote teaching and overall more comments relating to attitude. We speculate that this would have a negative impact on the confidence of teaching-intensive female academics hindering their leadership aspirations and career progression in academia.

An evaluation of pre-hearing conferences in the Children's Court of Victoria was carried out during 1994 by five members of staff from the School of Social Work at the University of Melbourne. An interesting theme which emerged from this evaluation is the role of the convenor as pivotal to the process of the pre-hearing conference. The convenor has emerged as a critical figure in the success of the mediation process, and the knowledge, skills, and values they are equipped with are seen as essential to their effective operation. This article describes the role of convenors and the many responsibilities they must juggle in fulfilling their role, and the characteristics which make for an effective and successful conference. As conferences become a more frequent method of resolving conflict between individuals, families and society, it is hoped that the principles which emerge from this article will be applied to other conference proceedings. It is clear that we are moving away from conventional adversarial methods, to mediative and conciliative modes, and in doing so we need to become clear about the characteristics which are required for such processes. This is one exploratory study of a pilot project in Victoria which should be of interest to other conferencing and mediation mechanisms.

This paper discusses the teaching of earthquake resistant design within schools of architecture. It aims to stimulate discussion on more effective means of teaching the subject, and to suggest ideas and resources for schools whose seismic design curriculum might benefit from further development. It is argued that seismic design issues should be included and integrated into architecture curricula. The case is based primarily on observations of building failures resulting from flawed architectural design decisions and subsequent critical reaction from within the architectural profession itself. However, another reason is that the large sizes and restrictive layouts of some seismic load resisting systems impact unavoidably upon architectural layouts. The content, teaching methods and teaching staff qualities appropriate for a seismic design curriculum are discussed in a case study from the School of Architecture, Victoria University of Wellington. Two key aspects of perceived success are the course's relevance to architectural design and the variety of presentation. Teaching methods, teaching aids and useful references are provided. The evaluation of the courses considered in the case study is discussed, and postgraduate and post-graduation seismic education in New Zealand is reviewed.

The objectives of this study were to perform an economic evaluation of a targeted school-based dental checkup program in northern metropolitan Melbourne, Victoria. A 12-mo retrospective case-control cohort analysis using the decision tree method evaluated the incremental cost-utility and cost-effectiveness ratio (ICUR/ICER) for passive standard care dental services and an outreach pilot intervention completed in 2013. A societal perspective was adopted. A total of 273 children ( n = 273) aged between 3 and 12 y met the inclusion/exclusion criteria: 128 in the standard care group and 145 in the intervention group. The total society costs included health sector costs, patient/family costs, and productivity losses in 2014 Australian dollars. Outcome measures were evaluated using quality-adjusted tooth years (QATY) and the combined deciduous and permanent decayed, missing, and filled teeth prevented (DMFT-prevented). A generic outcome variable was created to determine the impact of the intervention to reach underserved populations based on government concession eligibility (cardholder status). Uncertainties were incorporated using 95% confidence intervals. The mean total society cost per child is $463 and $291 ( P = 0.002), QATY utility difference is 0.283 and 0.293 ( P = 0.937), effectiveness difference is 0.16 and 0.10 ( P = 0.756), and cardholder status is 50.0% and 66.2% ( P = 0.007), respectively, for the standard care and intervention groups. On average per child, there was a cost saving of $172 and improvement of 0.01 QATY, with an additional proportion of 16.2% of cardholder children reached. The calculated ICER was $3,252 per DMFT-prevented. The intervention dominates standard care for QATY and per 1% cardholder reached outcome measures. Our study found the pilot checkup program was largely less costly and more effective compared with the current standard care. Further research is needed to quantify the value of outreach interventions to prevent dental caries development and progression in populations from low socioeconomic status. Knowledge Transfer Statement: The findings of this research demonstrated that an outreach dental program can be less costly and more effective than standard models of dental care. It showed that a school-based dental checkup program is beneficial despite other opinions that dental screening is ineffective as a method to improve public dental health. There is fiscal economic evidence to support broader expansion of similar programs locally and internationally to reduce dental caries for children from low-income families.

Learning via online activities (e-learning) was introduced to facilitate existing face-to-face teaching to encourage more effective student preparation and then informed participation in an undergraduate physiology laboratory-based course. Active learning was encouraged by hypothesis formation and predictions prior to classes, with opportunities for students to amend their e-learning submissions after classes. Automatic or tutor feedback was provided on student submissions. Evaluation of the course was conducted via student questionnaires, individual student interviews, and analysis of student marks in examinations and of the e-learning component. Student feedback on this entire subject in the university-wide quality of teaching survey was very high by University of Melbourne standards and most encouraging for the first implementation of such a curriculum modification. Results from further detailed surveys of student interactions and engagement and correlation analysis between student responses were also very supportive of the effectiveness of the course. There were no significant differences between examination marks in the new course with e-learning and the previous year without e-learning. However, there was a significant correlation between assessment of student e-learning work and their final examination mark. Correlation analysis between various survey responses helped interpret results and strengthened arguments for e-learning and suggested future improvements for student use of e-learning. This mode of e-learning used to support face-to-face learning activities in the laboratory can be adapted for other disciplines and may assist students in developing a greater appreciation and a deeper approach for learning from their practical class experiences.

The National Cultural Policy Discussion Paper—drafted to assist the Australian Government in developing the first national Cultural Policy since Creative Nation nearly two decades ago—envisages a future in which arts, cultural and creative activities directly support the development of an inclusive, innovative and productive Australia. "The policy," it says, "will be based on an understanding that a creative nation produces a more inclusive society and a more expressive and confident citizenry by encouraging our ability to express, describe and share our diverse experiences—with each other and with the world" (Australian Government 3). Even a cursory reading of this Discussion Paper makes it clear that the question of impact—in aesthetic, cultural and economic terms—is central to the Government's agenda in developing a new Cultural Policy. Hand-in-hand with the notion of impact comes the process of measurement of progress. The Discussion Paper notes that progress "must be measurable, and the Government will invest in ways to assess the impact that the National Cultural Policy has on society and the economy" (11). If progress must be measurable, this raises questions about what arts, cultural and creative workers do, whether it is worth it, and whether they could be doing it better. In effect, the Discussion Paper pushes artsworkers ever closer to a climate in which they have to be skilled not just at making work, but at making the impact of this work clear to stakeholders. The Government in its plans for Australia's cultural future, is clearly most supportive of artsworkers who can do this, and the scholars, educators and employers who can best train the artsworkers of the future to do this. Teaching Artsworkers to Measure the Impact of Their Work: The Challenges How do we train artsworkers to assess, measure and articulate the impact of what they do? How do we prepare them to be ready to work in a climate that will—as the National Cultural Policy Discussion Paper makes clear—emphasise measuring impact, communicating impact, and communicating impact across aesthetic, cultural and economic categories? As educators delivering training in this area, the Discussion Paper has made this already compelling question even more pressing as we work to develop the career-ready graduates the Government seeks. Our program, the Master of Creative Industries (Creative Production & Arts Management) offered in the Creative Industries Faculty at Queensland University of Technology in Brisbane, Australia, is, like most programs in arts and cultural management in the US, UK, Europe and Australia, offering a three-Semester postgraduate program that allows students to develop the career-ready skills required to work as managers of arts, cultural or creative organisations. That we need to train our graduates to work not just as producers of plays, paintings or recordings, but as entrepreneurial arts advocates who can measure and articulate the value of their programs to others, is not news (Hadley "Creating" 647-48; cf. Brkic; Ebewo and Sirayi; Beckerman; Sikes). Our program—which offers training in arts policy, management, marketing and budgeting followed by training in entrepreneurship and a practical project—is already structured around this necessity. The question of how to teach students this diverse skill set is, however, still a subject of debate; and the question of how to teach students to measure the impact of this work is even more difficult. There is, of course, a body of literature on the impact of arts, cultural and creative activities, value and evaluation that has been developed over the past decade, particularly through landmark reports like Matarasso's Use or Ornament? The Social Impact of Participation in the Arts (1997) and the RAND Corporation's Gifts of the Muse: Reframing the Debate about the Benefits of the Arts (2004). There are also emergent studies in an Australian context: Madden's "Cautionary Note" on using economic impact studies in the arts (2001); case studies on arts and wellbeing by consultancy firm Effective Change (2003); case studies by DCITA (2003); the Asia Pacific Journal of Arts and Cultural Management (2009) issue on "value"; and Australia Council publications on arts, culture and economy. As Richards has explained, "evaluation is basically a straightforward concept. E-value-ation = a process of enquiry that allows a judgment of amount, value or worth to be made" (99). What makes arts evaluation difficult is not the concept, but the measurement of intangible values—aesthetic quality, expression, engagement or experience. In the literature, discussion has been plagued by debate about what is measured, what method is used, and whether subjective values can in fact be measured. Commentators note that in current practice, questions of value are still deferred because they are too difficult to measure (Bilton and Leary 52), discussed only in terms of economic measures such as market share or satisfaction which are statistically quantifiable (Belfiore and Bennett "Rethinking" 137), or done through un-rigorous surveys that draw only ambiguous, subjective, or selective responses (Merli 110). According to Belfiore and Bennett, Public debate about the value of the arts thus comes to be dominated by what might best be termed the cult of the measurable; and, of course, it is those disciplines primarily concerned with measurement, namely, economics and statistics, which are looked upon to find the evidence that will finally prove why the arts are so important to individuals and societies. A corollary of this is that the humanities are of little use in this investigation. ("Rethinking" 137) Accordingly, Ragsdale states, Arts organizations [still] need to find a way to assess their progress in …making great art that matters to people—as evidenced, perhaps, by increased enthusiasm, frequency of attendance, the capacity and desire to talk or write about one's experience, or in some other way respond to the experience, the curiosity to learn about the art form and the ideas encountered, the depth of emotional response, the quality of the social connections made, and the expansion of one's aesthetics over time. Commentators are still looking for a balanced approach (cf. Geursen and Rentschler; Falk and Dierkling), which evaluates aesthetic practices, business practices, audience response, and results for all parties, in tandem. An approach which evaluates intrinsic impacts, instrumental impacts, and the way each enables the other, in tandem—with an emphasis not on the numbers but on whether we are getting better at what we are doing. And, of course, allows evaluators of arts, cultural and creative activities to use creative arts methods—sketches, stories, bodily movements and relationships and so forth—to provide data to inform the assessment, so they can draw not just on statistical research methods but on arts, culture and humanities research methods. Teaching Artsworkers to Measure the Impact of Their Work: Our Approach As a result of this contested terrain, our method for training artsworkers to measure the impact of their programs has emerged not just from these debates—which tend to conclude by declaring the needs for better methods without providing them—but from a research-teaching nexus in which our own trial-and-error work as consultants to arts, cultural and educational organisations looking to measure the impact of or improve their programs has taught us what is effective. Each of us has worked as managers of professional associations such as Drama Australia and Australasian Association for Theatre, Drama and Performance Studies (ADSA), members of boards or committees for arts organisations such as Youth Arts Queensland and Young People and the Arts Australia (YPAA), as well as consultants to major cultural organisations like the Queensland Performing Arts Centre and the Brisbane Festival. The methods for measuring impact we have developed via this work are based not just on surveys and statistics, but on our own practice as scholars and producers of culture—and are therefore based in arts, culture and humanities approaches. As scholars, we investigate the way marginalised groups tell stories—particularly groups marked by age, gender, race or ability, using community, contemporary and public space performance practices (cf. Hadley, "Bree"; Gattenhof). What we have learned by bringing this sort of scholarly analysis into dialogue with a more systematised approach to articulating impact to government, stakeholders and sponsors is that there is no one-size-fits-all approach. What is needed, instead, is a toolkit, which incorporates central principles and stages, together with qualitative, quantitative and performative tools to track aesthetics, accessibility, inclusivity, capacity-building, creativity etc., as appropriate on a case-by-case basis. Whatever the approach, it is critical that the data track the relationship between the experience the artists, audience or stakeholders anticipated the activity should have, the aspects of the activity that enabled that experience to emerge (or not), and the effect of that (or not) for the arts organisation, their artists, their partners, or their audiences. The combination of methods needs to be selected in consultation with the arts organisation, and the negotiations typically need to include detailed discussion of what should be evaluated (aesthetics, access, inclusivity, or capacity), when it should be evaluated (before, during or after), and how the results should be communicated (including the difference between evaluation for reporting purposes and evaluation for program improvement purposes, and the difference between evaluation and related processes like reflection, documentary-making, or market research). Translating what we have learned through our cultural research and consultancy into a study package for students relies on an understanding of what they want from their study. This, typically, is practical career-ready skills. Students want to produce their own arts, or produce other people's arts, and most have not imagined themselves participating in meta-level processes in which they argue the value of arts, cultural and creative activities (Hadley, "Creating" 652). Accordingly, most have not thought of themselves as researchers, using cultural research methods to create reports that inform how the Australian government values, supports, and services the arts. The first step in teaching students to operate effectively as evaluators of arts, cultural and creative activities is, then, to re-orient their expectations to include this in their understanding of what artsworkers do, what skills artsworkers need, and where they deploy these skills. Simply handing over our own methods, as "the" methods, would not enable graduates to work effectively in a climate were one size will not fit all, and methods for evaluating impact need to be negotiated again for each new context. 1. Understanding the Need for Evaluation: Cause and Effect The first step in encouraging students to become effective evaluators is asking them to map their sector, the major stakeholders, the agendas, alignments and misalignments in what the various players are trying to achieve, and the programs, projects and products through which the players are trying to achieve it. This starting point is drawn from Program Theory—which, as Joon-Yee Kwok argues in her evaluation of the SPARK National Mentoring Program for Young and Emerging Artists (2010) is useful in evaluating cultural activities. The Program Theory approach starts with a flow chart that represents relationships between activities in a program, allowing evaluators to unpack some of the assumptions the program's producers have about what activities have what sort of effect, then test whether they are in fact having that sort of effect (cf. Hall and Hall). It could, for example, start with a flow chart representing the relationship between a community arts policy, a community arts organisation, a community-devised show it is producing, and a blog it has created because it assumes it will allow the public to become more interested in the show the participants are creating, to unpack the assumptions about the sort of effect this is supposed to have, and test whether this is in fact having this sort of effect. Masterclasses, conversations and debate with peers and industry professionals about the agendas, activities and assumptions underpinning programs in their sector allows students to look for elements that may be critical in their programs' ability to achieve (or not) an anticipated impact. In effect to start asking about, "the way things are done now, […] what things are done well, and […] what could be done better" (Australian Government 12).2. Understanding the Nature of Evaluation: PurposeOnce students have been alerted to the need to look for cause-effect assumptions that can determine whether or not their program, project or product is effective, they are asked to consider what data they should be developing about this, why, and for whom. Are they evaluating a program to account to government, stakeholders and sponsors for the money they have spent? To improve the way it works? To use that information to develop innovative new programs in future? In other words, who is the audience? Being aware of the many possible purposes and audiences for evaluation information can allow students to be clear not just about what needs to be evaluated, but the nature of the evaluation they will do—a largely statistical report, versus a narrative summary of experiences, emotions and effects—which may differ depending on the audience.3. Making Decisions about What to Evaluate: Priorities When setting out to measure the impact of arts, cultural or creative activities, many people try to measure everything, measure for the purposes of reporting, improvement and development using the same methods, or gather a range of different sorts of data in the hope that something in it will answer questions about whether an activity is having the anticipated effect, and, if so, how. We ask students to be more selective, making strategic decisions about which anticipated effects of a program, project or product need to be evaluated, whether the evaluation is for reporting, improvement or innovation purposes, and what information stakeholders most require. In addition to the concept of collecting data about critical points where programs succeed or fail in achieving a desired effect, and different approaches for reporting, improvement or development, we ask students to think about the different categories of effect that may be more or less interesting to different stakeholders. This is not an exhaustive list, or a list of things every evaluation should measure. It is a tool to demonstrate to would-be evaluators points of focus that could be developed, depending on the stakeholders' priorities, the purpose of the evaluation, and the critical points at which desired effects need to occur to ensure success. Without such framing, evaluators are likely to end up with unusable data, which become a difficulty to deal with rather than a benefit for the artsworkers, arts organisations or stakeholders. 4. Methods for Evaluation: Process To be effective, methods for collecting data about how arts, cultural or creative activities have (or fail to have) anticipated impact need to include conventional survey, interview and focus group style tools, and creative or performative tools such as discussion, documentation or observation. We encourage students to use creative practice to draw out people's experience of arts events—for example, observation, documentation still images, video or audio documentation, or facilitated development of sketches, stories or scenes about an experience, can be used to register and record people's feelings. These sorts of methods can capture what Mihaly Csikszentmihalyi calls "flow" of experience (cf. Belfiore and Bennett, "Determinants" 232)—for example, photos of a festival space at hourly intervals or the colours a child uses to convey memory of a performance can capture to flow of movement, engagement, and experience for spectators more clearly than statistics. These, together with conventional surveys or interviews that comment on the feelings expressed, allow for a combination of quantitative, qualitative and performative data to demonstrate impact. The approach becomes arts- and humanities- based, using arts methods to encourage people to talk, write or otherwise respond to their experience in terms of emotion, connection, community, or expansion of aesthetics. The evaluator still needs to draw out the meaning of the responses through content, text or discourse analysis, and teaching students how to do a content analysis of quantitative, qualitative and performative data is critical at this stage. When teaching students how to evaluate their data, our method encourages students not just to focus on the experience, or the effect of the experience, but the relationship between the two—the things that act as "enablers" "determinants" (White and Hede; Belfiore and Bennett, "Determinants" passim) of effect. This approach allows the evaluator to use a combination of conventional and creative methods to describe not just what effect an activity had, but, more critically, what enabled it to have that effect, providing a firmer platform for discussing the impact, and how it could be replicated, developed or deepened next time, than a list of effects and numbers of people who felt those effects alone. 5. Communicating Results: Politics Often arts, cultural or creative organisations can be concerned about the image of their work an evaluation will create. The final step in our approach is to alert students to the professional, political and ethical implications of evaluation. Students learn to share their knowledge with organisations, encouraging them to see the value of reporting both correct and incorrect assumptions about the impact of their activities, as part of a continuous improvement process. Then we assist them in drawing the results of this sort of cultural research into planning, development and training documents which may assist the organisation in improving in the future. In effect, it is about encouraging organisations to take the Australian government at its word when, in the National Cultural Policy Discussion Paper, it says it that measuring impact is about measuring progress—what we do well, what we could do better, and how, not just success statistics about who is most successful—as it is this that will ultimately be most useful in creating an inclusive, innovative, productive Australia. Teaching Artsworkers to Measure the Impact of Their Work: The Impact of Our Approach What, then, is the impact of our training on graduates' ability to measure the impact of work? Have we made measurable progress in our efforts to teach artsworkers to assess and articulate the impact of their work? The MCI (CP&AM) has been offered for three years. Our approach is still emergent and experimental. We have, though, identified a number of impacts of our work. First, our students are less fearful of becoming involved in measuring the value or impact of arts, cultural and creative programs. This is evidenced by the number who chooses to do some sort of evaluation for their Major Project, a 15,000 word individual project or internship which concludes their degree. Of the 50 or so students who have reached the Major Project in three years—35 completed and 15 in planning for 2012—about a third have incorporated evaluation into their Major Project. This includes evaluation of sector, business or producing models (5), youth arts and youth arts mentorship programs (4), audience development programs (2), touring programs (4), and even other arts management training programs (1). Indeed, after internships in programming or producing roles, this work—aligned with the Government's interest in improving training of young artists, touring, audience development, and economic development—has become a most popular Major Project option. This has enabled students to work with a range of arts, cultural and creative organisations, share their training—their methods, their understanding of what their methods can measure, when, and how—with Industry. Second, this Industry-engaged training has helped graduates in securing employment. This is evidenced by the fact that graduates have gone on to be employed with organisations they have interned with as part of their Major Project, or other organisations, including some of Brisbane's biggest cultural organisations—local and state government departments, Queensland Performing Arts Centre, Brisbane Festival, Metro Arts, Backbone Youth Arts, and Youth Arts Queensland, amongst others. Thirdly, graduates' contribution to local organisations and industry has increased the profile of a relatively new program. This is evidenced by the fact that it enrols 40 to 50 new students a year across Graduate Certificate / MCI (CP&AM) programs, typically two thirds domestic students and one third international students from Canada, Germany, France, Denmark, Norway and, of course, China. Indeed, some students are now disseminating this work globally, undertaking their Major Project as an internship or industry project with an organisation overseas. In effect, our training's impact emerges not just from our research, or our training, but from the fact that our graduates disseminate our approach to a range of arts, cultural and creative organisations in a practical way. We have, as a result, expanded the audience for this approach, and the number of people and contexts via which it is being adapted and made useful. Whilst few of students come into our program with a desire to do this sort of work, or even a working knowledge of the policy that informs it, on completion many consider it a viable part of their practice and career pathway. When they realise what they can achieve, and what it can mean to the organisations they work with, they do incorporate research, research consultant and government roles as part of their career portfolio, and thus make a contribution to the strong cultural sector the Government envisages in the National Cultural Policy Discussion Paper. Our work as scholars, practitioners and educators has thus enabled us to take a long-term, processual and grassroots approach to reshaping agendas for approaches to this form of cultural research, as our practices are adopted and adapted by students and industry stakeholders. Given the challenges commentators have identified in creating and disseminating effective evaluation methods in arts over the past decade, this, for us—though by no means work that is complete—does count as measurable progress. References Beckerman, Gary. "Adventuring Arts Entrepreneurship Curricula in Higher Education: An Examination of Present Efforts, Obstacles, and Best pPractices." The Journal of Arts Management, Law, and Society 37.2 (2007): 87-112. Belfiore, Eleaonora, and Oliver Bennett. "Determinants of Impact: Towards a Better Understanding of Encounters with the Arts." Cultural Trends 16.3 (2007): 225-75. ———. "Rethinking the Social Impacts of the Arts." International Journal of Cultural Policy 13.2 (2007): 135-51. Bilton, Chris, and Ruth Leary. "What Can Managers Do for Creativity? Brokering Creativity in the Creative Industries." International Journal of Cultural Policy 8.1 (2002): 49-64. Brkic, Aleksandar. "Teaching Arts Management: Where Did We Lose the Core Ideas?" Journal of Arts Management, Law and Society 38.4 (2009): 270-80. Czikszentmihalyi, Mihaly. "A Systems Perspective on Creativity." Creative Management. Ed. Jane Henry. Sage: London, 2001. 11-26. Australian Government. "National Cultural Policy Discussion Paper." Department of Prime Minster and Cabinet – Office for the Arts 2011. 1 Oct. 2011 ‹http://culture.arts.gov.au/discussion-paper›. Ebewo, Patrick, and Mzo Sirayi. "The Concept of Arts/Cultural Management: A Critical Reflection." Journal of Arts Management, Law and Society 38.4 (2009): 281-95. Effective Change and VicHealth. Creative Connections: Promoting Mental Health and Wellbeing through Community Arts Participation 2003. 1 Oct. 2011 ‹http://www.vichealth.vic.gov.au/en/Publications/Social-connection/Creative-Connections.aspx›. Effective Change. Evaluating Community Arts and Community Well Being 2003. 1 Oct. 2011 ‹http://www.arts.vic.gov.au/Research_and_Resources/Resources/Evaluating_Community_Arts_and_Wellbeing›. Falk, John H., and Lynn. D Dierking. "Re-Envisioning Success in the Cultural Sector." Cultural Trends 17.4 (2008): 233-46. Gattenhof, Sandra. "Sandra Gattenhof." QUT ePrints Article Repository. Queensland University of Technology, 2011. 1 Oct. 2011 ‹http://eprints.qut.edu.au/view/person/Gattenhof,_Sandra.html›. Geursen, Gus and Ruth Rentschler. "Unravelling Cultural Value." The Journal of Arts Management, Law and Society 33.3 (2003): 196-210. Hall, Irene and David Hall. Evaluation and Social Research: Introducing Small Scale Practice. London: Palgrave McMillan, 2004. Hadley, Bree. "Bree Hadley." QUT ePrints Article Repository. Queensland University of Technology, 2011. 1 Oct. 2011 ‹http://eprints.qut.edu.au/view/person/Hadley,_Bree.html›. ———. "Creating Successful Cultural Brokers: The Pros and Cons of a Community of Practice Approach in Arts Management Education." Asia Pacific Journal of Arts and Cultural Management 8.1 (2011): 645-59. Kwok, Joon. When Sparks Fly: Developing Formal Mentoring Programs for the Career Development of Young and Emerging Artists. Masters Thesis. Brisbane: Queensland University of Technology, 2010. Madden, Christopher. "Using 'Economic' Impact Studies in Arts and Cultural Advocacy: A Cautionary Note." Media International Australia, Incorporating Culture & Policy 98 (2001): 161-78. Matarasso, Francis. Use or Ornament? The Social Impact of Participation in the Arts. Bournes Greens, Stroud: Comedia, 1997. McCarthy, Kevin. F., Elizabeth H. Ondaatje, Laura Zakaras, and Arthur Brooks. Gifts of the Muse: Reframing the Debate about the Benefits of the Arts. Santa Monica: RAND Corporation, 2004. Merli, Paola. "Evaluating the Social Impact of Participation in Arts Activities." International Journal of Cultural Policy 8.1 (2002): 107-18. Muir, Jan. The Regional Impact of Cultural Programs: Some Case Study Findings. Communications Research Unit - DCITA, 2003. Ragsdale, Diana. "Keynote - Surviving the Culture Change." Australia Council Arts Marketing Summit. Australia Council for the Arts: 2008. Richards, Alison. "Evaluation Approaches." Creative Collaboration: Artists and Communities. Melbourne: Victorian College of the Arts, University of Melbourne, 2006. Sikes, Michael. "Higher Education Training in Arts Administration: A Millennial and Metaphoric Reappraisal. Journal of Arts Management, Law and Society 30.2 (2000): 91-101.White, Tabitha, and Anne-Marie Hede. "Using Narrative Inquiry to Explore the Impact of Art on Individuals." Journal of Arts Management, Law, and Society 38.1 (2008): 19-35.

IntroductionThis article suggests extensions to the place of ‘national collections’ of Australia’s migration histories, and considers the role of regional libraries and museums in collecting, preserving, and making accessible the history of migration. The article describes a recent collaboration between the Bonegilla Migrant Experience site, the Albury LibraryMuseum and the regionally-based Charles Sturt University (CSU) to develop a virtual, three-dimensional tour of Bonegilla, a former migrant arrival centre. Through this, the role of regional collections as keeping places of migration memories and narratives outside of those institutions charged with preserving the nation’s memory is highlighted and explored.What Makes a Nation’s Memory?In 2018 the Australian Research Council (ARC) awarded a Linkage grant to a collaboration between two universities (RMIT and Deakin), and the National Library of Australia, State Library of South Australia, State Library of Victoria, and State Library of New South Wales titled “Representing Multicultural Australia in National and State Libraries” (LP170100222). This Linkage project aimed to “develop a new methodology for evaluating multicultural collections, and new policies and strategies to develop and provide access to these collections” (RMIT Centre for Urban Research).One planned output of the Linkage project was a conference, to be held in early 2019, titled “Collecting for a Society’s Memory: National and State Libraries in Culturally Diverse Societies.” The conference call for papers suggested themes that included an interrogation of the relationship between libraries and ‘the collecting sector’, but with a focus still on National and State Libraries (Boyd). As an aside, the correlation between libraries and memories seemed slightly incongruous here, as archives and museums in particular would also be key in this collecting (and preserving) society’s memory, and also the libraries that exist outside of the national and state capitals.It felt like the project and conference had a definite ‘national’ focus, with the ‘regional’ mentioned only briefly in a suggested theme.At the same time that I was reading this call for papers and about the Linkage, I was part of a CSU Learning and Teaching project to develop online learning materials for students in our Teacher Education programs (history in particular) based around the Bonegilla Migrant Arrival Centre in Wodonga, Victoria. This project uses three-dimensional film technology to bring students to the Centre site, where they can take an interactive, curriculum-based tour of the site. Alongside the interactive online tour, a series of curricula were developed to work with the Australian History Curriculum. I wondered why community-led collections like these in the regions fall to the side in discussions of a ‘national’ (aka institutional) memory, or as part of a representation of a multicultural Australia, such as in this Linkage.Before I start exploring this question I want to acknowledge the limitations of the ARC Linkage framework in terms of the project mentioned above, and that the work that is being done in the “Representing Multicultural Australia in National and State Libraries” project is of value to professional practice and community; in this article I am using the juxtaposition of the two projects as an impetus to interrogate the role of regional collaboration, and to argue for a notion of national memory as a regional collecting concern.Bonegilla: A Contested SiteFrom 1947 through to 1971 over 300,000 migrants to Australia passed through the Bonegilla Migrant Reception and Training Centre (“Bonegilla”) at a defining time in Australia’s immigration history, as post-World War II migration policies encompassed non-English speaking Europeans displaced by the war (Pennay "Remembering Bonegilla" 43). Bonegilla itself is a small settlement near the Hume Dam, 10 km from the New South Wales town of Albury and the Victorian town of Wodonga. Bonegilla was a former Army Camp repurposed to meet the settlement agendas of multiple Australian governments.New migrants spent weeks and months at Bonegilla, learning English, and securing work. The site was the largest (covering 130 hectares of land) and longest-lasting reception centre in post-war Australia, and has been confirmed bureaucratically as nationally significant, having been added to the National Heritage Register in 2007 (see Pennay “Remembering Bonegilla” for an in-depth discussion of this listing process). Bonegilla has played a part in defining and redefining Australia’s migrant and multicultural history through the years, with Bruce Pennay suggesting thatperhaps Bonegilla has warranted national notice as part of an officially initiated endeavour to develop a more inclusive narrative of nation, for the National Heritage List was almost contemporaneously expanded to include Myall Creek. Perhaps it is exemplary in raising questions about the roles of the nation and the community in reception and training that morph into modern day equivalents. (“Memories and Representations” 46)Given its national significance, both formally and colloquially, Bonegilla has provided rich material for critical thinking around, for example, Australian multicultural identity, migration commemorations and the construction of cultural memory. Alexandra Dellios argues that Bonegilla and its role in Australia’s memory is a contested site, and thatdespite criticisms from historians such as Persian and Ashton regarding Bonegilla’s adherence to a revisionist narrative of multicultural progress, visitor book comments, as well as exchanges and performances at reunions and festivals, demonstrate that visitors take what they will from available frameworks, and fill in the ‘gaps’ according to their own collective memories, needs and expectations. (1075)This recognition of Bonegilla as a significant, albeit “heritage noir” (Pennay, “Memories and Representations” 48), agent of Australia’s heritage and memory makes it a productive site to investigate the question of regional collections and collaborations in constructing a national memory.Recordkeeping: By Government and CommunityThe past decade has seen a growth in the prominence of community archives as places of memory for communities (for example Flinn; Flinn, Stevens, and Shepherd; Zavala et al.). This prominence has come through the recognition of community archives as both valid sites of study as well as repositories of memory. In turn, this body of knowledge has offered new ways to think about collection practices outside of the mainstream, where “communities can make collective decisions about what is of enduring value to them, shape collective memory of their own pasts, and control the means through which stories about their past are constructed” (Caswell, Cifor, and Ramirez 58). Jimmy Zavala, and colleagues, argue that these collections “challenge hierarchical structures of governance found in mainstream archival institutions” (212), and offer different perspectives to those kept on the official record. By recognising both the official record and the collections developed and developing outside of official repositories, there are opportunities to deepen understandings and interpretations of historical moments in time.There are at least three possible formal keeping places of memories for those who passed through, worked at, or lived alongside Bonegilla: the National Archives of Australia, the Albury LibraryMuseum in Albury, New South Wales, and the Bonegilla Migrant Experience site itself outside of Wodonga. There will of course be records in other national, state, local, and community repositories, along with newspaper articles, people’s homes, and oral lore that contribute to the narrative of Bonegilla memories, but the focus for this article are these three key sites as the main sources of primary source material about the Bonegilla experience.Official administrative and organisational records of activity during Bonegilla’s reception period are held at the National Archives of Australia in the national capital, Canberra; these records contribute to the memory of Bonegilla from a nation-state perspective, building an administrative record of the Centre’s history and of a significant period of migration in Australia’s past. Of note, Bonegilla was the only migrant centre that created its own records on site, and these records form part of the series known as NAA: A2567, NAA A2571 1949–56 and A2572 1957–71 (Hutchison 70). Records of local staff employed at the site will also be included in these administrative files. Very few of these records are publicly accessible online, although work is underway to provide enhanced online and analogue access to the popular arrival cards (NAA A2571 1949-56 and A2572 1957–71) onsite at Bonegilla (Pennay, personal communication) as they are in high demand by visitors to the site, who are often looking for traces of themselves or their families in the official record. The National Archives site Destination Australia is an example of an attempt by the holder of these administrative records to collect personal stories of this period in Australia’s history through an online photograph gallery and story register, but by 2019 less than 150 stories have been published to the site, which was launched in 2014 (National Archives of Australia).This national collection is complemented and enhanced by the Bonegilla Migration Collection at the Albury LibraryMuseum in southern New South Wales, which holds non-government records and memories of life at Bonegilla. This collection “contains over 20 sustained interviews; 357 personal history database entries; over 500 short memory pieces and 700 photographs” (Pennay “Memories and Representations” 45). It is a ‘live’ collection, growing through contributions to the Bonegilla Personal History Register by the migrants and others who experienced the Centre, and through an ongoing relationship with the current Bonegilla Migrant Experience site to act as a collection home for their materials.Alongside the collection in the LibraryMuseum, there is the collection of infrastructure at the Bonegilla Migrant Experience (BME) site itself. These buildings and other assets, and indeed the absence of buildings, plus the interpretative material developed by BME staff, give further depth and meaning to the lived experience of post-war migration to Australia. Whilst both of these collections are housed and managed by local government agencies, I suggest in this article that these collections can still be considered community archives, given the regional setting of the collections, and the community created records included in the collections.The choice to locate Bonegilla in a fairly isolated regional setting was a strategy of the governments of the time (Persian), and in turn has had an impact on how the site is accessed; by who, and how often (see Dellios for a discussion of the visitor numbers over the history of the Bonegilla Migrant Experience over its time as a commemorative and tourist site). The closest cities to Bonegilla, Albury and Wodonga, sit on the border of New South Wales and Victoria, separated by the Murray River and located 300 km from Melbourne and 550 km from Sydney. The ‘twin towns’ work collaboratively on many civic activities, and are an example of a 1970s-era regional development project that in the twenty-first century is still growing, despite the regional setting (Stein 345).This regional setting justifies a consideration of virtual, and online access to what some argue is a site of national memory loaded with place-based connections, with Jayne Persian arguing that “the most successful forays into commemoration of Bonegilla appear to be website-based and institution-led” (81). This sentiment is reflected in the motivation to create further online access points to Bonegilla, such as the one discussed in this article.Enhancing Teaching, Learning, and Public Access to CollectionsIn 2018 these concepts of significant heritage sites, community archives, national records, and an understanding of migration history came together in a regionally-based Teaching and Learning project funded through a CSU internal grant scheme. The scheme, designed to support scholarship and enhance learning and teaching at CSU, funded a small pilot project to pilot a virtual visit to a real-life destination: the Bonegilla Migrant Experience site. The project was designed to provide key teaching and learning material for students in CSU Education courses, and those training to teach history in particular, but also enhance virtual access to the site for the wider public.The project was developed as a partnership between CSU, Albury LibraryMuseum, and Bonegilla Migrant Experience, and formalised through a Memorandum of Understanding with shared intellectual property. The virtual visit includes a three-dimensional walkthrough created using Matterport software, intuitive navigation of the walkthrough, and four embedded videos linked with online investigation guides. The site is intended to help online visitors ‘do history’ by locating and evaluating sources related to a heritage site with many layers and voices, and whose narrative and history is contested and told through many lenses (Grover and Pennay).As you walk through the virtual site, you get a sense of the size and scope of the Migrant Arrival Centre. The current Bonegilla Migrant Experience site sits at Block 19, one of 24 blocks that formed part of the Centre in its peak time. The guiding path takes you through the Reception area and then to the ‘Beginning Place’, a purpose built interpretative structure that “introduces why people came to Australia searching for a new beginning” (Bonegilla site guide). Moving through, you pass markers on the walls and other surfaces that link through to further interpretative materials and investigation guides. These guides are designed to introduce K-10 students and their teachers to practices such as exploring online archives and thematic inquiry learning aligned to the Australian History Curriculum. Each guide is accompanied by teacher support material and further classroom activities.The guides prompt and guide visitors through an investigation of online archives, and other repositories, including sourcing files held by the National Archives of Australia, searching for newspaper accounts of controversial events through the National Library of Australia’s digital repository Trove, and access to personal testimonies of migrants and refugees through the Albury LibraryMuseum Bonegilla Migration Collection. Whilst designed to support teachers and students engaging with the Australian History Curriculum, these resources are available to the public. They provide visitors to the virtual site an opportunity to develop their own critical digital literacy skills and further their understanding of the official records along with the community created records such as those held by the Albury LibraryMuseum.The project partnership developed from existing relationships between cultural heritage professionals in the Albury Wodonga region along with new relationships developed for technology support from local companies. The project also reinforced the role of CSU, with its regional footprint, in being able to connect and activate regionally-based projects for community benefit along with teaching and learning outcomes.Regional CollaborationsLiz Bishoff argues for a “collaboration imperative” when it comes to the galleries, libraries, archives, and museums (GLAM) sector’s efficacy, and it is the collaborative nature of this project that I draw on in this article. Previous work has also suggested models of convergence, where multiple institutions in the GLAM sector become a single institution (Warren and Matthews 3). In fact the Albury LibraryMuseum is an example of this model. These converged models have been critiqued from resourcing, professionalisation and economic perspectives (see for example Jones; Hider et al.; Wellington), but in some cases for local government agencies especially, they are an effective way of delivering services to communities (Warren and Matthews 9). In the case of this virtual tour, the collaboration between local government and university agencies was temporal for the length of the project, where the pooling of skills, resources, and networks has enabled the development of the resource.In this project, the regional setting has allowed and taken advantage of an intimacy that I argue may not have been possible in a metropolitan or urban setting. The social intimacies of regional town living mean that jobs are often ‘for a long time (if not for life)’, lives intersect in more than a professional context, and that because there are few pathways or options for alternative work opportunities in the GLAM professions, there is a vested interest in progress and success in project-based work. The relationships that underpinned the Bonegilla virtual tour project reflect many of these social intimacies, which included former students, former colleagues, and family relationships.The project has modelled future strategies for collaboration, including open discussions about intellectual property created, the auspicing of financial arrangements and the shared professional skills and knowledge. There has been a significant enhancement of collaborative partnerships between stakeholders, along with further development of professional and personal networks.National Memories: Regional ConcernsThe focus of this article has been on records created about a significant period in Australia’s migration history, and the meaning that these records hold based on who created them, where they are held, and how they are accessed and interpreted. Using the case study of the development of a virtual tour of a significant site—Bonegilla—I have highlighted the value of regional, non-national collections in providing access to and understanding of national memories, and the importance of collaborative practice to working with these collections. These collections sit physically in the regional communities of Albury and Wodonga, along with at the National Archives of Australia in Canberra, where they are cared for by professional staff across the GLAM sector and accessed both physically and virtually by students, researchers, and those whose lives intersected with Bonegilla.From this, I argue that by understanding national and institutional recordkeeping spaces such as the National Archives of Australia as just one example of a place of ‘national memory’, we can make space for regional and community-based repositories as important and valuable sources of records about the lived experience of migration. Extending this further, I suggest a recognition of the role of the regional setting in enabling strong collaborations to make these records visible and accessible.Further research in this area could include exploring the possibility of giving meaning to the place of record creation, especially community records, and oral histories, and how collaborations are enabling this. In contrast to this question, I also suggest an exploration of the role of the Commonwealth staff who created the records during the period of Bonegilla’s existence, and their social and cultural history, to give more meaning and context to the setting of the currently held records.ReferencesBishoff, Liz. “The Collaboration Imperative.” Library Journal 129.1 (2004): 34–35.Boyd, Jodie. “Call for Papers: Collecting for a Society’s Memory: National and State Libraries in Culturally Diverse Societies.” 2018. 1 Apr. 2019 <https://networks.h-net.org/node/73374/announcements/2079324/collecting-society%E2%80%99s-memory-national-and-state-libraries>.Caswell, Michelle, Marika Cifor, and Mario H. Ramirez. “‘To Suddenly Discover Yourself Existing': Uncovering the Impact of Community Archives.” The American Archivist 79.1 (2016): 56–81.Dellios, Alexandra. “Marginal or Mainstream? Migrant Centres as Grassroots and Official Heritage.” International Journal of Heritage Studies 21.10 (2015): 1068–83.Flinn, Andrew. “Community Histories, Community Archives: Some Opportunities and Challenges.” Journal of the Society of Archivists 28.2 (2007): 151–76.Flinn, Andrew, Mary Stevens, and Elizabeth Shepherd. “Whose Memories, Whose Archives? Independent Community Archives, Autonomy and the Mainstream.” Archival Science 9.1–2 (2009): 71.Grover, Paul, and Bruce Pennay. “Learning & Teaching Grant Progress Report.” Albury Wodonga: Charles Sturt U, 2019.Hider, Philip, Mary Anne Kennan, Mary Carroll, and Jessie Lymn. “Exploring Potential Barriers to Lam Synergies in the Academy: Institutional Locations and Publishing Outlets.” The Expanding LIS Education Universe (2018): 104.Hutchison, Mary. “Accommodating Strangers: Commonwealth Government Records of Bonegilla and Other Migrant Accommodation Centres.” Public History Review 11 (2004): 63–79.Jones, Michael. “Innovation Study: Challenges and Opportunities for Australia’s Galleries, Libraries, Archives and Museums.” Archives & Manuscripts 43.2 (2015): 149–51.National Archives of Australia. “Snakes in the Laundry... and Other Horrors”. Canberra, 29 May 2014. <http://www.naa.gov.au/about-us/media/media-releases/2014/25.aspx>.Pennay, Bruce. “‘But No One Can Say He Was Hungry’: Memories and Representations of Bonegilla Reception and Training Centre.” History Australia 9.1 (2012): 43–63.———. “Remembering Bonegilla: The Construction of a Public Memory Place at Block 19.” Public History Review 16 (2009): 43–63.Persian, Jayne. “Bonegilla: A Failed Narrative.” History Australia 9.1 (2012): 64–83.RMIT Centre for Urban Research. “Representing Multicultural Australia in National and State Libraries”. 2018. 11 Feb. 2019 <http://cur.org.au/project/representing-multicultural-australia-national-state-libraries/>.Stein, Clara. “The Growth and Development of Albury-Wodonga 1972–2006: United and Divided.” Macquarie U, 2012.Warren, Emily, and Graham Matthews. “Public Libraries, Museums and Physical Convergence: Context, Issues, Opportunities: A Literature Review Part 1.” Journal of Librarianship and Information Science (2018): 1–14.Wellington, Shannon. “Building Glamour: Converging Practice between Gallery, Library, Archive and Museum Entities in New Zealand Memory Institutions.” Wellington: Victoria U, 2013.Zavala, Jimmy, Alda Allina Migoni, Michelle Caswell, Noah Geraci, and Marika Cifor. “‘A Process Where We’re All at the Table’: Community Archives Challenging Dominant Modes of Archival Practice.” Archives and Manuscripts 45.3 (2017): 202–15.