Sing with Us A choir evaluation April 06
Contents. Acknowledgements.... Methods.... Findings.... Open Ended Questions... 5. The Best thing...
. Acknowledgements Many thanks to the choir leaders who so diligently assisted to ensure questionnaires were distributed, collected and returned on time. A massive thank you to all the participants from all the choirs who gave responses. A particular thank you must go to City Voices Cardiff who agreed to also take part in the project. Their responses provide a very interesting comparison to our own.
. Methods Back to Top This project used a simple survey design. A questionnaire was distributed to all members of Sing With Us Choirs (except Cardiff South who had been running less than weeks at the time of the project and the Office Choir which operates in a different way to the other choirs.) Participants were given three weeks to complete the questionnaire. This meant that participants could complete the questionnaire immediately, take it away and return or complete and send by post. It also meant it gave the greatest chance of collecting data as from as many participants as possible including those who may not attend choir regularly. The questionnaire included a variety of types of questions. This included statements which Likert scaling as well as questions which allowed for more open answers. The closed questions could be quantified and measured through finding averages. The open answers were thematically coded and, again measured for frequency. In total 5 Sing With Us Choirs took part in the project as well as a non Sing With Us Choir called City Voices Cardiff. Overall, the 6 Sing With Us Choirs were analysed collectively with City Voices measured in exactly the same way but separately. This meant that in addition to analysing the findings from the choirs, the results could be compared for initial trends. Finally, two questions were broken down and analysed per choir (see appendix ).
. Findings Back to Top In total 78 Sing with Us choir members participated in the project. This represents approximately 70.% of the total Sing With Us Choir membership. 9 members of the City Voices choir participated in the survey. This represents approximately 5%. Choir Members per choir by % Abergavenny 5. 8.0 6.9. 5.0 Aberystwyth Bangor Barry Bridgend Carmarthen. 6.7 6.5 Cwmbran Guildford Llandudno Llanelli Llanidloes 5.6.0. 6..8 7.6..9 Merthyr Tydfil North Cardiff Pontypridd Swansea Wrexham 5
Participants in Project by choir % 0. Abergavenny 5. 6.7 7.9. 5.5 5. Aberystwyth Bangor Barry Bridgend Carmarthen Cwmbran. 5. 6.0 Guildford Llandudno Llanelli Llanidloes 6..7. 6.9.7 7.. Merthyr Tydfil North Cardiff Pontypridd Swansea Wrexham Responses came from all choirs asked. As the two tables show, overall the breakdown of participants is representative of the size of the choirs. 6
How did you first hear about the SWU choir? %..9 Advert. 0.5.0..9 0.9 6... 8. 7.0 5.8 0..8 Another member Concert Facebook Family Friend Hospital Internet Leaflet Poster Professional. Support Group Through Tenovus Cancer Care Word of mouth The most common method for first hearing about the choir was through a friend (.%). Family came second with0.% respondents hearing of choir in this way. Therefore, over 50% of choir members heard about the choir from another person. Whilst it is unclear how friends and family first heard of the choirs, it does show the importance of ensuring that the choir is advertised in places over and above locations simply where patients are likely to be. It also suggests that many are more likely to respond to a personal contact. There are some interesting comparisons to be drawn here with the City Voices non-cancer choir. Whilst these respondents also reported a friend as a likely way to hear about the choir (0.%) the most likely method from City Voices was through the use of the internet (.8%). This is far higher than the.7% of respondents who used the internet to hear of the Sing with Us choir. Also, 8.% of SWU participants heard of the choir via an advertisement whilst this number was only.% of the City Voices choir. Along with the other data, this suggests that people are more likely to seek out a non-cancer related choir, expecting there to be one, whilst it is still important for Tenovus Cancer Care to use as many methods as possible to publicise the choirs, something that many may not equate to cancer. The following are the responses to statements: When the questions are positive statements, e.g. I find sing with us staff helpful, the score of 6 means the participant strongly agrees. When the statement is negative, e.g. I find the instruction confusing in rehearsals, the score of is positive because that means that the 7
individual strongly disagrees. Overall the scores for the statements are very positive. Whilst this is encouraging, it also means that additional analysis is required in order to observe where improvements can be made. For example it may be necessary to set the threshold for what success, looks like quite high. For example, with the average number of participants rating a positive statement either 5 or 6 being 90.% to find improvements it may be necessary to address statements below this average even though they might still be high. I find Sing with Us staff helpful SWU City Voices 79.0 58.7 0. 0.0 0.0. 0... 7.6 0. 6.5 0. 0.0. 95.8% of participants rated sing with us staff between 5 and 6 in terms of being helpful. Only 5 participants out of 78 rated the staff or below. City Voices responded to the same question with 89.% giving a score of 5 or 6. I find rehearsals run on time SWU City Voices 6.86.0 5.5.9.0 0.9 0.0 0.....5 0.. 8
As the graph above shows 89.% of participants ranked this statement 5 or 6 out of 6. However, caution must be taken here. 6.8% gave a 6 for this answer which is lower than the average percentage (7.9%) giving a 6 than the other statements. This % is more in line with the average 6 score given for a positive statement for City Voices choir. 85.9% of City Voices choir ranked this statement 5 or 6 out of 6. 6% gave a 6. I find the instructions in rehearsals confusing 66.6 6.0 SWU City Voices 0. 5.0 5.9.9..60.0.6.5 0..6..8 In the first question to use a negative statement, it shows that participants largely disagreed that instructions in rehearsals were confusing. 8.6% scored this statement between and suggesting they disagree. 9.% of respondents scored either a 5 or 6 for this statement. Initially, this might suggest that 9.% strongly agree that rehearsals are confusing. However, when compared to scores given for the other statements, this suggests that this number is influenced by the methods used to collect data. It appears likely that given this is the first negative statement, many of these participants failed to notice that the scoring for the statement had been reversed. It is difficult to know exactly how many failed to notice but, given the other scores, it seems reasonable to suggest that this can be as much out of the 9% of this score. City Voices seemed to score similarly with 88% scoring between and and 9.7% scoring 5-6. As questions below suggests, it is fair to assume that a higher percentage of participants in City Voices choir had an interest and experience of choirs and singing prior to joining than participants who attend SWU. Therefore this might suggest that SWU choir leaders are pitching their teaching at the right level to adjust for this. 9
I feel there should be more variety of songs in choir SWU City Voices 0.8. 9. 5.9 7.8. 0. 7.9 7.6 8.8 8.7 6.0.. 85.6% of participants did not agree that there should be more variety in choir. However,.9% of participants scored this statement between and 6 meaning that approximately 00 ( in 8) participants are inclined to agree that there should be more variety. Several of these may still be scoring their answer incorrectly but, as shown later, requests for different songs also appears when participants are given an open request for potential ideas to improve the choir. This is not unique to SWU choirs with nearly a third (.6%) also scoring between -6 for this statement. I enjoy attending choir SWU City Voices 85.0 67. 0. 0.0 0.. 0. 0.0 0.6.. 8. 5 6 A very high percentage reported enjoying attending choir with 97.% ranking this statement either a 5 or 6 with 85% giving a 6. Enjoying attending may be hardly surprising as if participants did not enjoy attending, they would stop doing so. However, 85% of the total number giving a 6 is still a very high satisfaction rate. City Voices choir also scored highly with 95.7% ranking the statement with either 5 or 6 (probably for similar reasons.) However, less scored the statement a 6 with 67.% doing so. 0
70.6 8.5.. I can get bored at choir SWU City Voices.8 0..8. 8.7.9 5. 0..9..8. In the next negative statement, 8.9% of individuals scored - for this statement, showing that participants largely disagree that they can get bored at choir. 7.9% scored a 5-6. 59.7% of participants gave - in the City Voices choir. I have made friends at choir SWU City Voices 69.0 65. 0.6 0.8.0. 0. 7.6.0.7 6.8 0..0 85.9% of participants scored this statement 5-6. This score is supported by the significant percentage of participants (56.%) who stated that friendship was the best thing to have come out of choir (see below). 79% of City Voices choir members also scored 5-6 though, as discussed later, it appears that in City Voices, friendship making was often a motivation for joining a SWU choir unlike a City Voices choir where it was more of a secondary outcome.
I feel I get support from other choir members SWU City Voices 65. 56.5 0..0. 5. 0. 8.0.9 7..0.0.5 5 6 Incomplete 86.% of participants scored this statement 5-6. Whilst this overall score is similar to the City Voices choir (8.7%) there is a noticeable difference in those that scored a 6 with almost 9% more participants giving this score in the SWU choirs. In a similar finding to discussing friendship, it is noticeable that many indicated support as an important factor in both joining the choir in the first place and the best thing about the choir (see below). In City Voices choir, whilst many might indicate that they get support when asked it may be a different type of support and it is certainly not regarded as a primary reason for attending. I get on well with all choir members SWU City Voices 6.7 6. 0.0 0.8... 7. 8. 0..8 0. 9... 86.9% of participants scored this statement 5-6. 6.% rated it 6. This is the lowest percentage to rate this a 6 and 0% lower than the average. The reason for this is likely to be because participants were asked to comment if they got on with ALL choir members. The comments in the free text section suggest that some members would like to see more social events to get to know more/new members whilst a small percentage also suggesting that there were cliques in some choirs. Whilst the figures are small, this type of issue is possibly under-reported so may be worth considering.
Whilst 76% of the City Voices choir scored 5-6, only 9.% scored a 6. This choir has approximately 80 members, larger than any individual SWU choir so this might explain the lower score. It possibly adds quantifiable data to the assumption that the larger the choir, the harder it is to maintain a sense of community. However, this may only be part of the reason as 65% of the North Cardiff choir (who had 97 respondents) indicated friendship as one of the best things about their choir (see below). I feel choir has a positive atmosphere SWU City Voices 8.8 56.5 5.9 0. 0. 0...0 5.. 0.. 5 5.5 6 Incomplete 96.% of respondents scored between 5-6 for this statement. Again, this is also supported indirectly in the open text when members gave several examples where enthusiasm and positivity were frequently mentioned. This was often the enthusiasm for personal well-being, enjoyment and from the choir leaders. The positive atmosphere is a really important part of the purpose of the choir and the graph above suggests that it is working well. The 8.8% of participants who scored a 6 is significantly higher than the 56.5% who gave a 6 in City Voices choir. This seems indicative of the main differences between the two choirs. I feel I have more energy after attending choir SWU City Voices 6.8 0. 7.0.0 0. 0.6..7 7. 9.7 0.9 0.9 5 6 Incomplete
85.7% of participants scored this statement 5-6. This possibly provides some evidence to support the theory that choir can have a sense of physical benefit as well as psycho-social. 67.% of City Voices choir gave this score. Caution must be taken when making direct comparisons here. For example, the City Voices Choir sessions last over twice as long as SWU sessions and they are not primarily organised for this purpose either. However, it does suggest that the SWU choir sessions are organised and operated so that they are an effective way of providing more energy. 6.8% is below the average score to give a 6 but, given the demographic of the group, these are unsurprising and despite longer rehearsals being far and away the most common suggestion for improving the choir (see below), doing so may decrease this score further. I feel I can be myself at choir SWU City Voices 69.0 5.9 5.7 6.5 7. 8.7 0.9. 0.9.0 0. 0.0 0.9. 8.6% of participants reported that they can be themselves at choir. This is important as shown by many of the comments where individuals felt they were able to make friends, get a sense of personal well-being and are supported by others. However, what also seems important was the opportunity to forget other ongoing troubles so to this end perhaps some participants interpreted this question as an opportunity not to be themselves in this respect. SWU choir is not a major part of my life SWU City Voices.8.7 0.7 0. 9..09.6 0. 6.5.0 5. 7.6...7.
In the last statement framed in negative terminology, it seems that overall SWU choir does form a major part of the life of the participant. 5.% scored this statement - (meaning they disagree with the statement). When this question was asked to City Voices choirs, 5.% gave this score. Interestingly, in both choirs there is more of a spread across all of the potential scores. This suggests that individuals have different relationships with their corresponding choir. It is important for this to be recognised as putting too much pressure and emphasis on commitment might possibly have the potential to isolate some participants. I feel committed to choir SWU City Voices 6.5 5. 8.0. 0.5. 0... 9.0 8.7. 5 6 Incomplete Following on from the last statement, 87.9% of participants scored 5-6 showing they feel committed to their choir. This is a very similar score to City Voices (88.%). However, those that scored a 6 were 6.5% for Sing With Us. In City Voices the score was 5.%. This suggests that whilst the overall level of commitment to choir is quite similar in both choirs, there is a higher proportion that is very committed to the Sing With Us choir. I feel proud of being in a SWU choir SWU City Voices 8.9 75 0.5...8.8 0.. 5 5.5 6 Incomplete 5
95.8% of choir members scored 5-6 for the statement asking if they feel proud of being in a Sing With Us choir. Those scoring 5-6 in City Voices is similar at 97.8%. Similarly to the last statement, those scoring a 6 was higher in the Sing With Us choir (8.9%) than in the City Voices choir (75%) again suggesting that there is a greater proportion of those at the highest end in the SWU choir. It is possibly surprising that these scores are similar as it might be assumed that a SWU choir, standing for values in addition to making quality music, might attract a greater sense of pride than City Voices. However, this is explained when we consider the themes in the open text below. There are different reasons as to why members attend each of the choirs. Therefore, the sense of pride comes from whether they feel those agendas have been addressed. For example, in SWU, many people reported attending choir to represent cancer, fundraise of make friends. Many in City Voices attended due to the quality of the music produced. In both choirs, there is a feeling that these reasons are being achieved and therefore there is a high sense of pride. I would recommend SWU to others SWU City Voices 89. 78 0. 0.9 7.6 8.0 5 6 Incomplete 96.8% of participants would strongly recommend Sing With Us to others. This is exactly the same score with City Voices. Again, those scoring a 6 in Sing With Us (89.%) was higher than City Voices (78.%) reinforcing the suggestion from the last two statements that there is a higher percentage of very highly committed members in SWU. On average those scoring a 6 were 0.% higher for SWU than City Voices for the last statements. 6
Which of the following musical genres would you like the choir to sing? % % 75.9 6.6. 56.6 9.7 7. 6.. 0.0 Classical Indie Rock Jazz Musical Theatre Pop Motown Welsh language Other SWU choirs were also asked what genre they would like to sing. Participants were able to select as many genres as they wished and this is why the percentages above exceed 00%. Musical theatre was the most popular genre with 75.9% of participants selecting this. Indie was the least popular at.%. Other was made up of suggestions such as Blues, Gospel and Country and Western 7
. Open Ended Questions Participants were asked open questions and given space to write a response. Therefore, some answers were short, sometimes just one word, whilst others were a couple of lines. Themes that emerged from these answers were then coded and then themed. As new themes emerged, a new category was added. A category would have its own label if it was indicated by more than one participant. In many instances, participants would give two or more reasons as their answer and these reasons would be individually coded. The graphs below show what percentage of participants who answered the question gave a particular theme in their answer. The results below only report themes where over % of those who answered the question had identified them. Those that were less than % were culminated and described as other. First appealed about SWU choir %.9 % 8.8.. 5.8 6..... 5.9 5.9 7. 7.8 8.. 5. 6.5 5.0.5 8
First appealed about City Voices choir % % of those who answered the question 8.8 8.8 6. 5.0 5.0 7.5 6..8. 7.5.8.8 Participants were asked why they first decided to join the choir. This question looked to ascertain what they were looking for in a choir in the first place. We can see several differences between the two choirs. The first difference is that there was a larger variety of answers given by choir members in the SWU choirs. This seems obvious given that a greater number of people is likely to provide a greater variety. However, it does show that participants joining SWU choir for a very diverse number of reasons. It may be surprising to see that a larger number of participants in SWU choirs indicated that the reason they joined the choir was that they enjoyed singing (.9%) than in the City Voices choir (6.%). Many of those in the SWU choir, who gave this answer, did so alongside other answers such as socialising and relationship to cancer. It is likely that those in the City Voices choir thought it would be assumed that they enjoyed singing, so they did not immediately think to give this as an answer. We can see from the answers given that there seems to be a fundamental difference in the reasons the choirs are joined. If we look at the top 5 answers given, of the 5 in the Sing With Us choir are social (Friendship 8.8%, wanted to be involved with the charity 8.%, the atmosphere 7.8% and the social aspect 7.%). If we do the same for the City Voices choir we see that the reasons are more orientated towards music itself. The top answers include Choice of songs 8.8%, inclusivity 8.8%; enjoy singing 6.%, the atmosphere 5%, quality of choir and friendship, both 7.5%). Whilst reasons such as friendship and the atmosphere were popular reasons in City Voices, factors such as looking for support and a sense of It should be noted that the theme inclusivity in City Voices represented the open text answers which included that what most appealed was the lack of auditions. 9
community were all important in Sing with Us choirs where these were not mentioned in the City Voices choir. Best thing about SWU is % 56. % of those who answered question.6. 7. 0.5 6.9. 9.5 9.9.7. 5. 6. 5.. The best thing about City Voices is % % of those who answered the question 9.5 0.5 9...6. 7....5.9 6.0 8.. 0.9 Participants were asked what the best thing about their choir might be. Again, many would give several answers which were then individually themed. The two top answers for both 0
choirs was friendship followed by personal wellbeing. Under these answers, we see that in SWU, support (6.%) and the enthusiasm of the choir leader (5.%) are regarded as the best thing about choir. City Voices answers tend to be more focussed on the songs themselves such as choice of songs (0.5%), enjoyment of singing (9.%) and the quality of the choir (8.%). As discussed, despite being significantly the highest answer, friendship was not initially indicated by City Voices as the reason for attending in the first place but was the nd highest answer with SWU. Many attended SWU to find friendship and found it whilst in City Voices; this was a secondary outcome after the quality of the choir itself. If I could do one thing to improve SWU it would be % % who answered question.6 7.7 7.0 5..7.6.....5..9..9.6.6..6.
If I could do one thing to improve City Voices choir it would be % % who answered question 6..9..6..6 8..6.6.9...6..6.6.5 9.8 8..6..6.6 Finally, participants were asked to indicate what might improve their choir experience. Overall most only gave one answer but, again, some gave more than one answer which were each themed separately. Far fewer participants tended to answer this question. In SWU, the most popular answer is for rehearsals to last longer (.6%). The second issue was to change the venue. This could include a larger venue or a change of location. In City Voices, the two highest themes for improvement are for there to be more variety (6.%) in the songs and more socialising (.5%). It seems that SWU choirs are satisfied with the social element but want to do more singing whilst the City Voices choir are happy with the singing but want to do more socialising. The best thing about choir and one improvement which can be made have been separately analysed per choir. By doing this we can see that certain themes, such as choice of venue, can be localised to one choir more than others. This then has the potential to appear to be an issue generally when actually most choir are unaffected by it. By variety, participants are referring to the type of music that is sung.
5. The Best thing Back to Top The below graphs show the best thing about choir and the one thing to improve about choir by choir. Abergavenny the best thing 56.0 6.7 5. 5..0 9.0.0 9 0. 56.7. 5..0.0 9.7 7. Abergavenny to improve..5.7 5.0 8.8 8.8 5.0 8.0 5.9 5.9.0.0.0.0.0.0.0.0.0 5.9.9.9.9.9.9.9.0.9.9.9.9.9.9.0.0.0.0.0.0.0
Aberystwyth the best thing.7 7. 6. 0.5 7.9 7. 5 0.5 7.9 5..6 7.9 8 5..6 0.5 0 Aberystwyth to improve.7 6.7 6.7 6.7 8. 8. 5 Different learning methods Fundraising Increase members Longer rehersals More rehersals More variety
Bangor the best thing 58..8..8 5.6 6.7.9 6 5.8 8.9..8 5.6 6. 7.8 0 Bangor to improve. 6.7 0.0. 6.7 5 6.7 6.7 6.7 Better parking Bigger venue Longer rehersals More gigs More rehersals More variety More welsh songs Other 5
Barry the best thing 56.8 Total % 0.5 8. 0.8 8.9 7.7 0.8.7 0.8 5.7 5..6 8 6 6. Barry to improve Total % 5.8 5.8 0.5 0.5 5. 5. 5. 5. 5. 5. 5. 5. 5. 5. 6
Bridgend the best thing 5. 5. 0. 9. 7.0.7. 9. 9.. 5.6.. 9..7 Bridgend to improve 5 0 5 5 0 9 5 5 5 Input on choice of songs longer rehersals More continuity More members more men More variety other Quicken pace of learning 7
Carmarthen the best thing 5.5 6..5 0 8..6.6 9..5 8 9..7.7 5 5 Carmarthen Total % who answered question..... 7. 7. 7. Increase members Longer rehersals More members More variety Other Practice at home Sing in unison Sing songs already learned 8
Cwmbran the best thing Total % of those who answered question 58 0 5 9 8 0 5 6 8 9 8 6 8 6 8 Cwmbran to improve 9. 5. 5.8.8 7.7 5..8.8.8.8.8.5 7.7 9
Guildford the best thing.. 5.0 6.7 6.7 6.7 8. 8. 8. Guildford to improve 60 0 0 6 0 Be supplied with the music Increase members More gigs More variety 0
Llandudno the best thing 6.6 8.5 5.. 5... 5.5 6.8 9. 0.5 9 9. 9... 5 5 Llandudno to improve 7.6.8.8.8 5.9 5.9 5.9 5.9 5.9 5.9 5.9 5.9
Llanelli the best thing 50.0 5.5.5.6.6.6 9. 9..5 9..5 Llanelli to improve 5 6.7 8. 8. 8. 8. 8. 8. 8. Be supplied with the music Change time of gigs Increase choir members Longer More rehersals local gigs More variety More welsh songs Music available via the website sooner Sing songs already learned
Llanidloes the best thing 50.0 5..9 5.9 7 8.8.9.8.9.9 5.9 6 7.6 Llanidloes to improve 8.6... 7. 7. 7. 7. 7. Bigger venue Different uniform Increase choir members Less talking Longer More gigs More rehersals rehersals Other Sing songs already learned
Merthyr Tydfil the best thing 5.5..5.6 6...6 5 5 6.5..5 9 6.8 9.. 5 Merthyr Tydfil to improve 8.5.8 0.8.5 7.7.8 5..8.8.8.8.8
North Cardiff the best thing 66.0 6 7. 6. 6 6. 8. 8.. 9. 9... 8.6 8. 5 5.. North Cardiff to improve 9..8 0.5 0.5 6 6.5.5.0 8.5.8.8.8.5.8.8.8.5.8.5.5.8.5.5.8.8 5
Pontypridd the best thing 77. 5.7 7 8.6..9.9 6 8.6 0 8.6 5.7 Pontypridd to improve.7 8..6.6 9..5 5.5.5.5.5 6
Swansea the best thing 6.... 8 5.6. 7 8.9 5... 5 0 6.7. 5.6 7 Swansea to improve.8 9.5 9.5.8.8.8.8.8. 9.5.8.8.8.8.8 5 7
Wrexham the best thing 6.6 5.7 7 0 5.. 5.5 9 5.. 8.6 5 7. 0.. 7. 0 8.6. 5. 5 Wrexham to improve.8.. 9.5 9.5 9.5 9.5.8 5.8.8.8 8