Spain, cultural
What changed on this trip?
Across 36 students who answered both before and after the Spain, cultural trip, reported outcomes moved +0.12 points further than 24 students not travelling over the same weeks, on the four-point scale. Outcomes moved furthest relative to students not travelling in agency and self-management, though not clearly separated from social connection and belonging. Whether it lasted is not yet known; the follow-up wave has not closed. Results varied between students. Students not travelling were not randomly assigned, so this does not prove the trip caused the change.
What changed for students?
| Outcome domain | Change just after | Matched | Before | Just after |
|---|---|---|---|---|
| Learning and educational value | +0.05−0.11 to +0.20 | 36 / 24 | 2.88 | 3.03 |
| Agency and self-management | +0.25+0.06 to +0.44 | 36 / 24 | 2.82 | 3.05 |
| Social connection and belonging | +0.20+0.05 to +0.35 | 36 / 24 | 3.02 | 3.17 |
| Perspective and accomplishment | −0.05−0.24 to +0.14 | 36 / 24 | 3.32 | 3.24 |
| Overall | +0.12+0.03 to +0.22 | 36 / 24 | 3.01 | 3.12 |
- Learning and educational valueChange just after+0.05−0.11 to +0.20
- Agency and self-managementChange just after+0.25+0.06 to +0.44
- Social connection and belongingChange just after+0.20+0.05 to +0.35
- Perspective and accomplishmentChange just after−0.05−0.24 to +0.14
- OverallChange just after+0.12+0.03 to +0.22
- Changes are in points on the four-point scale, with the 95% interval under each, for students who answered before and at that wave. Matched is their number for each change column, travelling against not travelling. Change is measured against students not travelling over the same weeks. The means are over everyone who answered each wave, so they can differ from the change. The 4 weeks after column appears when that wave closes.
Grey dot: before. Coloured dot: just after. Both are means over everyone who answered that wave. Change against students not travelling is in the table above.
How answers were spread, light to dark from strongly disagree to strongly agree.
What changed on each question?
Single questions vary more than the domain scores above.
| Question | Change just after | Up · same · down | Matched |
|---|---|---|---|
| Learning and educational value | |||
| I want to learn more about new places and ideas.C01 | 0.00−0.24 to +0.24 | 9 · 18 · 9 | 36 |
| I listen well when I learn about new places or ideas.C02 | +0.28+0.01 to +0.54 | 13 · 18 · 5 | 36 |
| I ask questions when I want to know more.C13 | +0.11−0.13 to +0.35 | 11 · 18 · 7 | 36 |
| I can see how what I learn links to everyday life.C03 | +0.14−0.08 to +0.35 | 8 · 24 · 4 | 36 |
| I can explain what I have learned to someone else.C04 | +0.22−0.05 to +0.49 | 14 · 15 · 7 | 36 |
| I use what I learn in one place when I am somewhere else.C14 | +0.33+0.14 to +0.53 | 14 · 20 · 2 | 36 |
| Agency and self-management | |||
| I can cope when things are new to me.C05 | +0.19−0.06 to +0.45 | 12 · 18 · 6 | 36 |
| When something is hard, I can work out what to do next.C06 | +0.33+0.09 to +0.58 | 13 · 20 · 3 | 36 |
| If I keep trying, I can do most things.C15 | +0.17−0.11 to +0.44 | 13 · 15 · 8 | 36 |
| I do my jobs without an adult reminding me.C07 | +0.39+0.16 to +0.62 | 16 · 17 · 3 | 36 |
| I get on with a task even when no one is watching.C16 | +0.28−0.03 to +0.59 | 17 · 10 · 9 | 36 |
| I can stay calm and wait when things take time.C17 | +0.19−0.02 to +0.41 | 11 · 21 · 4 | 36 |
| Social connection and belonging | |||
| I feel that I belong in this class or group.C08 | +0.19−0.05 to +0.43 | 11 · 20 · 5 | 36 |
| I can work well with classmates I would not usually pick.C09 | +0.11−0.17 to +0.39 | 8 · 21 · 7 | 36 |
| There are people in my class I can count on.C18 | +0.14−0.13 to +0.41 | 9 · 22 · 5 | 36 |
| I try to understand people whose lives are different from mine.C10 | −0.03−0.26 to +0.21 | 6 · 22 · 8 | 36 |
| I listen to people even when I do not agree with them.C19 | +0.42+0.18 to +0.65 | 17 · 16 · 3 | 36 |
| Perspective and accomplishment | |||
| I think about how what I do affects other people and the world.C11 | 0.00−0.30 to +0.30 | 9 · 17 · 10 | 36 |
| I feel proud when I get better at something hard.C12 | −0.11−0.35 to +0.13 | 6 · 21 · 9 | 36 |
| I feel good about myself most of the time.C20 | −0.08−0.34 to +0.18 | 7 · 21 · 8 | 36 |
| I keep going with something until I have got it done.C21 | −0.06−0.25 to +0.14 | 5 · 24 · 7 | 36 |
- Learning and educational value
- I want to learn more about new places and ideas. C01Change just after0.00−0.24 to +0.24
- I listen well when I learn about new places or ideas. C02Change just after+0.28+0.01 to +0.54
- I ask questions when I want to know more. C13Change just after+0.11−0.13 to +0.35
- I can see how what I learn links to everyday life. C03Change just after+0.14−0.08 to +0.35
- I can explain what I have learned to someone else. C04Change just after+0.22−0.05 to +0.49
- I use what I learn in one place when I am somewhere else. C14Change just after+0.33+0.14 to +0.53
- Agency and self-management
- I can cope when things are new to me. C05Change just after+0.19−0.06 to +0.45
- When something is hard, I can work out what to do next. C06Change just after+0.33+0.09 to +0.58
- If I keep trying, I can do most things. C15Change just after+0.17−0.11 to +0.44
- I do my jobs without an adult reminding me. C07Change just after+0.39+0.16 to +0.62
- I get on with a task even when no one is watching. C16Change just after+0.28−0.03 to +0.59
- I can stay calm and wait when things take time. C17Change just after+0.19−0.02 to +0.41
- Social connection and belonging
- I feel that I belong in this class or group. C08Change just after+0.19−0.05 to +0.43
- I can work well with classmates I would not usually pick. C09Change just after+0.11−0.17 to +0.39
- There are people in my class I can count on. C18Change just after+0.14−0.13 to +0.41
- I try to understand people whose lives are different from mine. C10Change just after−0.03−0.26 to +0.21
- I listen to people even when I do not agree with them. C19Change just after+0.42+0.18 to +0.65
- Perspective and accomplishment
- I think about how what I do affects other people and the world. C11Change just after0.00−0.30 to +0.30
- I feel proud when I get better at something hard. C12Change just after−0.11−0.35 to +0.13
- I feel good about myself most of the time. C20Change just after−0.08−0.34 to +0.18
- I keep going with something until I have got it done. C21Change just after−0.06−0.25 to +0.14
- Changes are in points on the four-point scale, with the 95% interval under each, for students who answered the question before and at that wave: 36 just after. Up, same and down count them just after, by whole points. Each wave's means are in the section above, over everyone who answered it.
- These are the travelling students' own changes, before any comparison with students not travelling.
Did the change last?
The follow-up wave is open now. This appears when it closes.
How many students improved, and who did not?
Most students scored higher: of 36 students who answered both waves, 72% scored higher after the trip, 8% the same and 19% lower. Counting only movement larger than measurement error, 25% improved and 6% declined.
Share of students whose score fell (left) or rose (right) after the trip, counting any movement; the share that stayed the same is beside each row. Students who answered both waves: learning and educational value 36, agency and self-management 36, social connection and belonging 36, perspective and accomplishment 36, overall 36.
Half-point steps from −2 to +2; the black tick is the median. A student already at the top of the scale cannot register a gain.
Did change exceed that of students not travelling?
On students who answered both waves, the difference in change between Spain, cultural and students awaiting the Ski, Austria trip was +0.12 points overall, 36 against 24.
Axis 2.5 to 3.5 of the 1 to 4 scale.
- Everyone who answered at each wave: Spain, cultural 39, Ski, Austria 25. Both groups answered the same items on the same dates; students were not randomly assigned.
- 95% interval for the difference +0.03 to +0.22.
How well was the experience designed?
Reflection, Autonomy and Novelty had the lowest ratings on this trip.
How the trip was run, rated by 39 students, days after the trip. Shared with the operator. The priorities below compare each dimension with the platform median where there is one, so a dimension rated low here can still be ahead of other trips.
Every question, as students read it
| Question | Mean | Students |
|---|---|---|
| PreparationBefore we left, I knew what we would be doing and why. | 3.0 | 39 |
| NoveltySomeone explained the new parts of the trip before they happened. | 2.9 | 39 |
| ChallengeThe activities made me try hard, but they were not too hard. | 3.2 | 39 |
| AutonomyThere were times when we made real choices ourselves. | 2.9 | 39 |
| EducatorThe adults in charge explained things clearly and listened to us. | 3.3 | 39 |
| ReflectionWe had time to think or talk about what we had done. | 2.6 | 39 |
| GroupI worked in small groups where everyone took part. | 3.0 | 39 |
| TransitionsMoving from one place to the next was calm and well organised. | 3.1 | 39 |
- PreparationBefore we left, I knew what we would be doing and why.Mean3.0Students39
- NoveltySomeone explained the new parts of the trip before they happened.Mean2.9Students39
- ChallengeThe activities made me try hard, but they were not too hard.Mean3.2Students39
- AutonomyThere were times when we made real choices ourselves.Mean2.9Students39
- EducatorThe adults in charge explained things clearly and listened to us.Mean3.3Students39
- ReflectionWe had time to think or talk about what we had done.Mean2.6Students39
- GroupI worked in small groups where everyone took part.Mean3.0Students39
- TransitionsMoving from one place to the next was calm and well organised.Mean3.1Students39
Priorities for the next cultural and language trip
- 1Design small-group tasks where everyone has a part.Group was relatively weak, at 3.0 across 39 students against a platform median of 3.4.
- 2Plan calmer, better-organised moves between activities and places.Transitions was relatively weak, at 3.1 across 39 students against a platform median of 3.3.
- 3Prepare students for what the trip will involve before departure.Preparation was relatively weak, at 3.0 across 39 students against a platform median of 3.1.
Keep what is working: autonomy, reflection. Autonomy 2.9 against a platform median of 2.7, Reflection 2.6 against a platform median of 2.4.
- Set by fixed rules from the experience scores.
Who benefited: change by starting level
| Score before the trip | Students | Change | Not travelling |
|---|---|---|---|
| Below 2.67 | 11 | +0.22 | withheld |
| 2.67 to below 3.24 | 12 | +0.09 | withheld |
| 3.24 and above | 13 | +0.16 | withheld |
By sex, where the school recorded it
| Group | Students | Started at | Change |
|---|---|---|---|
| Female | 17 | 3.04 | +0.13 |
| Male | withheld | — | withheld |
| Other | fewer than ten | — | withheld |
- Bands by score before the trip, split into thirds. Where many students share a score the bands are unequal, or one is empty; each is named by the scores it covers. Students who start low tend to rise and students who start high tend to fall whatever happens. Compare each band with students not travelling: a real difference is a gap between the two columns.
- 95% intervals: below 2.67 +0.03 to +0.40; 2.67 to below 3.24 −0.07 to +0.25; 3.24 and above +0.01 to +0.30.
- Sex was recorded for 31 of these 36 students. 95% intervals: female −0.01 to +0.26.
Data quality
- 39 of 42Before · complete
- 39 of 42Days after · complete
- 22 of 424 weeks after · open now
- Every figure is what students say about themselves. Definitions are on the methods page.
The statistics
Spain, cultural students moved further than Ski, Austria students not yet travelling on two of the four outcome domains, over the same weeks.
On the two remaining domains there was no clear change. With 36 students matched against 24, this trip can pick up moderate differences but not small ones: a real change smaller than g = 0.32 would probably not show here.
- Learning and educational value. Points up, but this group is too small to tell it apart from normal variation.
- Agency and self-management. Moved up further than students not travelling. Clear enough to report.
- Social connection and belonging. Moved up further than students not travelling. Clear enough to report.
- Perspective and accomplishment. Points down, but this group is too small to tell it apart from normal variation.
Hedges' g with 95% intervals, difference in change against the comparison group, for students who answered both waves.
Dot: estimated change. Line: the 95% interval. Shaded band: changes smaller than this group could detect; a grey dot sits inside its band.
| Measure | Points | 95% interval | g | 95% interval | Cliff’s δ | Matched n | Smallest detectable |
|---|---|---|---|---|---|---|---|
| Overall | +0.12 | +0.03 to +0.22 | +0.25 | +0.05 to +0.44 | +0.35 medium | 36 / 24 | g ≥ 0.32 |
| Learning and educational value | +0.05 | −0.11 to +0.20 | +0.09 | −0.19 to +0.36 | +0.10 negligible | 36 / 24 | g ≥ 0.39 |
| Agency and self-management | +0.25 | +0.06 to +0.44 | +0.50 | +0.13 to +0.86 | +0.34 medium | 36 / 24 | g ≥ 0.58 |
| Social connection and belonging | +0.20 | +0.05 to +0.35 | +0.37 | +0.08 to +0.65 | +0.32 small | 36 / 24 | g ≥ 0.45 |
| Perspective and accomplishment | −0.05 | −0.24 to +0.14 | −0.10 | −0.45 to +0.26 | −0.13 negligible | 36 / 24 | g ≥ 0.54 |
- OverallPoints+0.1295% interval+0.03 to +0.22g+0.2595% interval+0.05 to +0.44Cliff’s δ+0.35 mediumMatched n36 / 24Smallest detectableg ≥ 0.32
- Learning and educational valuePoints+0.0595% interval−0.11 to +0.20g+0.0995% interval−0.19 to +0.36Cliff’s δ+0.10 negligibleMatched n36 / 24Smallest detectableg ≥ 0.39
- Agency and self-managementPoints+0.2595% interval+0.06 to +0.44g+0.5095% interval+0.13 to +0.86Cliff’s δ+0.34 mediumMatched n36 / 24Smallest detectableg ≥ 0.58
- Social connection and belongingPoints+0.2095% interval+0.05 to +0.35g+0.3795% interval+0.08 to +0.65Cliff’s δ+0.32 smallMatched n36 / 24Smallest detectableg ≥ 0.45
- Perspective and accomplishmentPoints−0.0595% interval−0.24 to +0.14g−0.1095% interval−0.45 to +0.26Cliff’s δ−0.13 negligibleMatched n36 / 24Smallest detectableg ≥ 0.54
Where an interval excludes zero, the change is larger than this group's normal variation. Where it includes zero, the change is unresolved. An interval lying wholly within ±0.10 is read as no change worth reporting, or, where it also excludes zero, as a change too small to matter. Cliff’s δ is the chance a travelling student’s change beats a comparison student’s, minus the reverse. An estimate can clear zero and still sit inside the shaded band; treat that size as an upper bound.
Reliability of the scales
Cronbach’s α before the trip, beside each scale’s item count. Short scales cap α.
- Learning and educational value0.82 · 6 items
- Agency and self-management0.84 · 6 items
- Social connection and belonging0.81 · 5 items
- Perspective and accomplishment0.77 · 4 items
Change beyond measurement error
Per student, on the overall score.
- 25% improved
- 69% no reliable change
- 6% declined
n = 36 · α = 0.94 · a change counts beyond 0.30 scale points.
How each figure is calculated is on the methods page.