Skip to content

Commit

Permalink
Add mean confidence per session
Browse files Browse the repository at this point in the history
  • Loading branch information
richelbilderbeek committed May 27, 2024
1 parent a8d8e43 commit 1c10887
Show file tree
Hide file tree
Showing 22 changed files with 153 additions and 12 deletions.
Binary file added evaluations/20240524/20240524_confidence.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
7 changes: 4 additions & 3 deletions lesson_plans/20230911/20230911_richel.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Lesson plan 2023-09-11 for Richel's lessons

* Intro to Bianca
* Richel
* [Reflection](../../reflections/20230911_richel.md)
- Date: 2023-09-11
- Course: Basic Bianca
- Teacher: Richel
- [Reflection](../../reflections/20230911/20230911_richel.md)

As preparation, with the team, we discussed the schedule, as well as the goals:

Expand Down
7 changes: 4 additions & 3 deletions lesson_plans/20231211/20231211_richel.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Lesson plan 2023-12-11

* Intro to Bianca
* Richel
* [Reflection](../../reflections/20231211_richel.md)
- Date: 2023-12-11
- Course: Basic Bianca
- Teacher: Richel
- [Reflection](../../reflections/20231211/20231211_richel.md)

This was the schedule for 'Intro to Bianca':

Expand Down
7 changes: 4 additions & 3 deletions lesson_plans/20231214/20231214_richel.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Lesson plan 2023-12-14

* Bianca In-Depth Hackathon
* Richel
* [Reflection](../../reflections/20231214_richel.md)
- Date: 2023-12-14
- Course: Bianca Intermediate
- Teacher: Richel
- [Reflection](../../reflections/20231214/20231214_richel.md)

This was the schedule for 'Bianca In-Depth Hackathon':

Expand Down
5 changes: 5 additions & 0 deletions lesson_plans/20240419/20240419_richel.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
# Lesson plan

- Date: 2024-04-19
- Course: Basic Bianca
- Teacher: Richel
- [Reflection](../../reflections/20240419/20240419_richel.md)

I will be teaching mostly in the morning:

When | Who | What
Expand Down
1 change: 1 addition & 0 deletions lesson_plans/20240524/20240524_richel.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
- Date: 2024-05-24
- Course: Intermediate Bianca
- Teacher: Richel
- [Reflection](../../reflections/20240524/20240524_richel.md)

I will be teaching at the start and end of the day:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

* Intro to Bianca
* Richel
* [Lesson plan](../lesson_plans/20230911/20230911_richel.md)
* [Lesson plan](../../lesson_plans/20230911/20230911_richel.md)

I spent quite some time to prepare my lectures and I think I did a good job
there. However -as happens more often- I felt without energy when
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

* Intro to Bianca
* Richel
* [Lesson plan](../lesson_plans/20231211/20231211_richel.md)
* [Lesson plan](../../lesson_plans/20231211/20231211_richel.md)

Monday 11th Dec 2023 was the first time we ran the 'Intro to Bianca'
course with the idea of that day being suitable for complete beginners,
Expand Down
File renamed without changes
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

* Bianca In-Depth Hackathon
* Richel
* [Lesson plan](../lesson_plans/20231214/20231214_richel.md)
* [Lesson plan](../../lesson_plans/20231214/20231214_richel.md)

Thursday 14th Dec 2023 was the first time we ran the 'Bianca In-Depth Hackathon'
course, with the idea of that day being suitable for experience users,
Expand Down
File renamed without changes
File renamed without changes.
Binary file added reflections/20240525/20240524_confidence.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added reflections/20240525/20240524_enough_time.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
38 changes: 38 additions & 0 deletions reflections/20240525/20240525_richel.md
Original file line number Diff line number Diff line change
Expand Up @@ -162,12 +162,50 @@ I checked the breakout rooms regularily and
was commonly (as I encouraged them!) ignored:
they were busy reading. I was happy with that.

## 2025-05-27

OK, I make a rougher evaluation now:

- Our newest team member showed up in the Zoom.
I set him to work. I told him some ideas behind my teachings.
There were other colleagues in the Zoom room too, but they had to teach
after my session, so I let them prepare their sessions instead

Taking a look at the amount of learners in time

![](n_learners_in_time.png)

- One learner was on time out of the 6 that would arrive in the first 6 minutes
- During the break, 4 left. I can explain 2:
- One person just started using Bianca and was in the wrong course
- One person came for the Slurm part only (although he'd come back at 13:18
for a short while)


## Evaluation

We had 4 learners filling in an evaluation.
These were all the learners that stayed around till the end,
hence a bias for the persistent learners.
I announced the link to the evaluation at the start of the day,
in the hope of catching the complete set of learners.

We decided to do an evaluation by looking at the raw evaluation results.
I suggested to look at it later. The colleagues, however, wanted to take
a look together and immediately.

We, including me, drew the wrong conclusions about which sessions scheduled
enough time for exercises.
The Google Form image, that I just took a screenshot of, shows a trend I can understand:

![Evaluation result for enough time](20240524_enough_time.png)

Out of the 4 learners there was 1 that wrote 'more time'
at 'In the course, what should we improve?'.

Also, the confidences that learners had were hard to interpret:

![Evaluation result on confidence](20240524_confidence.png)



41 changes: 41 additions & 0 deletions reflections/20240525/create_confidence_plot.R
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
#!/bin/env Rscript
raw_table <- readr::read_csv(
"20240524.csv"
)

remove_irrevant_cols <- function(t) {
t$Tidstämpel <- NULL
t$`In the course, what should we keep doing?` <- NULL
t$`In the course, which section(s) scheduled enough time for exercises?` <- NULL
t$`In the course, what should we improve?` <- NULL
t$`Are there any other comments on the course?` <- NULL
names(t) <- stringr::str_extract(names(t), pattern = "\\[.*\\]")
names(t) <- stringr::str_sub(names(t), start = 2, end = -2)
t
}

google_forms_table <- remove_irrevant_cols(t = raw_table)
table_with_rowname <- t(google_forms_table)

# No rownames
table <- tibble::tibble(matrix(nrow = nrow(table_with_rowname), ncol = 5))
table[ , 1] <- rownames(table_with_rowname)
table[ , 2:5] <- table_with_rowname[ , 1:4]
names(table) <- c("session", paste0("learner_", 1:4))
table

tidy_table <- tidyr::pivot_longer(table, cols = 2:5)

confidence_per_topic <- dplyr::summarise(
dplyr::group_by(tidy_table, session),
mean_confidence = mean(value)
)
confidence_per_topic
ggplot2::ggplot(
data = confidence_per_topic,
mapping = ggplot2::aes(x = session, y = mean_confidence)
) + ggplot2::geom_col() +
ggplot2::scale_y_continuous(limits = c(0, 5)) +
ggplot2::theme(axis.text.x = ggplot2::element_text(angle = 90, vjust = 0.5, hjust=1))

ggplot2::ggsave("mean_confidence_per_session.png", height = 7)
33 changes: 33 additions & 0 deletions reflections/20240525/create_n_learners_in_time_plot.R
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
#!/bin/env Rscript
n_learners_in_time <- readr::read_csv(
"learners_in_time.csv"
)

ggplot2::ggplot(
data = n_learners_in_time,
mapping = ggplot2::aes(x = time, y = n_learners)
) + ggplot2::geom_line(
) + ggplot2::geom_rect(mapping = ggplot2::aes(
xmin = readr::parse_time("9:00"),
xmax = readr::parse_time("10:20"),
ymin = 0,
ymax = 8
), fill = ggplot2::alpha("orange", 0.01)
) + ggplot2::geom_rect(mapping = ggplot2::aes(
xmin = readr::parse_time("15:30"),
xmax = readr::parse_time("16:00"),
ymin = 0,
ymax = 8
), fill = ggplot2::alpha("orange", 0.01)
) + ggplot2::geom_rect(mapping = ggplot2::aes(
xmin = readr::parse_time("12:06"),
xmax = readr::parse_time("13:00"),
ymin = 0,
ymax = 8
), fill = ggplot2::alpha("blue", 0.01)
) + ggplot2::theme(text = ggplot2::element_text(size = 20)) +
ggplot2::labs(
title = "Number of learners in time",
caption = "Intermediate Bianca, 2024-05-25, orange = me, blue = break"
)
ggplot2::ggsave("n_learners_in_time.png", width = 7, height = 7)
20 changes: 20 additions & 0 deletions reflections/20240525/learners_in_time.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
time,n_learners
9:00,1
9:01,2
9:02,3
9:03,4
9:04,5
9:05,6
9:25,6
9:30,7
10:10,7
10:38,8
12:07,8
13:00,4
13:18,5
14:10,4
15:00,4
15:15,3
15:30,3
16:00,3

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added reflections/20240525/n_learners_in_time.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 1c10887

Please sign in to comment.