Prepare blinded rating sheets

Write rating sheets for human coders and a separate key for the researcher. Each sheet contains the text, random material codes, and blank rating columns. It leaves out condition labels, generation prompts, and the original IDs. Each coder gets a separately shuffled sheet.

Usage

export_rating_task(
  materials,
  path,
  dimensions,
  key_path = NULL,
  scale = c(1, 7),
  n_raters = 1L,
  condition_col = "condition",
  text_col = "text",
  seed = 42
)

Arguments

materials

A data frame of materials to be rated.

path

Path for a new rating sheet CSV. Existing output files are never overwritten; choose new paths for a new task.

dimensions

Named character vector of dimensions, as passed to synthetic_ratings. One blank column per dimension is added.

key_path

Path for the key CSV. Defaults to path with a _key suffix.

scale

Numeric length-2 vector of rating endpoints (default c(1, 7)). This is reported in the console message rather than written into the sheet, so tell your coders the endpoints yourself.

n_raters

Number of coders who will each complete a copy. When greater than one, a separate shuffled sheet is written per coder.

condition_col

Column holding the condition (default "condition"). Written to the key, never to the sheet.

text_col

Column holding the material text (default "text").

seed

Integer seed for the shuffle (default: 42).

Value

Invisibly, a list with sheets (paths written) and key_path. The key maps blinded material_id codes to original_material_id and condition. Import restores original IDs.

Details

Keep the key away from the coders. import_human_ratings uses it to restore the original IDs and conditions. The text can still reveal the manipulation, so I'd check that before sending the sheets.

Examples

m <- data.frame(
  condition = c("economic", "moral"),
  text = c("Jobs and growth follow.", "We owe our children better.")
)
tmp <- tempfile(fileext = ".csv")
export_rating_task(m, tmp, dimensions = c(economic = "economic appeal"))
#> ✔ Wrote 1 blinded rating sheet; key at /var/folders/hj/4jw7nfmx44q2c83zpn3h2n6m0000gq/T//RtmpgaBih4/file10b5f2c90e626_key.csv
#> ℹ Rate each dimension from 1 to 7. Do not share the key with coders.