This dataset contains fourteen documents (PDF) and one data file (csv) detailing the set up and results of a research study entitled "Approaches to evaluating the complexity of an engineered system".

This study explored the relative strengths and weakness of two candidate tools for evaluating system complexity: (1) the Thales Group "Complexity Profiler" and (2) the novel "Complexity Register". 

A virtual, tabletop exercise to evaluate the complexity of a fictitious system was conducted by four different groups: a group of Thales participants using the "Complexity Profiler", a group of Thales participants using the "Complexity Register", a group of non-Thales participants using the "Complexity Register" and a control group who were not given an explicit complexity assessment tool. 

Alongside observations of the tabletop exercise, data was collected from a repeated questionnaire and one-on-one interviews with participants.

This study took place between 12 August 2020 and 3 September 2020. The study protocol was approved by the University of Bristol Ethics Committee on 2 July 2020 (application number 105925).

The Particiant Information Sheet (PottsTTXParticipantInformationSheet.pdf) and Participant Consent Form (PottsTTXParticipantConsentForm.pdf) are included.
The information given to the control group is included (PottsTTXControlGroupInformation.pdf ).
The questions asked during the questionnaire are included (PottsTTXSurveyQuestions.pdf).
The documents outlining the fictious system to be evaluated as part of the "scenario" are included (PottsTTXScenarioYellow.pdf,PottsTTXScenarioDevelopmentNotesGreen.pdf, PottsTTXScenarioInject.pdf, PottsTTXScenarioOverarchingArchitectureRed.pdf).
The questions asked during the interviews are included (PottsTTXInterviewQuestions.pdf).
An anonymized biography of the research participants is included (PottsTTXAnonymizedBiography.pdf).
Key excerpts from the tabletop exercise are included (PottsTTXCompletedCxAssessmentTools.pdf).
Facilitator observations of the tabletop exercise are included (PottsTTXObservationsofTabletopExercises.pdf).
Key exceprts from the interviews are included (PottsTTXExcerptsfromInterviews.pdf). 

The results from the questionnaire are included (PottsTTXSurveyData.csv) and the headings for this file are shown below:
ID|How important is it to evaluate the complexity of your target systems early in their lifecycle?|How important is it to evaluate the complexity of your target systems throughout their system lifecycle?|When you think about evaluating the complexity of your target systems, which of the following terms come to mind?Please select up to five terms.|In your own words, what terms come to mind when you think about evaluating system complexity? Please provide at least five terms.|How experienced are you at evaluating the complexity of a system?|How experienced are you at using the [TOOL]?|How effective do you think the [TOOL] can be at supporting a successful complexity evaluation of your target systems early in their system lifecycle? How effective do you think the [TOOL] can be at supporting a successful complexity evaluation of your target systems throughout their  lifecycle?|Please briefly describe the target systems you were thinking of in your own words:|What role would describe you best over the course of your career?|Approximately how much experience (in years) do you have in the role you answered the previous question with?

To view or edit the data you will need a PDF reader such as the free Adobe Acrobat Reader DC software.

File name	Title
PottsTTXParticipantInformationSheet.pdf		Participant Information Sheet
PottsTTXParticipantConsentForm.pdf  		Participant Consent Form
PottsTTXControlGroupInformation.pdf 		Validation Exercise Control Group Informaiton
PottsTTXSurveyQuestions.pdf			Validation Exercise Survey Questions
PottsTTXScenarioYellow.pdf			Validation Exercise - Scenario (Yellow)
PottsTTXScenarioDevelopmentNotesGreen.pdf 	Validation Exercise - Development Notes (Green)
PottsTTXScenarioInject.pdf			Validation Exercise - Scenario - Inject
PottsTTXScenarioOverarchingArchitectureRed.pdf  Validation Exercise - Overarching Architecture (Red)
PottsTTXInterviewQuestions.pdf 			Validatoon Exercise Interview Questions
PottsTTXAnonymizedBiography.pdf	 		Validation Exercise Anonymized Biography 
PottsTTXCompletedCxAssessmentTools.pdf 		Extracts from the completed complexity assessment tools from the tabletop validation exercises 
PottsTTXObservationsofTabletopExercises.pdf	Validation Exercise Observations of Tabletop Exercises
PottsTTXExcerptsfromInterviews.pdf  	 	Validation Exercise Excerpts from Interviews
PottsTTXSurveyData.csv				Results from the questionnaire