First Round Validation Results

Posted by Yifei Yu on March 25, 2024 · 6 mins read

Hello, dear participants! First, I would like to extend my sincere thanks to all of you. Thank you so much for attending the validation sessions and offering your feedback.

In this update, you are going to read the following key points:

  • What did we do?
  • How does the model perform?
  • Do you agree with these results?
  • Summary

1. What did we do?

In the past few months, we conducted several validation sessions with different participants. The major steps of each session are listed as follows:

  • Explain the design background;
  • Demonstrate the model;
  • Discuss and collect feedback;
  • Fill in the evaluation form.

To help you remember what the model looks like, two screenshots of the model are provided as follows:

Figure 1: User interface: Scale selection Figure 2: Screenshots of the circular matchmaking model at the city (A), province (B), and country (C) scales (legend: circles – existing buildings; squares – planned buildings; green icons – circularity hubs)

2. How does the model perform?

The evaluation form includes the statements as follows:

A -- Clarity

  • A1: It is clear to me what the model is developed for.
  • A2: It is clear to me what the agent’s architecture is.
  • A3: It is clear to me what the simulation environment is.
  • A4: It is clear to me what the temporal (time) factors are.
  • A5: It is clear to me what the spatial (space) factors are.

B -- Validity

  • B1: I think the model represents possible matchmaking dynamics in reality.
  • B2: I think the model animation shows the matchmaking dynamics at multiple levels of detail.
  • B3: I think the model shows a phenomenon that is difficult to observe in reality.
  • B4: I think the model’s structure is logical and coherent.
  • B5: I think the model’s outputs are understandable and reasonable.
  • B6: I think the model captures the randomness of matchmaking in reality.

C -- Functionality

  • C1: The model is useful to explain the concept of circular matchmaking in the built environment at an urban level.
  • C2: The model is useful to demonstrate the process and mechanism of circular matchmaking over space and time.
  • C3: The model is useful for predicting the potential phenomenon of circular matchmaking under different scenarios.
  • C4: The model is useful for predicting the potential effect of circularity hubs at different locations.
  • C5: The model helps users to learn Circular Economy beyond the boundary of individual projects.
  • C6: The model can serve as an educational tool to facilitate Circular Economy learning.

D -- Summary

  • D1: Because of the model, I have a new perspective on Circular Economy in the built environment.
  • D2: Overall, it is interesting to know the model.

Based on the evaluation form and statements, the Likert-scale feedback is collected and presented in Figure 1.

Figure 3. Heatmap of form results with scores: strongly disagree -- 1; disagree -- 2; neutral -- 3; agree -- 4; strongly agree -- 5

3. Do you agree with these results?

We analysed the feedback and dialogues. Then, we outlined several key statements and findings from the results above. Now, we ask for your extra confirmation and remarks. Since we had the discussion a while ago, it is helpful to revisit the key points with a refreshed mind. It is believed that an extra round of feedback helps to achieve the objectives as follows:

  • Summarise what is known;
  • Present a clearer picture of the topic;
  • Correct misunderstandings;
  • Pick up overlooked points;
  • Delve into the topic to a further extent.

We highlight the key points and ask for your further feedback in two aspects: (1) What the model can do now, and (2) What the model can do in the future. Could you please review these highlights and fill in the form below?

In case you are not able to fill in the form on this page, a supplementary form link is provided here: https://forms.gle/iYxQusLssVs4KkMKA

4. Summary

Thank you so much for your time and feedback! We enjoyed the validation sessions with you a lot. Your experiences, insights, and enthusiasm about Circular Economy energise us. We are grateful for your generous support and help. Meanwhile, we hope the shared knowledge here could add value to your work. Further, it is exciting to see this validation brings several potential collaboration opportunities!

We are now preparing the official report about this model. Soon, we will share the final version of the detailed results with you after we finish this second (final) round of feedback collection.

Please feel free to contact me if you have any questions. Thank you!