This study requires a laptop or a tablet. It will not work on a phone. The test may also not work properly on older versions of Internet Explorer. We apologize for not being able to support all browsers.

 

Price Estimation Test

Welcome! You are about to take a test on Lab in the Wild.

How well can you estimate prices of apartments?

Given an apartment description, how good are you at estimating its price? Compare yourself to other people and to an Artificial Intelligent agent! This study takes around 7 minutes.

 

Please read the following information carefully before proceeding.

What is the purpose of this research: The purpose of this research is to understand how people make decisions when assisted by Artificial Intelligence systems.

What can I expect if I take part in this research: This study is an online study. You will be asked to complete 24 decision-making questions. In each of them, you will read a description about the description of an apartment and be asked to estimate the price of the property. An Artificially Intelligent (AI) system may also assist you in the decision-making. In the beginning of the study, you will be asked to fill a questionnaire about your personality traits. In the end of the study, you will also fill out a questionnaire about your overall experience with the system. As part of this research design, you may not be told the purpose or procedures of this research. However, the purpose or procedures of the research will be disclosed to you following your participation.

Potential risks: There are no risks anticipated in taking part in this study and you are free to leave at any time without penalty or loss of benefits to which you are otherwise entitled.

Privacy: Your responses will be kept anonymous. We do not collect any information that could be used to directly establish your identity.

Duration: Approximately 8 minutes.

What should I know about a research study:

Who can I talk to: If you have questions, concerns, or complaints, or think the research has hurt you, talk to the research team at zbucinca@seas.harvard.edu

By clicking the "I agree" button you confirm that you have read and understood the above and agree to take part in this research. Your participation is voluntary and you are free to leave the experiment at any time by simply closing the web browser.

 

Please tell us a little bit about yourself. Why?

These questions are optional, but if you could answer at least the first four, that would really help us.

Have you taken this test before? (important)

How old are you? (important)

What is your gender? (important)

What is the highest level of education you have received or are pursuing?



First we want to learn a little bit more about you in order to understand your personal decision style when choosing between options.



Instructions

You will be presented with 24 questions about apartment price prediction. For each question you will be given an apartment description, and your task is to estimate what that apartment actually sold for. You may also be assisted by an AI that is still under development.

The apartments are located in the Upper West Side in New York City.


Here is what a typical question looks like:

example of a question you will be asked in this test

Try to answer the questions as accurately as possible.

Great Job :)!

The main source of carbohydrates on this plate is: mashed potatoes.

Now for the real deal. It'll be the same as the practice you just took.

When you're ready, press next to begin the test!


Question out of

Question goes here


What do you think this apartment actually sold for?




How was your experience?



 

How mentally demanding was understanding how this AI makes decisions?

    Very high

Now, you will complete the second part of the test!

Instructions

As before, you will be presented with 6 questions about exercise recommendation. For each, among the activities present you will choose the one that is the most optimal for the person given what you know about them. You will then see an AI suggestion about the optimal activity, and will be asked to evaluate your previous choice.


Here is what a typical question looks like:

example of a question you will be asked in this test

Try to answer the questions as accurately as possible.

 

You're halfway through! How was your experience?


Thank you for your participation!

Before we continue to the results, please answer the following two questions:

Did you encounter any technical difficulties or interruptions during this study?  


Did you cheat or in any way provide false information? If yes, how?  


Do you have any comments for the researcher? Questions, Suggestions, or Concerns?


Press and hold to speak your comment.



OR
Write your comment








 


In general, you the prices of the apartments. Your estimations were off on average by >.


Other people, who took the same test, on average the prices of the apartments. Their estimations were off by .


We also trained an Artificially Intelligent (AI) model to predict the prices of apartments given their descriptions. For the same apartments, the AI model the prices of the apartments. Its estimations on average were off by .

More about this study.
With this study we seek to understand how to best support people with AI during decision-making. We designed several assistance types and assigned participants, such as yourself, randomly to them.

The following is the list of different designs of the study that a participant could be randomly assigned to:

Enjoyed this study?

If so...

1. You can follow us on Facebook to see results of our studies and to be among the first to hear about new tests.

2. Please tell your friends about this test

3. And check out LabintheWild for more test!

Multitasking Test

How well can you multitask? Compare yourself to others by taking this test!
The test typically takes 10 minutes. Try it!

 

If you have any additional thoughts you'd like to share about this test, please email zbucinca@seas.harvard.edu.