Making Data Useful Contest Description

“Data is the new oil” is a debatable modern adage. There is a lot of data online, but it is often distributed across multiple websites and it becomes difficult to integrate all the data and gain a unified understanding.

1. Scrape multiple public websites for necessary data and integrate them into a unified dataset.
2. Perform data cleaning:
   1. Standardize units (eg. convert different metrics like inches, cm to a single metric throughout the dataset).
   2. Standardize formats.
   3. Account for missing fields (include your assumptions on how you are handling missing fields along with your submission.) For example, if a certain field is missing data you can do one of the following: i) Assign a value of zero, ii) Assign the most common value for the field, iii) Assign a certain value of your choice based on your reasoning, or iv) Any other option based on your dataset and assumptions.
3. The integrated dataset must contain a minimum of 5000 rows.
4. The integrated dataset must contain a minimum of 20 attributes.
5. Develop a web interface for users to explore your integrated dataset.
6. Use D3 to present both tabular and graphical views of the data.
7. The choice of which graphical view to present (e.g., bar chart/time series plot/pie chart etc.) depends on your dataset.
8. Create a website to include the following:
   1. A write-up about the site’s purpose and intended audience.
   2. A list of the team members.
   3. Acknowledgements to thank the data sources.
   4. D3 interfaces that present your final data reports.
9. The website must allow the user to download the full/selected data for individual use.

Submission guidelines will be posted closer to the deadline. Stay tuned!