Welcome to the UP Singapore data wiki. The objective of this wiki is to:
- document the various datasets that will be available during the UP Singapore festivals,
- give you the tools and resources needed to get started with the data, and
- answer any questions you might have.
Remember, this is a wiki, so if you think there's information missing, or can contribute some sample code, or just want to ask a question, make sure to edit the page!
The datasets for the hackathon are securely hosted in the cloud with our technology partners, Amazon Web Services. To access them, you will need a (free) AWS account, so do follow these directions ahead of the hackathon weekend:
We also have a number of the datasets uploaded to our SAP HANA One instance. Follow these directions to get connected.
The following datasets are being made available for the period of the E3 Hackathon. While the sandbox will be closed on Sunday evening, access to the data beyond the weekend can be negotiated with the data owner on a case-by-case basis.
|S/N||Dataset||Dataset description||Period of data||Data Source|
|1||Anonymised Microdata on Monthly Households Electricity Consumption – Public Housing||Exclusive granular monthly electricity consumption data for individual households in public housing types (1-,2-,3-,4-,5-room and executive units)||2010-2012||SP,EMA|
|2||Anonymised Microdata on Monthly Households Town Gas Consumption – Public Housing||Exclusive granular monthly gas consumption data for individual households in public housing types (1-,2-,3-,4-,5-room and executive units)||2010-2012||SP, EMA|
|3||Anonymised Microdata on Monthly Households Electricity Consumption – Private Housing||Exclusive granular monthly electricity consumption data for individual households in private housing types (private apartment, executive condo, semi-detached, terrace house & bungalow)||2010-2012||SP, EMA|
|4||Anonymised Microdata on Monthly Households Town Gas Consumption – Private Housing||Exclusive granular monthly gas consumption data for individual households in private housing types (private apartment, executive condo, semi-detached, terrace house & bungalow)||2010-2012||SP, EMA|
|5||Anonymised sample Microdata on Households Half-Hourly Electricity Consumption||Exclusive half-hourly electricity consumption data from a one off study on a sample group of individual households in Singapore||Aug 2012-Mar 2013||EMA|
|6||U-Save Rebates per Household Data||Amount of rebates provided for eligible households to help offset utilities bills based on their housing types for specific months||Jan 2002-Jan 2013||MOF|
|7||Monthly Electricity & Town Gas Tariffs||Low Tension Electricity Tariffs (for <6.6kV), General Gas Tariffs (for <1000kWh of gas per month)||Jan 2001-Sept 2013||EMA|
|8||Average Electricity Consumption by Appliances||Average amount of electricity which specific electrical appliances consume||N/A||SP|
|9||Average Floor Area by Dwelling Types||Average Floor area of each HDB public housing types (1-,2-,3-,4-,5-room and executive units)||n/a||HDB|
|10||Resident Households by Planning Area (Population Census 2010)||Data on number of resident households in year 2010||2010||DOS|
|11||List of URA Planning Areas and Codes||Sub-division of Singapore into 55 urban planning areas by the Urban Redevelopment Authority, organised into five regions.||n/a||URA|
|12||Building Energy Consumption (Tampines) by Years||Provided by NEA during Clean & Green Hackathon||NEA|
|13||Average Weekly Households Energy Consumption by Premise Types & Appliances||Provided by NEA during Clean & Green Hackathon||NEA|
|14||Archived Weather Forecasts & Nowcasts||Provided by NEA during Clean & Green Hackathon||March 2013||NEA|
|15||Daily Air Quality Data||Provided by NEA during Clean & Green Hackathon||Jan-Mar 2013||NEA|
|16||Meteorological Radar plots (~400MB)||Provided by NEA during Clean & Green Hackathon||March 2013||NEA|
Note: This page is being regularly updated with more details.
In order to access the datasets, you will need a free Amazon Web Services account. Please follow the directions to create that and be updated as the datasets are published.
Please look over the sites below for additional interesting data sets. If you find data sets that you think are interesting, feel free to edit the wiki, either add them here or create new, linked pages that have data sets by topic, by ministry, by inverse cube of the sum on the first letters in the agency name… however it makes sense to you to start and we will collaboratively edit.
If you're interested in getting social data sources via an API, check out:
DataSift is also probably the most sophisticated re-syndicator of Twitter data. One of the possibility is to geo-fence tweet streams to all of Singapore only.
If you want to visualize geospatial data sets that are stored as shapefils, QGIS is a fantastic, free, open-source GIS application for Windows, Mac and OSX. Download it at http://www.qgis.org/
Google offers an application called Google Refine that is built for processing and cleanup of large data sets in a wide variety of formats. Read more about Google Refine and download it at http://code.google.com/p/google-refine/
- If you find something neat.
- If you need access to some data and we can expedite
- If you have data and want to share
- If you have data and want it hosted
- If you want data cleaned–or want to help clean / reformat data
- Have something cool you want to pitch in and do
…email us at firstname.lastname@example.org and we'll see what we can do together!