0% found this document useful (0 votes)
15 views17 pages

2nd ICC CIty Lab - Open-Data-Tech-Tutorial

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
15 views17 pages

2nd ICC CIty Lab - Open-Data-Tech-Tutorial

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 17

Open Data Technical Tutorial

Dr Alex Gluhak, Urban Data Collective


Outline

• Open data – a means of data sharing


• The role of data portals
• Different data – different tools
• Open data portals (Solutions and standards)
• Urban data platforms (Solution and standards)
Different types of urban data
• Public sector data • Static data sets
• Private sector data • Periodic data dumps
• Research data • Real time data streams
• Personal data
• Geo spatial data • File based access
• Open data • API based access
• Commercially available data
• Crowd sourced data
• Closed data
Open data
Open data is data that can be freely used, re-used and redistributed by anyone -
subject only, at most, to the requirement to attribute and sharealike.

Stars Principle
• Publishing open data requires * Make your stuff available on the
web (whatever format) under an
• Choosing an appropriate open data license open licence
• Ensuring the quality of open data. ** Make it available as structured data
(e.g. Excel instead of image scan or
• Ensuring discoverability of open data PDF)
*** Use non-proprietary formats (e.g.
CSV instead of Excel)
**** Use URIs to denote things, so that
people can point at your stuff
***** Link your data to other data to
provide context
Open data by domain
The role of open data portals

• Open data can be shared by making them


available on the Internet, e.g. on a website

• Open data portals simplify the task of making


open data websites

• They are like website content management


systems providing tools to streamline publishing,
sharing, finding and using data
Benefits of using an open data portal

• Streamlined way to make your data discoverable and presentable


• User interfaces for simple data publication and management
• Each dataset is given its own page with a rich set of meta-data
• Data store and file store infrastructure
• Provides google like search and discovery over metadata/tags
• Offers plugins for visualising data
• Support API based access to data
• Supports federation with other data portals
Popular open data portals (open source)
CKAN (used by 200+ orgs) DKAN (used by nearly 100 orgs)
Setting up an open data portal such as CKAN

Basic steps
• Setting up a server (e.g. on AWS)
• Download source / packages
• Install and configure
• Start sharing data

Customisation
• User administration
• Customise look and feel
• Add extensions
• Embed into city website…
Open data portals (commercial examples)
Socrata
opendatasoft
Open data standards
Data catalogue standard
Data standards

W3C Data Catalogue Vocabulary (DCAT v2)


From static to real time urban data

• Moving from documents to APIs and


time series data

• Open data portals can link to APIs


• Real time extension for portals such
as CKAN exist but not optimal

• Urban data platforms emerge as


alternatives – exposing city data
lakes
Example: IoT applications
Example: London data store evolution
Urban data platforms and emerging ecosystems

Open source building blocks for


urban data/service platforms

NGSI-LD as standard for context


information management

Smart city data models


Urban data exchange (UDX)

• Developed as part of the EU


SynchroniCity project

• Allows sharing real time


urban data across cities
• Data onboarding
• Data standardisation
• Data discovery
• License management and
access control
• Federation
Q&A
Contact me: alex@urbandatacollective.com

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy