3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel Pletinckx, Visual Dimension bvba

3D-‐ICONS:
Interac1ve
storytelling

through
innova1ve
interfaces

Carlo<a
Capurro,
Daniel
Ple1nckx

Visual
Dimension
bvba

carlo<a.capurro@visualdimension.be

daniel.ple1nckx@visualdimension.be

This
project
has
been
funded
with
support
from
the
European
Commission‘s
CIP
ICT
PSP
programme

Click
to
edit
Master
1tle
style

Introduc1on

!   Funded
under
the
European
Commission’s
ICT
Policy

Support
Programme

!   Built
on
the
results
of
CARARE
and
3D-‐COFORM
EU

projects

!   16
partners
from
across
Europe
(11
countries)
with

relevant
exper1se
in
3D
modelling
and
digi1za1on.

Click
to
edit
Master
1tle
style

The
3D-‐ICONS
Project

!   3D-‐ICONS
provides
Europeana
with
3D
models
of

architectural
and
archaeological
monuments
of

remarkable
cultural
importance
(World
Heritage)

!   Purpose
of
the
project:
to
produce
around
4000
accurate

3D
models,
to
be
processed
into
a
simpler
form
in
order

to
be
visualised
also
on
low
end
personal
computers
and

on
the
web.

!   Challenge
for
Cultural
Heritage
sector
to
bring
their
3D

models
used
for
scien1ﬁc
&
research
purposes
into
the

public
domain

Click
to
edit
Master
1tle
style

What
is
Europeana?

h<p://www.europeana.eu

!   A
huge
database
of
informa1on
about
digital
content

(metadata)
held
by
European
cultural
heritage
ins1tu1ons

–  Funded
by
the
European
Commission

–  Supplied
by
a
range
of
Best
Prac1ces
and
other
Pilot
Projects
as
well
as

directly
by
(larger)
ins1tu1ons

!   Catalyst
for
new
content
services

–  Europeana
services
and
tools,
standards,
Linked
Open
Data,
…

–  Hackathons
–
new
content-‐based
apps

–  Europeana
Research,
next
stage

!   Source
of
on-‐line
exhibi1ons
(engaging
the
public)

!   Network
of
cultural
heritage
organisa1ons
and
exper1se

Click
to
edit
Master
1tle
style

Guidelines:

!   The
3D-‐ICONS
project
exploits
exis1ng
tools
and

methodologies
and
integrates
them
in
a
complete
supply

chain
of
3D
digi1sa1on.

!   Creates
a
complete
pipeline
which
covers
all
technical
and

logis1c
aspects
to
create
3D
models
of
cultural
heritage

objects
with
a
variety
of
digi1sa1on
techniques.

1.
3D
Data
Capture
Techniques

2.
Post
Processing
of
3D
Content

3.
3D
Publishing
Methodology

4.
Metadata

5.
Licensing
&
IPR
Considera1ons

Click
to
edit
Master
1tle
style

3D
Data
Capture
Techniques:

Non-‐invasive

and

Non-‐destruc0ve

Non-‐contact
systems
(means
that
they
do
not
require
physical

contact
with
poten1ally
fragile
artefacts
and
structures):

-‐
ac1ve

-‐
passive

Click
to
edit
Master
1tle
style

3D
Data
Capture
Techniques:

l  Short
Range
Techniques

-‐
Laser
Triangula1on
(LT)

-‐
Structured
Light
(SL)

l  Long
&
Mid
Range
Techniques

-‐
Time
of
Flight
(TOF)

-‐
Phase
shig
laser
scanning
(PS)

l  Mul1
Scale
Image
based
Techniques

-‐
Tradi1onal
Photogrammetry

-‐
Semi
Automated
Image
Based
Methods

Click
to
edit
Master
1tle
style

Post
Processing
of
3D
Content:

•  A
sequence
of
steps
that
result
in
the

direct
improvement
of
acquired
3D
data

and
its
transforma1on
into
visually

enriched
geometric
representa1ons.

•  It
allows
the
crea1on
of
mul1ple
3D

models
star1ng
from
the
same
gathered

data
according
to
the
desired
applica1on,

level
of
detail
and
other
addi1onal
criteria.

•  The
results
are
3D
geometric

representa1ons
accompanied
by

complementary
2D
media,
which
are
the

digital
assets
ready
to
be
converted
(or

embedded)
into
the
ﬁnal
web
publishing

formats.

Click
to
edit
Master
1tle
style

Post
Processing
of
3D
Content:

Processing
of
point
clouds
data:
involves
cleaning
and
the
alignment
phases.

Processing
mesh
data:
transforma1on
of
point
cloud
data
into
a
surface
of
triangular

meshes.

Mesh
Cleaning:
ﬁlling
holes,
remove
spikes,
unreferenced
ver1ces,
and
non-‐manifold
edges.

Mesh
Simpliﬁca1on:
reduce
the
amount
of
data
required
to
describe
the
surface
of
an

object
while
retaining
the
geometrical
quality
of
the
3D
model.

Mesh
retopologisa1on:
generate
a
simpler
version
of
the
original
dense
model,
by
u1lising

the
original
topology
as
a
suppor1ve
underlying
layer.

Texture
mapping:

topological
enhancement
of
low
complexity
geometry
with
special
2D

relief
maps,
that
can
carry
high
frequency
informa1on
about
detailed
topological
features.

Click
to
edit
Master
1tle
style

Post
Processing
of
3D
Content:

•  Digital
restora1on:

-‐
Reconstruc1on
of
missing
details
based
on
the
predic1on
of
their
shape

•  Hypothe1cal
reconstruc1on:

-‐
Modeling
based
on
addi1onal
sources

-‐
Valida1on
by
a
range
of
diﬀerent
experts

-‐
Document
reconstruc1on
process
and
uncertain1es

Click
to
edit
Master
1tle
style

3D
Publishing
Methodology:

Op1mal
delivery
and
display
of
rich

and
complex
3D
assets
online.

-‐
3D
PDF

-‐
HTML5/WebGL
Solu1ons

-‐
Unity
-‐
Serious
Games
Solu1ons

-‐
Pseudo-‐3D
(ObjectVR)
solu1ons

-‐
3DHOP
(3D
Heritage
Online
Presenter)

→
3D
Streaming

Click
to
edit
Master
1tle
style

Metadata:

The
metadata
provides
key
informa1on
and

context
data
to
ﬁve
key
areas:

•  It
describes
in
detail
the
artefact
or
monument
and

its
provenance

•  It
describes
in
detail
the
digital
representa1on
of
the

artefact
or
monument
and
its
online
loca1on

•  It
provides
informa1on
on
technical
methods
u1lised

in
the
digi1sa1on
and
modelling
of
heritage
objects

•  It
provides
informa1on
on
the
access,
licensing
and

reuse
of
the
created
3D
models
and
any
associated

digital
content

•  It
enables
the
search
and
discovery
of
content

through
the
mapping
of
metadata
based
on
the

Europeana
Data
Model
(EDM)

Click
to
edit
Master
1tle
style

Licensing
&
IPR
Considera1ons:

In
order
for
the
eﬀec1ve
sharing
and

reuse
of
3D
content
of
heritage

objects
a
common
framework
is

required.

Example:
Ename,
Belgium

Archaeological site of Ename, Belgium

Ename

4D visualisation of evolution of the Ename abbey site (1065)

Ename


Interpreta1on
of
archaeology

Aerial photo of the archaeological site of Ename

Interpreta1on
of
archaeology

Synthetic archaeology map with the first abbey highlighted

Interpreta1on
of
archaeology

Conceptual model of buildings and terrain

Interpreta1on
of
sources

Depiction of the early Ename abbey (around 1100) in Viel Rentier
(1275)

Object
modelling

Blender model of building crane

Object
modelling

Blender model of ferry boat

Object
modelling

Painting of Dutch ferry boat (Salomon van Ruysdael, 1649)

Object
modelling
and
behaviour

Animated Blender model of medieval chariot and horse

Object
modelling
and
anima1on

13th century depiction of medieval chariot and horse (Viel Rentier)

Ename
1020

Resistivity measurements at the archaeological site of Ename

Ename
1020

Resistivity results of the archaeological site of Ename
E
B E
A
A
R
N
S
T
R A
A
T
U
C
E
N
A
M
L
E
P
E IN
S
t.
-
SA
L
V A
T
R
T
R A
A
O
S
T
N
0
A KKE R
BR A A K
A K KE R
WE ILA N D
WE ILA N D
BR A A K
RIE TV E LD
BR A A K
10.000
12.299
12
.058
912.16
12.212
1
0.850
9.42
0
.5989
9815.
9.648 10.913
9.148
3
65
9.
9.1
93
10.220
9.874
10.027
9.978
9.495
9 .251
9.030
14
9.0
10.057
0710.7
9649.
7
9
.9 2
9.
869
9.068
9.755
9.696
9.629
569.5
9
.4 94
9428.
936
7
.
.2899
.1749
9065.
9.216
9.414
9.56
8
9.672
7549 .
9.877
9
.818
9.850
983.8
9
9
.21
9.974 1
0.005
1 0.111
01.170
1
1920.
710.18
1
0 4.1210.1 34
10.138
10.12
8
1
0.131
1013
6
.
9.907
9942.
11.792
1
94
1 .7
9
0
11.8
11965.
83311.
11 6.81
11.887
9
13.1
8
24.363
12.584
10.000
9.520
fenopalpa v
ilioenkijkenter
a
vs
enopa lwk
t
F
- aerfee
s
D
orpelelektri citei
tcabnei
ps
elu nt
o
tp
p-u
dnaa r
vo
e de
GIN
-tkes t
e
vpsie-ijkvn
r
e
v
p-site-ke t
mep
unt
et
P
H
Hm
P
© Archaeological Pr ospection
Services of Southam pton
Ename, Belgium
0 100m
N

Ename
1020

Magnetometer results of the archaeological site of Ename
E
B E
A
A
R
N
S
T
R A
A
T
U
C
E
N
A
M
L
E
P
E IN
S
t.
-
SA
L
V A
T
R
T
R A
A
O
S
T
N
0
A KKE R
BR A A K
A K KE R
WE ILA N D
WE ILA N D
BR A A K
RIE TV E LD
BR A A K
10.000
12.299
12
.058
912.16
12.212
1
0.850
9.42
0
.5989
9815.
9.648 10.913
9.148
3
65
9.
9.1
93
10.220
9.874
10.027
9.978
9.495
9 .251
9.030
14
9.0
10.057
0710.7
9649.
7
9
.9 2
9.
869
9.068
9.755
9.696
9.629
569.5
9
.4 94
9428.
936
7
.
.2899
.1749
9065.
9.216
9.414
9.56
8
9.672
7549 .
9.877
9
.818
9.850
983.8
9
9
.21
9.974 1
0.005
1 0.111
01.170
1
1920.
710.18
1
0 4.1210.1 34
10.138
10.12
8
1
0.131
1013
6
.
9.907
9942.
11.792
1
94
1 .7
9
0
11.8
11965.
83311.
11 6.81
11.887
9
13.1
8
24.363
12.584
10.000
9.520
fenopalpa v
ilioenkijkenter
a
vs
enopa lwk
t
F
- aerfee
s
D
orpelelektri citei
tcabnei
ps
elu nt
o
tp
p-u
dnaa r
vo
e de
GIN
-tkes t
e
vpsie-ijkvn
r
e
v
p-site-ke t
mep
unt
et
P
H
Hm
P
© Archaeological Pr ospection
Services of Southam pton
Ename, Belgium
0 100m
N

Ename
1020

Reconstruction of Ename in 1020, before the abbey phase

Ename
1020

Reconstruction of Ename in 1020, trade settlement

Ename
1020

Reconstruction of Ename in 1020, harbour and castrum

Ename
1020

Reconstruction of Ename in 1020, harbour and Saint Salvator church

Ename
1020

Reconstruction of Ename in 1020, market place and Saint Salvator church

Workﬂow

Conceptual model of reconstructed buildings and terrain features

Workﬂow

Top view map in Photoshop

Workﬂow

Terrain types and applied height map (Vue)

Workﬂow

Terrain without vegetation (Vue)

Workﬂow

Terrain with water and vegetation after population (Vue)

Workﬂow

Terrain with vegetation, buildings and (animated) objects (Collada)

4D
visualisa1on:
1020-‐1730

Procedural landscape simulation in Vue (1730)

Interac1ve
storytelling

•  Exploration through POIs (points of interest)
–  Panorama based (TimeScope)
–  ObjectVR based (TimeLine)
•  3D-ICONS approach
– ObjectVR based (9 periods + 1 evolution)
– Linked sources (images)

Ename
TimeScope

Ename TimeScope on the archaeological site

Ename
TimeScope

Ename TimeScope (new version in 2013)

Ename
TimeLine

Ename TimeLine (new version in 2014)

Thank
You!

h<p://www.3dicons-‐project.eu

3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel Pletinckx, Visual Dimension bvba

More Related Content

What's hot (20)

Viewers also liked (11)

Similar to 3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel Pletinckx, Visual Dimension bvba (20)

More from 3D ICONS Project (18)

Recently uploaded (20)