Data quality assessment - connecting the pieces...
2 likes954 views
The document discusses data quality assessment, highlighting its dimensions and how it relates to various data types and quality standards. It emphasizes the importance of managing data quality through automation and validation processes, as well as the need for good tool support. Strategies for improvement focus on identifying errors close to the source and ensuring fitness for use in diverse applications.
Data quality assessment - connecting the pieces...
- 1. {RDF} Data Quality Assessment Connecting the pieces...
- 6. Quality of life... Image credits
- 9. Which one is better? ex:Foo a dbo:Person ; dbo:birthDate ”2000-01-01”^^xsd:date . ex:Bar a foaf:Person ; foaf:age 18 . ex:Baz wkd:p31 wk:Q5 ; wkd:p569 ”2000-01-01”^^xsd:date .
- 10. Would you use this information for … ex:Chickenpox a ex:InfectiousDisease ; ex:symptoms ”rash”, “fever”, “headache” ; ex:treatWithVaccine ex:VaricellaVaccine . ex:VaricellaVaccine a ex:Vaccine ; ex:treats ex:Chickenpox, ex:HerpesZoster . - a visualization? - a disease website? - automated treatment?
- 11. Fitness for use Data Quality is
- 12. Data Quality Dimension themes
- 17. How good do you need it to get? Quality Cost ($)
- 18. Where things can go wrong
- 19. Where data can go wrong
- 20. Where data can go wrong
- 24. birthDate max cardinality 1 birthDate min cardinality 1 dirthDate must be xsd:date
- 25. Evolution & quality ↻ ↻ ↻ ↻ ↻ ↻ See http://aligned-project.eu
- 26. Sounds good so far… now what?
- 27. Strategies for managing quality > Needs good tool support > Generic tools missing > Validation engines improved
- 28. Validate closer to the source of the error ↻ ↻ ↻ ↻ ↻ > Always in the K range > Scales with source size > Errors scale as well
- 29. Automate, automate & automate... ex:name a rdf:Property ; rdfs:range rdf:langString . Schema.ttl ex:Foo a dbo:Person ; ex:name “Foo @en” . Data.ttl
- 30. Automate, automate & automate... ex:name a rdf:Property ; rdfs:range rdf:langString . Schema.ttl ex:Foo a dbo:Person ; ex:name “Foo @en” . ex:name “Foo”@en . Data.ttl
- 31. CI/CD is your best friend
- 32. Recap