Translating the classics: An automated system for translating Dutch uniform classical music titles INGMAR VROOMEN & CASPER KARREMAN, MUZIEKWEB

Transcription

1 Translating the classics: An automated system for translating Dutch uniform classical music titles INGMAR VROOMEN & CASPER KARREMAN, MUZIEKWEB

2 Ingmar Vroomen Project manager Casper Karreman Senior developer

3 Introducing Muziekweb

4 Muziekweb: a short introduction Founded in 1961 as Stichting Centrale Discotheek (CDR)

5

6

7 Collection 2018: ± CD s LP s music DVD s Historical audio formats: wax cylinders, shellac, Pathé records, Edison Diamond Discs

8

9 Music library of the Netherlands Deutsches Musikarchiv British Library Sound Archive Bibliothèque nationale de France Muziekweb

10 Projects Music and science Internationalisation

11 (International) Collaborations Scientific research: sharing data, contributing to research, e.g. with TU Delft or Utrecht University All public libraries in The Netherlands and Flanders Dutch Royal Library, national library of The Netherlands Foreign music libraries like DMA and BLSA but all our data is in Dutch!

12 Project automated translation

13 Project: automated translation Translate our website muziekweb.nl for international visitors Share data with foreign (non-dutch speaking) libraries Enable easier linking of our database to other international music services and databases

14 Translating 1000 titles by hand

15 The need for an automated solution

16 Steps in the translation process What do we translate? Generic title or identifying name Instruments and voices Identifying opus or catalogue number Key (A major, d minor)

17 Steps in the translation process What do we translate? Wolfgang Amadeus Mozart, Requiem voor soli [4], koor en orkest KV.626 in d kl.t. Wolfgang Amadeus Mozart, Requiem for soloists [4], choir, orchestra KV.626 in d minor

18 Steps in the translation process What do we translate? Pjotr Iljitsj Tsjaikovski, Schoppenvrouw, op.68 Google: English French German Spade woman Pelle femme Spaten Frau Muziekweb: Queen of spades Dame de pique Pique dame

19 Steps in the translation process What do we translate? Research for other datasets

20 Research for other datasets ISNI for names of creators / collaborators WorldCat for library collections DDEX for music distribution None focus on the musical composition

21 Research for other datasets Find datasets with overlapping content in different languages Cantorion - Focus on classical music, concerts and sheet music MusicBrainz - Open music encyclopedia Wikidata Open structured dataset, interacts well with machines and humans

22 Steps in the translation process What do we translate? Research for other datasets Analyze the data

23 Analyze the data Find out how our subject is addressed What information is in the data; data is not information! Each dataset contains different information and presentations

24 Analyze the data Cantorion example

25 Analyze the data Wikidata example

26 Analyze the data Muziekweb

27 Steps in the translation process What do we translate? Research for other datasets Analyze the data Query the datasets

28 Query the datasets Every resource has it s own interface Results rely on the question asked so ask the right questions

29 Query the datasets Cantorion

30 Query the datasets Wikidata

31 Steps in the translation process What do we translate? Research for other datasets Analyze the data Query the datasets Rating the results / deciding when to translate

32 Rating the results / deciding when to translate Rate probability of matching results When more sources say the same it must be true

33 Rating the results / deciding when to translate

34 Rating the results / deciding when to translate

35 Steps in the translation process What do we translate? Research for other datasets Analyze the data Query the datasets Rating the results / deciding when to translate Store proposed translation including decision attributes

36 System design

37 Results most popular titles: 95% accuracy Translated in 16 hours to prevent exhaustion of the remote systems

38 Thank you Ingmar Vroomen MUZIEKWEB Casper Karreman MUZIEKWEB