|
|
| Line 5: |
Line 5: |
|
| |
|
| ==Useful documentation== | | ==Useful documentation== |
| '''For new members''', useful tools and information describing the main procedures and practicalities to get on board can be found in the [https://wiki.share-vde.org/wiki/ShareVDEmembers:MembersArea Members area section]. | | '''For new members''', useful tools and information describing the main procedures and practicalities to get on board can be found in the [https://wiki.share-vde.org/wiki/ShareVDEmembers:MembersArea '''Members area section''']. |
|
| |
|
| While the [[ShareDoc:PublicDocumentation|Public documentation section]] collects detailed information on the components and tools underlying the Share-VDE and Share Family technology. | | While the [[ShareDoc:PublicDocumentation|Public documentation section]] collects detailed information on the components and tools underlying the Share-VDE and Share Family technology. |
| Line 11: |
Line 11: |
| The following activities track the '''major progresses''' in order to make Share-VDE evolve, as sketched in the [[Main Page|presentation of the initiative]]. | | The following activities track the '''major progresses''' in order to make Share-VDE evolve, as sketched in the [[Main Page|presentation of the initiative]]. |
|
| |
|
| * <span style="color: rgb(51, 51, 51)">As of September 2021,</span> '''the new version Share-VDE 2.0 is live''' '''at [https://svde.org/ https://svde.org]''' <span style="color: rgb(51, 51, 51)">with an enhanced Entity Discovery Portal and Linked Data Management System</span><span style="color: rgb(51, 51, 51)">.</span> The load of Share-VDE libraries’ data is being done progressively and currently the new web portal hosts a subset of the data of member institutions. <span style="color: rgb(51, 51, 51)">If you want to discover the advanced functions of Share-VDE 2.0, the web portal at</span> [https://svde.org/ https://svde.org] <span style="color: rgb(51, 51, 51)">is the place to go.</span> | | * '''Share-VDE is live''' '''at [https://svde.org/ https://svde.org]''' <span style="color: rgb(51, 51, 51)">with an enhanced Entity Discovery Portal and Linked Data Management System</span><span style="color: rgb(51, 51, 51)">.</span> The load of Share-VDE libraries’ data will be done progressively and currently the discovery portal hosts a subset of the data of member institutions. Developments are being carried on to move all the technological components to a full production state. |
|
| |
|
| * '''Users external to Share-VDE are welcome to provide feedback''' on the discovery portal, report bugs and suggestions: reach out through the forum [https://forum.svde.org/ '''https://forum.svde.org'''/]. | | * '''Users external to Share-VDE are welcome to provide feedback''' on the discovery portal, report bugs and suggestions: reach out through the forum [https://forum.svde.org/ '''https://forum.svde.org'''/]. |
|
| |
|
| * The linked data entity editor JCricket is being released in its initial version: the back-end APIs have been completed and the corresponding front-end functions are in progress, see the overview [https://wiki.share-vde.org/w/images/7/74/JCricket_overview_-_2023-Jan-26.pdf JCricket Cluster Knowledge Base editing functions]. | | * The linked data entity editor JCricket has released in its first version: see the overview at [[ShareDoc:PublicDocumentation/LODPlatform/EntityEditor]]. |
| * After the installation of the new Share-VDE triple store, a small dataset has been loaded to initially test the new tool. It is named "SHAREVDE" and includes 899,845 quadruples created from the conversion of a subset of Berkeley Law Library original data. The triple store set-up includes two different methods for searching and viewing the data, ie.:
| | News and updates are periodically published on this wiki [[ShareFamily:NewsAndUpdates|in an extensive Bulletin]]. |
| ** graphic user interface SPARQL UI Console at https://data-staging.svde.org: it's the graphic end user interface where the dataset loaded to the triple store can be selected; selecting "Query" in the user menu opens the query interface;
| |
| ** direct access to SPARQL Endpoint at https://data-staging.svde.org/sparql: it's the HTTP endpoint to run queries directly on the dataset.
| |
| | |
| To access the triple store and consult the data contact info@svde.org.
| |
|
| |
|
| ===Share development team organisation=== | | ===Share development team organisation=== |
| The numerous upgrades to the back-end and front-end infrastructures (see below) brought to the '''SVDE linked data management and entity discovery system 2.0''' supported by the new version of the [https://wiki.share-vde.org/wiki/ShareFamily:Main_Page#The_Share_Family_technology:_the_LOD_Platform '''LOD Platform'''], that is the technology framework of the Share Family of initiatives. | | The numerous upgrades to the back-end and front-end infrastructures over the years lead to an enhanced version of the [https://wiki.share-vde.org/wiki/ShareFamily:Main_Page#The_Share_Family_technology:_the_LOD_Platform '''LOD Platform'''], that is the technology framework of the Share Family of initiatives. |
|
| |
|
| The '''SVDE IT team''' '''has been restructured and enlarged''' in order to cope with the increasing complexity of the developments, meet the needs of the community and interconnect with several projects. There are several development sub-teams devoted to the main components of the system: | | The '''Share IT team''' '''has been restructured and enlarged''' in order to cope with the increasing complexity of the developments, meet the needs of the community and interconnect with several projects. There are several development sub-teams devoted to the main components of the system: |
|
| |
|
| *Infrastructure & Architecture (set-up and enhancement of the backbone of the system); | | *Infrastructure & Architecture (set-up and enhancement of the backbone of the system); |
| *Clustering module (continuous optimisation of the core component for data processing); | | *Clustering module (continuous optimisation of the core components for data processing and aggregated entities creation); |
| *SVDE Backend APIs (Database and Indexing, APIs development for Share Family portals, JCricket backend functions); | | *Backend APIs (Database and Indexing, APIs development for Share Family portals, JCricket backend functions); |
| *SVDE Frontend (design and creation of general frontend components, frontend Share Family portals implementation and interaction with backend, JCricket front-end functions); | | *Frontend (design and creation of general frontend components, frontend of Share Family portals implementation and interaction with backend, JCricket front-end functions); |
| *BIBFRAME and RDF conversion (refactoring of the component that creates BIBFRAME / RDF data and that feeds SVDE triple store for SPARQL queries). | | *BIBFRAME and RDF conversion (refactoring of the component that creates BIBFRAME / RDF data and that feeds triple store for SPARQL queries). |
| | |
| ===Overview of major developments===
| |
| As far as the '''frontend infrastructure''', the new SVDE 2.0 portal ([https://www.svde.org www.svde.org]) has been completed and its design was enhanced by the activities around the JCricket Cluster Knowledge Base editor, the requirements for the University of Pennsylvania localisation and for the [https://www.kubikat-lod.org/ Kubikat-LOD] parallel pilot project. Based on this enhanced prototype, SVDE IT team has connected the new components of the frontend of the SVDE platform with the backend infrastructure. The same is being done for the ad hoc localisation for the University of Pennsylvania. The other skin portals foreseen are being prepared.
| |
| | |
| A complex [https://www.figma.com/file/vBFVe5ZoXOTO7xfzrpbvWi/Dreamforest-overview-diagram diagram of the frontend development] project has been created <span class="ve-pasteProtect" style="color: #000000" data-ve-attributes="{"style":"color: #000000"}">and will be used to generate and display SVDE portal and the connected skin portals. The naming of the infrastructure components in the diagram are arbitrary and respond to the metaphor of a big forest: it’s a way to avoid ambiguity within the various development teams working on SVDE. The names of the skins and tenants for users outside the development teams will reflect the names of the institutions. Please note that it’s a work in progress populated with a few placeholder data for demonstrative purposes; for this reason it might be unstable, it reflects the search and navigation functions though.</span>
| |
| | |
| As far as the '''[https://drive.google.com/file/d/1w91EZuqr_uV1_eWovCNJ3yX1ZJXqAnLD/view backend layer]''', the enhancements of the new user interface increased the dependencies between the features specific to each localisation of the SVDE frontend (i.e. SVDE general interface, Penn localisation, JCricket module, Kubikat-LOD pilot project etc.) and the underlying system components common to all of them, for example the search logic. This implied a deep revision of the SVDE backend layer that is now supported by a '''complex set of''' '''APIs'''.
| |
| | |
| Moreover, '''the Cluster Knowledge Base and the clustering module are being enhanced''' with new attributes and new controlled vocabularies as a result of the UI design, the revision of the backend infrastructure and the continuous work of the SEI - Sapientia Entity Identification working group.
| |
| | |
| Initial ideas for the implementation of the '''[https://wiki.share-vde.org/w/images/1/1d/Schema_Share_family_tenant.png tenant infrastructure]''' are being exchanged. Data from libraries of the Share Family would be grouped by similar domains or characteristics in ad hoc tenants of the software architecture. This would enable each tenant to manage the data independently, allowing in the same time an infrastructure for potential data exchange services.
| |
| | |
| Parallel work was done on the pilot '''[https://www.kubikat-lod.org/ Kubikat-LOD] localisation of art libraries''', supporting Kubikat-specific features. Kubikat-LOD pilot has been released on February 1st 2022 in its beta version. It represents the linked open data entity discovery platform containing the whole catalogues of the libraries belonging to the following four art history institutions:
| |
| | |
| *Kunsthistorisches Institut in Florence, Max-Planck-Institut ([http://www.khi.fi.it www.khi.fi.it])
| |
| *Zentralinstitut für Kunstgeschichte in Munich ([https://www.zikg.eu www.zikg.eu]), funded by the Bayerisches Staatsministerium für Bildung und Kultus, Wissenschaft und Kunst
| |
| *Deutsches Forum für Kunstgeschichte / Centre allemand d'histoire de l'art in Paris ([https://dfk-paris.org dfk-paris.org]), funded by Max Weber Stiftung - Foundation of German Humanities Institutes Abroad
| |
| *Bibliotheca Hertziana, Max Planck-Institut für Kunstgeschichte in Rome ([https://www.biblhertz.it www.biblhertz.it])
| |
| | |
| This is the result of the joint work of the Kubikat group of libraries that are envisaging a new tool for scholars, researchers and end users as well as for librarians to manage bibliographic resources.
| |
| | |
| SVDE team has been working on the procedure to '''fully automate the workflow for receiving updated MARC data''' from all SVDE member institutions. After the initial import of the MARC full catalogues of SVDE libraries done in 2019, the procedures for the ingestion in SVDE of subsequent regular updates of MARC data have been created and constantly refined for processing, enrichment and clustering in SVDE. However, the recent changes to the infrastructure of the system imposed to re-design the module managing delta updates, that will soon be completed.
| |
| | |
| '''SVDE participates to [https://wiki.lyrasis.org/pages/viewpage.action?pageId=187176106 Linked Data for Production 3]''' project with two major tasks:
| |
| | |
| #build two-ways flow '''APIs to connect SVDE and Sinopia''' BIBFRAME cataloguing module. The first step has been done, i.e. the Sinopia team has built an API pipeline that pulls records built by Sinopia and the functioning has been tested by the SVDE team. Moreover, SVDE has analysed Sinopia documentation on the structure of records output from Sinopia: this will be the basis for SVDE to build the connector to import Sinopia records in SVDE. The [https://drive.google.com/file/d/1uahdMCxOinkpty5dI2P6iYEdXjflcTl6/view initial sketch of how SVDE is envisaging to close the loop] is available;
| |
| #'''provide the conversion and housing of PCC data''' in an ad hoc PCC data pool working as autonomous tenant, with a separated enriched CKB and ad hoc PCC URIs with dedicated namespace. <span class="ve-pasteProtect" style="color: #000000" data-ve-attributes="{"style":"color: #000000"}">SVDE has delivered PCC records converted in BIBFRAME for the initial load of approx 4.5 million MARC bibliographic records created by PCC libraries; regular updates are ongoing, on a monthly basis, for the duration of LD4P3.</span>
| |
| | |
| The SVD<span style="color: #000000">E team is working on the</span> <span style="color: #000000">'''development of the authority services''', based on the analysis carried on by the working groups. The '''initial release''' of the authority control features has been delivered '''to Stanford University Libraries'''.</span>
| |
| | |
| ===Members' activities with Share team===
| |
| The list of SVDE members can be consulted at [[ShareVDE:Main Page/SVDE institutions|Share-VDE institutions]].
| |
| | |
| The '''continuous cooperation between the SVDE IT team and the [[ShareVDE:Members/Share-VDE working groups|working groups of SVDE libraries]]''' brought several important results.
| |
| | |
| In the context of the SVDE AIMS-CKB working groups, SVDE has prepared the ground for '''JCricket Cluster Knowledge Base Editor and authority services developments''': the design of the editor module has been completed as far as functions for user interaction with the module itself (see an example of the [https://xd.adobe.com/view/bcae5027-64c1-4a56-5a31-3b6feae5e338-ca9f/?fullscreen&hints=off function merging two author clusters in one]). SVDE IT team is currently working on a detailed analysis of authentication and permission functions. This is key for JCricket editing functions (e.g. definition of roles for users and actions that they can perform), but it’s also functional to SVDE in general as far as interaction with other skin portals/tenants is concerned.
| |
| | |
| Also, the analysis of authority services has been completed within the AIMS working group and SVDE team is analysing the '''integration with Wikidata''' and ISNI. Connected to authority services and interaction between SVDE and external sources, the PCC has launched the '''PCC Wikidata pilot'''. This pilot can be beneficial to SVDE interaction and data exchange with Wikidata, and Casalini Libri is taking part in the pilot with reference to SVDE, see the project page on Wikidata [[wikidata:Wikidata:WikiProject_PCC_Wikidata_Pilot/Casalini_Libri._SVDE-Wikidata_Interaction|Casalini Libri. SVDE-Wikidata Interaction]].
| |
| | |
| The '''revision of the [http://bit.ly/Comparison_LRM-BF-SVDE entity model]''' with the Sapientia Entity Identification (SEI) working group is a major achievement: SVDE model is a four layered adaptation of BIBFRAME comprising the entities svde:Opus | svde:Work | svde:Instance | svde:Item. This structure ensures interoperability with other environments using LRM-based models or pure BIBFRAME models.
| |
| | |
| Among the Share Family of library driven initiatives [[ShareVDE:Members/Share-VDE working groups|a new '''working group''' has started dedicated to the practical cooperation among the '''National Bibliographies''']]. Considering the important presence of several National Libraries in the Share-VDE community and in the broader network of institutions that follow the progress of this initiative and of other Linked Open Data projects, this working group has been launched in order to study and address the needs of National Libraries and institutions that hold National Bibliographies in the framework of a shared entity discovery environment such as the Share Family of initiatives. [https://wiki.share-vde.org/w/images/9/9f/National_Bibliographies_Share_Family_initiative_%282022-June%29.pdf Read the Executive summary of the National Bibliographies initiative].
| |
|
| |
|
| ==Current goals== | | ==Current goals== |
| Line 79: |
Line 33: |
|
| |
|
| *the first version of the linked data entity editor JCricket, that will enable several actions on the clusters of entities saved in the SVDE Cluster Knowledge Base, including creation, modification, merge of clusters of works, of agents etc.; | | *the first version of the linked data entity editor JCricket, that will enable several actions on the clusters of entities saved in the SVDE Cluster Knowledge Base, including creation, modification, merge of clusters of works, of agents etc.; |
| *third parties integration through the automated interaction between SVDE and external ILS/LSP such as FOLIO and Sinopia; | | *third parties integration through the automated interaction between SVDE and external ILS/LSP such as Alma, FOLIO and Sinopia; |
| *the creation of a SVDE ontology as outcome of the dedicated Sapientia Entity Identification working group; | | *the creation of a SVDE ontology as outcome of the dedicated Sapientia Entity Identification working group; |
| *further progresses on the developments of new tenants, skin portals and SVDE localisations; | | *further progresses on the developments of new tenants, skin portals and SVDE localisations; |
This section is a summary of Share-VDE and Share Family activities. If after clicking on a link to a page or a file you are requested to input your credentials, it means that the resource is available to Share-VDE and Share Family members only.
Useful documentation
For new members, useful tools and information describing the main procedures and practicalities to get on board can be found in the Members area section.
While the Public documentation section collects detailed information on the components and tools underlying the Share-VDE and Share Family technology.
Latest activities
The following activities track the major progresses in order to make Share-VDE evolve, as sketched in the presentation of the initiative.
- Share-VDE is live at https://svde.org with an enhanced Entity Discovery Portal and Linked Data Management System. The load of Share-VDE libraries’ data will be done progressively and currently the discovery portal hosts a subset of the data of member institutions. Developments are being carried on to move all the technological components to a full production state.
- Users external to Share-VDE are welcome to provide feedback on the discovery portal, report bugs and suggestions: reach out through the forum https://forum.svde.org/.
News and updates are periodically published on this wiki in an extensive Bulletin.
Share development team organisation
The numerous upgrades to the back-end and front-end infrastructures over the years lead to an enhanced version of the LOD Platform, that is the technology framework of the Share Family of initiatives.
The Share IT team has been restructured and enlarged in order to cope with the increasing complexity of the developments, meet the needs of the community and interconnect with several projects. There are several development sub-teams devoted to the main components of the system:
- Infrastructure & Architecture (set-up and enhancement of the backbone of the system);
- Clustering module (continuous optimisation of the core components for data processing and aggregated entities creation);
- Backend APIs (Database and Indexing, APIs development for Share Family portals, JCricket backend functions);
- Frontend (design and creation of general frontend components, frontend of Share Family portals implementation and interaction with backend, JCricket front-end functions);
- BIBFRAME and RDF conversion (refactoring of the component that creates BIBFRAME / RDF data and that feeds triple store for SPARQL queries).
Current goals
Among many work strands that the Share Family development staff is involved in, the current focus is on the enhancement of the whole Share-VDE and Share Family infrastructure, including:
- the first version of the linked data entity editor JCricket, that will enable several actions on the clusters of entities saved in the SVDE Cluster Knowledge Base, including creation, modification, merge of clusters of works, of agents etc.;
- third parties integration through the automated interaction between SVDE and external ILS/LSP such as Alma, FOLIO and Sinopia;
- the creation of a SVDE ontology as outcome of the dedicated Sapientia Entity Identification working group;
- further progresses on the developments of new tenants, skin portals and SVDE localisations;
- continuously feeding the PCC data pool with regular updates of PCC records converted to linked data.
To read the latest updates issued to the Share Family community and track back previous progresses, see the Share Family News and updates page.
Events and conferences
Share-VDE fosters the participation of its members to conferences, events and initiatives of interest for the community. The dedicated sub-group Library Community Events monitors the events in the library community and evaluates which ones are appropriate to submit to. The aim of this group is to put SVDE member libraries in the foreground as the protagonists of SVDE initiative itself, share outcomes, disseminate results and possibly expand the SVDE community as an effect of the group activity.
An internal calendar is continuously updated with the relevant events (see below) and the output of participation to initiatives, events and presentations are collected in the section dedicated to articles and resources.
Screenshot from the internal calendar of events monitored by the Library Community Events sub-group
