mNo edit summary |
mNo edit summary |
||
Line 1: | Line 1: | ||
{{DISPLAYTITLE:Share Family news and updates}} | {{DISPLAYTITLE:Share Family news and updates}} | ||
Line 32: | Line 33: | ||
*the configuration of the simple search function that enables the option of Publication simple search default, where this is relevant (e.g. in the National Bibliographies tenant and [https://bl.natbib-lod.org/ British National Bibliography skin portal]); | *the configuration of the simple search function that enables the option of Publication simple search default, where this is relevant (e.g. in the National Bibliographies tenant and [https://bl.natbib-lod.org/ British National Bibliography skin portal]); | ||
*the initial version of Subject entity, that [https://www.svde.org/infinite-jest-a-novel-p1401654885176149/subjects aggregates all subjects pertaining to a resource], with their Provenance. This will be enhanced by Concepts, ie. the pieces that form a subject string and that are currently added to the [https://www.svde.org/family-life-fiction-s1031654873687244/original-works-about Subject pages] in a rough version; | *the initial version of Subject entity, that [https://www.svde.org/infinite-jest-a-novel-p1401654885176149/subjects aggregates all subjects pertaining to a resource], with their Provenance. This will be enhanced by Concepts, ie. the pieces that form a subject string and that are currently added to the [https://www.svde.org/family-life-fiction-s1031654873687244/original-works-about Subject pages] in a rough version; | ||
*the tracking of Provenance: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, while the discovery portal shows which institutions have contributed e.g. to subjects. Provenance is also key to support the editing of linked data entities with [https://wiki.share-vde.org/w/images/7/74/JCricket_overview_-_2023-Jan-26.pdf | *the tracking of Provenance: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, while the discovery portal shows which institutions have contributed e.g. to subjects. Provenance is also key to support the editing of linked data entities with [https://wiki.share-vde.org/w/images/7/74/JCricket_overview_-_2023-Jan-26.pdf JCricket editor], to track updates and collaborative services; | ||
*as mentioned above, skin portals are available for individual institutions. While the main entity discovery portal of a tenant shows the data of all the institutions feeding the tenant's Cluster Knowledge Base (e.g. svde.org), the skin portal gives the ability to filter only the data of the institution that the skin portal has been designed for. To this aim, an ad hoc function was added to filter publications by what is available at the current library. It is enabled on skin portals at Publication (= Instance) level in these cases: | *as mentioned above, skin portals are available for individual institutions. While the main entity discovery portal of a tenant shows the data of all the institutions feeding the tenant's Cluster Knowledge Base (e.g. svde.org), the skin portal gives the ability to filter only the data of the institution that the skin portal has been designed for. To this aim, an ad hoc function was added to filter publications by what is available at the current library. It is enabled on skin portals at Publication (= Instance) level in these cases: | ||
**in advanced search, see e.g. NYU data pre-filtered here https://nyu.svde.org/advanced-search/publications?q=(title+does_not_contain+xyz)&heldAtLibrary=true (see the toggle on the right of the screen, you can turn it on / off); | **in advanced search, see e.g. NYU data pre-filtered here https://nyu.svde.org/advanced-search/publications?q=(title+does_not_contain+xyz)&heldAtLibrary=true (see the toggle on the right of the screen, you can turn it on / off); | ||
Line 46: | Line 47: | ||
===Major milestones during 2023=== | ===Major milestones during 2023=== | ||
One of the most important work strands involves the '''linked data entity editor | One of the most important work strands involves the '''linked data entity editor JCricket'''. The work on the back-end APIs has been completed, while the respective front-end features are being developed. As soon as a preview of the early functions will be available, we will provide more updates on this. To give evidence to the ongoing work, we are organizing a step-by-step release method that will allow us to share progresses with the community as we go along. | ||
Much work is also ongoing behind the scenes to complete '''all the pieces of the Share-VDE system pipeline''', that we aim to finalise during 2023: | Much work is also ongoing behind the scenes to complete '''all the pieces of the Share-VDE system pipeline''', that we aim to finalise during 2023: | ||
Line 208: | Line 209: | ||
mso-ansi-language:IT;mso-fareast-language:EN-US;mso-bidi-language:AR-SA">Management of the Provenance</span>''' <span style="font-size:11.0pt;font-family:"Arial Nova Cond",sans-serif; | mso-ansi-language:IT;mso-fareast-language:EN-US;mso-bidi-language:AR-SA">Management of the Provenance</span>''' <span style="font-size:11.0pt;font-family:"Arial Nova Cond",sans-serif; | ||
mso-fareast-font-family:"Times New Roman";mso-bidi-font-family:Calibri; | mso-fareast-font-family:"Times New Roman";mso-bidi-font-family:Calibri; | ||
mso-ansi-language:IT;mso-fareast-language:EN-US;mso-bidi-language:AR-SA">of library resources: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, and alo to show which institutions have contributed to a given linked data cluster (through the Provenance itself). This is crucial to support the editing of linked data entities that will be enabled by the | mso-ansi-language:IT;mso-fareast-language:EN-US;mso-bidi-language:AR-SA">of library resources: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, and alo to show which institutions have contributed to a given linked data cluster (through the Provenance itself). This is crucial to support the editing of linked data entities that will be enabled by the JCricket editor that is under development. See more on Provenance [https://wiki.share-vde.org/w/images/b/b3/Share-VDE_perspective_on_Cluster_Knowledge_Base_and_Provenance.pdf in a recent presentation].</span> | ||
<span style="font-family:"Arial Nova Cond",sans-serif">Concerning other work strands, the developments for the ''' | <span style="font-family:"Arial Nova Cond",sans-serif">Concerning other work strands, the developments for the '''JCricket linked data entity editor''' are moving forward: a lot of work is going on behind the scenes for the implementation of the back-end features that will support the editing of the data in the Cluster Knowledge Base. For example, federated authentication and authorization to manage JCricket users; entity status mechanism to rule concurrent editing and cluster variations; notification management.</span> | ||
<span style="font-family:"Arial Nova Cond",sans-serif">Much work is also being done to '''optimise the general performance of the system''' and in particular of the indexing process, which is a key part of the data load to the web portals. This is not a trivial task when it comes to the very large size of SVDE tenant, which supports an exponential number of clusters created from the original library records. It is critical to have a responsive system and we are doing our best to provide the best user experience possible.</span> | <span style="font-family:"Arial Nova Cond",sans-serif">Much work is also being done to '''optimise the general performance of the system''' and in particular of the indexing process, which is a key part of the data load to the web portals. This is not a trivial task when it comes to the very large size of SVDE tenant, which supports an exponential number of clusters created from the original library records. It is critical to have a responsive system and we are doing our best to provide the best user experience possible.</span> | ||
Line 256: | Line 257: | ||
<span style="font-family:"Arial Nova Cond",sans-serif">The recent huge improvements to the system infrastructure will support the operations for the incremental import of SVDE libraries catalogues that will populate the entity discovery.</span> | <span style="font-family:"Arial Nova Cond",sans-serif">The recent huge improvements to the system infrastructure will support the operations for the incremental import of SVDE libraries catalogues that will populate the entity discovery.</span> | ||
<span style="font-family:"Arial Nova Cond",sans-serif"> | <span style="font-family:"Arial Nova Cond",sans-serif">JCricket, the module for the editing of linked data entities, will be developed throughout 2022 and will benefit from the developments done for SVDE 2.0. Also, the functional analysis done by the [[ShareVDE:Members/Share-VDE working groups|SVDE dedicated working groups]] has framed the interaction with external data sources to be incorporated into JCricket, and we look forward to start working on the inclusion of Wikidata and ISNI data, after the main features of the editor will be completed.</span> | ||
<span style="font-family:"Arial Nova Cond",sans-serif">The working group devoted to [https://wiki.share-vde.org/w/images/7/79/Comparison_IFLA-LRM_BIBFRAME_SVDE.pdf entity modeling] will consolidate the definition of Share-VDE Instance entity properties and will review clustering and conversion rules to optimise system processes, as part of the regular group activities. This is one of the added values to the management of a union catalogue such as Share-VDE.</span> | <span style="font-family:"Arial Nova Cond",sans-serif">The working group devoted to [https://wiki.share-vde.org/w/images/7/79/Comparison_IFLA-LRM_BIBFRAME_SVDE.pdf entity modeling] will consolidate the definition of Share-VDE Instance entity properties and will review clustering and conversion rules to optimise system processes, as part of the regular group activities. This is one of the added values to the management of a union catalogue such as Share-VDE.</span> | ||
Line 323: | Line 324: | ||
This year has been complex for everyone because of the consequences of the COVID pandemic, but that didn’t stop us from moving forward: as announced earlier this month, Casalini Libri and its technological partner @Cult joining forces is the most recent of many steps taken on the Share-VDE path. | This year has been complex for everyone because of the consequences of the COVID pandemic, but that didn’t stop us from moving forward: as announced earlier this month, Casalini Libri and its technological partner @Cult joining forces is the most recent of many steps taken on the Share-VDE path. | ||
From the modelling of Share-VDE entities, to the outline of the main functions of the Cluster Knowledge Base editor | From the modelling of Share-VDE entities, to the outline of the main functions of the Cluster Knowledge Base editor JCricket, we feel that the outcomes of the intense activities carried on with the Share-VDE working groups are of high scientific value for the advancement of Linked Open Data for the library community and the cultural heritage sector. In the same time, we are working with complete dedication to the technical enhancement of the Share-VDE back-end and front-end components and we are eager to apply the tools that we have designed with your precious contribution and collaboration. | ||
We are confident that the results will greatly increase the benefits that linked data offer to libraries, and the progress report attached is an attempt to sketch the development strands that are running simultaneously and the main accomplishments (the report is also available at https://bit.ly/SVDE_WG_progress). | We are confident that the results will greatly increase the benefits that linked data offer to libraries, and the progress report attached is an attempt to sketch the development strands that are running simultaneously and the main accomplishments (the report is also available at https://bit.ly/SVDE_WG_progress). |
Revision as of 13:48, 7 September 2023
Find out the latest news about the Share Family of initiatives and the most relevant updates on the developments going on within the various branches of the family.
As the year 2023 has started, we are happy to look at the results achieved within the Share-VDE and Share Family initiatives over the past year and share with you the goals for the next period.
Among the most recent news, it’s very important to mention that on December 7th the Share-VDE Advisory Council has approved the new Executive Summary. Following the Share-VDE Statement published in 2021, the new Summary outlines the scope of Share-VDE in the context of Linked Open Data for Libraries. We owe much gratitude to the joint effort of the Advisory Council members in writing this important document.
SVDE 2.0 system infrastructure
As you know, we are putting much effort into the work needed towards the production environment.
The adoption of AWS - Amazon Web Services was a milestone to better support system scalability, make it more robust and meet high availability expectations. Right now, we are working on the pre-conditions for the system components to progressively migrate from staging to production. To this aim, we will inform you about planned downtimes of the system in the coming period (one downtime is in course right now, see the alert message a few days ago).
Also, once the back-end environments for all the Share Family tenants will be switched to production and the module of the system managing regular data updates will be in place, the URIs of the entities stored in the various tenants will be persistent.
So far, SVDE 2.0 system processed around 65 million of MARC bibliographic records and 13 million of authority records, to create approximately 150,2 million of BIBFRAME entities. These have been created from the catalogues of SVDE institutions that we have loaded to https://svde.org [1], and for all of them a skin portal is available (see more on skin portals below).
During 2023, we will conclude this round of data ingestion and publication to the SVDE portal.
Regarding the other tenants of the Share Family: the process towards the production environment described above will take place in the same way as we are doing for Share-VDE also for the National Bibliographies tenant (https://natbib-lod.org/), the British National Bibliography skin portal (preview of its beta site: https://bl.natbib-lod.org/), and the PCC data pool that is hosted by the Share-VDE infrastructure (https://pcc-lod.org).
Also, a dedicated task group formed by volunteers PCC members is testing the PCC data pool discovery portal, and the results will greatly improve our work.
New content and overview of technical developments
Among SVDE brand new content, you might want to look at the demo of the Share-VDE entity discovery portal available at https://bit.ly/SVDE-discovery-live-demo. This walkthrough includes an introduction on the Share-VDE user experience and user interface design process. Also, supporting slides with further materials are available at https://bit.ly/SVDE-discovery-demo-slides.
In this video you will see some features of the discovery portal that is worth summarising:
- the configuration of the simple search function that enables the option of Publication simple search default, where this is relevant (e.g. in the National Bibliographies tenant and British National Bibliography skin portal);
- the initial version of Subject entity, that aggregates all subjects pertaining to a resource, with their Provenance. This will be enhanced by Concepts, ie. the pieces that form a subject string and that are currently added to the Subject pages in a rough version;
- the tracking of Provenance: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, while the discovery portal shows which institutions have contributed e.g. to subjects. Provenance is also key to support the editing of linked data entities with JCricket editor, to track updates and collaborative services;
- as mentioned above, skin portals are available for individual institutions. While the main entity discovery portal of a tenant shows the data of all the institutions feeding the tenant's Cluster Knowledge Base (e.g. svde.org), the skin portal gives the ability to filter only the data of the institution that the skin portal has been designed for. To this aim, an ad hoc function was added to filter publications by what is available at the current library. It is enabled on skin portals at Publication (= Instance) level in these cases:
- in advanced search, see e.g. NYU data pre-filtered here https://nyu.svde.org/advanced-search/publications?q=(title+does_not_contain+xyz)&heldAtLibrary=true (see the toggle on the right of the screen, you can turn it on / off);
- in the Original work entity page that lists Publications, see e.g. https://nyu.svde.org/suite-de-la-mancha-flute-cello-piano-unknown-author-o781654264663247/library-publications (see the toggle on the right of the screen, you can turn it on / off);
- a caveat: this function is visible and clickable on all skin portals, but currently works on institutions’ skins that have item data clustered and rendered to the portal. As soon as other institutions’ item data will be clustered and rendered to the portal, the toggle will work there as well;
- all tenants of the Share Family can now search for classification numbers in advanced search.
Moreover, we are working to complete the connection with local library services, to enable the integration with e.g. circulation services, lending system etc.
Regarding other technical developments, the core of SVDE system, ie. the clustering module that creates clusters of BIBFRAME entities, has been reviewed based on the input that users and SVDE libraries have provided (in particular through the dedicated Sapientia Entity Identification Working Group). This revision cycle is still ongoing, and some items are being addressed by this group (see below).
Connected to that, in order to ensure flexibility in gathering users’ feedback and in reviewing the clustering logics, we are preparing a new test environment, which will immediately highlight the changes to data elaboration carried out from time to time.
Major milestones during 2023
One of the most important work strands involves the linked data entity editor JCricket. The work on the back-end APIs has been completed, while the respective front-end features are being developed. As soon as a preview of the early functions will be available, we will provide more updates on this. To give evidence to the ongoing work, we are organizing a step-by-step release method that will allow us to share progresses with the community as we go along.
Much work is also ongoing behind the scenes to complete all the pieces of the Share-VDE system pipeline, that we aim to finalise during 2023:
- the new RDF conversion tool, that will support the export of RDF data dumps (including an updated triple store database) and the import of Sinopia data to close this loop of LD4P project;
- the regular updates module (AKA “delta” updates), to enable periodic imports of MARC records for continuous update of SVDE data;
- the creation of entity clusters of items, generated from libraries’ item data;
- the development of tools / protocols for third parties’ data consumption and harvesting, including APIs, OAI-PMH, Atom feeds and Activity stream;
- a Share Family index, to set-up interconnections among the linked data entities stored in the various tenants.
Community work
Share-VDE initiative is also committed to a continuous community work, through its regular working groups and the participation to the discussion within the broader BIBFRAME community.
In the Share-VDE Advisory Council, Nina Servizzi from New York University is the new Chair starting her service in 2023, following Beth P. Camden from the University of Pennsylvania who served until 2022. We are very grateful to Beth for her wise guidance and we will continue to rely on her as Past Chair. We are very glad to welcome Nina in this role.
The SVDE User Experience – User Interface Working Group has been reconvened recently, having as co-chairs Abigail Sparling from the University of Alberta and Kayt Ahnberg from the University of Pennsylvania. This group steered the design of the current SVDE web portal a few years ago, and it’s now called to review the discovery features currently implemented for potential optimisations. These and discussions around new features for future versions of the discovery will be carried on also in cooperation with the National Bibliographies working group, that will also address discovery features specific to the National Bibliographies tenant.
The work of the Sapientia Entity Identification Working Group has among the current tasks the formalization of a SVDE ontology, and to give recommendations on the use of bf:Hub in SVDE data.
In the broader community, we are consolidating the cooperation about BIBFRAME data exchange, launched by the PCC with the PCC – BIBFRAME Interoperability Group that SVDE participate in.
Also, the continuous discussions with the Library of Congress, the PCC, the LD4P – Linked Data for Production project, and OCLC will be of great importance to contribute to BIBFRAME interoperability among linked data nodes.
Events and conferences
Finally, numerous events and conferences have taken place in the latest months where the Share-VDE team and member libraries had the occasion to contribute, and we hope for more in the future.
On January 19th Jim Hahn from the University of Pennsylvania will present at a session of the ALA/Core Linked Data Interest Group, addressing topics about BIBFRAME interoperability that also touch the SVDE experience.
The Share-VDE wiki Resources page collects the materials presented at such events.
As usual, we would be happy to have your feedback on the initiative, or any other questions or comments. Don’t hesitate to look at the SVDE wiki https://wiki.svde.org for more details on the initiative, or to contact us at info@svde.org.
[1] Library catalogues loaded to svde.org and converted to BIBFRAME so far:
Duke University https://duke.svde.org
Library of Congress https://loc.svde.org/
National Library of Finland https://natlibfi.svde.org/
National Library of Norway https://nln.svde.org/
New York University https://nyu.svde.org
Smithsonian Institution https://smithsonian.svde.org/
Stanford University https://stanford.svde.org
University of Pennsylvania https://penn.svde.org
University of Alberta Library https://ualberta.svde.org
September and the coming autumn are continuing a rich set of conferences where Share-VDE and the wider Share Family community will contribute with presentations and speeches.
As you might already know, on September 20th – 21st the BIBFRAME Workshop in Europe will take place in Budapest, with a pre-meeting on Monday 19th specific to SVDE.
After visiting Frankfurt, Florence and Stockholm, and two online editions, the 2022 workshop will be a free hybrid event, hosted by the National Széchényi Library. This year's focus will be on BIBFRAME in operation, new developments and interoperability.
The aim of the BIBFRAME Workshop in Europe is to be a forum for sharing knowledge about planning, practice and production relating to BIBFRAME implementation. The intention is to bring together the community working or interested in the transition from MARC to Linked Data using the BIBFRAME model and related tools.
The workshop areas are strongly focused on the practical implementation of BIBFRAME, rather than being a theoretical Linked Data / Semantic Web event.
Share-VDE presentation will be on Wednesday 21st focussing on the progress of the initiative and on the compatibility of SVDE BIBFRAME output with other BIBFRAME nodes in the library community.
The full programme, registration link and practical information on how to join in presence or online are available at https://2022.bfwe.eu.
Also, for those who will be in Budapest, you are welcome to join the informal SVDE meeting on Monday 19th at 2.30pm – 4.30pm CEST.
It will be a nice occasion to get together in person and discuss the status of the initiative. This pre-meeting will be in presence, but online connection should also be supported – we will post the link to join as soon as available.
In general, please find here the major events that took place during the Summer and that will take place in the coming Fall touching the Share-VDE world:
ALA annual:
- A Comparative Evaluation of Linked Data Discovery in the Share-VDE 2.0 Catalog, on June 25th, by Jim Hahn, Beth Camden, Kayt Ahnberg (University of Pennsylvania);
- Share-VDE semi-annual Workshop on June 27th, with Share-VDE and Share Family members; the agenda including the link to the presentations and the recording is available at https://bit.ly/SVDE_workshop_2022-Jun-27;
LD4 Conference – The Share Family—One Project, Many Tenants, on July 15th, by Beth Picknally Camden (University of Pennsylvania), Alan Danskin (British Library), Abigail Sparling (University of Alberta), Roberto Delle Donne (University of Naples Federico II); recording available;
WOLFcon – Tiziana’s presentation Share-VDE and FOLIO cooperation on September 2nd;
Linked Data and International Standards for Cultural Heritage at KBR – Royal Library of Belgium – Tiziana’s presentation The Share family, a shared and integrated ecosystem for library linked data, on September 13th;
TPDL conference 2022 – Conducting the Opera: The Evolution of the RDA Work to the Share-VDE Opus and BIBFRAME Hub, on September 22nd, by Ian Bigelow (University of Alberta);
DCMI 2022 – Dublin Core Metadata Initiative – virtual panel BIBFRAME Implementation Experiences, on October 4th, with Sally McCallum (Library of Congress), Niklas Lindström (National Library of Sweden), Tiziana Possemato (@Cult and Casalini Libri / Share-VDE);
Charleston Conference – online session From idea to implementation: BIBFRAME becomes reality, on November 14th, with Sally H. McCallum (Library of Congress), Beth Picknally Camden (University of Pennsylvania), Nancy Lorimer (Stanford), Simeon Warner (Cornell), Tiziana Possemato (@Cult-Casalini Libri)
SWIB 2022 – online session Evaluation and evolution of the Share-VDE 2.0 Linked Data Catalog, between November 28th and December 2nd, with Beth Camden, Jim Hahn, Kayt Ahnberg (University of Pennsylvania), Filip Jakobsen (Samhæng)
To see the full list of presentations and events, please browse the Share-VDE wiki resources section.
As always, you can follow the implementations and the progresses of the numerous activities related to the entity management, the discovery platform and the connected output on https://wiki.svde.org.
We are happy to announce the Share-VDE semi-annual workshop for current and former members and for observer institutions on Monday June 27th at 8am - 10am PDT | 11am - 1pm EDT | 5pm - 7pm CEST.
It’s a great pleasure to announce that the meeting will be held in hybrid format, both in presence and online. For those who are able to join the session in presence, the venue is in the Jefferson Building at the Library of Congress, in the Room # LJ119.
Much gratitude goes to the Library of Congress for hosting the meeting.
In the file https://bit.ly/SVDE_workshop_2022-Jun-27 you can find the link to the agenda document that includes the instructions to join remotely.
See below an extensive update on the latest developments for Share-VDE and the other branches of the Share Family that are supported by the same LOD Platform technology, towards the production environment. Since the last update shared via this mailing list a few months ago, important advancements have been made particularly to the system infrastructure and to the features that leverage the API layer orchestrating the query of SVDE data.
Having a system capable of hosting union catalogs that integrate catalogs from many libraries producing a rich and articulated structure of linked data entities imposes the challenge of having adequate technological and infrastructural resources to support the connected complexity and amount of data. For this reason, SVDE has recently adopted AWS - Amazon Web Services which will better support system scalability to make it more robust and meet high availability expectations.
Obviously, this further enhancement of infrastructure meant a lot of work in setting up the AWS backbone and integrating it with the pre-existing components, in particular the clustering module and algorithms that are constantly refined and enriched based on the input of the SVDE community itself, particularly through the work of the SEI - Sapientia Entity Identification group.
In light of this, in March we processed an initial set of approximately 42 millions bibliographic and authority MARC records that were converted to create 98 millions of clusters of linked data entities. This process is iterative until all components of the system are stable; therefore in the next few weeks we will continue with the data uploads and the final numbers will be much higher.
A similar process is in course to be replicated also for the other branches and portals housed by the Share Family, that is: the portal dedicated to National Bibliographies which hosts the data of the British National Bibliography, with the British Library being the first institution participant in this tenant; the open pool of PCC-quality BIBFRAME data; the portal of the Kubikat-LOD pilot project which aggregates the catalogs of the four German art history libraries of the Kubikat group.
The SVDE staff is testing the results of loading the data on the various portals through a structured method that will be useful for making constant optimizations to the functioning of the system. (Please note a caveat: because of this reprocessing work, during this and the next week you might experience intermittent outage or downtimes of the Share Family portals due to the re-load of the data. If some of the links included in this message do not work properly, that’s for this reason.)
In parallel with the infrastructure improvement, a number of advancements have been developed, including clustering and search algorithm refinements. Those enhancements are beneficial to all Share Family tenants, and the new processing run of library catalogues in progress these weeks is a prerequisite to activate the new functions.
Just to mention some of the most relevant new features involved:
1. Improvements and refinements to the search functions, including:
Publication simple search, including the default simple search on Publications and the ability to filter for Language, Year, Type, Library, Electronic / Print, Auctions / Exhibitions. The default simple search on Publications will be enabled only on some tenants of the Share Family. As soon as it will be available, we’ll be able to show you more on this.
The search mechanism and search features like facets are configurable at tenant level.
Support for the federated search and integration of data from external sources (es. JSTOR for the Kubikat-LOD pilot portal).
2. Initial version of Subject management, including subject strings linked in the Subject tab of the Publication page and the display of concepts; currently this is visible for example on Kubikat-LOD pilot, and will be displayed soon on the other Share Family portals. There will also be an improvement of the current feature in future versions of the system.
3. User interface functions that enable connections with local library environments or connected services, including the link to the local OPACs and in the future interactive features like circulation request buttons (e.g. see an example of the button “Available at”). Other similar functions are being analysed for further enhancements of the actions available for end users.
4. Link to resources connected with the records (e.g. table of content, review, publisher website etc.).
5. Data representation in different formats including JSON, MARC, MARCXML, RIS (other linked-data based representation formats are in progress, including JSON-LD, RDF XML, N-triples, N3, Turtle, N-Quads, TriX, TriG).
6. Management of the Provenance of library resources: the system can be queried via API to return the bibliographic records of a given Provenance (= institution) connected to an Instance, and alo to show which institutions have contributed to a given linked data cluster (through the Provenance itself). This is crucial to support the editing of linked data entities that will be enabled by the JCricket editor that is under development. See more on Provenance in a recent presentation.
Concerning other work strands, the developments for the JCricket linked data entity editor are moving forward: a lot of work is going on behind the scenes for the implementation of the back-end features that will support the editing of the data in the Cluster Knowledge Base. For example, federated authentication and authorization to manage JCricket users; entity status mechanism to rule concurrent editing and cluster variations; notification management.
Much work is also being done to optimise the general performance of the system and in particular of the indexing process, which is a key part of the data load to the web portals. This is not a trivial task when it comes to the very large size of SVDE tenant, which supports an exponential number of clusters created from the original library records. It is critical to have a responsive system and we are doing our best to provide the best user experience possible.
Developments are also ongoing to complete customised skin portals and SVDE localisations, starting from the University of Pennsylvania dedicated portal.
From the community work standpoint, the SEI - Sapientia Entity Identification working group has concluded the work on the definition of the Instance entity and how it should be clustered among the other SVDE entities, and defined the rules to model the relationships between entities in order to relate them appropriately. This represents a significant contribution to the BIBFRAME based SVDE ontology that is also compatible with IFLA LRM.
Moreover, we are very happy with the progress of the National Bibliographies working group. After the initial discussion phase opened in the first months of the group’s work, we are now structuring the use cases for a tenant hosting a collective global catalogue of national bibliographies in linked open data, thanks to the input of the participating libraries. Starting from this input, we have distilled a first set of high-level use cases that the group is analyzing; the next step is for the group to define priority use cases, that is, those that will be transformed into functions that libraries want to be developed first in the National Bibliographies tenant.
It’s also worth mentioning that the involvement in the discussions stemming from the PCC BIBFRAME Data Exchange meeting will be of great value for the advancement of interoperability and cooperation within the community, and for the Share Family itself. This focus on interoperability among BIBFRAME nodes will also be beneficial to the harmonisation of SVDE - LD4P3 interaction, and the connection with the Sinopia environment.
Regarding other Share-VDE connected services, the initial release of the authority control features for MARC-based environments is now available, while we look forward to designing the BIBFRAME-based authority workflows which will complete the picture of authority control services.
The information to process is a lot, so don’t hesitate to ask for functional, infrastructural or technical details on any of the above.
To provide feedback on the new version of https://svde.org, do report bugs and suggestions by reaching out through the forum https://forum.svde.org/.
For further information on any of the above, do not hesitate to contact us at info@svde.org or consult the SVDE https://wiki.svde.org, that is the source of information about Share-VDE and the Share Family.
As 2022 has started, we are happy to look at the results achieved within the Share-VDE initiative over the past year and share with you the goals for the next period.
Since the release of Share-VDE 2.0 new version in September available at www.svde.org, other advancements have been done particularly to the system infrastructure and to the features that leverage the API layer orchestrating the query of SVDE data. Among others, the content negotiation mechanism used for serving different representations of a resource, and the Provenance that supports the tracking of the data source. More information is available, don’t hesitate to ask for details about API queries.
To provide feedback on the new version of www.svde.org, do report bugs and suggestions reaching out through the forum https://forum.svde.org/.
The new year is very promising as far as upgrades to the Share-VDE 2.0 linked data management system and discovery portal.
We are working on several important objectives and it may be useful to anticipate some that we hope will be of interest to the members of Share-VDE and to the wider community of the Share Family of initiatives.
The recent huge improvements to the system infrastructure will support the operations for the incremental import of SVDE libraries catalogues that will populate the entity discovery.
JCricket, the module for the editing of linked data entities, will be developed throughout 2022 and will benefit from the developments done for SVDE 2.0. Also, the functional analysis done by the SVDE dedicated working groups has framed the interaction with external data sources to be incorporated into JCricket, and we look forward to start working on the inclusion of Wikidata and ISNI data, after the main features of the editor will be completed.
The working group devoted to entity modeling will consolidate the definition of Share-VDE Instance entity properties and will review clustering and conversion rules to optimise system processes, as part of the regular group activities. This is one of the added values to the management of a union catalogue such as Share-VDE.
Developments will continue to complete customised skin portals and SVDE localisations.
After the analysis done by the SVDE working groups dedicated to authority management, the initial release of the authority control features (through both automated and manual processes) for MARC-based environments is being refined, and Stanford University Libraries is early adopter. The next step will be the implementation of BIBFRAME-based authority workflows.
We are very happy about the progress of the new working group dedicated to National Bibliographies that has been meeting regularly since early September. The involvement of SVDE members and external institutions enriches the discussion of interesting input for the creation of an ad hoc Share Family tenant hosting national bibliographies data.
Connected to this, we will be working to the Share Family tenant infrastructure that allows configurability and flexibility of the data grouped and presented according to each specific library or library consortia domain needs.
Various strands of cooperation have been continued and new ones have been activated within the community of institutions that adopt linked data.
Our commitment with the PCC is proceeding to feed the open pool of PCC-quality BIBFRAME data available as a trusted data source for cataloguers.
The collaboration with LD4P3 continues to be an important part of SVDE community work, e.g. as far as the harmonisation of SVDE conversion vs. Sinopia data and connection with Sinopia environment is concerned.
Working Groups involving the Library of Congress, Stanford, OCLC and SVDE stemmed from the PCC BIBFRAME Data Exchange meeting held in September 9-10 2021: the output of this activity will be crucial to reinforce the role of the BIBFRAME nodes in the library community and to foster interoperability among them.
Among the other initiatives and projects based on the same LOD Platform technology framework as Share-VDE, it’s worth mentioning the Kubikat-LOD pilot project where important components emerged that serve the whole Share Family infrastructure. Work is currently progressing for the release of the specific Kubikat tenant.
The Share-Catalogue project is working on the alignment of their processes to SVDE, for example through the update of UNIMARC - BIBFRAME conversion.
All the results achieved and the forthcoming ones are possible also thanks to library members of Share-VDE and Share Family Working Groups and parallel projects that support this initiative and are constantly contributing with the competences of their Subject Matter Experts.
The input that we gather from the linked data community as a whole is also very precious to improve our work.
For further information on any of the above, do not hesitate to contact us at info@svde.org or consult this wiki site.
The new version Share-VDE 2.0 is live at https://svde.org with an enhanced Entity Discovery Portal and Linked Data Management System. The previous version at https://share-vde.org/ will be active in parallel to Share-VDE 2.0 until the migration of libraries’ data on the new system will be completed. The load of Share-VDE libraries’ data is being done progressively and currently the new web portal hosts a subset of the data available on the previous version.
If you want to discover the advanced functions of Share-VDE 2.0, the web portal at https://svde.org is the place to go.
To provide feedback on the new version, report bugs and suggestions reach out through the forum https://forum.svde.org/.
This news has also been published in a dedicated Share-VDE press release.
An important aspect to underline is that the Share-VDE and Share Family components are supported by the LOD Platform technology framework. Among these components, it’s relevant to mention the services for the authority control, that we have developed based on the analysis carried on by the Share-VDE working groups, and the Share Family tenant infrastructure that allows configurability and flexibility of the data grouped and presented according to each specific library or library consortia domain needs.
The Share-VDE Statement has been distributed widely to give context on Share-VDE position in the linked data ecosystem. In light of the work that Share-VDE is carrying on and of its involvement in several international initiatives, the SVDE Advisory Council has approved and published an official statement that is the explanation of position of the initiative in the broader context of Library Linked Open Data.
Several events over the last weeks have marked significant steps for Share-VDE and for knowledge sharing in the library community:
- the NLN – National Libraries Now 2021 conference on 16th – 17th September was a fruitful event where Tiziana Possemato delivered a speech about Experience of International Cooperation: Towards a Collective and Global Catalog of National Bibliographies.
- On the subject of national libraries, a new working group has been formed in Share-VDE and in the Share Family of initiatives dedicated to practical cooperation among institutions managing National Bibliographies. Considering the important presence of several National Libraries in the Share-VDE community and in the broader network of institutions that follow the progress of this initiative and of other Linked Open Data projects, this working group has been launched in order to study and address the needs of National Libraries and institutions that hold National Bibliographies in the framework of a shared entity discovery environment such as the Share Family of initiatives.
If you are interested in this new group, don’t hesitate to contact us at info@svde.org. The materials of the first meeting are available: agenda and notes https://bit.ly/SVDE_National-Bib-WG_2021-Sep-01 and meeting recording National_bibliographies_WG_2021-09-01.mp4.
- The semi-annual SVDE workshop on 20th September was the occasion where the new version of the system was presented. The major achievements are included in the SVDE Workshop agenda https://bit.ly/SVDE_workshop_2021-Sep-20. Among the workshop materials:
- SVDE workshop 2021-Sep-20_progress_status.pdf (this presentation was delivered also at the BIBFRAME Workshop in Europe on September 21st);
- as mentioned above, the new SVDE 2.0 is now live at https://svde.org, you are welcome to have a tour of the beta system (some information about it is available at https://www.svde.org/about/about-share-vde);
- the recording of the SVDE Workshop can be useful to see a thorough demo of the new systemShare-VDE Workshop September 20 2021.mp4.
- The BIBFRAME Workshop in Europe from September 21st to 23rd engaged a large community of BIBFRAME adopters and professionals working in the transition from MARC to Linked Data using the BIBFRAME model. The first afternoon was focused on implementations (including Share-VDE), the second afternoon on new developments, and the third one on a vast data exchange topic including a panel on RDA/RDF. The presentations and links to the recordings of the sessions are available at https://2021.bfwe.eu/.
As the year comes to an end, several important updates on Share-VDE in 2020 are worth sharing. Those of you who follow the initiative very closely are already informed about the major achievements so far, but I am pleased to share our progresses with the whole Share-VDE community.
This year has been complex for everyone because of the consequences of the COVID pandemic, but that didn’t stop us from moving forward: as announced earlier this month, Casalini Libri and its technological partner @Cult joining forces is the most recent of many steps taken on the Share-VDE path.
From the modelling of Share-VDE entities, to the outline of the main functions of the Cluster Knowledge Base editor JCricket, we feel that the outcomes of the intense activities carried on with the Share-VDE working groups are of high scientific value for the advancement of Linked Open Data for the library community and the cultural heritage sector. In the same time, we are working with complete dedication to the technical enhancement of the Share-VDE back-end and front-end components and we are eager to apply the tools that we have designed with your precious contribution and collaboration.
We are confident that the results will greatly increase the benefits that linked data offer to libraries, and the progress report attached is an attempt to sketch the development strands that are running simultaneously and the main accomplishments (the report is also available at https://bit.ly/SVDE_WG_progress).
For the future, we hope that the Share family will expand and we are very grateful to every single institution involved and to Linked Data for Production for the fruitful and constant cooperation.
The following document includes the most relevant achievements of the Share-VDE initiative over the 2019: Share-VDE major achievements in 2019.