Last edited 2 weeks ago
by Anna Lionetti

ShareFamily:NewsAndUpdates: Difference between revisions

mNo edit summary
mNo edit summary
Line 15: Line 15:
* [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/January2023 Number 7, January 2023]
* [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/January2023 Number 7, January 2023]
* [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/December2023 Number 8, December 2023]
* [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/December2023 Number 8, December 2023]
* [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/July2024 Number 9, July 2024]






'''<big>Number 9, July 2024</big>'''
'''<big>Number 10, April 2025</big>'''
 
You can download a printable version at https://bit.ly/SFBulletin_n9_Jul2024
 
Citation: Share Family Team, ''Share Family Bulletin'' ''9'' (July 2024), https://bit.ly/SFBulletin_n9_Jul2024
 


You can download a printable version at 


Citation: Share Family Team, ''Share Family Bulletin'' ''10'' (April 2025),
== Introduction ==
== Introduction ==
The Share Family progress continues, with ongoing efforts dedicated to advancing the [https://wiki.share-vde.org/wiki/ShareDoc:PublicDocumentation/LODPlatform LOD Platform technology] into production workflows, enhancing system components, and transitioning to the new version 3 of our application.
The Share Family is committed to fostering cooperation among its member institutions and within the broader GLAM community to showcase the immense value of being part of an initiative developed and driven by libraries for libraries.  
 
== Version 3.0.0 release and LOD Platform developments ==
First of all, we're very excited to announce the major release of the 3.0.0 version of our software! You can find the release notes here: [[ShareDoc:PublicDocumentation/Release notes|https://wiki.share-vde.org/wiki/ShareDoc:PublicDocumentation/Release_notes]].   
 
This is a major release that introduces many changes in the software and in data processing algorithms. The new version of the [[ShareDoc:PublicDocumentation/LODPlatform|Share Family LOD Platform technology]] framework will be installed in the various environments of [[ShareFamily:Main Page#The%20Share%20Family%20branches%20(tenants)|Share Family tenants]] over the next period.
 
The release encompasses the following components of the LOD Platform: Cluster Management Module (which manages the clusters of entities that feed the CKB - Cluster Knowledge Base, also called Entity Knowledge Base), API layer, Front-end module, RDBMS (database), RDFizer (BIBFRAME / RDF conversion module). Being a major release, several important features and new components have been added to the system, ie. Delta processes, UNIMARC services and JCricket entity editor, the platform’s shared cataloguing tool. This release addresses both bug fixes as well as new developments and enhancements.


The software versions released over time are shared across all layers of [https://www.share-family.org/ Share Family initiative]’s technology. For an overview of the software versions installed on the different environments, see [https://docs.google.com/presentation/d/17rqBd5YPx4LlTs22d8-uMAeZca5sfZp1NARUASPIKEw/edit#slide=id.g213b29c3396_0_0 Share Family AWS environments summary].
The Share Family’s collaborative approach to linked open data results in advanced technology applications for bibliographic descriptions and shared data management tools. Member institutions embrace the recent progress of LOD Platform technology and are empowered by the advantages of linked open data for knowledge sharing.


The summary below describes some of the major and most relevant features, with a high-level mention. Further information on descriptive tasks corresponding to implementations can be found in the release notes.
== Version 3.1.1 and LOD Platform developments ==
The version 3.0.0 of the [[ShareDoc:PublicDocumentation/LODPlatform|LOD Platform]] that was announced [https://bit.ly/SFBulletin_n9_Jul2024 in the latest issue of the Share Family Bulletin] has introduced substantial changes to the technology framework supporting the system. JCricket entity editor and shared cataloguing tool is the major enhancement of v.3.0.0, but the system has undertaken important optimisations in the [[ShareDoc:PublicDocumentation/Release notes|following software releases 3.1.0 and 3.1.1]], which are currently being tested by member institutions.  


=== JCricket Entity Editor ===
The LOD Platform technology is shared across all environments of the [https://www.share-family.org/ Share Family initiative], and software releases are rolled out to the various [[ShareFamily:Main Page#The%20Share%20Family%20branches%20(tenants)|tenants]] following a dedicated schedule.
JCricket is the tool for collaborative linked data entity management and shared cataloguing. It enables - according to the BIBFRAME ontology - the entity curation (e.g. creation of new entities, entity modification, the application of entity merge and split functions). The scope is to improve the quality of the Entity Knowledge Base, a source of living data produced through clustering and ongoing update processes. JCricket is a manual application that makes it possible to manage bibliographic data in the form of entities. It empowers professional librarians to enhance the quality of machine-generated data output of MARC to BIBFRAME transformation. Its optimal application is within a large data pool formed through contributions from multiple libraries, such as Share-VDE; therefore, it does not impact original data that reside in member libraries’ systems, unless libraries want to use ad hoc APIs for entity updates both in SVDE and in their local systems, which is also an option.


Initially, Share members are currently testing JCricket under controlled conditions. You can explore more of JCricket in the [[ShareDoc:PublicDocumentation|Public Documentation section]] of the Share Family wiki at [[ShareDoc:PublicDocumentation/LODPlatform/EntityEditor|https://wiki.share-vde.org/wiki/ShareDoc:PublicDocumentation/LODPlatform/EntityEditor]] and check out Tiziana Possemato’s demo of JCricket entity editor at the 2024 Share Family Workshop: https://www.youtube.com/live/8xBeGB3Npls.
=== Cluster Knowledge Base and Data Management ===
'''<big>Entity model and Cluster Knowledge Base</big>'''


=== Data management ===
The LOD Platform currently supports the latest version of the BIBFRAME ontology, and will upgrade the MARC-to-BIBFRAME mapping to the most up to date version. The use of BIBFRAME within the Share Family initiative has been extended to guarantee interoperability with IFLA LRM and with applications not based on BIBFRAME. The [https://zenodo.org/doi/10.5281/zenodo.8332350 SVDE Ontology] is the result of work that has been carried on since last year by the SEI - Sapientia Entity Identification Working Group, with the svde:Opus entity being the most prominent extension of the ontology.
'''<big>Fine-tuning of data update procedures</big>'''


Data update processes handle ongoing updates (“delta updates” in Share Family jargon), to enable periodic imports of MARC records for continuous update of system data. By “Delta” updates we mean the changes that occur to the library records that are periodically pushed to the LOD Platform, to be published on the discovery portal. The automation of the ingestion in the LOD Platform of updated library records has the purpose of regularly updating the data available through the discovery interface and the other endpoints of the workflow where the data are available. This means updating the data of the clustered entities and the related resources searchable on the discovery interface and in the triplestore, according to the frequency requested by the library.
The output of the SEI Working Group is being incorporated in the LOD Platform components, e.g. the OpusType property is available in the test environment and can be used in the JCricket entity editor that is being tested.


A key aspect of LOD Platform data management is the ability to manage data at a very fine granularity level. The aim is to have the [[ShareDoc:PublicDocumentation/LODPlatform/ClusterKnowledgeBase|CKB - Cluster Knowledge Base]] (or Entity Knowledge Base) as a single source of truth for the LOD Platform and Share Family installations. This will improve:


* a “format-agnostic” CKB where all input formats converge into one conversion source (eg. MARC21, UNIMARC, native BIBFRAME/RDF eg. from LD4P Sinopia application profiles…);


<big>'''RDFizer'''</big>
* improved conversion from MARC to BIBFRAME and vice versa;
* single conversion pipeline from the CKB – removing the conversion pipeline based on MARC.


The RDFizer module that automates the entire process of converting and publishing data in RDF-based BIBFRAME descriptions has implemented conversion for additional MARC21 bibliographic tags and subfields to be compliant with the mapping and conversion rules published by the Library of Congress (version 2.4). As mentioned in [https://wiki.share-vde.org/wiki/ShareFamily:NewsAndUpdates/December2023#Granularization_of_the_Cluster_Knowledge_Base_and_new_conversion_model previous updates], the work is proceeding for creating a finer granularity level in the CKB: all MARC and UNIMARC fields and subfields have been mapped, which will also support the implementations related to Linked Data Fragments (see below).
One of the main pipelines we’re following in this context is the management of attributes through controlled vocabularies instead of literals. This is being achieved by:


* defining each controlled vocabulary in collaboration with the Sapientia Entity Identification Working Group;
* enriching each vocabulary with external authoritative sources (RDA, Library of Congress, FINTO…);
* clustering of controlled vocabularies and assignment of a URI to each value.


 
After completing the work on these vocabularies, they will be made available on JCricket.
'''<big>Linked Data Fragments</big>'''
 
We are experimenting with a new approach for publishing linked data descriptions in various serialization formats. In big data-driven environments, accessing, querying, and processing vast datasets efficiently is challenging. Linked Data Fragments (LDF) have emerged as a promising paradigm to address these challenges by providing a distributed and scalable approach for publishing and serving Linked Data. As part of this initial investigation, we developed a set of Web APIs that adopt Linked Data Fragments and provide the following benefits: real-time RDF generation and publication, on-demand ontology mapping, and multi-provenance management.
 
More will be shared as soon as the proof of concept will be available. In the meantime, access Andrea Gazzarini’s presentation about Linked Data Fragments titled ''Real-Time “RDFization” - How to provide instant Semantic Graphs without any RDF storage'' at the 2024 Share Family Workshop:
 
* slides: https://bit.ly/SVDE_Workshop2024_slides;
* recording: https://www.youtube.com/live/8xBeGB3Npls?t=4071s .
 




'''<big>UNIMARC</big>'''
'''<big>UNIMARC</big>'''


Numerous advancements were implemented based on direct mapping between UNIMARC and BIBFRAME. The UNIMARC services development stems from the SHARE Catalogue project and the Italian libraries affiliated to this platform, but it can benefit all institutions adopting UNIMARC. These libraries are involved in a specific project related to the direct management of UNIMARC records in clusterization and reconciliation processes without the “middle step conversion” from UNIMARC to MARC21. All related developments are finalized to allow the migration of the SHARE Catalogue platform to the new CKB infrastructure, according to the above-mentioned approach. This work will be shared with the linked data community through a Wikibase instance https://unimarc2bibframe.wikibase.cloud/ that will be enriched and documented.
The direct management of UNIMARC records in clusterization and reconciliation processes without the “middle step conversion” from UNIMARC to MARC21 has been completed, and a Wikibase instance https://unimarc2bibframe.wikibase.cloud/ documents this work. An update has also been provided at the 6th IFLA UNIMARC Users Meeting in November 2024, with the presentation by Tiziana Possemato and Claudio Forziati [https://wiki.share-vde.org/w/images/c/c4/10_Possemato_Forziati.pdf UNIMARC-BIBFRAME Mapping: Evolving Interoperability in Data Modelling] ([https://youtu.be/uNpQXHTS3pw?feature=shared&t=3561 recording available]).


To learn more about this topic, you can check out ''The SHARE Catalogue: UNIMARC-BIBFRAME Mapping - An Evolving Path'', presented by Claudio Forziati at the 2024 Share Family Workshop.  
The related developments had as a result the migration of the SHARE Catalogue platform to the new CKB infrastructure and enhanced entity discovery portal https://www.sharecatalogue-lod.org/ (see also).


* slides: https://bit.ly/SVDE_Workshop2024_slides;
* recording: https://www.youtube.com/live/8xBeGB3Npls?t=3504s .


'''<big>UAT – User Acceptance Testing environment</big>'''


In the Share-VDE tenant, sets of real data from SVDE members institutions have been loaded to a UAT (User Acceptance Testing) environment that runs on the latest software version. The purpose is to test the most recent output of the clusterization of SVDE libraries’ data in a small-scale data pool. Members are validating the results of clusterization processes in the common CKB, ie. the quality of data processing, clustering, linked data conversion and entity display on the discovery portal. Input from the SVDE and Share Family community has always been the foundation of the initiative and an added value to developments.


'''<big>Clusterization processes</big>'''


For further details on improvements on the Share Family’s clusterization processes, delve into this version’s release notes on the Share Family wiki at [[ShareDoc:PublicDocumentation/Release notes]].   
'''<big>Data update procedures</big>'''


Incremental updates of data ingested from member institutions are managed through a dedicated module that has been continuously fine-tuned to streamline and automate the so-called “delta updates” imports. On the Natbib tenant, the institutional portal for the BNB - British National Bibliography currently supports a stable workflow of delta updates ingestion.


The delta updates workflow will be applied to all tenants as soon as massive data import and indexing will be stable.


'''<big>Third parties integration</big>'''                           
=== JCricket Entity Editor ===
     
Upon the release of the LOD Platform v.3.0.0, JCricket was rolled out in a test environment dedicated to member institutions. The first round of tests has been done in the second half of 2024, and a new testing phase is ongoing. Feedback from testers will be incorporated in the application. You can explore more of JCricket in the [[ShareDoc:PublicDocumentation|Public Documentation section]] of the Share Family wiki at [[ShareDoc:PublicDocumentation/LODPlatform/EntityEditor|LOD Platform Entity Editor - JCricket]] and check out the demo of JCricket entity editor at the [https://youtu.be/sD3qYbx0n0Q BIBFRAME Workshop in Europe 2024] ([https://wiki.share-vde.org/w/images/6/6c/day1_004_SFamily_BFWE_2024.pdf slides] are also available).
New data workflows are being analysed to support the use of the LOD Platform technology even outside of the Share Family environment, for the integration with ILS / LSP. We are considering several scenarios where the Share linked data system can simultaneously or alternatively operate on local library systems using libraries’ own tools, and share and cooperatively edit linked data resources across different environments using the JCricket entity editor.
 
The integration with environments and tools like FOLIO, Sinopia and WeCat is proceeding, and a use case for the integration of JCricket and FOLIO will be presented at future conferences this year. A first look at the integration between Share Family technologies and FOLIO was recently presented by Sebastian Hammer and Boaz Nadav Manes at the 2024 Share Family Workshop, in a session named ''FOLIO and Lehigh University Pilot''.
 
* slides: https://bit.ly/SVDE_Workshop2024_slides;
* recording: https://www.youtube.com/live/8xBeGB3Npls?t=1369s.
 
=== Front-end enhancements ===
'''<big>Subjects and Concepts</big>'''
 
We have made improvements to the previous version of Subjects and Concepts display. The concept types implemented in the backend include: Date, Event, Family, Form, Format, Generic Concept, Genre, Language, Meeting, Opus, Organization, Person, Place, Topic. They are returned on the front-end with a basic set of data and relationships with the works connected with the subject.
 
The Subject tab in the Publication page shows the list of subject string and the concepts derived from it:
[[File:Subject tab.png|thumb|547x547px|none]]
 
By clicking on a subject string, users can see a list of works related to that subject, as well as how the subject string is connected to the concepts it comprises.
[[File:Subject page.png|thumb|559x559px|none]]


Clicking on the concepts, a basic version of the Concept page is displayed.
JCricket operates on all layers of the LOD Platform entity model (ie. bf:Agent, svde:Opus, svde:Work, bf:Instance, Item). Also, JCricket users see multi-provenance data at individual attribute level. The tracking of the [[ShareDoc:PublicDocumentation/LODPlatform/EntityEditor#Provenance%20and%20Prism|Provenance]] has been implemented since the beginning as a pivotal element to enable entity data curation by cataloguers from different institutions in a shared space.  


The evolution of JCricket over time illustrates the progress of the tool and future goals.


=== Architecture and infrastructure ===
<big>'''Multi-tenant architecture'''</big>


'''<big>Similar Publications tab</big>'''
Multi-tenancy is an infrastructure configuration that allows many clients to share a single instance of a software application and the related infrastructure resources. We have implemented and are rolling out this approach to reduce effort and machine resources needed to set-up and configure a new tenant or an institutional installation within it. This ensures that data is stored and managed in a unified way, optimizing security, scalability, and efficiency. While built for multi-tenancy, the architecture also seamlessly adapts to private deployments for those who require a dedicated installation.


A new tab on the Publication page showing similar Publications in the same language. We are analysing the algorithm to create similar publications to extend its scope to broader similarity criteria.
[[File:Similar publications.png|thumb|593x593px|none]]


'''<big>New database</big>'''


Because the scale of the Share Family environment has been growing at a big data level (particularly for the largest tenant Share-VDE), we are testing a new database solution that would rely on a NoSQL approach. This would ensure scalability and stable performance in massive data imports and incremental updates.


'''<big>Small revamping to look and feel</big>'''
=== Third parties integration ===
The evolution of the LOD Platform technology encompasses the ability to mutually integrate the data produced with external systems, notably with local ILS and Library Service Platforms and authority sources. This is being achieved through the integration of the LOD Platform tools with local ILS and LSP, or cataloguing modules:


As part of the UX/UI working group's activities, it was decided to switch to sans-serif fonts for a modern look and feel. Additionally, elements on the homepage of https://www.natbib-lod.org/ have been resized to create a more harmonious and visually appealing design.
* Alma: connection to circulation processes have been established; exploration of CRUD APIs together with Alma libraries is in course, to push data from JCricket to Alma;
* FOLIO: pilot integration in progress with Lehigh University (Share-VDE member and FOLIO adopter); initial tests are completed for the automated data flow from JCricket into FOLIO’s Inventory module. The FOLIO Instance is automatically updated starting from input data in JCricket as the “source of truth”. Further use cases of mutual integration are being analysed and tested.
* Sinopia LD4P BIBFRAME cataloguing module: connection to Sinopia and parsing of Sinopia-generated data has been completed; after the testing phase, Sinopia data will be included in the LOD Platform CKB - Cluster Knowledge Base and edited through JCricket.


This work aims to facilitate a hybrid cataloging environment that retains support for existing MARC-based integrations while developing the flexibility and interconnectedness offered by Share Family-maintained entities. By automating this process, this integration project not only enhances the metadata management capabilities of libraries but also paves the way for seamless collaborative cataloging within the Share Family community.


Further references can be found at this wiki page [https://wiki.share-vde.org/wiki/ShareVDE:Activities/Integrations Integration with third parties].


'''<big>Portal switch mechanism</big>'''
Lookup on authoritative sources such as Wikidata is also being developed to query and pull data while using JCricket. An endpoint has been set-up to query Wikidata Agents and Works via API and SPARQL. Currently, this implementation lives in the internal development environment.


A new Switch site button has been added at the bottom of svde.org portal group and skin / institutional portals homepages internal pages ([[ShareDoc:PublicDocumentation/LODPlatform/DiscoveryInterface|see definitions of portal groups and skin portals]]). This button opens a menu where users can select through which portal they want to explore. The aim is to connect portal groups with the related skin portal, so that end users have an immediate overview of what individual skin portals are connected to a portal group.
Finally, efforts to integrate LOD Platform features in other applications are progressing steadily also on other fronts. Two conference presentations by Jim Hahn (University of Pennsylvania) have demonstrated some of the options for interoperability supported by JCricket and LOD Platform search APIs:
[[File:Switch site.png|thumb|584x584px|none]]


Overall, the majority of fixes and enhancements extend to rectifying data retrieval errors and fine-tuning data retrieval errors, culminating in a more uniform and seamless user interaction with the system. Across the board, these efforts work cohesively to bolster the system's intuitiveness and reliability, facilitating smoother navigation and ensuring precise data representation.
* [https://wiki.share-vde.org/w/images/3/3a/Integration_of_The_Share-VDE_Entity_Editor_and_Alma.pdf ''Integration of the Share Family Entity Editor and the Alma ILS''], at the LD4 Conference, 11 October 2024;
* [https://wiki.share-vde.org/w/images/3/39/SWIB_2024_Jim_Hahn_browser-plugin-linked-data-find.pdf ''Browser plugin to enable linked data discovery in a Blacklight Catalog''], at SWIB Conference 2024, 27 November 2024.


== Share Family community work and cooperation ==
== Share Family community work and cooperation ==

Revision as of 10:12, 17 April 2025


This section includes the latest issue of the Share Family Bulletin. More information on the current activities going on within the various branches of the Share Family can be found throughout this wiki website https://wiki.svde.org/, which is the informative hub of Share-VDE and the Share Family.

For a general presentation of the Share Family, of its mission and values, and to find out the latest news, you can also explore the brochure website https://www.share-family.org/.

To explore previous issues of the Share Family Bulletin, feel free to navigate through the following links:


Number 10, April 2025

You can download a printable version at

Citation: Share Family Team, Share Family Bulletin 10 (April 2025),

Introduction

The Share Family is committed to fostering cooperation among its member institutions and within the broader GLAM community to showcase the immense value of being part of an initiative developed and driven by libraries for libraries.

The Share Family’s collaborative approach to linked open data results in advanced technology applications for bibliographic descriptions and shared data management tools. Member institutions embrace the recent progress of LOD Platform technology and are empowered by the advantages of linked open data for knowledge sharing.

Version 3.1.1 and LOD Platform developments

The version 3.0.0 of the LOD Platform that was announced in the latest issue of the Share Family Bulletin has introduced substantial changes to the technology framework supporting the system. JCricket entity editor and shared cataloguing tool is the major enhancement of v.3.0.0, but the system has undertaken important optimisations in the following software releases 3.1.0 and 3.1.1, which are currently being tested by member institutions.

The LOD Platform technology is shared across all environments of the Share Family initiative, and software releases are rolled out to the various tenants following a dedicated schedule.

Cluster Knowledge Base and Data Management

Entity model and Cluster Knowledge Base

The LOD Platform currently supports the latest version of the BIBFRAME ontology, and will upgrade the MARC-to-BIBFRAME mapping to the most up to date version. The use of BIBFRAME within the Share Family initiative has been extended to guarantee interoperability with IFLA LRM and with applications not based on BIBFRAME. The SVDE Ontology is the result of work that has been carried on since last year by the SEI - Sapientia Entity Identification Working Group, with the svde:Opus entity being the most prominent extension of the ontology.

The output of the SEI Working Group is being incorporated in the LOD Platform components, e.g. the OpusType property is available in the test environment and can be used in the JCricket entity editor that is being tested.

A key aspect of LOD Platform data management is the ability to manage data at a very fine granularity level. The aim is to have the CKB - Cluster Knowledge Base (or Entity Knowledge Base) as a single source of truth for the LOD Platform and Share Family installations. This will improve:

  • a “format-agnostic” CKB where all input formats converge into one conversion source (eg. MARC21, UNIMARC, native BIBFRAME/RDF eg. from LD4P Sinopia application profiles…);
  • improved conversion from MARC to BIBFRAME and vice versa;
  • single conversion pipeline from the CKB – removing the conversion pipeline based on MARC.

One of the main pipelines we’re following in this context is the management of attributes through controlled vocabularies instead of literals. This is being achieved by:

  • defining each controlled vocabulary in collaboration with the Sapientia Entity Identification Working Group;
  • enriching each vocabulary with external authoritative sources (RDA, Library of Congress, FINTO…);
  • clustering of controlled vocabularies and assignment of a URI to each value.

After completing the work on these vocabularies, they will be made available on JCricket.


UNIMARC

The direct management of UNIMARC records in clusterization and reconciliation processes without the “middle step conversion” from UNIMARC to MARC21 has been completed, and a Wikibase instance https://unimarc2bibframe.wikibase.cloud/ documents this work. An update has also been provided at the 6th IFLA UNIMARC Users Meeting in November 2024, with the presentation by Tiziana Possemato and Claudio Forziati UNIMARC-BIBFRAME Mapping: Evolving Interoperability in Data Modelling (recording available).

The related developments had as a result the migration of the SHARE Catalogue platform to the new CKB infrastructure and enhanced entity discovery portal https://www.sharecatalogue-lod.org/ (see also).


UAT – User Acceptance Testing environment

In the Share-VDE tenant, sets of real data from SVDE members institutions have been loaded to a UAT (User Acceptance Testing) environment that runs on the latest software version. The purpose is to test the most recent output of the clusterization of SVDE libraries’ data in a small-scale data pool. Members are validating the results of clusterization processes in the common CKB, ie. the quality of data processing, clustering, linked data conversion and entity display on the discovery portal. Input from the SVDE and Share Family community has always been the foundation of the initiative and an added value to developments.


Data update procedures

Incremental updates of data ingested from member institutions are managed through a dedicated module that has been continuously fine-tuned to streamline and automate the so-called “delta updates” imports. On the Natbib tenant, the institutional portal for the BNB - British National Bibliography currently supports a stable workflow of delta updates ingestion.

The delta updates workflow will be applied to all tenants as soon as massive data import and indexing will be stable.

JCricket Entity Editor

Upon the release of the LOD Platform v.3.0.0, JCricket was rolled out in a test environment dedicated to member institutions. The first round of tests has been done in the second half of 2024, and a new testing phase is ongoing. Feedback from testers will be incorporated in the application. You can explore more of JCricket in the Public Documentation section of the Share Family wiki at LOD Platform Entity Editor - JCricket and check out the demo of JCricket entity editor at the BIBFRAME Workshop in Europe 2024 (slides are also available).

JCricket operates on all layers of the LOD Platform entity model (ie. bf:Agent, svde:Opus, svde:Work, bf:Instance, Item). Also, JCricket users see multi-provenance data at individual attribute level. The tracking of the Provenance has been implemented since the beginning as a pivotal element to enable entity data curation by cataloguers from different institutions in a shared space.

The evolution of JCricket over time illustrates the progress of the tool and future goals.

Architecture and infrastructure

Multi-tenant architecture

Multi-tenancy is an infrastructure configuration that allows many clients to share a single instance of a software application and the related infrastructure resources. We have implemented and are rolling out this approach to reduce effort and machine resources needed to set-up and configure a new tenant or an institutional installation within it. This ensures that data is stored and managed in a unified way, optimizing security, scalability, and efficiency. While built for multi-tenancy, the architecture also seamlessly adapts to private deployments for those who require a dedicated installation.


New database

Because the scale of the Share Family environment has been growing at a big data level (particularly for the largest tenant Share-VDE), we are testing a new database solution that would rely on a NoSQL approach. This would ensure scalability and stable performance in massive data imports and incremental updates.

Third parties integration

The evolution of the LOD Platform technology encompasses the ability to mutually integrate the data produced with external systems, notably with local ILS and Library Service Platforms and authority sources. This is being achieved through the integration of the LOD Platform tools with local ILS and LSP, or cataloguing modules:

  • Alma: connection to circulation processes have been established; exploration of CRUD APIs together with Alma libraries is in course, to push data from JCricket to Alma;
  • FOLIO: pilot integration in progress with Lehigh University (Share-VDE member and FOLIO adopter); initial tests are completed for the automated data flow from JCricket into FOLIO’s Inventory module. The FOLIO Instance is automatically updated starting from input data in JCricket as the “source of truth”. Further use cases of mutual integration are being analysed and tested.
  • Sinopia LD4P BIBFRAME cataloguing module: connection to Sinopia and parsing of Sinopia-generated data has been completed; after the testing phase, Sinopia data will be included in the LOD Platform CKB - Cluster Knowledge Base and edited through JCricket.

This work aims to facilitate a hybrid cataloging environment that retains support for existing MARC-based integrations while developing the flexibility and interconnectedness offered by Share Family-maintained entities. By automating this process, this integration project not only enhances the metadata management capabilities of libraries but also paves the way for seamless collaborative cataloging within the Share Family community.

Further references can be found at this wiki page Integration with third parties.

Lookup on authoritative sources such as Wikidata is also being developed to query and pull data while using JCricket. An endpoint has been set-up to query Wikidata Agents and Works via API and SPARQL. Currently, this implementation lives in the internal development environment.

Finally, efforts to integrate LOD Platform features in other applications are progressing steadily also on other fronts. Two conference presentations by Jim Hahn (University of Pennsylvania) have demonstrated some of the options for interoperability supported by JCricket and LOD Platform search APIs:

Share Family community work and cooperation

The Share Family is committed to fostering cooperation among its member institutions to showcase the immense value of being part of an initiative developed and driven by libraries for libraries.

Ongoing conversations with consortia representatives are underway to define the configurations of this innovative collaboration.

As an example of this effort, the Share Family Executive Summary for Consortia offers additional insights into how the Share Family can assist consortia in transitioning to linked open data, providing valuable strategies and support. Approved by our Advisory Council, the document emphasizes Share Family’s pivotal role in aiding consortia in adopting linked data methodologies for enhanced collaboration. The Share Family aims to empower consortia with the tools and knowledge necessary to seamlessly integrate linked open data principles, fostering innovation and interoperability within consortia networks.

Share-VDE and Share Family Working Groups

Working Groups are the backbone of Share Family activities, which are driven by input from member institutions in a joint effort with Share Staff.

Important tasks are being carried on to support the complete shaping of the SVDE Ontology within the Sapientia Entity Identification group: at the time of writing, the definition of the Opus type individuals is being consolidated (ie. the addition to the ontology of the definitions of the various types of Opus, ie. abstract works and resources that the entity model can support). These additions will be reflected by both the general search and discovery portal, as well as in JCricket Entity Editor.

More on the work carried out on the Opus types was shared by Nancy Lorimer at the 2024 Share Family Workshop in her SVDE Ontology - Update July 2024.

The User Experience – User Interface Working Group cooperating with the National Bibliographies Working Group has analyzed the front-end layer of the entity discovery portals according to a set of evaluation criteria (including for example usability and accessibility, consistency of design and navigation, overall user friendliness, integration with SVDE features and local library discoveries etc.), and is now revising a new design proposal for the Publication page of the entity discovery portal, presenting the aggregation of Work and Instance data. Also the relationship between publication data and the connected item data are being reviewed by identifying user tasks for publication and item data discovery, to support better navigation and end user data consumption.

IFLA, Linked data and BIBFRAME communities

Share Family members continue to play an active role in the library information and linked data communities.

Tiziana Possemato takes on the role of Official liaison IFLA Bibliography Section / Share Family National Bibliographies group, formerly held by Maud Henry from KBR - Royal Library of Belgium. This will ensure the continuation of the collaboration with the IFLA Bibliography Section that Tiziana is already a member of. Related to IFLA activities, a presentation was given at IFLA Midterm meeting of the IFLA Section Preservation and Conservation (PRESCONS), on March 22 2024, by Tiziana Possemato, on the topic of The Share Family initiative to bring Linked Open Data into practice.

Share-VDE participation in the BIG - BIBFRAME Interoperability Group established to create guidelines for data exchange in BIBFRAME, continues successfully, This cooperation with organisations and projects in the BIBFRAME community will foster the extension of the methods and tools shared by linked data nodes for BIBFRAME interoperability.

Information resources

To facilitate the continuous exchange of ideas and principles that collectively define the vision, aims, and progress of Share Family environments and their tools, new materials and accompanying documents have been created to guide member institutions through this process. By utilizing shared materials and documents, member institutions can seamlessly integrate into the Share Family, actively participate in collaborative initiatives, and contribute to the ongoing development and success of the endeavor.

Publications

Article in the Cataloging & Classification Quarterly journal "A Comparative Evaluation of the Share-VDE Search System"

We are pleased to announce the publication of "A Comparative Evaluation of the Share-VDE Search System" by Jim Hahn, Kayt Ahnberg, and Liliana Giusti Serra from the University of Pennsylvania in Cataloging & Classification Quarterly.

This article details a two-year study involving remote UX interviews with twenty participants, including catalogers, students, and faculty. The research used IFLA LRM user tasks and interface evaluation methods to assess how linked data, specifically BIBFRAME, supports search objectives through the Share-VDE portal.

CNI Project Briefing Series contribution with Share Family video presentation

We recently participated in the Coalition for Networked Information's Project Briefing Series, where we shared insights from the ongoing efforts of the Share Family initiative.

Nina Servizzi, Martin Knott and Jacquie Samples presented "The Share Family: Cooperation and Interconnection for a Sustainable Linked Open Data Ecosystem", providing an overview of the Share Family's linked data ecosystem and its impact on library operations.

They explored various aspects, including collaborative cataloging, advanced metadata management tools, and discovery portals, highlighting how these innovations are shaping knowledge accessibility. Access the recording and presentation slides on the CNI’s website and on our wiki at https://wiki.share-vde.org/wiki/ShareFamily:Resources#Year_2024.

You can read and share the announcement on the Share Family website: https://www.share-family.org/news?id=664f471a6b3c1.

Parsifal: monograph on "A model of library collaboration for sharing recorded knowledge"

The digital edition of Parsifal proceedings is online at https://doi.org/10.36253/979-12-215-0356-2. It features papers presented at Parsifal catalog inauguration: "A model of library collaboration for sharing recorded knowledge", held at the Pontificia Università Urbaniana, Vatican City, on May 11th, 2023, along with other previously unpublished essays. The print edition has been released in May. You can access this resource also on the Share Family wiki https://wiki.share-vde.org/wiki/ShareFamily:Resources#Bibliographic_references.

Highlighted articles include:

You can read and share the announcement on the Share Family website: https://www.share-family.org/news?id=664f471a6b3c4.

Dissemination channels

Website www.share-family.org

The primary channel for staying up to date with our project is the Share Family website, www.share-family.org. This digital hub connects our community and serves as a window into the heart of the Share Family initiative, offering a comprehensive overview of our mission, values, goals, and technology. Additionally, the website is a dynamic platform for staying informed about our latest activities, events, and advancements.

YouTube channel

Check out the Share Family’s new YouTube channel at https://www.youtube.com/@Share_Family.

Subscribe to keep up to date with our presentations and events, access informative materials and more!  

Our latest videos:

New Public Documentation section in the Share Family wiki

This wiki section offers a wealth of resources meticulously curated to enhance your knowledge of our projects.

This section contains information about the technological core of the Share Family, the LOD Platform. Insights into the LOD Platform provide a comprehensive overview of the tools, frameworks, and technologies employed to construct and maintain this robust infrastructure supporting the Share Family. Also, the options available for configuring the Entity Discovery Portal part of the LOD Platform provide an overview of the options designed to enhance the experience of end users navigating the linked data descriptions of the resources displayed. These can be applied to individual institutions, consortia or networks of institutions.

From detailed user guides about our discovery portals and editing tool, to the glossary, to exhaustive release notes providing insights into every incremental update, this documentation ensures you're always informed and up-to-date about new developments.

Developers and enthusiasts alike will also be able to access a wealth of API documentation and delve deeper into the technological underpinnings of Share Family with comprehensive information on its core components. This section is a work in progress and will be enriched with more detailed documentation about key components.

Begin your exploration of Share Family's documentation by clicking on this link: https://wiki.share-vde.org/wiki/ShareDoc:PublicDocumentation.

You can read and share the announcement on the Share Family website: https://www.share-family.org/news?id=6698cc0bce0f6.

Events

Regular virtual and in-person events, such as conferences, workshops, and working group meetings, provide opportunities for member institutions to connect, share ideas, and explore potential areas of collaboration.

As usual, documentation stemming from events and presentations (slides and, often, recordings) is available on this page Share Family wiki.

Share Family workshop at ALA 2024

We're excited to share that slides and recording of the 2024 Share-VDE workshop, held on July 1, 2024 at ALA Annual, are now available for access on our wiki page.

Workshop Agenda:

  • JCricket Linked Data Editor Demonstration, Tiziana Possemato, Casalini Libri and @Cult - Share Family;
  • FOLIO and Lehigh University Pilot, Boaz Nadav Manes, Lehigh University and Sebastian Hammer, Index Data;
  • SVDE Ontology - Update July 2024, Nancy Lorimer, Stanford University;
  • The SHARE Catalogue: Unimarc-Bibframe Mapping - An Evolving Path, Claudio Forziati, Federico II University in Naples, SHARE Catalogue;
  • Real-Time “RDFization” - How to Provide Instant Semantic Graphs without Any RDF Storage, Andrea Gazzarini, Spaziocodice - Share Family.

Direct links:

Share Family update at the Library of Congress July 2024 BIBFRAME Update Forum

Tiziana Possemato participated in the Library of Congress July 2024 BIBFRAME Update Forum, providing an update on the Share Family linked data ecosystem and its component, Share-VDE.

The various Share Family projects uphold the standardization of BIBFRAME linked data as defined by the Library of Congress. The presentation emphasized how standard BIBFRAME is crucial to the library community’s integrated environments, especially as systems proliferate, from both the interoperability and the data curation perspectives.

Follow this link for slides and a recording of the presentation titled Fostering BIBFRAME collaboration: interoperability and data curation with the Share Family.  

Next events

Updates on events involving the Share Family are regularly published on the website page https://www.share-family.org/en/events.

BIBFRAME Workshop in Europe 2024

Tiziana Possemato will present Share Family: advancements in linked data collaboration at the 2024 BIBFRAME Workshop in Europe. This will be an update on current developments,  especially on the JCricket entity editor, UNIMARC management and third party interoperability. Check out the BIBFRAME Workshop in Europe’s website and register in person or online: https://www.bfwe.eu/helsinki_2024.

Share Family meeting in Helsinki – members only

On Thursday 19th September 2024 we will hold a private, informal Share Family meeting in Helsinki, at NLF National Library of Finland!

This meeting will be after the two-days BIBFRAME Workshop in Europe, also held at NLF on 17-18 September. More logistic instructions on how to participate in-presence and online will be sent to members.

WOLFCon 2024

Tiziana Possemato, Sebastian Hammer and representatives from Lehigh University Libraries will participate in WOLFcon 2024 with a session titled MARC My Words: Navigating the BIBFRAME Frontier. Learn more about WOLFcon and how to register here: https://openlibraryfoundation.org/about/wolfcon/upcoming/.

DCMI 2024

Andrea Gazzarini will present Leveraging Linked Data Fragments for enhanced data publication: the Share-VDE case study at this year’s DCMI in Toronto. More information about the 2024 DCMI here: https://www.dublincore.org/conferences/2024/cfp/. More details will be shared as soon as the program is available.

Charleston Conference 2024

Nina Servizzi, Boaz Nadav-Manes, Sebastian Hammer, Tiziana Possemato will present in a joint session New pathways for resource description and interoperability: innovative strategies from the Share Family Ecosystem. More information about the Charleston Conference 2024 here: https://charlestonconference.regfox.com/2024-charleston-conference. More details will be shared as soon as the program is available.


Your opinion is always welcome: to provide feedback on the Share Family discovery website, report bugs and suggestions as external users reach out through the forum https://forum.svde.org/ or send a message to helpdesk@svde.org.

For general information on the initiative, contact info@share-family.org.