ShareFamily:NewsAndUpdates/December2023 - Revision history

Anna at 07:32, 31 July 2024

2024-07-31T07:32:22Z

← Older revision		Revision as of 07:32, 31 July 2024
Line 3:		Line 3:
	You can download a printable version at https://bit.ly/SFBulletin_n8_Dec2023		You can download a printable version at https://bit.ly/SFBulletin_n8_Dec2023

	Citation: Share Family Team, ''Share Family Bulletin'' 8 (December 2023), https://bit.ly/SFBulletin_n8_Dec2023		Citation: Share Family Team, ''Share Family Bulletin'' ''8'' (December 2023), https://bit.ly/SFBulletin_n8_Dec2023

	== Introduction ==		== Introduction ==

Anna at 07:28, 31 July 2024

2024-07-31T07:28:55Z

← Older revision		Revision as of 07:28, 31 July 2024
Line 14:		Line 14:
	A useful perspective on how we carry on this family of initiatives can be found in the [https://bit.ly/SVDE-Executive-Summary Share-VDE Executive Summary]: the outline of SVDE role in linked open data for libraries is reflected on the overall approach to all the branches of the Share Family.		A useful perspective on how we carry on this family of initiatives can be found in the [https://bit.ly/SVDE-Executive-Summary Share-VDE Executive Summary]: the outline of SVDE role in linked open data for libraries is reflected on the overall approach to all the branches of the Share Family.

	In this context, we also find useful to provide a comprehensive overview of the main stepping stones that have marked the path of the Share Family of initiatives over the years, described in detail in the next sections:		In this context, we also find useful to provide a comprehensive overview of the main stepping stones that have marked the path of the Share Family of initiatives over the years, described in detail in the next sections:[[File:timeline updated.jpg\|alt=\|none\|thumb\|750x750px]]In this extensive update are reported - among others - prominent achievements:

	In this extensive update are reported - among others - prominent achievements:

	* the extension of the community of members and parallel pilots;		* the extension of the community of members and parallel pilots;
Line 39:		Line 37:
	* [https://www.natbib-lod.org/ National Bibliographies] in Linked Open Data;		* [https://www.natbib-lod.org/ National Bibliographies] in Linked Open Data;
	* [https://parsifal.urbe.it/parsifal/?l=en Parsifal] - the LOD portal of the URBE consortium (Roman Union of Ecclesiastical Libraries).		* [https://parsifal.urbe.it/parsifal/?l=en Parsifal] - the LOD portal of the URBE consortium (Roman Union of Ecclesiastical Libraries).
	* [https://lillit.share-family.org/lillit/?l=en LILLIT] - portal for Italian illustrated books with Linked Open Data descriptions and illustrations of Italian editions printed in the 16th-18th centuries.		* [https://lillit.share-family.org/lillit/?l=en LILLIT] - portal for Italian illustrated books with Linked Open Data descriptions and illustrations of Italian editions printed in the 16th-18th centuries
			[[File:loghi.jpg\|none\|thumb\|600x600px]]The tenant infrastructure is designed to be flexible, therefore it’s possible to show the data of participating members at the tenant level or even in an institutional customised sub-portal of a pre-existing tenant (also called “skin portal” in Share Family jargon). This can be done according to the institution/consortia’s needs and policies.[[File:sf infrastr.jpg\|none\|thumb\|700x700px]]The Share Family team is committed to advancing the technical developments of each tenant and also to fostering user engagement through outreach initiatives. Below are reported the main facts around membership and outreach within the Share Family.
	The tenant infrastructure is designed to be flexible, therefore it’s possible to show the data of participating members at the tenant level or even in an institutional customised sub-portal of a pre-existing tenant (also called “skin portal” in Share Family jargon). This can be done according to the institution/consortia’s needs and policies.

	The Share Family team is committed to advancing the technical developments of each tenant and also to fostering user engagement through outreach initiatives. Below are reported the main facts around membership and outreach within the Share Family.

	=== New Share-VDE members and ongoing pilots ===		=== New Share-VDE members and ongoing pilots ===
Line 143:		Line 138:
	JCricket operates on the Share-VDE CKB - Cluster Knowledge Base (and on the CKB of the other Share Family tenants), which is not a local data storage for a single library, but rather the outcome of complex integration processes that generate entities from local data in traditional formats, such as MARC, and new formats, like RDF. Its optimal application is within a large data pool formed through contributions from multiple libraries, such as Share-VDE; therefore, it does not impact original data that reside in member libraries’ systems (unless libraries want to use ad hoc APIs for entity updates both in SVDE and in their systems).		JCricket operates on the Share-VDE CKB - Cluster Knowledge Base (and on the CKB of the other Share Family tenants), which is not a local data storage for a single library, but rather the outcome of complex integration processes that generate entities from local data in traditional formats, such as MARC, and new formats, like RDF. Its optimal application is within a large data pool formed through contributions from multiple libraries, such as Share-VDE; therefore, it does not impact original data that reside in member libraries’ systems (unless libraries want to use ad hoc APIs for entity updates both in SVDE and in their systems).

	The following picture illustrates JCricket workflow from a conceptual standpoint:		The following picture illustrates JCricket workflow from a conceptual standpoint:[[File:jcr.jpg\|none\|thumb\|1000x1000px]]The system fetches MARC records from member libraries for ingestion and BIBFRAME conversion; linked data entities are created from this process and stored in the Cluster Knowledge Base. Entities are in fact clusters, ie. entities created through the aggregation of data from multiple institutions (Provenances).

	The system fetches MARC records from member libraries for ingestion and BIBFRAME conversion; linked data entities are created from this process and stored in the Cluster Knowledge Base. Entities are in fact clusters, ie. entities created through the aggregation of data from multiple institutions (Provenances).

	Using JCricket, member libraries are able to authenticate in a dedicated area of the search portal and manually edit potential errors found in entities that are created during the conversion of records contributed by member libraries. These edits on entities will be saved in the system.		Using JCricket, member libraries are able to authenticate in a dedicated area of the search portal and manually edit potential errors found in entities that are created during the conversion of records contributed by member libraries. These edits on entities will be saved in the system.
Line 151:		Line 144:
	Also, JCricket APIs allow communication with member libraries’ systems, to notify the changes made on the entities in the CKB: this can be done in case the libraries want to use this service to be informed about the changes in the clusters to which the library data contributed, or even to optionally activate the entity update APIs.		Also, JCricket APIs allow communication with member libraries’ systems, to notify the changes made on the entities in the CKB: this can be done in case the libraries want to use this service to be informed about the changes in the clusters to which the library data contributed, or even to optionally activate the entity update APIs.

	JCricket is integrated in the discovery portal web interface, for authenticated users.		JCricket is integrated in the discovery portal web interface, for authenticated users.[[File:jcr.jpg\|none\|thumb\|1000x1000px]]Several demos have been done this year, showing the advancements of JCricket user interface, which will be released in a test version shortly:

	Several demos have been done this year, showing the advancements of JCricket user interface, which will be released in a test version shortly:

	* JCricket première at the ALA Conference 2023, during the [https://drive.google.com/file/d/16vv_xOT7leOwf-TcWjC_mcJUCisLhudO/view Share-VDE Workshop];		* JCricket première at the ALA Conference 2023, during the [https://drive.google.com/file/d/16vv_xOT7leOwf-TcWjC_mcJUCisLhudO/view Share-VDE Workshop];
Line 209:		Line 200:

	==== Subjects and Concepts ====		==== Subjects and Concepts ====
	Collaboration with numerous libraries has contributed to improving the data processing of subject-related information. Currently, we identify and display the most general level, which is the Related Subjects. These subjects may encompass various linguistic variations, but these variations will not be explicitly categorized as such; typically, they will be considered as Related Subjects.		Collaboration with numerous libraries has contributed to improving the data processing of subject-related information. Currently, we identify and display the most general level, which is the Related Subjects. These subjects may encompass various linguistic variations, but these variations will not be explicitly categorized as such; typically, they will be considered as Related Subjects.[[File:concepts.jpg\|none\|thumb\|900x900px]]In the future, we plan to highlight more specific subsets of equivalent subjects or linguistic variations. This selection will be based on the original data provided by the libraries. Variations will only be identified as such if the library has accurately flagged them in their own records. Additionally, further analysis is being conducted to enhance the development of Concepts and their display in all Share Family tenants.[[File:topics.jpg\|none\|thumb\|600x600px]]

	In the future, we plan to highlight more specific subsets of equivalent subjects or linguistic variations. This selection will be based on the original data provided by the libraries. Variations will only be identified as such if the library has accurately flagged them in their own records. Additionally, further analysis is being conducted to enhance the development of Concepts and their display in all Share Family tenants.

	==== Non-Latin scripts ====		==== Non-Latin scripts ====
	Within the Share Family community, a significant and ongoing discussion revolves around the processing of non-Latin scripts. This encompassing dialogue includes active participation from members within the Advisory Council. Testing of data provided by the National Taiwan University Library will be carried out by the LD4P Non-Latin Script Material affinity group.		Within the Share Family community, a significant and ongoing discussion revolves around the processing of non-Latin scripts. This encompassing dialogue includes active participation from members within the Advisory Council. Testing of data provided by the National Taiwan University Library will be carried out by the LD4P Non-Latin Script Material affinity group.

Anna at 07:24, 31 July 2024

2024-07-31T07:24:57Z

← Older revision		Revision as of 07:24, 31 July 2024
Line 161:		Line 161:

	=== Third parties integration ===		=== Third parties integration ===
			The evolution of the Share Family technology encompasses the ability to mutually integrate the data produced by the LOD Platform with external systems, notably with local ILS and Library Service Platforms and authority sources.

			As to ILS and LSP integration, it’s worth mentioning some advancements:

			* the new authority services for MARC-based workflows – designed with [[ShareVDE:Members/Share-VDE working groups#SVDE-AC%20Authority.2FIdentifier%20Management%20Services%20working%20group%20.28AIMS.29\|SVDE AIMS Working Group]] and further input by Stanford University Library – have been completed and are available for institutions willing to test and use them. Also, the AIMS Working Group will reconvene in 2024 to analyse and devise the authority control features for RDF / linked data based workflows;
			* the integration of Alma circulation APIs for local library services is almost completed;
			* the integration with the native BIBFRAME cataloguing editor Sinopia is progressing: the parser for incoming RDF data from Sinopia to be clustered by Share-VDE processes is under development;
			* the connection to FOLIO ILS has been analysed to correlate FOLIO Inventory data with Share-VDE data, and to integrate JCricket user interface in FOLIO. [https://wiki.share-vde.org/w/images/7/74/ShareVDE_meets_FOLIO_Collaborative_Entity_Editing.pdf A possible model for ILS/LSP interaction through FOLIO] was presented by Andrea Gazzarini from the Share Family team and Sebastian Hammer from Index Data at WOLFcon 2023, to engage discussion within the linked data community on how to pursue this connection.

			As to integration with authority systems, several data sources are being investigated and in some cases the initial integration steps have been completed:

			* LD4P Questioning Authority lookup tool;
			* Wikidata for mutual enrichment of entity IDs (initial specifications were shaped by SVDE working groups);
			* ISNI for mutual enrichment of entity IDs (initial specifications were shaped by SVDE working groups).

			The resulting scenario will translate into an integrated, “hybrid” operational ecosystem, based on a variety of tools and diverse data sources including traditional workflows (eg. new authority services for MARC workflows) as well as advanced models for data exchange, eg. those envisaged above to simultaneously operate through JCricket and local BIBFRAME editors both within the Share Family system and locally.

			=== Data processing and BIBFRAME conversion ===

			==== Catalogues ingestion and ongoing data updates ====
			Much work is going on to complete the full workflow of data ingestion, conversion, regular updates of data exports from libraries and publication to the discovery portal of the Share-VDE tenant.

			The very complex architecture of the Share Family, made of different tenants each one residing on a separate branch of the system infrastructure with its own installation of databases and system components, entails articulated processes that often take some time to become stable, due to the impact they have on the whole system. In this scenario, the completion of the module handling ongoing updates (“delta updates” in Share Family jargon) done in 2023 is a significant milestone adding value to a system moving towards the support of stable production workflows.

			The full workflow of ingestion and ongoing updates has been tested for the beta version of the BNB – British National Bibliography skin portal on NatBib tenant, and is being fine tuned for the future steps towards bringing the BNB in production. The BNB experience will also be useful to measure the performance of the system in view of the much larger scale process for the Share-VDE tenant.

			It’s also important to mention that we anticipate the release of a new version 3 of the software supporting JCricket and introducing major changes, that will trigger a new ingestion of libraries’ catalogues and the connection to the delta updates module - pausing the load of library catalogue using the previous version of the software was preparatory to this major change. The new version 3 release is expected in early 2024, starting with the Share-VDE tenant, and the subsequent steps (ie. delta updates module set-up and data ingestion, publication of new data on svde.org portal), will follow.

			==== Granularization of the Cluster Knowledge Base and new conversion model ====
			So far, the support of linked data conversion from multiple input formats has been managed through multiple conversion pipelines.

			In line with the evolution of the system over time, it became clear that a single “source of truth” is needed to orchestrate a conversion workflow as frictionless as possible. So, several analysis and implementation actions have been undertaken to revise the current conversion model and streamline this process by extending input data capabilities and making the conversion component format-agnostic.

			To achieve this, the new conversion model should support:

			* a finer granularity level of the CKB in compliance with BIBFRAME granularity;
			* a “format-agnostic” CKB with extended input data capabilities to converge all input formats into one conversion source (eg. MARC21, UNIMARC, native BIBFRAME/RDF eg. from LD4P Sinopia application profiles etc.);
			* one single conversion pipeline from the CKB – removing the conversion pipeline based on MARC.

			In addition, the granularization of the CKB will facilitate the implementation of the Share-VDE Ontology extensions that have been introduced during 2023 by the work of the SEI – Sapientia Entity Identification Working Group (see the current version of the SVDE Ontology at https://zenodo.org/doi/10.5281/zenodo.8332350), and the ongoing improvements to the clustering algorithm that will derive from members’ and users’ tests with the data.

			Finally, the review of the CKB will facilitate the integration of data from other domains, including archival and museum domains.

			Once the final pipeline conversion will be in place, the triple store will make available the stable version of the data that will be even more compatible for reuse externally of the Share system.

			This work will continue in 2024.

			==== Subjects and Concepts ====
			Collaboration with numerous libraries has contributed to improving the data processing of subject-related information. Currently, we identify and display the most general level, which is the Related Subjects. These subjects may encompass various linguistic variations, but these variations will not be explicitly categorized as such; typically, they will be considered as Related Subjects.

			In the future, we plan to highlight more specific subsets of equivalent subjects or linguistic variations. This selection will be based on the original data provided by the libraries. Variations will only be identified as such if the library has accurately flagged them in their own records. Additionally, further analysis is being conducted to enhance the development of Concepts and their display in all Share Family tenants.

			==== Non-Latin scripts ====
			Within the Share Family community, a significant and ongoing discussion revolves around the processing of non-Latin scripts. This encompassing dialogue includes active participation from members within the Advisory Council. Testing of data provided by the National Taiwan University Library will be carried out by the LD4P Non-Latin Script Material affinity group.

			Also, an experiment is being carried out with a test portal supporting Arabic script that gave us the occasion to further test with non-Latin scripts, and to apply to the LOD Platform features that will be propagated to all other Share Family tenants, ie.:

			* the creation of Subject entity starting from authority subjects (ie. not only from bib. record access points);
			* an improved version of Subject management, including related subjects.

			==== Goals for the next period ====
			By adopting BIBFRAME as the main ontology in compatibility with IFLA-LRM, the Share Family takes advantage of the potentials of linked open data to facilitate interoperability among data pools, in coexistence with MARC. Leveraging this approach, we work to ultimately:

			* consolidate outputs and collaborative tools to enhance workflows and services for consortia or individual libraries;
			* transform library catalogs into research tools with structured access and visibility to original language research in all disciplines;
			* serve as an authoritative data source, contribute to a new bibliographic ecosystem where data modeling, enrichment and sharing are handled collectively;
			* apply and support open metadata policies.

			As always, this will be achieved by being independent of local practices and of ILS/LSP local systems, and through the international collaboration at the heart of the Share Family vision.

			We will continue to cooperate with any kind of system or initiative that will be eager to become “Share-ready”.

			Your opinion is always welcome: to provide feedback on the Share Family discovery website, report bugs and suggestions as external users reach out through the forum https://forum.svde.org/ or send a message to helpdesk@svde.org.

			For general information on the initiative, contact info@svde.org.
	__FORCETOC__		__FORCETOC__

Anna at 07:23, 31 July 2024

2024-07-31T07:23:44Z

Show changes

Anna at 07:21, 31 July 2024

2024-07-31T07:21:46Z

← Older revision		Revision as of 07:21, 31 July 2024
Line 28:		Line 28:

	== News from members, promotion and outreach ==		== News from members, promotion and outreach ==
			__FORCETOC__

Anna at 07:21, 31 July 2024

2024-07-31T07:21:29Z

← Older revision		Revision as of 07:21, 31 July 2024
Line 1:		Line 1:
	{{DISPLAYTITLE:Share Family Bulletin - n. 8 December 2023}}		{{DISPLAYTITLE:Share Family Bulletin - n. 8 December 2023}}

			You can download a printable version at https://bit.ly/SFBulletin_n8_Dec2023

			Citation: Share Family Team, ''Share Family Bulletin'' 8 (December 2023), https://bit.ly/SFBulletin_n8_Dec2023

			== Introduction ==
			As 2023 comes to an end, we take a moment to look back at the achievements and challenges within the Share Family initiative during the past year. This report serves as a comprehensive reflection on the accomplishments of this year, while also offering insights into the exciting goals we've set for the upcoming period. It provides a glimpse into both the highlights of the past year and our shared vision for the future within the Share Family community.

			The international reach of the Share Family, spread across different countries and bibliographic traditions, stimulates mutual exchanges and gives us the occasion to improve our processes, data treatment and outputs.

			The efforts and resources devoted to the development of the initiative (both technical and in terms of cooperation and outreach) are always rewarded by the added value of working side by side with member institutions and partners in the linked data community. This co-operative approach, with time, expertise and costs shared across the community for the benefit of all members, is creating a truly global network of interconnected institutions and information resources that transcends traditional cataloging boundaries.

			A useful perspective on how we carry on this family of initiatives can be found in the [https://bit.ly/SVDE-Executive-Summary Share-VDE Executive Summary]: the outline of SVDE role in linked open data for libraries is reflected on the overall approach to all the branches of the Share Family.

			In this context, we also find useful to provide a comprehensive overview of the main stepping stones that have marked the path of the Share Family of initiatives over the years, described in detail in the next sections:

			In this extensive update are reported - among others - prominent achievements:

			* the extension of the community of members and parallel pilots;
			* the publication of new branches of the Share Family dedicated to specific initiatives, supported by dedicated entity discovery portals and linked data infrastructure (the portals for the BNB - British National Bibliography, Parsifal, and LILLIT);
			* the involvement in the international library and cultural heritage community through cross-institutional working groups;
			* the development of JCricket collaborative entity editor for shared cataloguing;
			* the continuous enhancement of the system components and upgrade to a new version 3 of the technology in use, towards the support of production workflows;
			* the extension of LOD Platform technology capabilities for the integration with third parties.

			To cope with all this, the Share Family internal team of metadata experts and technicians is constantly working to improve the internal organisation of work and is increasingly formalising project rules and methodology to streamline development processes and achieve better results.

			== News from members, promotion and outreach ==

Anna: Created page with "{{DISPLAYTITLE:Share Family Bulletin - n. 8 December 2023}}"

2024-07-31T07:20:43Z

Created page with "{{DISPLAYTITLE:Share Family Bulletin - n. 8 December 2023}}"

New page