From Big Data to Smart Data with Physics-LLM

Physics-LLM is addressing pressing challenges in research data management by developing a dedicated LLM-enhanced RDM toolkit. Building on state-of-the-art  developments in LLMs and accompanying concepts, this toolkit will allow for the seamless publication and curation of scientific data, while at the same time fostering their findability and therefore increasing the effectiveness of scientific workflows.

Data Collection vs. Data Provision

The amount of data recorded and analyzed in physics experiments has rapidly grown over the last decade, and is expected to grow even further with the generation of facilities. At the same time the provision of FAIR data is lagging behind. This imbalance between data collection and data provision requires technical and conceptual developments in order to enable the envisioned transition from Big Data to Smart Data.

An LLM-enhanced RDM toolkit

Physics-LLM is addressing these pressing questions by developing an LLM-enhanced toolkit for research data management (RDM). These developments include the collection, reduction and analysis of data, as well as its storing, sharing and finding. The envisioned RDM-toolkit will foster swift and convenient data publication, as well as the availability of robust metadata and machine readable standards.

Large Language Models and Agentic-AI

Leveraging the capabilities of LLMs and agentic AI, Physics-LLM will significantly increase the effectiveness of research workflows and the efficiency of data usage. A simultaneous reduction of complexity in data curation will be highly beneficial for combining current and archival data for future discoveries. By also including non-classical data sources, like software repositories and laboratory notebooks, the Physics-LLM toolkit will allow for the extraction of knowledge that would be hard to obtain otherwise.

The Physics-LLM Consortium

The Physics-LLM consortium unites scientists from all ErUM communities, as well as researches from computer science and industry. Details on the principal investigators and the contributing institutions can be found in the consortium section.

The infrastructure of Physics-LLM is supported by PUNCH4NFDI.