../

A Baseline Framework for the Qualification of LTL Specification Miners


Year
2025
Authors
Samuele Germiniani, Daniele Nicoletti, Graziano Pravadelli
DOI
10.23919/DATE64628.2025.10992993

Related

Persistent Notes

In-text annotations

“We demonstrate the utility of our framework through comparative analyses with four well-known LTL miners, illustrating its ability to standardize and enhance the specification mining evaluation process." Page 1

“It already includes the orchestration of four well-known LTL specification miners," Page 1

“by an LLM-based tool, for their evaluation." Page 1

"• comparison of the mined specifications against a set of golden specifications through semantic and syntactic methods; • computation of the fault coverage to determine how well the mined specifications are capable of identifying design regressions; • computation of performance metrics regarding how much resources are required by the miner to generate the specifications; this usually involves measuring how long it takes to complete the execution." Page 2

“The framework employs a combination of synthetic and user-defined designs to ensure a comprehensive evaluation of specification miners." Page 3

“This is achieved using the ltlsynt tool [16]" Page 3

“comparing the golden against the mined specifications” Page 4

“computing the Specification Fault Coverage (SFC)" Page 4

%% Import Date: 2026-05-26T10:27:18.342-04:00 %%