39
Weighted Automata: Theory and Applications WATA 2020/2021 20-23 April 2021 https://wata2020.lis-lab.fr The workshop covers all aspects of weighted automata, ranging from the theory of weighted automata and quantitative logics to applications for real-time systems and natural language processing. The aim is to present tutorials and invited lectures by outstanding scientists in this area. Because of the Covid-19, WATA has been shifted from April 2020 to April 2021, and happens entirely online. There are more than 80 registered participants, coming from 16 countries around the world. Organisers: Manfred Droste (Universit¨ at Leipzig), Paul Gastin (ENS Paris-Saclay, LMF), Pierre Guillon (Aix-Marseille Universit´ e, I2M), Benjamin Monmege (Aix-Marseille Universit´ e, LIS), Heiko Vogler (TU Dresden) Sponsors: LIS, QuantLA, LMF, I2M, FRUMAM 1

Weighted Automata: Theory and Applications - LIS lab

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Weighted Automata: Theory and Applications - LIS lab

Weighted Automata: Theory and Applications

WATA 2020/2021

20-23 April 2021

https://wata2020.lis-lab.fr

The workshop covers all aspects of weighted automata, ranging from the theory ofweighted automata and quantitative logics to applications for real-time systemsand natural language processing. The aim is to present tutorials and invitedlectures by outstanding scientists in this area. Because of the Covid-19, WATAhas been shifted from April 2020 to April 2021, and happens entirely online.There are more than 80 registered participants, coming from 16 countries aroundthe world.

Organisers: Manfred Droste (Universitat Leipzig), Paul Gastin (ENS Paris-Saclay, LMF),Pierre Guillon (Aix-Marseille Universite, I2M), Benjamin Monmege (Aix-Marseille Universite,LIS), Heiko Vogler (TU Dresden)

Sponsors: LIS, QuantLA, LMF, I2M, FRUMAM

1

Page 2: Weighted Automata: Theory and Applications - LIS lab

Programme

Tuesday April 20

9:00-11:15 Tutorial - Andreas Maletti - Neural Networks and Weighted Automata

11:45-12:05 Uli Fahrenberg - Posets with Interfaces

12:05-12:25 Lena Schi↵er - Combinatory Categorial Grammars as Acceptors of WeightedTree Languages

14:00-14:45 Invited talk - Miko laj Bojanczyk - Weighted languages, monads, and dis-tributive laws

15:00-15:20 Frank Drewes - Can we preserve the polynomial parsability of restricted graphgrammars when adding contextuality?

15:20-15:40 Stefan Stanimirovic - Approximate simulation and bisimulation relations forfuzzy automata

15:40-... Discussion

Wednesday April 21

9:00-9:45 Invited talk - Guillermo Perez - Parameter Synthesis for One-Counter Auto-mata

10:00-10:45 Invited talk - Laure Daviaud - Weighted automata and Cost-register Auto-mata over the max-plus semiring

11:15-11:35 C. Aiswarya - Weighted Tiling Automata on Graphs: Evaluation Complexity

11:35-11:55 Gayathri Lakshmi M - Weighted Hexagonal Picture Automata

13:45-14:30 Invited talk - Karin Quaas - On the universality problem for unambiguousregister automata

14:45-15:05 Kevin Stier - Disambiguation of Weighted Tree Automata

15:05-15:25 David Purser - The Big-O Problem for Weighted Automata

15:25-15:45 Frederic Dorband - Kleene and Buchi for Weighted Forest Languages over M-Monoids

15:45-... Discussion

2

Page 3: Weighted Automata: Theory and Applications - LIS lab

Thursday April 22

9:00-11:15 Tutorial - Anca Muscholl - A View on String Transducers

11:45-12:05 Thomas Ruprecht - Statistical machine translation using streaming string trans-ducers

12:05-12:25 Sven Dziadek - Greibach Normal Form and Simple Automata for Weighted!-Context-Free Languages

14:00-14:45 Invited talk - George Rahonis - Logical description of (weighted) parametriccomponent-based systems with (w)FOEIL

15:00-15:20 Aleksandar Stamenkovic - State reduction of weighted automata using certainequivalences

15:20-15:40 Gustav Grabolle - Weighted linear dynamic logic with two-sorted semantics

15:40-... Discussion

Friday April 23

9:00-9:45 Invited talk - Glenn Merlet - Separating words with weighted automata

10:00-10:45 Invited talk - Jean-Eric Pin - Polynomial functions and sequential products

11:15-11:35 David Koszo - Decidability of crisp-determinization for weighted finite automataover past-finite monotonic strong bimonoids

11:35-11:55 Richard Morbitz - Weighted Parsing for Grammar-Based Language Models overMultioperator Monoids

11:55-12:15 Miroslav Ciric - Weakly linear systems for matrices over the max-plus quantaleand their applications

13:45-14:30 Invited talk - Filip Mazowiecki - Copyless cost-register automata

14:45-15:05 Erik Paul - Finite Sequentiality of Max-Plus Tree Automata

15:05-15:25 Ivana Micic - Blockmodeling of fuzzy transition systems using approximateregular relations

15:25-15:45 Jelena Ignjatovic - Weighted context-free grammars over a complete strongbimonoid

15:45-... Discussion

3

Page 4: Weighted Automata: Theory and Applications - LIS lab

Neural Networks and Weighted Automata

Tutorial on Tuesday April 20, 9:00

Andreas Maletti

We carefully introduce (recurrent) neural networks from the perspective of weightedautomata and present several variants that are used in practice. In addition, weinvestigate the expressive power and the decidability and complexity of severalstandard operations and compare those results to the corresponding results forweighted automata over the field of rationals or reals. Finally, we introduce astandard procedure for neural network training, which di↵ers significantly fromthe standard learning techniques for weighted automata over fields

2

Page 5: Weighted Automata: Theory and Applications - LIS lab

Weighted languages, monads, and distributive laws

Invited talk on Tuesday April 20, 14:00

Miko laj Bojanczyk

I will discuss a perspective on weighted languages that is based on monads anddistributive laws. Using this perspective, one can automatically get definitions ofweighted languages, and polynomial time algorithms for their equivalence, in awide variety of settings, such as words, trees, or graphs of bounded treewidth.

3

Page 6: Weighted Automata: Theory and Applications - LIS lab

Parameter Synthesis for One-Counter Automata

Invited talk on Wednesday April 21, 9:00

Guillermo Perez

One-counter automata are obtained by extending classical finite-state automatawith a counter whose value can range over non-negative integers and be tested forzero. The updates and tests applicable to the counter can further be made para-metric by introducing a set of integer-valued variables called parameters. Duringthis talk we will focus on parameter synthesis problems for such automata. Thatis, we ask whether there exists a valuation of the parameters such that all infin-ite runs of the automaton satisfy some omega-regular property. The problem hasbeen shown to be encodable in a restricted one-alternation fragment of Presburgerarithmetic with divisibility. We will see that said fragment, called EARPAD, isunfortunately undecidable. Fortunately, there is an alternative encoding of theproblem into a decidable restriction of EARPAD. Finally, we will study an al-ternative solution going via alternating two-way automata. The latter gives us apolynomial-space algorithm for the special case of the problem where parameterscan only be used in tests, and not updates, of the counter.

4

Page 7: Weighted Automata: Theory and Applications - LIS lab

Weighted automata and Cost-register Automata

over the max-plus semiring

Invited talk on Wednesday April 21, 10:00

Laure Daviaud

In this talk, I will review some concepts related to max-plus automata and cost-register automata, and in particular, look at the hierarchy of (some) classes thatare defined using ambiguity, restrictions on register updates... and how thesenotions relate.

5

Page 8: Weighted Automata: Theory and Applications - LIS lab

On the universality problem for unambiguous

register automata

Invited talk on Wednesday April 21, 13:45

Karin Quaas

The talk gives an overview over recent results concerning the universality problemfor unambiguous register automata.

6

Page 9: Weighted Automata: Theory and Applications - LIS lab

A View on String Transducers

Invited talk on Thursday April 22, 9:00

Anca Muscholl

This tutorial will review recent results on string transducers, ranging from ex-pressiveness questions to algorithmic ones. In particular, we will present two-wayand streaming string transducers, with and without origin semantics, and we willdiscuss the equivalence problem.

7

Page 10: Weighted Automata: Theory and Applications - LIS lab

Logical description of (weighted) parametric

component-based systems with (w)FOEIL

Invited talk on Thursday April 22, 14:00

George Rahonis

One of the key aspects in component-based design is specifying the software ar-chitecture that characterizes the topology and the permissible interactions of thecomponents of a system.

We present an extended propositional interaction logic and investigate its first-order level (FOEIL) which serves as a formal language for architectures appliedon parametric component-based systems, i.e., systems that consist of an unknownnumber of instances of each component. Our logic achieves to encode the executionorder of interactions, which is a main feature in several important architectures, aswell as to model recursive interactions. We state the decidability of equivalence,satisfiability, and validity of FOEIL formulas.

Then, we introduce a weighted FOEIL (wFOEIL), over a commutative semiring,and describe parametric component-based systems and their architectures withquantitative features. We show decidability results for wFOEIL formulas over a(subsemiring of a) skew field.

This is a joint work with Maria Pittou.

10

Page 11: Weighted Automata: Theory and Applications - LIS lab

Separating words with weighted automata

Invited talk on Friday April 23, 9:00

Glenn Merlet

The separating words problem is the problem of finding the smallest deterministicfinite automaton that behaves di↵erently on two given strings, meaning that itaccepts one of the two strings and rejects the other string.

If the words have di↵erent length, one can compute this length modulo b for awell chosen b, which is logarithmic in the sum of the length.

If the lengths are equal, however, the problem is surprisingly di�cult : the bestlower bound on the number of states is logarithmic, while the upper bound isO(n2

/5 (log n)3/5). With weighted automata, one can imagine separating allwords with finitely many automata. It happens for weights in (R,+,⇥).

With Zur Izhakian, we inductively build pairs of words that can not be separatedby any max-plus automaton of a given size. In this talk, I will present this problemin more detail, and the strategy of our proof, which is based on the analysis ofranks of large powers of tropical matrices.

9

Page 12: Weighted Automata: Theory and Applications - LIS lab

Polynomial functions and sequential products

Invited talk on Friday April 23, 10:00

Jean-Eric Pin

Polynomial functions from N to Z are familiar to everyone. Is there a similarnotion in a noncommutative setting, that is, for functions from a free monoid A

to a free group F (B)? The aim of this lecture is to answer this question positivelyin two di↵erent ways. First, by using di↵erential operators and next by using anew operation, the sequential product of functions.

10

Page 13: Weighted Automata: Theory and Applications - LIS lab

Copyless cost-register automata

Invited talk on Friday April 23, 13:45

Filip Mazowiecki

Copyless cost-register automata are a recently defined fragment of weighted auto-mata. In this talk I will discuss some of our recent results regarding their express-iveness and decidability properties. In particular I will sketch undecidability ofthe equivalence problem for linear copyless cost-register automata over the tropicalsemiring, disproving a conjecture of Alur et al. from 2012.

11

Page 14: Weighted Automata: Theory and Applications - LIS lab

Contributed talks

By order of appearance

12

Page 15: Weighted Automata: Theory and Applications - LIS lab

Posets with Interfaces(Extended Abstract)

Uli Fahrenberg1, Christian Johansen2, Georg Struth3, and Ratan Bahadur Thapa2

1 Ecole Polytechnique, Palaiseau, France2 University of Oslo, Norway3 University of She�eld, UK

This work is inspired by Tony Hoare’s programme of building graph models of concurrentKleene algebra (CKA) [5] for real-world applications. CKA extends the sequential compositions,nondeterministic choices and unbounded finite iterations of imperative programs modelled byKleene algebra into concurrency, adding operations of parallel composition and iteration, and aweak interchange law for the sequential-parallel interaction. Such algebras have a long historyin concurrency theory, dating back at least to Winkowski [21].

CKA has both interleaving and true concurrency models, that is, shu✏e as well as pomsetlanguages. Series-parallel pomset languages, which are generated from singletons by finitaryapplications of sequential and parallel compositions, form free algebras in this class [10, 13](at least when parallel iteration is ignored). The inherent compositionality of algebra is thusbalanced by the generative properties of this model. Yet despite this and other theoreticalwork, applications of CKA remain rare.

One reason is that series-parallel pomsets are not expressive enough for many real-worldapplications: even simple producer-consumer examples cannot be modelled [14]. Tests, whichare needed for the control structure of concurrent programs, and assertions are hard to capturein models of CKA (see [8] and its discussion in [9]). Finally, it remains unclear how modaloperators could be defined over graph models akin to pomset languages, which is desirablefor concurrent dynamic algebras and logics beyond alternating nondeterminism [3,15].

A natural approach to generating more expressive pomset languages is to “cut across” pom-sets in more general ways when (de)composing them. This can be achieved by (de)composingalong interfaces, and this idea can be traced back again to Winkowski [21]. As a side e↵ect,interfaces may yield notions of tests, assertions or modalities. When they consist of events,cutting across them presumes that they extend in time and thus form intervals. Interval or-ders [2, 20] of events with duration have been applied widely in partial order semantics ofconcurrent and distributed systems [6, 11, 12, 16–19] and the verification of weak memorymodels [4], yet generating them remains an open problem [7].

We propose a new class and algebra of posets with interfaces (iposets) based on these ideas.We introduce a new gluing composition that acts like standard serial po(m)set compositionoutside of interfaces, yet glues together interface events, thus composing events that did notend in one component with those that did not start in the other one. Our definitions arecategorical so that isomorphism classes of posets are considered ab initio. We show that thehierarchy of gluing-parallel posets generated by finitary applications of this gluing compositionand the standard parallel composition, starting from singleton iposets, contains both theseries-parallel posets and the interval orders. Iposets thus retain the pleasant compositionalityproperties of series-parallel pomsets and the wide applicability of interval orders in concurrencyand distributed computing.

This extended abstract is based on [1] which will be presented at the 18th InternationalConference on Relational and Algebraic Methods in Computer Science, RAMICS, in April2020.

References

1. U. Fahrenberg, C. Johansen, G. Struth, and R. Bahadur Thapa. Generating posets beyond N.CoRR, abs/1910.06162, 2019.

Page 16: Weighted Automata: Theory and Applications - LIS lab

2 Uli Fahrenberg, Christian Johansen, Georg Struth, and Ratan Bahadur Thapa

2. P. C. Fishburn. Intransitive indi↵erence with unequal indi↵erence intervals. J. Math. Psych.,7(1):144–149, 1970.

3. H. Furusawa and G. Struth. Concurrent dynamic algebra. ACM Trans. Comput. Log., 16(4):30:1–30:38, 2015.

4. M. Herlihy and J. M. Wing. Linearizability: A correctness condition for concurrent objects. ACMTrans. Program. Lang. Syst., 12(3):463–492, 1990.

5. T. Hoare, B. Moller, G. Struth, and I. Wehrman. Concurrent Kleene algebra and its foundations.J. Log. Algebr. Program., 80(6):266–296, 2011.

6. R. Janicki and M. Koutny. Structure of concurrency. Theor. Comput. Sci., 112(1):5–52, 1993.7. R. Janicki and X. Yin. Modeling concurrency with interval traces. Inf. Comput., 253:78–108,

2017.8. P. Jipsen and M. A. Moshier. Concurrent Kleene algebra with tests and branching automata. J.

Log. Algebr. Meth. Program., 85(4):637–652, 2016.9. T. Kappe, P. Brunet, J. Rot, A. Silva, J. Wagemaker, and F. Zanasi. Kleene algebra with

observations. In CONCUR 2019, vol. 140 of LIPIcs. Schloss Dagstuhl - Leibniz-Zentrum furInformatik, 2019.

10. T. Kappe, P. Brunet, A. Silva, and F. Zanasi. Concurrent Kleene algebra: Free model andcompleteness. In ESOP 2018, vol. 10801 of LNCS. Springer, 2018.

11. L. Lamport. The mutual exclusion problem: Part I - a theory of interprocess communication. J.ACM, 33(2):313–326, 1986.

12. L. Lamport. On interprocess communication. Part I: basic formalism. Distributed Computing,1(2):77–85, 1986.

13. M. R. Laurence and G. Struth. Completeness theorems for pomset languages and concurrentKleene algebras. CoRR, abs/1705.05896, 2017.

14. K. Lodaya and P. Weil. Series-parallel languages and the bounded-width property. Theor.

Comput. Sci., 237(1-2):347–380, 2000.15. D. Peleg. Concurrent dynamic logic. J. ACM, 34(2):450–479, 1987.16. R. J. van Glabbeek. The refinement theorem for ST-bisimulation semantics. In IFIP TC2 Working

Conf. Programming Concepts and Methods. North-Holland, 1990.17. R. J. van Glabbeek and F. W. Vaandrager. Petri net models for algebraic theories of concurrency.

In PARLE (2), vol. 259 of LNCS. Springer, 1987.18. W. Vogler. Failures semantics based on interval semiwords is a congruence for refinement. Dis-

tributed Computing, 4:139–162, 1991.19. W. Vogler. Modular Construction and Partial Order Semantics of Petri Nets, vol. 625 of Lecture

Notes in Computer Science. Springer, 1992.20. N. Wiener. A contribution to the theory of relative position. Proc. Camb. Philos. Soc., 17:441–

449, 1914.21. J. Winkowski. An algebraic characterization of the behaviour of non-sequential systems. Inf.

Process. Lett., 6(4):105–109, 1977.

Page 17: Weighted Automata: Theory and Applications - LIS lab

Combinatory Categorial Grammars asAcceptors of Weighted Tree Languages

Lena Katharina Schi�erú

Institute of Computer Science, Universität Leipzig, Germany.E-mail: [email protected]

Combinatory Categorial Grammar (CCG) is an extension of categorial grammar thatis well-established in computational linguistics. It is mildly context-sensitive, so it ise�ciently parsable and reaches an expressiveness that is conjectured to be su�cientto describe natural languages. The basis for CCG is provided by a lexicon and a rulesystem. The lexicon assigns syntactic categories to the symbols of the input and therule system describes how adjoining categories can be combined to eventually obtaina (binary) derivation tree. The seminal work by Vijay-Shanker and Weir showed weakequivalence of CCG, Tree-Adjoining Grammar (TAG), and Linear Indexed Grammar(LIG), i.e. they accept the same string languages.1 However, in a linguistic setting weare also interested in the underlying structure of an input sentence in the form of aconstituency parse tree. In our previous work we related three di�erent variants of CCGto classes of tree languages.2 Here we extend our results to a weighted scenario usingarbitrary commutative semirings as a weight structure. The tree language acceptedby a CCG is defined as a relabeling of its derivation trees. In the weighted case, eachrule is associated with a weight. To obtain the weight of a given tree, we sum over theweights of all derivation trees that are relabeled to that tree, where the weight of a singlederivation tree is the product of the weights of the applied rules. Our main result is thatthe weighted tree languages accepted by weighted CCGs are included in the weightedsimple monadic context-free tree languages (wsCFTG). When restricting the rule systemto application rules and composition rules of first degree, the accepted weighted treelanguages are exactly the weighted regular tree languages. When only application rulesare allowed, a proper subset of the weighted regular tree languages is accepted.

úSupported by the German Research Foundation (DFG) Research Training Group GRK 1763 ‘Quanti-tative Logics and Automata’

1K. Vijay-Shanker and D. J. Weir, “The Equivalence of Four Extensions of Context-Free Grammars,”in Mathematical Systems Theory, vol. 27, no. 6, pp. 511–546. Springer, 1994.

2M. Kuhlmann, A. Maletti and L. K. Schi�er, “The Tree-Generative Capacity of Combinatory CategorialGrammars,” in Foundations of Software Technology and Theoretical Computer Science (FSTTCS2019), vol. 150 of LIPIcs, pp. 44:1–44:14. Schloss Dagstuhl–Leibniz-Zentrum für Informatik, 2019.

Page 18: Weighted Automata: Theory and Applications - LIS lab

Can we preserve the polynomial parsability of restricted graphgrammars when adding contextuality?

Henrik Björklund, Johanna Björklund, Frank Drewes, Anna JonssonDepartment of Computing Science, Umeå University, Sweden

Abstract (describing work-in-progress)

The management of semantic representations lies at the heart of many high-level naturallanguage tasks, e.g., question answering and knowledge mining. Motivated by the interest ingraph-based semantic representations, we explore two current graph-generating formalismswith the goal of combining them to obtain a formalism that can express well-structuredsemantic graphs while at the same time being efficiently parsable. Specifically, the semanticrepresentation that we aim to express is the abstract meaning representation (AMR) byBanarescu et al. [1].

The first formalism that we consider is the order-preserving dag grammars (OPDGs)presented by Björklund et al. [2], a type of graph grammar based on hyperedge replacement

grammars (HRGs [3], see, e.g., [4] for a survey) that is efficiently parsable by imposinga number of structural restrictions. Intuitively, these restrictions combine to ensure thateach generated graph can be uniquely represented by a term in a particular graph algebra.Under this lens, the graph language essentially becomes a tree language of terms. The secondformalism is the contextual HRG, developed by Drewes and Hoffmann [5]. This formalismextends the ordinary HRGs with so-called contextual rules, which allow for isolated nodesin their left-hand-sides. Contextual rules can access previously generated nodes, that arenot attached to the replaced nonterminal hyperedge, and add structure to them.

Despite their restrictions, OPDGs seem to be able to describe central structural prop-erties of AMR, but their limitation lies in the modelling of reantrancies. We propose todistinguish between two types of reentrancies: we speak of (i) structural reentrancies whenthey are syntactically governed, e.g. by control or coordination, and of (ii) non-structural

reentrancies when they represent coreferences, which can in principle refer to any antecedent,essentially disregarding the structure of the graph. An example of (i) could be subject con-trol as in “They persuaded him to talk to her”, where the person who does the talking mustbe the same person who was persuaded, whereas “[. . . ], but she liked them” is an exampleof (ii) since antecedent of “them” may be picked from anywhere in “[. . . ]” for the semanticrepresentation to be a valid one. Type (i) can to a large extent be modelled using OPDGs,but modelling type (ii) cannot be done (except for in very limited cases) since it requiresadding edges in an unstructured way, which cannot be achieved using only context-freeness.

We have previously shown that contextual HRGs can handle both structural and non-structural reentrancies [6]. Moreover, a parser generator has been provided by Drewes,Hoffmann, and Minas for contextual HRGs [7] that, when it succeeds in producing a parser,guarantees that the parser will run in quadratic (and in the common case, linear) time onits input. However, for some input HRGs the generator discovers a parsing conflict and failsto output a parser. It is unknown whether the class of contextual HRGs on which the parsergenerator succeeds is sufficient to cover all AMR languages, but it is known that these areincomparable to OPDGs. For these reasons, we are now looking to combine OPDGs withthe contextual mechanism used in [7], so as to be able to efficiently parse graph languagesthat contain reentrancies of both type (i) and (ii).

Page 19: Weighted Automata: Theory and Applications - LIS lab

References

[1] Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Herm-jakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. Abstractmeaning representation for sembanking. In Proc. of the 7th Linguistic Annotation Work-

shop and Interoperability with Discourse, 2013.

[2] Henrik Björklund, Frank Drewes, and Petter Ericson. Parsing weighted order-preservinghyperedge replacement grammars. In Proceedings of the 16th Meeting on the Mathemat-

ics of Language, pages 1–11, 2019.

[3] Annegret Habel. Hyperedge replacement: grammars and languages, volume 643. SpringerScience & Business Media, 1992.

[4] Frank Drewes, Hans-Jörg Kreowski, and Annegret Habel. Hyperedge replacement graphgrammars. In Handbook of Graph Grammars and Computing by Graph Transformation.1997.

[5] Frank Drewes and Berthold Hoffmann. Contextual hyperedge replacement. Acta Infor-

matica, 52(6):497–524, 2015.

[6] Frank Drewes and Anna Jonsson. Contextual hyperedge replacement grammars forabstract meaning representations. In Proceedings of the 13th International Workshop

on Tree Adjoining Grammars and Related Formalisms, pages 102–111, Umeå, 2017.Association for Computational Linguistics.

[7] Frank Drewes, Berthold Hoffmann, and Mark Minas. Extending predictive shift-reduceparsing to contextual hyperedge replacement grammars. In Esther Guerra and FernandoOrejas, editors, Graph Transformation, pages 55–72, Cham, 2019. Springer InternationalPublishing.

2

Page 20: Weighted Automata: Theory and Applications - LIS lab

Approximate simulation and bisimulation relationsfor fuzzy automata

Stefan Stanimirović1, Ivana Micić

2, Miroslav Ćirić

3

University of Niš, Faculty of Sciences and Mathematics, Višegradska 33, 18000 Niš,Serbia1 [email protected] [email protected] [email protected]

Algorithms for checking and computing the behavioural equivalences of

various systems have been investigated in many areas of mathematics and

computer science under different names, most commonly as simulations and

bisimulations. They have also taken an important place in the automata

theory, or more precisely, in the context of nondeterministic [2, 5], weighted

[1, 4], fuzzy [3] and probabilistic automata, etc.

Roughly speaking, two states of fuzzy automata are considered bisimilar

if and only if they can perform the same actions to reach bisimilar states.

As it turns out, this condition can be too rigorous even for some simple real

time systems. The study of approximate bisimulation relations for fuzzy

automata has lately received a wide attention [6, 7, 8, 9, 10].

In this talk, we introduce two types of �-approximate simulations and

four types of �-approximate bisimulations for fuzzy automata, where � is

the degree taken from the underlying set of truth values, which is a complete

Heyting algebra. We show that �-approximate simulations between fuzzy

automata imply that the degree of inclusion of the corresponding fuzzy lan-

guages is at least �, while �-approximate bisimulations imply that the degree

of equality of the corresponding fuzzy languages is at least than �. More-

over, we show that, for any �-approximate (bi)simulation, the exact degree

of fuzzy language similarity (or equality) can be computed. We investi-

gate further properties of �-approximate (bi)simulations, and in particular,

we pay attention to those �-approximate (bi)simulation which are uniform

fuzzy relations. In the end, we show that �-approximate (bi)simulations are

superior in the state reduction of fuzzy automata when compared to exact

(bi)simulations, in the sense that there are cases when no reduction can be

made using fuzzy (bi)simulations, while it is possible to reduce the number

of states of a given fuzzy automaton using �-approximate (bi)simulations.

1

Page 21: Weighted Automata: Theory and Applications - LIS lab

References[1] P. Buchholz, Bisimulation relations for weighted automata, Theoretical Computer

Science, 393 (2008) 109–123.[2] M. Ćirić, J. Ignjatović, M. Bašić, I. Jančić, Nondeterministic automata: Equivalence,

bisimulations, and uniform relations, Information Sciences 261 (2014) 185 – 218.[3] M. Ćirić, J. Ignjatović, N. Damljanović, M. Bašić, Bisimulations for fuzzy automata,

Fuzzy Sets and Systems 186 (2012) 100–139.[4] N. Damljanović, M. Ćirić, J. Ignjatović, Bisimulations for weighted automata over an

additively idempotent semiring, Theoretical Computer Science 534 (2014) 86–100.[5] A. Dovier, C. Piazza, A. Policriti, An efficient algorithm for computing bisimulation

equivalence, Theoretical Computer Science 311 (2004) 221–256.[6] S. Stanimirović, I. Micić, and M. Ćirić, Approximate bisimulations for fuzzy au-

tomata over complete heyting algebras, IEEE Transactions on Fuzzy Systems, 2020.doi: 10.1109/TFUZZ.2020.3039968.

[7] S. Qiao and P. Zhu. Limited approximate bisimulations and the corresponding roughapproximations. International Journal of Approximate Reasoning 130 (2021) 50–82.

[8] C. Yang and Y. Li, "–bisimulation relations for fuzzy automata. IEEE Transactionson Fuzzy Systems, 26(4):2017 – 2029, 2018.

[9] C. Yang and Y. Li, Approximate bisimulation relations for fuzzy automata. SoftComputing, 22(14):4535–4547, 2018.

[10] C. Yang and Y. Li. Approximate bisimulations and state reduction of fuzzy automataunder fuzzy similarity measures. Fuzzy Sets and Systems, 391:72–95, 2020.

2

Page 22: Weighted Automata: Theory and Applications - LIS lab

Weighted Tiling Automata on Graphs:Evaluation Complexity

C. Aiswarya

Chennai Mathematical Institute, IndiaInternational Research Lab ReLaX, CNRS France

[email protected]

Paul Gastin

LSV, ENS Paris-Saclay,CNRS, Universite Paris-Saclay, France

[email protected]

Abstract

We consider weighted automata to represent functions from graphsto a commutative semiring such as Natural semiring or Tropical semir-ing. The automaton labels the nodes of a graph by its states, and checkif the neighbourhood of every node belongs to a the set of permissibletiles, and assigns a weight accordingly. The weight of a labeling is thesemiring-product of the weights assigned to the nodes, and the weightof the graph is the semiring-sum of the weights of labelings. We showthat we can model interesting algorithmic questions using this for-malism - like computing the clique number of a graph or computingthe permanent of a matrix. We study the complexity of evaluation asa function problem, and the associated decision problems (thresholdlanguages). The complexity varies between NP and PSPACE in thecounting hierarchy for di↵erent semirings and problems. We give tightupper and lower bounds for each combination.

1

Page 23: Weighted Automata: Theory and Applications - LIS lab

Weighted Hexagonal Picture Automata

Meenakshi Paramasivan1, D. Gnanaraj Thomas2, S. James Immanuel3, and M.Gayathri Lakshmi4

1 Institut fur Informatik, Universitat Leipzig, D-04009 Leipzig, Germany,2 Department of Applied Mathematics, Saveetha School of Engineering, SIMATS,

Chennai - 602105, India,[email protected]

3 Department of Mathematics, Sri Sairam Institute of Technology, Chennai 600044,India,

james [email protected] Department of Mathematics, Saveetha Engineering College, Chennai - 602105,

India,[email protected]

Abstract. Two-dimensional picture languages generated by grammarsor recognized by automata have been studied since 1970s for the compli-cations arising in the framework of pattern recognition and image analy-sis. Rani Siromoney and her co-authors (1970) studied two-dimensionalpicture languages with applications.K. Inoue and I. Nakamura (1977) introduced two-dimensional on-line tes-sellation automata (2OTA). D. Giammarresi and her co-authors workedon two-dimensional picture languages and investigated connections toTiling systems, Domino systems (1997) by defining the family REC ofrecognizable picture languages and 2OTA. The family REC is robust andhas been characterized by many di↵erent devices, for instance it has beenshown that a set of pictures is recognized by a finite tiling system if andonly if it is definable in existential monadic second-order logic (1996).Bozapalidis and Grammatikopoulou (2005) introduced weighted pictureautomata (WPA). WPA operates (the unweighted version of a WPAcharacterizes precisely REC) in a natural way on pictures and whosetransitions carry weights; the weights are taken as elements from a givencommutative semiring. Ina Fichtner (2007, 2011) has investigated formalpower series on pictures and proved the equivalence between recognizablepicture languages and EMSO-definable picture languages in quantitativesetting.Two-dimensional hexagonal arrays on a triangular grid can be viewedor treated as the two-dimensional representations of three-dimensionalrectangular parallelopipeds. R. Siromoney (1976) worked on hexagonalarrays and hexagonal patterns that are found in literature on pictureprocessing and scene analysis. K. G. Subramanian and his co-authors(2005) defined local and hexagonal recognizable picture languages. D.G. Thomas and his co-authors (2007) defined three directions on-linetessellation automata (3OTA) to recognize hexagonal picture languages.In this paper, we introduce weighted three directions OTA (W3OTA)and study formal power series on hexagonal picture languages.

Page 24: Weighted Automata: Theory and Applications - LIS lab

Disambiguation of Weighted Tree Automata

Kevin Stier, Markus Ulbricht

Faculty of Mathematics and Computer Science, Universitat Leipzig, Germany

Abstract

We extend the disambiguation construction presented by Mohri and Riley [1]in two ways. First we change the underlying structure of their automata fromwords to trees and second we show that these results hold not only for thetropical semiring but also the arctic one.

References

[1] Mohri, Mehryar, and Michael D. Riley. ”A disambiguation algorithm forweighted automata.” Theoretical Computer Science 679 (2017): 53-68.

1

Page 25: Weighted Automata: Theory and Applications - LIS lab

The Big-O Problem for Weighted AutomataDmitry ChistikovUniversity of Warwick

Stefan KieferUniversity of Oxford

Andrzej S. MurawskiUniversity of Oxford

David PurserUniversity of Warwick and

MPI-SWS

Given two weighted automata A, B over an algebraic struc-ture (S, +,⇥), the equivalence problem asks whether the twoassociated functions 5A, 5B : ⌃⇤ ! S are equal: 5A(F) =5B (F) for all �nite words F over the alphabet ⌃. Over thering (Q, +,⇥), equivalence is decidable in polynomial timeby the results of Schützenberger [9] and Tzeng [11].Replacing = with makes the problem harder: even for

the ring (Q, +,⇥) the question of whether 5A(F) 5B (F)for allF 2 ⌃⇤ is undecidable—even if 5A is constant [7].

We introduce and study another natural problem, in whichthe ordering is relaxed from inequality to inequality towithina constant factor.De�nition. Given two WA A and B, is it true that thereexists a constant 2 > 0 such that

5A(F) 2 · 5B (F) for allF 2 ⌃⇤ ?Using standard mathematical notation, this condition as-

serts that 5A(F) = $ (5B (F)) as |F | ! 1, and we refer tothis problem as the big-O problem accordingly.The big-⇥ problem (which turns out to be computation-

ally equivalent to the big-O problem), in line with the ⇥(·)notation in analysis of algorithms, asks whether 5A = $ (5B)and 5B = $ (5A).We restrict our attention to the ring (Q, +,⇥) and only

consider non-negative weighted automata, i.e., those in whichall transitions have non-negative weights. Our main �ndingsare as follows:

• The big-O problem for non-negative WA is undecidablein general, by a reduction from nonemptiness for proba-bilistic automata. The result applies even for the specialcases of labelled Markov chains and probabilistic automata.

• For unambiguous automata, (where every word has atmost one accepting path) the big-O problem is decidablein polynomial time.

• In theunary case, i.e., if the input alphabet ⌃ is a singleton,the big-O problem is also decidable and, complete for thecomplexity class coNP. Our upper bound argument re�nesan analysis of growth of entries in powers of non-negativematrices by Friedland and Schneider [8], and the lowerbound is by a reduction from unary NFA universality [10].

• In amore general bounded case, i.e., if the languages of allwords positiveweightedwords are included inF⇤

1F⇤2 . . .F

⇤<

for some �nite wordsF1, . . . ,F< 2 ⌃⇤ the big-O problemis decidable subject to Schanuel’s conjecture (awell-knownconjecture in transcendental number theory [5], entailingthat the �rst-order theory of the real numbers with theexponential function is decidable [6]).

Relation to total variation distances In the labelledMarkovchain setting, the big-O problem can be reformulated as aboundedness problem for the following function. For twoLMCsA and B, de�ne the (asymmetric) ratio variation func-tion by

r (A,B) = sup⇢✓⌃⇤

5A(⇢)5B (⇢)

,

where 5A(⇢) and 5B (⇢) denote the total probability massassociated with an arbitrary set of �nite words ⇢ ✓ ⌃⇤ inA and B, respectively. The supremum over ⇢ ✓ ⌃⇤ can bereplaced with supremum over F 2 ⌃⇤. Consequently, thebig-O problem for LMCs is equivalent to deciding whetherr (A,B) < 1.Finding the value of r amounts to asking for the optimal

(minimal) constant in the big-O notation.r is a ratio-oriented variant of the classic total variation

distance tv, de�ned bytv(A,B) = sup

⇢✓⌃⇤5A(⇢) � 5B (⇢),

which is a well-established way of comparing two labelledMarkov chains [1, 4].We also consider the problem of approx-imating r to a given precision and the problem of comparingit with a given constant (threshold problem), showing thatboth are undecidable.

Application to privacy Consider a system M, modelledby a single labelled Markov chain, where output words areobservable to the environment but we want to protect theprivacy of the starting con�guration. We write 5B for theweighting function ofM when executed from state B .De�nition. [2, 3] Let ' ✓ & ⇥ & be a symmetric relation,which relates the starting con�gurations intended to remainindistinguishable. Given n � 0, M is n-di�erentially private(with respect to ') if, for all pairs B, B 0 2 & such that (B, B 0) 2 ',we have 5B (⇢) 4n · 5B0 (⇢) for every observable set of traces⇢ ✓ ⌃⇤.

Note that there exists such an n if and only if r (B, B 0) < 1for all (B, B 0) 2 ' or, equivalently, (the LMC M executedfrom) the state B is big-O of (the LMC M executed from)the state B 0 for all (B, B 0) 2 '. The minimal such n satis�es4n = max(B,B0)2' r (B, B 0).

Hence, our results show that even deciding whether theratio variation distance is �nite or +1 is, in general, impossi-ble. Likewise, it is undecidable whether a systemmodelled bya labelled Markov chain provides any degree of di�erentialprivacy, however low.

Page 26: Weighted Automata: Theory and Applications - LIS lab

References[1] Taolue Chen and Stefan Kiefer. 2014. On the total variation distance of labelled Markov chains. In Proceedings of the Joint Meeting of the Twenty-Third

EACSL Annual Conference on Computer Science Logic (CSL) and the Twenty-Ninth Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).ACM, 33.

[2] Dmitry Chistikov, Andrzej S. Murawski, and David Purser. 2019. Asymmetric Distances for Approximate Di�erential Privacy. In 30th InternationalConference on Concurrency Theory, CONCUR 2019, August 27-30, 2019, Amsterdam, the Netherlands. 10:1–10:17.

[3] Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam D. Smith. 2006. Calibrating Noise to Sensitivity in Private Data Analysis. In Theory ofCryptography, Third Theory of Cryptography Conference, TCC 2006, New York, NY, USA, March 4-7, 2006, Proceedings. 265–284. h�ps://doi.org/10.1007/11681878_14

[4] Stefan Kiefer. 2018. On Computing the Total Variation Distance of Hidden Markov Models. In 45th International Colloquium on Automata, Languages,and Programming (ICALP 2018). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.

[5] Serge Lang. 1966. Introduction to transcendental numbers. Addison-Wesley Pub. Co.[6] Angus Macintyre and Alex J Wilkie. 1996. On the decidability of the real exponential �eld. A K Peters, 441–467.[7] Azaria Paz. 2014. Introduction to probabilistic automata. Academic Press.[8] Hans Schneider. 1986. The in�uence of the marked reduced graph of a nonnegative matrix on the Jordan form and on related properties: A survey.

Linear Algebra Appl. 84 (1986), 161–189.[9] Marcel Paul Schützenberger. 1961. On the de�nition of a family of automata. Information and control 4, 2-3 (1961), 245–270.[10] Larry J Stockmeyer and Albert R Meyer. 1973. Word problems requiring exponential time (preliminary report). In Proceedings of the �fth annual ACM

symposium on Theory of computing. ACM, 1–9.[11] Wen-Guey Tzeng. 1992. A polynomial-time algorithm for the equivalence of probabilistic automata. SIAM J. Comput. 21, 2 (1992), 216–227.

2

Page 27: Weighted Automata: Theory and Applications - LIS lab

Kleene and Buchi for Weighted Forest Languagesover M-Monoids

Frederic Dorband1

Technische Universitat Dresden, February 10, 2020

We recall forests as finite tuples of trees. This syntactic extension of trees already oc-curred in [2, 3, 4]. We define weighted forest automata (wfa) as an extension of weightedtree automata (wta). Our definition generalizes the unweighted forest automata intro-duced in [1] to the weighted case, while also generalizing the weighted forest automataintroduced in [3] from commutative semirings to M-monoids. In comparison with [2] ,our paper is a generalization from semirings to M-monoids, but also a restriction fromhedge languages to forest languages.A wfa is syntactically similar to a wta, however the semantics of wfa allow for entire

forests to be processed (instead of single trees). The essence of our paper is a theoremstating that our automaton model generates only so-called rectangular weighted forestlanguages. That is, for every recognizable weighted forest language ', there are rec-ognizable weighted tree languages (the so-called rectangular components of '), whosehorizontal concatenation equals '.Using this rectangularity property, we then infer both, a Kleene-like result and a

Buchi-like result for weighted forest languages. On the one hand, this generalizes theKleene-like result for weighted tree automata from [5] to the case of forests and theKleene-like result for unweighted forest automata [1] to the case of M-monoids. On theother hand, this generalizes the Buchi-like result for weighted tree automata from [6] tothe case of forests.For our Kleene-like result, we introduce rational forest expressions, which are hori-

zontal products of rational tree expressions and for our Buchi-like result, we introduceforest M-expressions, which are horizontal products of tree M-expressions. We ultimatelyask the question, whether the definitions for rational forest expressions and forest M-expressions can be done inductively. However, we see that straightforward inductivedefinitions are not possible due to ambiguity in the choice of rectangular components.

1Research of this author is supported by the DFG Research Training Group 1763 “QuantLA”

2L. Straßburger. “A Kleene theorem for forest languages”. In: Language and automata theory andapplications. Vol. 5457. Lecture Notes in Comput. Sci. Springer, Berlin, 2009, pp. 715–727. url:https://doi.org/10.1007/978-3-642-00982-2_61.

3C. Mathissen. Weighted Automata and Weighted Logics over Tree-like Structures. Citeseer, 2009.

4F. Dorband. “A Kleene Theorem for Weighted Forest Automata”. MA thesis. Technische Universitat

Dresden, 2019.5Z. Fulop, A. Maletti, and H. Vogler. “A Kleene theorem for weighted tree automata over distributive

multioperator monoids”. In: Theory Comput. Syst. 44 (2009), pp. 455–499.6Zoltan Fulop, Torsten Stuber, and Heiko Vogler. “A Buchi-like theorem for weighted tree automata

over multioperator monoids”. In: Theory of Computing Systems 50.2 (2012), pp. 241–278.

1

Page 28: Weighted Automata: Theory and Applications - LIS lab

ai�iBbiB+�H K�+?BM2 i`�MbH�iBQMmbBM; bi`2�KBM; bi`BM; i`�Mb/m+2`b

h?QK�b _mT`2+?ih2+?MBb+?2 lMBp2`bBi i .`2b/2M

i?QK�bX`mT`2+?i!im@/`2b/2MX/2

�#bi`�+iLQM/2i2`KBMBbiB+ bi`2�KBM; bi`BM; i`�Mb/m+2`b UMbbiV (R) �`2 bi`BM;@iQ@bi`BM; i`�Mb/m+2`b �M/ 72�@

im`2 � }MBi2 b2i Q7 bi�i2b- �b mbm�HX 1�+? i`�MbBiBQM `2�/b 2t�+iHv QM2 BMTmi bvK#QH �M/ +QKTQb2bb2p2`�H QmiTmi bi`BM;b i?�i �`2 biQ`2/ BM `2;Bbi2`bc i?Bb K�v BMi`Q/m+2 M2r bvK#QHb �M/ �`#Bi`�`BHv+QKTQb2 i?2 bi`BM;b T`2pBQmbHv biQ`2/ BM i?2 `2;Bbi2`b- #mi MQi /mTHB+�i2 i?2KX aBM+2 i?2`2 �`2 MQ7m`i?2` `2bi`B+iBQMb- i?2 BMTmi H�M;m�;2 Q7 2�+? Mbbi Bb `2;mH�`X h?2 T`QT2`iB2b Q7 i?2 bi`BM;@iQ@bi`BM;i`�Mb/m+iBQMb BKTQb2/ #v Mbbi r2`2 2t�KBM2/ BMi2MbBp2Hv #v �Hm` �M/ .2b?KmF? (R)- v2i Ĝ +QKT�`2/iQ r2HH@2bi�#HBb?2/ i`�Mb/m+2` 7Q`K�HBbKb- bm+? �b }MBi2 bi�i2 i`�Mb/m+2`b Ĝ i?Bb 7Q`K�HBbK Bb `�i?2`vQmM;X �T�`i 7`QK i?2 i`�Mb/m+iBQM +QKTmi2/ #v Mbbi- "QD�Ɩ+xvF (k) �HbQ BMi`Q/m+2/ Q`B;BM b2K�M@iB+b 7Q` i?Bb i`�Mb/m+2` KQ/2HX h?2v +QMbB/2` i?2 `2H�iBQM #2ir22M BMTmi �M/ QmiTmi TQbBiBQMb rBi?`2bT2+i iQ r?B+? QmiTmi TQbBiBQMb r2`2 BMi`Q/m+2/ r?2M i?2 BMTmi TQbBiBQM r�b `2�/X "QD�Ɩ+xvF-.�pB�m/- :mBHHQM- �M/ S2M2HH2 (j) +?�`�+i2`Bx2/ i?2 +H�bb Q7 i?2b2 Q`B;BM ;`�T?b 7Q` Mbbi �M/ +QK@T�`2/ Bi iQ i?2 +H�bb2b Q7 Q`B;BM ;`�T?b /2}M2/ i`�Mb/m+iBQMb #v irQ@r�v �miQK�i� �M/ KQM�/B+b2+QM/@Q`/2` HQ;B+X

ai�iBbiB+�H K�+?BM2 i`�MbH�iBQM UbKiV /2�Hb rBi? i?2 �miQK�iB+ i`�MbH�iBQM 7`QK b2Mi2M+2b Q7 QM2M�im`�H H�M;m�;2 BMiQ b2Mi2M+2b Q7 �MQi?2` M�im`�H H�M;m�;2 (e)X hvTB+�HHv- H�`;2 #BHBM;m�H +Q`TQ`��`2 mb2/ iQ �miQK�iB+�HHv BM/m+2 � }MBi2 b2i Q7 T`Q#�#BHBbiB+ i`�MbH�iBQM `mH2b Q7 bQK2 mM/2`HvBM;7Q`K�HBbKX h?Bb b2i Q7 `mH2b b2`p2b 7Q` i?2 i`�MbH�iBQM Q7 T`2pBQmbHv mMb22M b2Mi2M+2bX _2+2MiHvL2/2`?Q7 �M/ oQ;H2` (3) BMp2biB;�i2/ i?2 bi`BM;@iQ@bi`BM; i`�Mb/m+iBQM BKTQb2/ #v Mbbi r?Qb2 BMTmiBb `2bi`B+i2/ iQ � KmHiBTH2 +QMi2ti@7`22 H�M;m�;2- `2bmHiBM; BM i`�Mb/m+iBQMb Q7 bvM+?`QMQmb KmHiBTH2+QMi2ti@7`22 ;`�KK�`bX �b bvM+?`QMQmb KmHiBTH2 +QMi2ti@7`22 ;`�KK�`b r2`2 bm++2bb7mHHv �TTHB2/ BMbKi (8)- i?2 [m2biBQM �`Bb2b ?Qr Mbbi T2`7Q`K BM i?Bb b2iiBM;X

>2`2 r2 +QMbB/2` T`Q#�#BHBbiB+ MQM/2i2`KBMBbiB+ bi`2�KBM; bi`BM; i`�Mb/m+2`b UTMbbiV �b �M mM@/2`HvBM; 7Q`K�HBbK 7Q` bKiX q2 T`2b2Mi �M BM/m+iBQM 7Q` TMbbi 7`QK #BHBM;m�H +Q`TQ`� rBi? rQ`/�HB;MK2Mib Ur?B+? �`2 i`2�i2/ �b Q`B;BM ;`�T?bVX lbBM; i2+?MB[m2b FMQrM 7Q` i?2 BM/m+iBQM Q7 KmHiB@TH2 +QMi2ti@7`22 ;`�KK�`b (d)- r2 /2}M2 Mbbi i?�i `2+Q;MBx2 � ;Bp2M b2i Q7 Q`B;BM ;`�T?bX q2B;?ib 7Q`2�+? i`�MbBiBQM �`2 BM/m+2/ �++Q`/BM; iQ i?2 K�tBKmK HBF2HB?QQ/ 2biBK�i2 (9) rBi? `2bT2+i iQ i?2 b2iQ7 Q`B;BM ;`�T?bX aQK2 T`QT2`iB2b Q7 i?2 BM/m+2/ TMbbi �`2 /Bb+mbb2/ BM i?2 +QMi2ti Q7 BM72`2M+2- BX2Xi?2 T`2/B+iBQM Q7 i?2 KQbi T`Q#�#H2 Q`B;BM ;`�T? 7Q` � }t2/ BMTmiX

_272`2M+2b(R) _X �Hm` �M/ CX oX .2b?KmF?X dzLQM/2i2`KBMBbiB+ bi`2�KBM; bi`BM; i`�Mb/m+2`bǴX AM, A*�GSX aT`BM;2`X kyRRX(k) JX "QD�Ɩ+xvFX dzh`�Mb/m+2`b rBi? Q`B;BM BM7Q`K�iBQMǴX AM, A*�GSX aT`BM;2`X kyR9X(j) JX "QD�Ɩ+xvF- GX .�pB�m/- "X :mBHHQM- �M/ oX S2M2HH2X dzq?B+? +H�bb2b Q7 Q`B;BM ;`�T?b �`2 ;2M2`�i2/ #v

i`�Mb/m+2`b\Ǵ AM, A*�GSX kyRdX(9) �X SX .2KTbi2`- LX JX G�B`/- �M/ .X "X _m#BMX dzJ�tBKmK GBF2HB?QQ/ 7`QK AM+QKTH2i2 .�i� pB� i?2 1J

�H;Q`Bi?KǴX AM, CQm`M�H Q7 i?2 _Qv�H ai�iBbiB+�H aQ+B2ivX a2`B2b " UJ2i?Q/QHQ;B+�HV jNXR URNddVX(8) JX E�2b?�KK2`X dzavM+?`QMQmb GBM2�` *QMi2ti@6`22 _2r`BiBM; avbi2Kb 7Q` J�+?BM2 h`�MbH�iBQMǴX AM, S`Q@

+22/BM;b Q7 i?2 a2p2Mi? qQ`Fb?QT QM avMi�t- a2K�MiB+b �M/ ai`m+im`2 BM ai�iBbiB+�H h`�MbH�iBQMX �*G- kyRjX(e) �X GQT2xX dzai�iBbiB+�H J�+?BM2 h`�MbH�iBQMǴX AM, �*J *QKTmiX am`pX 9yXj Ukyy3VX(d) qX J�B2` �M/ �X aǠ;��`/X dzh`22#�MFb �M/ KBH/ +QMi2ti@b2MbBiBpBivǴX AM, S`Q+22/BM;b Q7 6Q`K�H :`�KK�`X

kyy3X(3) JX@CX L2/2`?Q7 �M/ >X oQ;H2`X dz_2;mH�` i`�Mb/m+iBQMb rBi? J*6: BMTmi bvMi�tǴX AM, S`Q+22/BM;b Q7 6aJLGSX

�*G- kyRNX

Page 29: Weighted Automata: Theory and Applications - LIS lab

Greibach Normal Form andSimple Automata for

Weighted !-Context-Free Languages

Manfred Droste1, Sven Dziadek1, and Werner Kuich2

1Institut fur Informatik, Universitat Leipzig, Germany2Institut fur Diskrete Mathematik und Geometrie, Technische Universitat Wien, Austria

In weighted automata theory, many classical results on formal languages have been ex-

tended into a quantitative setting. Here, we investigate weighted context-free languages

of infinite words, a generalization of !-context-free languages (Cohen, Gold 1977) and an

extension of weighted context-free languages of finite words (Chomsky, Schutzenberger

1963). As in the theory of formal grammars, these weighted context-free languages,

or !-algebraic series, can be represented as solutions of (mixed) !-algebraic systems of

equations and by weighted !-pushdown automata.

In our first main result, we show that (mixed) !-algebraic systems can be transformed

into Greibach normal form. We use the Greibach normal form in our second main result

to prove that simple !-reset pushdown automata recognize all !-algebraic series. Simple

!-reset automata do not use ✏-transitions and can change the stack only by at most

one symbol. These results generalize fundamental properties of context-free languages

to weighted context-free languages.

This talk is based on [1] and its corresponding short version [2].

[1] M. Droste, S. Dziadek, W. Kuich. Greibach normal form for !-algebraic systems and

weighted simple !-pushdown automata, 2020. Submitted, arXiv:2007.08866.

[2] M. Droste, S. Dziadek, W. Kuich. Greibach normal form for !-algebraic systems

and weighted simple !-pushdown automata. In: Foundations of Software Technologyand Theoretical Computer Science (FSTTCS 2019), LIPIcs, vol. 150, pp. 38:1–38:14,2019. doi:10.4230/LIPIcs.FSTTCS.2019.38.

Page 30: Weighted Automata: Theory and Applications - LIS lab

State reduction of weighted automata using certain equivalences

Aleksandar Stamenkovic

Faculty of Sciences and Mathematics, University of Nis, Visegradska 33,18000 Nis, Serbia

In this talk, for a given weighted automaton A over an alphabet X, we introduce L−weakly leftand L−weakly right invariant equivalences corresponding to A, where L is an arbitrary language overX. We give a simple procedure to build the resulting weighted automaton from the staring one usingL−weakly left (resp. L−weakly right) invariant equivalence. Since resulting weighted automata havesmaller or equal number of states than the starting ones, the above-mentioned equivalences can be usedfor state reduction. Moreover, we prove that starting and resulting weighted automata are L−equivalentin case L is suffix-closed (prefix closed) and using that result we obtain some additional consequences.We also provide a procedure for computing L−weakly left (resp. L−weakly right) invariant equivalencescorresponding to a weighted automaton A. Since, in general, given procedure has some drawbacksregarding its efficiency, we investigate some particular cases where these shortcomings are overcomed.

Page 31: Weighted Automata: Theory and Applications - LIS lab

Weighted linear dynamic logic with two-sortedsemantics

Gustav Grabolle

In 2013 Giuseppe De Giacomo and Moshe Vardi introduced linear dynamic logic.This logic uses the intuitive, two-sorted syntax of PDL, has good complexityproperties, and extends the expressive power of LTL: De Giacomo and Vardiprove LDL and finite automata are equally expressive. This is done via alternatingautomata. In 2016 Manfred Droste and George Rahonis introduced a weightedversion of LDL with weights taken from semirings.

In this talk, I will introduce a new adaptation of LDL into the weighted setting.While weighted LDL uses generalized rational expressions in the definition of itssemantics, nLDL mirrors the two-sorted semantics of LDL. This is to obtain anintuitive syntax similar to LDL. Moreover, nLDL is more expressive than weightedLDL, and relates to weighted LTL as LDL relates to LTL. I will show that, similarto PDL, the depth of the question-mark operator entails a hierarchy on the ex-pressive power of nLDL. To characterize nLDL, I will introduce n-level weightedfinite automata which are a subclass of nested weighted automata and capturethe expressive power of nLDL.

1

Page 32: Weighted Automata: Theory and Applications - LIS lab

Decidability of crisp-determinization for weighted finiteautomata over past-finite monotonic strong bimonoids

M. Drostea

Z. Fulopb1

D. Koszob2

H. Voglerc

aInstitute of Computer Science, University of LeipzigbDepartment of Foundations of Computer Science, University of Szeged

cFaculty of Computer Science, Technische Universitat Dresden

Abstract: A general problem in the theory of automata is the question whether an automaton

is determinizable, i.e., whether we can construct an equivalent deterministic automaton. While

each classical finite automaton is determinizable, this is not true for weighted finite automata

(wfa). In fact, there is a nondeterministic wfa over the field Q which is not determinizable (cf.

[2]). Thus, it is natural to identify classes of wfa which have the following property: for each

wfa A of that class it is decidable whether A is determinizable. If a class has this property

(respectively, does not have this property), then we say that the determinization problem for

this class is decidable (respectively, undecidable).

We consider the crisp-determinization problem for the class of wfa over strong bimonoids

[3,5]. A wfa is crisp-deterministic if it is deterministic, and each of its transitions carries either

the additive or multiplicative unit of the strong bimonoid; weights di↵erent from these units

may only appear as initial and final weights. In [6] it was shown that the crisp-determinization

problem for the class of wfa over strong bimonoids is undecidable.

In this presentation, we deal with wfa over past-finite monotonic strong bimonoids. Such

algebras are based on monotonic semirings [1] and they share many properties with the semiring

of natural numbers (strong kind of well-foundedness, monotonicity of operations, zero-sum and

zero-divisor free, partial order on the carrier set), however distributivity is not required and also

does not follow from the axioms. We obtain a general characterization of when trim wfa over

past-finite monotonic strong bimonoids are crisp-determinizable. As a consequence, we show

that the crisp-determinization problem for the class of (a) wfa over additively locally finite and

past-finite monotonic strong bimonoids and (b) unambiguous wfa over past-finite monotonic

strong bimonoids is decidable [4]. In this case, assuming the strong bimonoid to be computable,

the equivalent crisp-deterministic wfa can be computed. Moreover, we show that for each wfa

A over a past-finite monotonic strong bimonoid and a natural number k it is decidable whether

the cardinality of the image of the semantics of A is bounded by k.References[1] B. Borchardt, Z. Fulop, Z. Gazdag, and A. Maletti. Bounds for tree automata with polynomial

costs. J. Autom. Lang. Comb., 10:107–157, 2005.[2] B. Borchardt and H. Vogler. Determinization of finite state weighted tree automata. J. Autom.Lang. Comb., 8(3):417–463, 2003.[3] M. Ciric, M. Droste, J. Ignjatovic, and H. Vogler. Determinization of weighted finite automata over

strong bimonoids. Inf. Sci., 180(18):3479–3520, 2010.[4] M. Droste, Z. Fulop, D. Koszo, and H. Vogler. Crisp-Determinization of Weighted Tree Automata

over Additively Locally Finite and Past-Finite Monotonic Strong Bimonoids Is Decidable. G. Jiraskova

and G. Pighizzini (Eds.): DCFS 2020, LNCS 12442, pp. 39-51, 2020.

[5] M. Droste, T. Stuber, and H. Vogler. Weighted finite automata over strong bimonoids. Inf. Sci.,180(1):156–166, 2010.

[6] Z. Fulop, D. Koszo, and H. Vogler. Crisp-determinization of weighted tree automata over strong

bimonoids. see also: arXiv:1912.02660v2 [cs.FL] 2 Feb 2021.

1Research of this author was supported by grant TUDFO/47138-1/2019-ITM of the Ministry for Innovationand Technology, Hungary.

2Supported by the UNKP-19-3 and UNKP-20-3 - New National Excellence Program of the Ministry forInnovation and Technology from the source of the National Research, Development and Innovation Fund.

Page 33: Weighted Automata: Theory and Applications - LIS lab

Weighted Parsing for Grammar-Based Language Modelsover Multioperator Monoids

Richard Morbitz Heiko Vogler

We develop a general framework for weighted parsing called weighted RTG-based languagemodels, define the M-monoid parsing problem, and present an algorithm for its solution.

There is a variety of weighted parsing problems, e.g., probabilistic constituent parsing, wherethe task is to compute for each English sentence the most probable constituent tree (according tosome formal grammar). We view each of these particular problems as a mapping parse:L! K,where L is the set of syntactic objects (e.g., the set of English sentences) and K is the set ofweights (e.g., the set of English constituent trees).

Our approach makes heavy use of universal algebra, in the sense that both L and K areidentified with the carrier sets of algebras. We employ the initial algebra semantics1 to model thesyntactic structure ofL using regular tree grammars (RTG) and we choose multioperator monoids(M-monoids)2 to compute the weights in K. The M-monoid parsing problem determines how,given a syntactic object from L, the weight in K is to be computed using both algebras. Thusparticular weighted parsing problems amount to particular choices of L and K and are thereforeinstances of the M-monoid parsing problem.

We show that, in general, the M-monoid parsing problem cannot be solved by a terminatingalgorithm. We determine a large class of weighted RTG-based language models for whichthis is still possible. This class is essentially a generalization of the graphs weighted withclosed semirings from Mohri’s “single source shortest distance” framework.3 We prove that ouralgorithm terminates and is correct for the class of closed weighted RTG-based language models.

In the end we are also interested in application scenarios of our algorithm, i.e., which weightedparsing problems are covered by the class of closed weighted RTG-based language models. Itturns out that our approach subsumes the previous approaches to weighted parsing, semiringparsing4 and weighted deductive parsing,5 and also covers weighted parsing problems whichare outside the scope of both (e.g., parsing as intersection). Moreover, we can even solve theproblems of algebraic dynamic programming.6

This work was presented at the 14th International Conference on Finite-State Methods andNatural Language Processing (FSMNLP 2019), September 23–25, 2019, Dresden, Germany.

1J. A. Goguen, J. W. Thatcher, E. G. Wagner, and J. B. Wright. “Initial Algebra Semantics and ContinuousAlgebras”. In: Journal of the Association for Computational Machinery (1977).

2W. Kuich. “Linear systems of equations and automata on distributive multioperator monoids”. In: Contributionsto general algebra (1999).

3M. Mohri. “Semiring frameworks and algorithms for shortest-distance problems”. In: Journal of Automata,Languages and Combinatorics (2002).

4J. Goodman. “Semiring parsing”. In: Computational Linguistics (1999).5M.-J. Nederhof. “Weighted deductive parsing and Knuth’s algorithm”. In: Computational Linguistics (2003).6R. Giegerich, C. Meyer, and P. Ste↵en. “A discipline of dynamic programming over sequence data”. In: Science

of Computer Programming (2004).

Page 34: Weighted Automata: Theory and Applications - LIS lab

Weakly linear systems for matrices over the

max-plus quantale and their applications

Miroslav Ciric1, Aleksandar Stamenkovic1, and Dragan Djurdjanovic2

1University of Nis, Faculty of Science, Department of Computer Science, Nis, [email protected], [email protected]

2University of Texas, Department of Mechanical Engineering, Austin, TX, [email protected]

Weakly linear systems are a special kind of systems of relational or matrixinequations and equations that have recently emerged in the study of fuzzy au-tomata, and have also been applied in social network analysis. They have beenused to reduce the number of states of fuzzy automata [9–12], in the study of sim-ulations and bisimulations for nondeterministic, fuzzy and weighted automata[1–4], as well as in the positional analysis of social networks [5, 6]. In addition,certain types of WLS have been used to improve determinization algorithms forfuzzy automata [8] and in the conflict analysis of fuzzy discrete event systems[12]. In all these cases, the underlying structure of membership values was acomplete residuated lattice.

General properties of weakly linear systems of fuzzy relation inequationsand equations, with a complete residuated lattice as the underlying structureof membership values, have been studied in [5–7]. The key role in this study isplayed by completeness and residuation in the structure of membership values,which ensure completeness and residuation in the corresponding lattices of fuzzyrelations. The residuation reduces the problem of solving WLS to the problem ofcomputing post-fixed points of suitable isotone functions on the lattice of fuzzyrelations, and the completeness of this lattice enables to use the Knaster-TarskiFixed Point Theorem, according to which solutions of a WLS form a completelattice, and therefore, there exists the greatest solution. The greatest solutions ofWLS are computed using a procedure which is a modification of the Kleene FixedPoint Theorem. This procedure does not necessarily terminate in a finite numberof steps, and some sufficient conditions have been found when this happens.

Here we consider weakly linear systems in the context of matrices over themax-plus algebra. The complete max-plus algebra is very similar to completeresiduated lattices1, the only difference is that its multiplicative identity is notthe greatest element. In fact, the complete max-plus algebra is a commutativeunital quantale. We prove the existence of the greatest solution contained in agiven matrix X0, and present a procedure for its computation. In case of finiteWLS when all finite entries of matrices forming this WLS and the matrix X0

are integers, rationals or particular irrationals and a finite solution exists, theprocedure finishes in a finite number of steps. If in that case an arbitrary finite

1 we are talking about complete residuated lattices defined in the way that is the mostcommon in the fuzzy set theory (cf. [2, 3, 10, 5–8, 11, 12]).

Page 35: Weighted Automata: Theory and Applications - LIS lab

solution is given, a lower bound on number of computational steps is calculated.Otherwise, we use our algorithm to compute approximations to finite solutions.

We will also mention applications of WLS in the study of max-plus automata.

References

1. Ciric M, Ignjatovic J, Basic M, Jancic I (2014) Nondeterministic automata: equiv-alence, bisimulations, and uniform relations. Inf Sci 261:185–218

2. Ciric M, Ignjatovic J, Damljanovic N, Basic M (2012) Bisimulations for fuzzy au-tomata. Fuzzy Sets Syst 186:100–139

3. Ciric M, Ignjatovic J, Jancic I, Damljanovic N (2012) Computation of the greatestsimulations and bisimulations between fuzzy automata. Fuzzy Sets Syst 208:22–42

4. Damljanovic N, Ciric M, Ignjatovic, J (2014) Bisimulations for weighted automataover an additively idempotent semiring. Theor Comput Sci 534:86–100

5. Ignjatovic J, Ciric M (2012) Weakly linear systems of fuzzy relation inequalities andtheir applications: A brief survey. Filomat 26(2):207–241

6. Ignjatovic J, Ciric M, Bogdanovic S (2010) On the greatest solutions to weakly linearsystems of fuzzy relation inequalities and equations. Fuzzy Sets Syst 161:3081–3113

7. Ignjatovic J, Ciric M, Damljanovic N, Jancic I (2012) Weakly linear systems of fuzzyrelation inequalities: The heterogeneous case. Fuzzy Sets Syst 199:64–91

8. Jancic Z, Micic I, Ignjatovic J, Ciric M (2016) Further improvements of determiniza-tion methods for fuzzy finite automata. Fuzzy Sets Syst 301:79–102

9. Ciric M, Stamenkovic A, Ignjatovic J, Petkovic T (2007) Factorization of fuzzyautomata. in: E. Csuhaj-Varju, and Z. Esik (eds.), FCT 2007, Lecture Notes inComputer Science 4639:213–225

10. Ciric M, Stamenkovic A, Ignjatovic J, Petkovic T (2010) Fuzzy relation equationsand reduction of fuzzy automata. J Comput Syst Sci 76:609–633

11. Stamenkovic A, Ciric M, Basic M (2018) Ranks of fuzzy matrices. Applications instate reduction of fuzzy automata. Fuzzy Sets Syst 333:124–139

12. Stamenkovic A, Ciric M, Ignjatovic J (2014) Reduction of fuzzy automata by meansof fuzzy quasi-orders. Inf Sci 275:168–198

Page 36: Weighted Automata: Theory and Applications - LIS lab

Finite Sequentiality of Max-Plus Tree Automata

Erik Paul

Institute of Computer ScienceLeipzig University, Germany

Abstract

We consider the finite sequentiality problem for max-plus tree automata and its decid-ability for unambiguous and finitely ambiguous max-plus tree automata. A max-plustree automaton is a weighted tree automaton over the max-plus semiring. A max-plustree automaton is called unambiguous if there is at most one accepting run on everytree and it is called finitely ambiguous if the number of accepting runs on every treeis bounded by a global constant. The finite sequentiality problem asks whether for agiven max-plus tree automaton, there exist finitely many deterministic max-plus treeautomata whose pointwise maximum is equivalent to the given automaton. We show thatfor unambiguous and finitely ambiguous max-plus tree automata, the finite sequentialityproblem is decidable. This generalizes results by Bala and Koninski from words to trees.

Page 37: Weighted Automata: Theory and Applications - LIS lab

Blockmodeling of fuzzy transition systems using approximateregular relations?

Ivana Micic⇤, Stefan Stanimirovic, Zorana Jancic

University of Nis, Faculty of Sciences and Mathematics, Visegradska 33, 18000 Nis, Serbia

Abstract

For a fuzzy automata over complete Heyting algebra, the �-approximate bisimulations are

recently defined and used for factorization of automata. These relations are shown to be very

good means for constructing the models, which are similar at the degree �, to the original

automata, but with the much smaller size. Based on this methodology, in current work, we

investigate the �-approximate regular fuzzy relations on the fuzzy transition systems over

complete residuated lattices. We provide an algorithm for determining the �-approximate

regular fuzzy relations which are preorders. Afterward, we use these preorders for reduction

of fuzzy transition systems. At the end, we propose a method for determining all values �,such that reduction by means of �-approximate regular preorders produces the system of a

di↵erent size.

?Research supported by Ministry of Education, Science and Technological Development, Republic ofSerbia, Grant No. 174013

⇤Corresponding author. Tel.: +38118224492.Email addresses: [email protected] (Ivana Micic), [email protected]

(Stefan Stanimirovic), [email protected] (Zorana Jancic)

Preprint submitted to Elsevier March 16, 2021

Page 38: Weighted Automata: Theory and Applications - LIS lab

Weighted context-free grammars over a

complete strong bimonoid

Jelena Ignjatovic1, Miroslav Ciric1, and Manfred Droste2

1University of Nis, Faculty of Science, Department of Computer Science, Nis, [email protected], [email protected]

2University of Leipzig, Institute of Computer Science, Leipzig, [email protected]

Weighted context-free grammars are classical context-free grammars in whichthe productions carry weights. Adding weights allows a quantitative view of deri-vations, which can be very useful in many applications. Traditionally, the weightsare assumed to form the algebraic structure of a semiring, but recently otherways of weight computation are also considered. Shang, Lu and Lu [8] studiedcontext-free grammars with weights taken from particular algebraic structurescalled lattice-ordered quantum MV algebras. Droste and Vogler [3] were dealingwith CFGs over unital valuation monoids, whereas Jin and Li [5] and Rahonisand Torpari [7] have considered CFGs over bimonoids.

Here we are interested in weighted context-free grammars over completestrong bimonoids. Due to lack of distributivity we distinguish between two waysto define behaviour of such grammars: depth-first semantics and breadth-first se-mantics . In the depth-first semantics, we associate the weight of the derived wordby summing weights of all derivations of that word, where the weight of a deriva-tion is computed multiplying weights of the productions that form it. Contrary tothat, in the breadth-first semantics, we compute weights of derivations of differ-ent lengths, gradually increasing the length. If the underlying weight-structureis a semiring, we prove that these two semantics coincide. Moreover, we showthat two semantics coincide for every weighted context-free grammar G over Kwithout multiple direct derivations if and only if the underlying complete strongbimonoid K is right distributive. When K is an additively idempotent com-plete strong bimonoid, we prove that two semantics coincide for every weightedcontext-free grammar G over K if and only if K is a semiring.

Restricting attention only to grammars with leftmost derivations, we defineleftmost depth-first semantics and leftmost breadth-first semantics and we showthat these two semantics coincide for very weighted context-free grammar G overK if and only if K is right distributive.

Similar issues will be considered in the context of weighted pushdown autom-ata, along with the question of the equivalence of weighted context-free grammarsand weighted pushdown automata.

References

1. M. Ciric, M. Droste, J. Ignjatovic, H. Vogler, Determinization of weighted finiteautomata over strong bimonoids, Information Sciences 180 (2010) 3497–3520.

Page 39: Weighted Automata: Theory and Applications - LIS lab

2. M. Droste, T. Stuber, H. Vogler, Weighted finite automata over strong bimonoids,Information Sciences 180 (2010) 156–166.

3. M. Droste, H. Vogler, The Chomsky-Schtzenberger theorem for quantitativecontext-free languages, Internat. J. Found. Comput. Sci. 25 (2014) 955–969.

4. Z. Esik, W. Kuich, Modern automata theory, http://www.dmg .tuwien .ac .at/kuich, 2007.

5. J. H. Jin, C. Q. Li, The algebraic characterizations for a formal power series overcomplete strong bimonoids, Springer Plus 5 (2016) Article no. 310.

6. W. Kuich, A. Salomaa, Semirings, Automata, Languages, Monogr. Theoret. Com-put. Sci. EATCS Ser., vol.5, Springer, 1986.

7. G. Rahonis, F. Torpari, Weighted context-free grammars over bimonoids, ScientificAnnals of Computer Science 29 (1) (2019) 59–80.

8. Y. Shang, X. Lu, R. Lu, A theory of computation based on unsharp quantum logic:Finite state automata and pushdown automata, Theoretical Computer Science 434(2012) 53–86.