Decision Trees for Binary Subword-Closed Languages

Abstract

In this paper, we study arbitrary subword-closed languages over the alphabet $\{0,1\}$ (binary subword-closed languages). For the set of words $L\left(n\right)$ of the length n belonging to a binary subword-closed language L, we investigate the depth of the decision trees solving the recognition and the membership problems deterministically and nondeterministically. In the case of the recognition problem, for a given word from $L\left(n\right)$, we should recognize it using queries, each of which, for some $i\in \{1,\dots ,n\}$, returns the ith letter of the word. In the case of the membership problem, for a given word over the alphabet $\{0,1\}$ of the length n, we should recognize if it belongs to the set $L\left(n\right)$ using the same queries. With the growth of n, the minimum depth of the decision trees solving the problem of recognition deterministically is either bounded from above by a constant or grows as a logarithm, or linearly. For other types of trees and problems (decision trees solving the problem of recognition nondeterministically and decision trees solving the membership problem deterministically and nondeterministically), with the growth of n, the minimum depth of the decision trees is either bounded from above by a constant or grows linearly. We study the joint behavior of the minimum depths of the considered four types of decision trees and describe five complexity classes of binary subword-closed languages.

1. Introduction

In this paper, we study arbitrary binary languages (languages over the alphabet $E=\{0,1\}$) that are subword closed: if a word $w_1{u}_1{w}_2\cdots w_m{u}_m{w}_{m+1}$ belongs to a language, then the word $u_1\cdots u_m$ belongs to this language. Subword-closed languages have attracted the attention of researchers in the field of formal languages for many years [1,2,3,4,5].

For the set of words $L\left(n\right)$ of the length n belonging to a binary subword-closed language L, we investigate the depth of the decision trees solving the recognition and the membership problems deterministically and nondeterministically. In the case of the recognition problem, for a given word from $L\left(n\right)$, we should recognize it using queries, each of which, for some $i\in \{1,\dots ,n\}$, returns the ith letter of the word. In the case of the membership problem, for a given word over the alphabet E of the length n, we should recognize if it belongs to $L\left(n\right)$ using the same queries.

For an arbitrary binary subword-closed language, with the growth of n, the minimum depth of the decision trees solving the problem of recognition deterministically is either bounded from above by a constant or grows as a logarithm, or linearly. For other types of trees and problems (decision trees solving the problem of recognition nondeterministically and decision trees solving the membership problem deterministically and nondeterministically), with the growth of n, the minimum depth of decision trees is either bounded from above by a constant or grows linearly. We study the joint behavior of the minimum depths of the considered four types of decision trees and describe five complexity classes of binary subword-closed languages.

In [6], the following results were announced without proof. For an arbitrary regular language, with the growth of n, (i) the minimum depth of the decision trees solving the problem of recognition deterministically is either bounded from above by a constant or grows as a logarithm, or linearly, and (ii) the minimum depth of the decision trees solving the problem of recognition nondeterministically is either bounded from above by a constant or grows linearly. Proofs for the case of decision trees solving the problem of recognition deterministically can be found in [7,8]. To apply the considered results to a given regular language, it is necessary to know a deterministic finite automaton (DFA) accepting this language.

Each subword-closed language over a finite alphabet is a regular language [3]. In this paper, we do not assume that binary subword-closed languages are given by DFAs. So, we cannot use the results from [6,7,8]. Instead of this, for binary subword-closed languages, we describe simple criteria for the behavior of the minimum depths of decision trees solving the problems of recognition and membership deterministically and nondeterministically.

This paper is a theoretical work related to the field of formal languages. It has no direct applications. In the theory of formal languages, various parameters of languages are studied, in particular the growth of the number of words of the language with the growth of the length of words and, for regular languages, the minimum number of states of the automaton accepting the language. For many years, the author has been introducing new parameters of languages into scientific use: the minimum depth of deterministic and nondeterministic decision trees for the recognition and membership problems related to the language [6,7,8,9]. The present paper continues this line of research.

There is now an extensive collection of methods for constructing decision trees. It includes (i) a variety of greedy heuristics based on measures of uncertainty, such as entropy and the Gini index [10,11,12], (ii) exact optimization algorithms based on dynamic programming, branch-and-bound search, SAT-based methods, etc., [13,14,15,16], and (iii) approximate optimization algorithms with bounds of accuracy that are applicable to obtain theoretical results about the complexity of decision trees [8,17].

In this paper, we found simple combinatorial parameters of binary subword-closed languages, which made it possible to obtain bounds on the depth of the decision trees without using the effective but rather complicated methods developed in the monographs [8,17].

The rest of this paper is organized as follows. In Section 2, we consider the main notions; in Section 3, the main results; in Section 4, the proofs; and in Section 5, short conclusions.

2. Main Notions

Let $\omega =\{0,1,2,\dots \}$ be the set of nonnegative integers and $E=\{0,1\}$. By $E^{*}$, we denote the set of all finite words over the alphabet E, including the empty word $\lambda$. Any subset L of the set $E^{*}$ is called a binary language. This language is called subword closed if, for any word $w_1{u}_1{w}_2\cdots w_m{u}_m{w}_{m+1}$ belonging to L, the word $u_1\cdots u_m$ belongs to L, where $w_i$, $u_j$$\in E^{*}$, $i=1,\dots ,m+1$, $j=1,\dots ,m$. For any natural n, we denote by $L\left(n\right)$ the set of words from L, for which length is equal to n. We consider two problems related to the set $L\left(n\right)$. The problem of recognition: for a given word from $L\left(n\right)$, we should recognize it using attributes (queries) $l_1^n,\dots ,l_n^n$, where $l_i^n$, $i\in \{1,\dots ,n\}$, is a function from $E^{*}\left(n\right)$ to E such that $l_i^n(a_1\cdots a_n)=a_i$ for any word $a_1\cdots a_n\in E^{*}\left(n\right)$. The problem of membership: for a given word from $E^{*}\left(n\right)$, we should recognize if this word belongs to the set $L\left(n\right)$ using the same attributes. To solve these problems, we use decision trees over $L\left(n\right)$.

A decision tree over $L\left(n\right)$ is a marked finite directed tree with the root, which has the following properties:

• The root and the edges leaving the root are not labeled.
• Each node, which is not the root or terminal node, is labeled with an attribute from the set $\{l_1^n,\dots ,l_n^n\}$.
• Each edge leaving a node, which is not a root, is labeled with a number from E.

A decision tree over $L\left(n\right)$ is called deterministic if it satisfies the following conditions:

• Exactly one edge leaves the root.
• For any node, which is not the root nor terminal node, the edges leaving this node are labeled with pairwise different numbers.

Let $\Gamma$ be a decision tree over $L\left(n\right)$. A complete path in $\Gamma$ is any sequence $\xi =v_0,e_0,\dots ,v_m,e_m,v_{m+1}$ of nodes and edges of $\Gamma$ such that $v_0$ is the root, $v_{m+1}$ is a terminal node, $v_i$ is the initial, and $v_{i+1}$ is the terminal node of the edge $e_i$ for $i=0,\dots ,m$. We define a subset $E(n,\xi )$ of the set $E^{*}\left(n\right)$ in the following way: if $m=0$, then $E(n,\xi )=E^{*}\left(n\right)$. Let $m>0$, the attribute $l_{i_j}^n$ be assigned to the node $v_j$ and $b_j$ be the number assigned to the edge $e_j$, $j=1,\dots ,m$. Then,

$$E(n,\xi )=\{a_1\cdots a_n\in E^{*}\left(n\right):a_{i_1}=b_1,\dots ,a_{i_m}=b_m\}.$$

Let $L\left(n\right)\ne \varnothing$. We say that a decision tree $\Gamma$ over $L\left(n\right)$ solves the problem of recognition for $L\left(n\right)$ nondeterministically if $\Gamma$ satisfies the following conditions:

• Each terminal node of $\Gamma$ is labeled with a word from $L\left(n\right)$.
• For any word $w\in L\left(n\right)$, there exists a complete path $\xi$ in the tree $\Gamma$ such that $w\in E(n,\xi )$.
• For any word $w\in L\left(n\right)$ and for any complete path $\xi$ in the tree $\Gamma$ such that $w\in E(n,\xi )$, the terminal node of the path $\xi$ is labeled with the word w.

We say that a decision tree $\Gamma$ over $L\left(n\right)$ solves the problem of recognition for $L\left(n\right)$ deterministically if $\Gamma$ is a deterministic decision tree, which solves the problem of recognition for $L\left(n\right)$ nondeterministically.

We say that a decision tree $\Gamma$ over $L\left(n\right)$ solves the problem of membership for $L\left(n\right)$ nondeterministically if $\Gamma$ satisfies the following conditions:

• Each terminal node of $\Gamma$ is labeled with a number from E.
• For any word $w\in E^{*}\left(n\right)$, there exists a complete path $\xi$ in the tree $\Gamma$ such that $w\in E(n,\xi )$.
• For any word $w\in E^{*}\left(n\right)$ and for any complete path $\xi$ in the tree $\Gamma$ such that $w\in E(n,\xi )$, the terminal node of the path $\xi$ is labeled with the number 1 if $w\in L\left(n\right)$ and with the number 0, otherwise.

We say that a decision tree $\Gamma$ over $L\left(n\right)$ solves the problem of membership for $L\left(n\right)$ deterministically if $\Gamma$ is a deterministic decision tree which solves the problem of membership for $L\left(n\right)$ nondeterministically.

Let $\Gamma$ be a decision tree over $L\left(n\right)$. We denote by $h(\Gamma )$ the maximum number of nodes in a complete path in $\Gamma$ that are not the root nor terminal node. The value $h(\Gamma )$ is called the depth of the decision tree $\Gamma$.

We denote by $h_L^{ra}\left(n\right)$ ($h_L^{rd}\left(n\right)$) the minimum depth of a decision tree, which solves the problem of recognition for $L\left(n\right)$ nondeterministically (deterministically). If $L\left(n\right)=\varnothing$, then $h_L^{ra}\left(n\right)=h_L^{rd}\left(n\right)=0$.

We denote by $h_L^{ma}\left(n\right)$ ($h_L^{md}\left(n\right)$) the minimum depth of a decision tree, which solves the problem of membership for $L\left(n\right)$ nondeterministically (deterministically). If $L\left(n\right)=\varnothing$, then $h_L^{ma}\left(n\right)=h_L^{md}\left(n\right)=0$.

3. Main Results

Let L be a binary subword-closed language. For any $a\in E$ and $i\in \omega$, we denote by $a^i$ the word $a\cdots a$ of the length i (if $i=0$, then $a^i=\lambda$). For any $a\in E$, let $\overline{a}=1$ if $a=0$ and $\overline{a}=0$ if $a=1$.

We define the parameter $Hom\left(L\right)$ of the language L, which is called the homogeneity dimension of the language L. If for each natural number m, there exists $a\in E$ such that the word $a^m\overline{a}{a}^m$ belongs to L, then $Hom\left(L\right)=\infty$. Otherwise, $Hom\left(L\right)$ is the maximum number $m\in \omega$ such that there exists $a\in E$ for which the word $a^m\overline{a}{a}^m$ belongs to L. If $L=\varnothing$, then $Hom\left(L\right)=0$.

We now define the parameter $Het\left(L\right)$ of the language L, which is called the heterogeneity dimension of the language L. If for each natural number m, there exists $a\in E$ such that the word $a^m{\overline{a}}^m$ belongs to L, then $Het\left(L\right)=\infty$. Otherwise, $Het\left(L\right)$ is the maximum number $m\in \omega$ such that there exists $a\in E$ for which the word $a^m{\overline{a}}^m$ belongs to L. If $L=\varnothing$, then $Het\left(L\right)=0$.

Theorem 1. 

Let L be a binary subword-closed language.

(a) 

If $Hom\left(L\right)=\infty$, then $h_L^{rd}\left(n\right)=\Theta \left(n\right)$ and $h_L^{ra}\left(n\right)=\Theta \left(n\right)$.

(b) 

If $Hom\left(L\right)<\infty$ and $Het\left(L\right)=\infty$, then $h_L^{rd}\left(n\right)=\Theta (logn)$ and $h_L^{ra}\left(n\right)=O\left(1\right)$.

(c) 

If $Hom\left(L\right)<\infty$ and $Het\left(L\right)<\infty$, then $h_L^{rd}\left(n\right)=O\left(1\right)$ and $h_L^{ra}\left(n\right)=O\left(1\right)$.

Example 1. 

Let us consider the binary subword-closed language $L_0=\{1^i{0}^j:i,j\in \omega \}$. One can show that $Hom\left(L_0\right)=0$ and $Het\left(L_0\right)=\infty$. By Theorem 1, $h_{L_0}^{rd}\left(n\right)=\Theta (logn)$ and $h_{L_0}^{ra}\left(n\right)=O\left(1\right)$.

For a binary subword-closed language L, we denote by $L^C$ its complementary language $E^{*}\setminus L$. The notation $\left|L\right|=\infty$ means that L is an infinite language, and the notation $\left|L\right|<\infty$ means that L is a finite language.

Theorem 2. 

Let L be a binary subword-closed language.

(a) 

If $\left|L\right|=\infty$ and $L^C\ne \varnothing$, then $h_L^{md}\left(n\right)=\Theta \left(n\right)$ and $h_L^{ma}\left(n\right)=\Theta \left(n\right)$.

(b) 

If $\left|L\right|<\infty$ or $L^C=\varnothing$, then $h_L^{md}\left(n\right)=O\left(1\right)$ and $h_L^{ma}\left(n\right)=O\left(1\right)$.

Example 2. 

One can show that, for the binary subword-closed language $L_0=\{1^i{0}^j:i,j\in \omega \}$, considered in Example 1, $|L_0|=\infty$ and $L_0^C\ne \varnothing$. By Theorem 2, $h_{L_0}^{md}\left(n\right)=\Theta \left(n\right)$ and $h_{L_0}^{ma}\left(n\right)=\Theta \left(n\right)$.

To study all possible types of joint behavior of functions $h_L^{rd}\left(n\right)$, $h_L^{ra}\left(n\right)$, $h_L^{md}\left(n\right)$, and $h_L^{ma}\left(n\right)$ for binary subword-closed languages L, we consider five classes of languages ${\mathcal{L}}_1,\dots ,{\mathcal{L}}_5$ described in the columns 2–5 of

Table 1. Joint behavior of functions $h_L^{rd}$, $h_L^{ra}$, $h_L^{md}$, and $h_L^{ma}$ for binary subword-closed languages.

	$\mathbf{Hom}\left(\mathit{L}\right)$	$\mathbf{Het}\left(\mathit{L}\right)$	$\left|\mathit{L}\right|$	${\mathit{L}}^{\mathit{C}}$	${\mathit{h}}_{\mathit{L}}^{\mathbf{rd}}$	${\mathit{h}}_{\mathit{L}}^{\mathbf{ra}}$	${\mathit{h}}_{\mathit{L}}^{\mathbf{md}}$	${\mathit{h}}_{\mathit{L}}^{\mathbf{ma}}$
${\mathcal{L}}_1$	$=\infty$			$\ne \varnothing$	$\Theta \left(n\right)$	$\Theta \left(n\right)$	$\Theta \left(n\right)$	$\Theta \left(n\right)$
${\mathcal{L}}_2$	$=\infty$			$=\varnothing$	$\Theta \left(n\right)$	$\Theta \left(n\right)$	$O\left(1\right)$	$O\left(1\right)$
${\mathcal{L}}_3$	$<\infty$	$=\infty$			$\Theta (logn)$	$O\left(1\right)$	$\Theta \left(n\right)$	$\Theta \left(n\right)$
${\mathcal{L}}_4$	$<\infty$	$<\infty$	$=\infty$		$O\left(1\right)$	$O\left(1\right)$	$\Theta \left(n\right)$	$\Theta \left(n\right)$
${\mathcal{L}}_5$	$<\infty$	$<\infty$	$<\infty$		$O\left(1\right)$	$O\left(1\right)$	$O\left(1\right)$	$O\left(1\right)$

. In particular, ${\mathcal{L}}_1$ consists of all binary subword-closed languages L with $Hom\left(L\right)=\infty$and $L^C\ne \varnothing$. It is easy to show that the complexity classes ${\mathcal{L}}_1,\dots ,{\mathcal{L}}_5$ are pairwise disjointed, and each binary subword-closed language belongs to one of these classes. The behavior of functions $h_L^{rd}\left(n\right)$, $h_L^{ra}\left(n\right)$, $h_L^{md}\left(n\right)$, and $h_L^{ma}\left(n\right)$ for languages from these classes is described in the last four columns of Table 1. For each class, the results considered in Table 1 follow from Theorems 1 and 2 and the following three remarks: (i) from the condition $Hom\left(L\right)=\infty$, it follows $\left|L\right|=\infty$, (ii) from the condition $Het\left(L\right)=\infty$, it follows $\left|L\right|=\infty$, and (iii) from the condition $Hom\left(L\right)<\infty$, it follows $L^C\ne \varnothing$.

We now show that the classes ${\mathcal{L}}_1,\dots ,{\mathcal{L}}_5$ are nonempty. To this end, we consider the following five binary subword-closed languages:

$$\begin{array}{ccc}\hfill L_1& =& \{0^i{10}^j,0^i:i,j\in \omega \},\hfill \\ \hfill L_2& =& E^{*},\hfill \\ \hfill L_3& =& \{0^i{1}^j:i,j\in \omega \},\hfill \\ \hfill L_4& =& \{0^i:i\in \omega \},\hfill \\ \hfill L_5& =& \left\{0\right\}.\hfill \end{array}$$

It is easy to see that $L_i\in {\mathcal{L}}_i$ for $i=1,\dots ,5$.

4. Proofs of Theorems 1 and 2

In this section, we prove Theorems 1 and 2. First, we consider two auxiliary statements. For a word $w,$ we denote by $\left|w\right|$ its length.

Lemma 1. 

Let L be a binary subword-closed language for which $Hom\left(L\right)<\infty$. Then, any word w from L can be represented in the form

$$w_1{a}^i{w}_2{\overline{a}}^j{w}_3,$$

(1)

where $a\in E$, $i,j\in \omega$, and $w_1$, $w_2$, $w_3$ are words from $E^{*}$ with length at most $2Hom\left(L\right)$ each.

Proof. 

Denote $m=$$Hom\left(L\right)$. Then, the words $0^{m+1}{10}^{m+1}$ and $1^{m+1}{01}^{m+1}$ do not belong to L. Let w be a word from L. Then, for any $a\in E$, any entry of the letter a in w has at most m$\overline{a}$s to the left of this entry (we call it l-entry of a) or at most m$\overline{a}$s to the right of this entry (we call it r-entry of a). Let $a\in E$. We say that w is (i) a-l-word if any entry of a in w is l-entry; (ii) a-r-word if any entry of a in w is r-entry; and (iii) a-b-word if w is not a-l-word and is not a-r-word. Let $c,d\in \{l,r,b\}$. We say that w is $cd$-word if w is 0-c-word and 1-d-word. There are nine possible pairs $cd$. We divide them into four groups: (a) $ll$ and $rr$, (b) $lr$ and $rl$, (c) $lb$, $rb$, $bl$, and $br$, and (d) $bb$, and consider them separately. Let

$$w=a_1\cdots a_n.$$

We assume that w contains both 0s and 1s. Otherwise, w can be represented in the form (1).

(a) Let w be $ll$-word. Let $a_n=0$ and $a_i$ be the rightmost entry of 1 in w. Because w is $ll$-word, there are at most m 1s to the left of $a_n$ and at most m 0s to the left of $a_i$. Denote $w_1=a_1\cdots a_i$. Then, $w_1$ contains at most m 0s and at most m 1s, i.e., the length of $w_1$ is at most $2m$. Moreover, to the right of $a_i$, there are only 0s. Thus, $w=w_1{0}^{n-i}$, where $|w_1|=i\le 2m$, i.e., w can be represented in the form (1).

Let $a_n=1$ and $a_i$ be the rightmost entry of 0 in w. Denote $w_1=a_1\cdots a_i$. Then, $w_1$ contains at most m 0s and at most m 1s, i.e., $|w_1|\le 2m$. Moreover, to the right of $a_i$, there are only 1s. Thus, $w=w_1{1}^{n-i}$, i.e., w can be represented in the form (1).

One can prove in a similar way that any $rr$-word can be represented in the form (1).

(b) Let w be $lr$-word, $a_i$ be the rightmost entry of 0, and $a_j$ be the leftmost entry of 1. Then, either $j=i+1$ or $j<i$. Let $j=i+1$. Then, $w=0^i{1}^{n-i}$, i.e., w can be represented in the form (1). Let now $j<i$. Denote $w_2=a_j\cdots a_i$. The word w has at most m 0s to the right of $a_j$ and at most m 1s to the left of $a_i$. Therefore, $|w_2|\le 2m$ and $w=0^{j-1}{w}_2{1}^{n-i}$, i.e., w can be represented in the form (1).

One can prove in a similar way that any $rl$-word can be represented in the form (1).

(c) Let w be $lb$-word; $a_i$ be the rightmost entry of 1 such that to the left of this entry, we have at most m 0s; and $a_j$ be the next after $a_i$ entry of 1. It is clear that to the right of $a_j$, there are at most m 0s, $j\ge i+2$, and all letters $a_{i+1},\dots ,a_{j-1}$ are equal to 0. Let $a_k$ be the rightmost entry of 0. Then, to the left of $a_k$, there are at most m 1s. It is clear that either $k=j-1$ or $k>j$. Denote $w_1=a_1\cdots a_i$. Then, $|w_1|\le 2m$. Let $k=j-1$. In this case, $w=w_1{0}^{j-i-1}{1}^{n-j+1}$, i.e., w can be represented in the form (1). Let $k>j$. Denote $w_2=a_j\cdots a_k$. Then, $|w_2|\le 2m$. We have $w=w_1{0}^{j-i-1}{w}_2{1}^{n-k}$, i.e., w can be represented in the form (1).

One can prove in a similar way that any $rb$- or $bl$- or $br$-word can be represented in the form (1).

(d) Let w be $bb$-word, $a_i$ be the rightmost entry of 0 such that there are at most m 1s to the left of this entry, and $a_j$ be the next after $a_i$ entry of 0. Then, there are at most m 1s to the right of $a_j$, $j\ge i+2$, and $w=a_1\cdots a_{i}1\cdots 1a_j\cdots a_n$. Denote $A=\{1,\dots ,i\}$, $B=\{i+1,\dots ,j-1\}$, and $C=\{j,\dots ,n\}$. Let $a_k$ be the rightmost entry of 1 such that there are at most m 0s to the left of this entry and $a_l$ be the next after $a_k$ entry of 1. Then, there are at most m 0s to the right of $a_l$, $l\ge k+2$, and $w=a_1\cdots a_{k}0\cdots 0a_l\cdots a_n$.

There are four possible types of location of $a_k$ and $a_l$: (i) $k\in A$ and $l\in A$, (ii) $k\in A$ and $l\in B$ (the combination $k\in A$ and $l\in C$ is impossible because all letters with indices from B are 1s, but all letters between $a_k$ and $a_l$ are 0s), (iii) $k\in B$ and $l\in C$ (the combination $k\in B$ and $l\in B$ is impossible because all letters with indices from B are 1s, but all letters between $a_k$ and $a_l$ are 0s), and (iv) $k\in C$ and $l\in C$. We now consider cases (i)–(iv) in detail.

(i) Let $k\in A$ and $l\in A$. Then, $w=a_1\cdots a_{k}0\cdots 0a_l\cdots a_{i}1\cdots 1a_j\cdots a_n$. Denote $w_1=a_1\cdots a_k$, $w_2=a_l\cdots a_i$, and $w_3=a_j\cdots a_n$. The length of $w_1$ is at most $2m$ because from the left of $a_k$, there are at most m 0s, and from the left of $a_i$, there are at most m 1s. We can prove in a similar way that $|w_2|\le 2m$ and $|w_3|\le 2m$. Therefore, w can be represented in the form (1).

(ii) Let $k\in A$ and $l\in B$. Then, $l=i+1$ and

$$w=a_1\cdots a_{k}0\cdots 0a_i{a}_{i+1}1\cdots 1a_j\cdots a_n,$$

where $a_i=0$ and $a_{i+1}=1$. Denote $w_1=a_1\cdots a_k$ and $w_3=a_j\cdots a_n$. It is easy to show that $|w_1|\le 2m$ and $|w_3|\le 2m$. Therefore, w can be represented in the form (1).

(iii) Let $k\in B$ and $l\in C$. Then, $k=j-1$ and

$$w=a_1\cdots a_{i}1\cdots 1a_{j-1}{a}_{j}0\cdots 0a_l\cdots a_n,$$

where $a_{j-1}=1$ and $a_j=0$. Denote $w_1=a_1\cdots a_i$ and $w_3=a_l\cdots a_n$. It is easy to show that $|w_1|\le 2m$ and $|w_3|\le 2m$. Therefore, w can be represented in the form (1).

(iv) Let $k\in C$ and $l\in C$. Then, $w=a_1\cdots a_{i}1\cdots 1a_j\cdots a_{k}0\cdots 0a_l\cdots a_n$. Denote $w_1=a_1\cdots a_i$, $w_2=a_j\cdots a_k$, and $w_3=a_l\cdots a_n$. It is easy to show that $|w_1|\le 2m$, $|w_2|\le 2m$, and $|w_3|\le 2m$. Therefore, w can be represented in the form (1). □

Lemma 2. 

Let L be a binary subword-closed language for which $Hom\left(L\right)<\infty$ and $Het\left(L\right)<\infty$. Then, there exists natural p such that $\left|L\right(n\left)\right|\le p$ for any natural n.

Proof. 

Denote $m=max\left(Hom\right(L),Het(L\left)\right)$. Then, the words $0^{m+1}{1}^{m+1}$ and $1^{m+1}{0}^{m+1}$ do not belong to L. Using Lemma 1, we obtain that each word w from L can be represented in the form $w_1{a}^i{w}_2{\overline{a}}^j{w}_3$, where $a\in E$, the length of $w_k$ is at most $t=2m$ for $k=1,2,3$, $i,j\in \omega$, and $i\le m$ or $j\le m$. We now evaluate the number of such words, for which length is equal to n. Let $k\in \{1,2,3\}$. Then, the number of different words $w_k$ is at most $2^0+2^1+\cdots +2^t<2^{t+1}$. Let us assume that the words $w_1$, $w_2$, and $w_3$ are fixed and $|w_1|+|w_2|+|w_3|\le n$. Then, the number of different words $a^i{\overline{a}}^j$ of the length $n-|w_1|-|w_2|-|w_3|$ is at most $4(m+1)$ because $i\le m$ or $j\le m$. Thus, the number of words in $L\left(n\right)$ is at most $p=2^{3t+3}(2t+4)$. □

Proof of Theorem 1. 

It is clear that $h_L^{ra}\left(n\right)\le h_L^{rd}\left(n\right)$ for any natural n.

(a) Let $Hom\left(L\right)=\infty$ and n be a natural number. Then, there exists $a\in E$ such that $a^n\overline{a}{a}^n\in L$. Therefore, $a^n,a^i\overline{a}{a}^{n-i-1}\in L\left(n\right)$ for $i=0,\dots ,n-1$. Let $\Gamma$ be a decision tree over $L\left(n\right)$, which solves the problem of recognition for $L\left(n\right)$ nondeterministically and has the minimum depth $h_L^{ra}\left(n\right)$, and $\xi$ be a complete path in $\Gamma$ such that $a^n\in E(n,\xi )$. Let us assume that there is $i\in \{0,\dots ,n-1\}$ such that the attribute $l_{i+1}^n$ is not attached to any node of $\xi$, which is not the root nor the terminal node. Then, $a^i\overline{a}{a}^{n-i-1}\in E(n,\xi )$, which is impossible. Therefore, $h(\Gamma )\ge n$ and $h_L^{ra}\left(n\right)\ge n$. It is easy to show that $h_L^{rd}\left(n\right)\le n$. Thus, $h_L^{ra}\left(n\right)=h_L^{rd}\left(n\right)=n$ for any natural n.

(b) Let $Hom\left(L\right)<\infty$ and $Het\left(L\right)=\infty$. By Lemma 1, each word from L can be represented in the form $w_1{a}^i{w}_2{\overline{a}}^j{w}_3$, where $a\in E$, the length of $w_k$ is at most $t=2Hom\left(L\right)$ for $k=1,2,3$, and $i,j\in \omega$. Note that either $w_2=\lambda$ or $w_2$ is a word of the kind $\overline{a}\cdots a$.

Let n be a natural number such that $n\ge 10t$. We now describe the work of a decision tree over $L\left(n\right)$, which solves the problem of recognition for $L\left(n\right)$ deterministically. Let $w\in L\left(n\right)$. We represent this word as follows: $w=L_1{L}_2{L}_{3}A{R}_3{R}_2{R}_1$, where the length of each word $L_1,L_2,L_3,R_3,R_2,R_1$ is equal to t. First, we recognize all letters in the words $L_1,L_2,R_2,R_1$ using $4t$ queries (attributes). We now consider four cases.

(i) Let $L_2=R_2=a^t$ for some $a\in E$. Then, $L_{3}A{R}_3=a^{n-4t}$, and the word w is recognized.

(ii) Let $L_2=a^t$ for some $a\in E$, and $R_2$ contains both 0 and 1. Then, $R_2$ has an intersection with the word $w_2$. It is clear that $w_2$ has no intersection with the word A and $L_{3}A=a^{n-5t}$. We recognize all letters of the word $R_3$. As a result, the word w will be recognized.

(iii) Let $R_2=a^t$ for some $a\in E$, and $L_2$ contains both 0 and 1. Then, $L_2$ has an intersection with the word $w_2$. It is clear that $w_2$ has no intersection with the word A and $A{R}_3=a^{n-5t}$. We recognize all letters of the word $L_3$. As a result, the word w will be recognized.

(iv) Let $L_2=a^t$ and $R_2={\overline{a}}^t$ for some $a\in E$. Then, we need to recognize the position of the word $w_2$ and the word $w_2$ itself. Beginning with the left, we divide $L_{3}A{R}_3$ and, probably, a prefix of $R_2$ into blocks of the length t. As a result, we have $k\le n/t$ blocks. We recognize all letters in the block with the number $r=⌈k/2⌉$. If all letters in this block are equal to $\overline{a}$, then we apply the same procedure to the blocks with numbers $1,\dots ,r-1$. If all letters in this block are equal to a, then we apply the same procedure to the blocks with numbers $r+1,\dots ,k$. If the considered block contains both 0 and 1, then we recognize t letters before this block and t letters after this block and, as a result, recognize both the word $w_2$ and its position. After each iteration, the number of blocks is at most one-half of the previous number of blocks. Let q be the whole number of iterations. Then, after the iteration $q-1$, we have at least one unchecked block. Therefore, $k/2^{q-1}\ge 1$ and $q\le {log}_{2}k+1$.

In case (i), to recognize the word w, we make $4t$ queries. In cases (ii) and (iii), we make $5t$ queries. In case (iv), we make at most $t{log}_2(n/t)+7t$ queries. As a result, we have $h_L^{rd}\left(n\right)=O(logn)$.

Because $Het\left(L\right)=\infty$, for any natural n, the set $L\left(n\right)$ contains for some $a\in E$ words $a^i{\overline{a}}^{n-i}$ for $i=0,\dots ,n$. Then, $\left|L\right(n\left)\right|\ge n+1$, and each decision tree $\Gamma$ over $L\left(n\right)$ solving the problem of recognition for $L\left(n\right)$ deterministically has at least $n+1$ terminal nodes. One can show that the number of terminal nodes in $\Gamma$ is at most $2^{h(\Gamma )}$. Therefore, $h(\Gamma )\ge {log}_2(n+1)$. Thus, $h_L^{rd}\left(n\right)=\Omega (logn)$ and $h_L^{rd}\left(n\right)=\Theta (logn)$.

We now prove that $h_L^{ra}\left(n\right)=O\left(1\right)$. To this end, it is enough to show that there is a natural number c such that, for each natural n and for each word $w\in L\left(n\right)$, there exists a subset $B_w$ of the set of attributes $\{l_1^n,\dots ,l_n^n\}$ such that $\left|B_w\right|\le c$ and, for any word $u\in L\left(n\right)$ different from w, there exists an attribute $l_i^n\in B_w$ for which $l_i^n\left(w\right)\ne l_i^n\left(u\right)$. We now show that as c, we can use the number $7t$. In case (i), in the capacity of the set $B_w$, we can choose all attributes corresponding to $4t$ letters from the subwords $L_1$, $L_2$, $R_2$, and $R_1$. In case (ii), we can choose all attributes corresponding to $5t$ letters from the subwords $L_1$, $L_2$, $R_3$, $R_2$, and $R_1$. In case (iii), we can choose all attributes corresponding to $5t$ letters from the subwords $L_1$, $L_2$, $L_3$, $R_2$, and $R_1$. In case (iv), in the capacity of the set $B_w$, we can choose all attributes corresponding to $4t$ letters from the subwords $L_1$, $L_2$, $R_2$, and $R_1$, and $3t$ letters from the block containing both 0 and 1 and from the blocks that are its left and right neighbors.

(c) Let $Hom\left(L\right)<\infty$ and $Het\left(L\right)<\infty$. By Lemma 2, there exists natural p such that $\left|L\right(n\left)\right|\le p$ for any natural n. Let n be a natural number. Then, the set $L\left(n\right)$ contains at most p words, and there exists a subset B of the set of attributes $\{l_1^n,\dots ,l_n^n\}$ such that $\left|B\right|\le p^2$ and, for any two different words $u,w\in L\left(n\right)$, there exists an attribute $l_i^n\in B$ for which $l_i^n\left(w\right)\ne l_i^n\left(u\right)$. It is easy to construct a decision tree over $L\left(n\right)$ which solves the problem of recognition for $L\left(n\right)$ deterministically by sequentially computing attributes from B. The depth of this tree is at most $p^2$. Therefore, $h_L^{rd}\left(n\right)=O\left(1\right)$ and $h_L^{ra}\left(n\right)=O\left(1\right)$. □

Proof of Theorem 2. 

It is clear that $h_L^{ma}\left(n\right)\le h_L^{md}\left(n\right)$ for any natural n.

(a) Let $\left|L\right|=\infty$, $L^C\ne \varnothing$, and $w_0$ be a word with the minimum length from $L^C$. Because $\left|L\right|=\infty$, $L\left(n\right)\ne \varnothing$ for any natural n. Let n be a natural number such that $n>|w_0|$ and $\Gamma$ be a decision tree over $L\left(n\right)$ that solves the problem of membership for $L\left(n\right)$ nondeterministically and has the minimum depth. Let $w\in L\left(n\right)$ and $\xi$ be a complete path in $\Gamma$ such that $w\in E(n,\xi )$. Then, the terminal node of $\xi$ is labeled with the number 1. Let us assume that the number of nodes labeled with attributes in $\xi$ is at most $n-|w_0|$. Then, we can change at most $|w_0|$ letters in the word w such that the obtained word $w^{\prime }$ will satisfy the following conditions: $w_0$ is a subword of $w^{\prime }$ and $w^{\prime }\in$$E(n,\xi )$. However, it is impossible because in this case $w^{\prime }\notin L\left(n\right)$ and $w^{\prime }\in$ $E(n,\xi )$, but the terminal node of $\xi$ is labeled with the number 1. Therefore, the depth of $\Gamma$ is greater than $n-|w_0|$. Thus, $h_L^{ma}\left(n\right)=\Omega \left(n\right)$. It is easy to construct a decision tree over $L\left(n\right)$ that solves the problem of membership for $L\left(n\right)$ deterministically and has a depth equal to n. Therefore, $h_L^{md}\left(n\right)=O\left(n\right)$. Thus, $h_L^{md}\left(n\right)=\Theta \left(n\right)$ and $h_L^{ma}\left(n\right)=\Theta \left(n\right)$.

(b) Let $\left|L\right|<\infty$. Then, there exists natural m such that $L\left(n\right)=\varnothing$ for any natural $n\ge m$. Therefore, for each natural $n\ge m$, $h_L^{md}\left(n\right)=0$ and $h_L^{ma}\left(n\right)=0$.

Let $L^C=\varnothing$, n be a natural number, and $\Gamma$ be a decision tree over $L\left(n\right)$ which consists of the root, a terminal node labeled with $1,$ and an edge that leaves the root and enters the terminal node. One can show that $\Gamma$ solves the problem of membership for $L\left(n\right)$ deterministically and has a depth equal to 0. Therefore, $h_L^{md}\left(n\right)=0$ and $h_L^{ma}\left(n\right)=0$. □

5. Conclusions

In this paper, we studied arbitrary binary subword-closed languages. For the set of words $L\left(n\right)$ of the length n belonging to a binary subword-closed language L, we investigated the depth of the decision trees solving the recognition and the membership problems deterministically and nondeterministically. We proved that with the growth of n, the minimum depth of the decision trees solving the problem of recognition deterministically is either bounded from above by a constant or grows as a logarithm, or linearly. For other types of trees and problems, with the growth of n, the minimum depth of the decision trees is either bounded from above by a constant or grows linearly. We also studied the joint behavior of the minimum depths of the considered four types of decision trees and described five complexity classes of binary subword-closed languages.

In this paper, we did not assume that a binary subword-closed language is given by a deterministic finite automaton accepting this language. So, we could not use the parameters of the automaton for the study of decision tree complexity as it was done in [6,7,8,9]. Instead of this, for binary subword-closed languages, we described simple combinatorial criteria for the behavior of the minimum depths of the decision trees solving the problems of recognition and membership deterministically and nondeterministically.

In the future, we are planning to generalize this approach to some other classes of formal languages.