blob: d28d3105f4f2d1fcae7b450d50a7c8bb7f67a0af [file] [log] [blame]
<html>
<head>
<title>Character Sets</title>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<link rel="stylesheet" href="theme/style.css" type="text/css">
</head>
<body>
<table width="100%" border="0" background="theme/bkd2.gif" cellspacing="2">
<tr>
<td width="10">
</td>
<td width="85%">
<font size="6" face="Verdana, Arial, Helvetica, sans-serif"><b>Character Sets</b></font>
</td>
<td width="112"><a href="http://spirit.sf.net"><img src="theme/spirit.gif" width="112" height="48" align="right" border="0"></a></td>
</tr>
</table>
<br>
<table border="0">
<tr>
<td width="10"></td>
<td width="30"><a href="../index.html"><img src="theme/u_arr.gif" border="0"></a></td>
<td width="30"><a href="loops.html"><img src="theme/l_arr.gif" border="0"></a></td>
<td width="30"><a href="confix.html"><img src="theme/r_arr.gif" border="0"></a></td>
</tr>
</table>
<p>The character set <tt>chset</tt> matches a set of characters over a finite
range bounded by the limits of its template parameter <tt>CharT</tt>. This class
is an optimization of a parser that acts on a set of single characters. The
template class is parameterized by the character type <tt>CharT</tt> and can
work efficiently with 8, 16 and 32 and even 64 bit characters.</p>
<pre><span class=identifier> </span><span class=keyword>template </span><span class=special>&lt;</span><span class=keyword>typename </span><span class=identifier>CharT </span><span class=special>= </span><span class=keyword>char</span><span class=special>&gt;
</span><span class=keyword>class </span><span class=identifier>chset</span><span class=special>;</span></pre>
<p>The <tt>chset</tt> is constructed from literals (e.g. <tt>'x'</tt>), <tt>ch_p</tt>
or <tt>chlit&lt;&gt;</tt>, <tt>range_p</tt> or <tt>range&lt;&gt;</tt>, <tt>anychar_p</tt>
and <tt>nothing_p</tt> (see <a href="primitives.html">primitives</a>) or copy-constructed
from another <tt>chset</tt>. The <tt>chset</tt> class uses a copy-on-write scheme
that enables instances to be passed along easily by value.</p>
<table width="80%" border="0" align="center">
<tr>
<td class="note_box"><img src="theme/lens.gif" width="15" height="16"> <b>Sparse
bit vectors</b><br>
<br>
To accomodate 16/32 and 64 bit characters, the <tt>chset</tt> class
statically switches from a <tt>std::bitset</tt> implementation when the
character type is not greater than 8 bits, to a sparse bit/boolean set which
uses a sorted vector of disjoint ranges (<tt>range_run</tt>). The set is
constructed from ranges such that adjacent or overlapping ranges are coalesced.<br>
<br>
range_runs are very space-economical in situations where there are lots
of ranges and a few individual disjoint values. Searching is O(log n) where
n is the number of ranges.</td>
</tr>
</table>
<p> Examples:<br>
</p>
<pre><span class=identifier> </span><span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s1</span><span class=special>(</span><span class=literal>'x'</span><span class=special>);
</span><span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s2</span><span class=special>(</span><span class=identifier>anychar_p </span><span class=special>- </span><span class=identifier>s1</span><span class=special>);</span></pre>
<p>Optionally, character sets may also be constructed using a definition string
following a syntax that resembles posix style regular expression character sets,
except that double quotes delimit the set elements instead of square brackets
and there is no special negation <tt>^</tt> character.</p>
<pre> <span class=identifier>range </span><span class=special>= </span><span class=identifier>anychar_p </span><span class=special>&gt;&gt; </span><span class=literal>'-' </span><span class=special>&gt;&gt; </span><span class=identifier>anychar_p</span><span class=special>;
</span><span class=identifier>set </span><span class=special>= *(</span><span class=identifier>range_p </span><span class=special>| </span><span class=identifier>anychar_p</span><span class=special>);</span></pre>
<p>Since we are defining the set using a C string, the usual C/C++ literal string
syntax rules apply. Examples:<br>
</p>
<pre> <span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s1</span><span class=special>(</span><span class=string>&quot;a-zA-Z&quot;</span><span class=special>); </span><span class=comment>// alphabetic characters
</span><span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s2</span><span class=special>(</span><span class=string>&quot;0-9a-fA-F&quot;</span><span class=special>); </span><span class=comment>// hexadecimal characters
</span><span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s3</span><span class=special>(</span><span class=string>&quot;actgACTG&quot;</span><span class=special>); </span><span class=comment>// DNA identifiers
</span><span class=identifier>chset</span><span class=special>&lt;&gt; </span><span class=identifier>s4</span><span class=special>(</span><span class=string>&quot;\x7f\x7e&quot;</span><span class=special>); </span><span class=comment>// Hexadecimal 0x7F and 0x7E</span></pre>
<p>The standard Spirit set operators apply (see <a href="operators.html">operators</a>)
plus an additional character-set-specific inverse (negation <tt>~</tt>) operator:<span class=comment></span></p>
<table width="90%" border="0" align="center">
<tr>
<td class="table_title" colspan="2">Character set operators</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>~a</b></td>
<td class="table_cells" width="72%">Set inverse</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>a | b</b></td>
<td class="table_cells" width="72%">Set union</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>a &amp; </b></td>
<td class="table_cells" width="72%">Set intersection</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>a - b</b></td>
<td class="table_cells" width="72%">Set difference</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>a ^ b</b></td>
<td class="table_cells" width="72%">Set xor</td>
</tr>
</table>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p>where operands a and b are both <tt>chsets</tt> or one of the operand is either
a literal character, <tt>ch_p</tt> or <tt>chlit</tt>, <tt>range_p</tt> or <tt>range</tt>,
<tt>anychar_p</tt> or <tt>nothing_p</tt>. Special optimized overloads are provided
for <tt>anychar_p</tt> and <tt>nothing_p</tt> operands. A <tt>nothing_p</tt>
operand is converted to an empty set, while an <tt>anychar_p</tt> operand is
converted to a set having elements of the full range of the character type used
(e.g. 0-255 for unsigned 8 bit chars).</p>
<p>A special case is <tt>~anychar_p</tt> which yields <tt>nothing_p</tt>, but
<tt>~nothing_p</tt> is illegal. Inversion of <tt>anychar_p</tt> is asymmetrical,
a one-way trip comparable to converting <tt>T*</tt> to a <tt>void*.</tt></p>
<table width="90%" border="0" align="center">
<tr>
<td class="table_title" colspan="2">Special conversions</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>chset&lt;CharT&gt;(nothing_p)</b></td>
<td class="table_cells" width="72%">empty set</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>chset&lt;CharT&gt;(anychar_p)</b></td>
<td class="table_cells" width="72%">full range of CharT (e.g. 0-255 for unsigned
8 bit chars)</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>~anychar_p</b></td>
<td class="table_cells" width="72%">nothing_p</td>
</tr>
<tr>
<td class="table_cells" width="28%"><b>~nothing_p</b></td>
<td class="table_cells" width="72%">illegal</td>
</tr>
</table>
<p></p><table border="0">
<tr>
<td width="10"></td>
<td width="30"><a href="../index.html"><img src="theme/u_arr.gif" border="0"></a></td>
<td width="30"><a href="loops.html"><img src="theme/l_arr.gif" border="0"></a></td>
<td width="30"><a href="confix.html"><img src="theme/r_arr.gif" border="0"></a></td>
</tr>
</table>
<br>
<hr size="1">
<p class="copyright">Copyright &copy; 1998-2003 Joel de Guzman<br>
<br>
<font size="2">Use, modification and distribution is subject to the Boost Software
License, Version 1.0. (See accompanying file LICENSE_1_0.txt or copy at
http://www.boost.org/LICENSE_1_0.txt) </font> </p>
</body>
</html>