• file
• latest
• revisions
• annotate
• diff
• comparison
• raw

ThirdParty/CharDet/chardet/jpcntx.py@1d8dd9706f46 (annotated)

ThirdParty/CharDet/chardet/jpcntx.py

Sat, 02 Jan 2010 15:11:35 +0000

author

Detlev Offenbach <detlev@die-offenbachs.de>

date

Sat, 02 Jan 2010 15:11:35 +0000

changeset 12

1d8dd9706f46

parent 0

de9c2efb9d02

child 3537

7662053c3906

permissions

-rw-r--r--

First commit after changing to Python 3.1.

12 1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	1	######################## BEGIN LICENSE BLOCK ########################
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	2	# The Original Code is Mozilla Communicator client code.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	3	#
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	4	# The Initial Developer of the Original Code is
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	5	# Netscape Communications Corporation.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	6	# Portions created by the Initial Developer are Copyright (C) 1998
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	7	# the Initial Developer. All Rights Reserved.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	8	#
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	9	# Contributor(s):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	10	# Mark Pilgrim - port to Python
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	11	#
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	12	# This library is free software; you can redistribute it and/or
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	13	# modify it under the terms of the GNU Lesser General Public
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	14	# License as published by the Free Software Foundation; either
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	15	# version 2.1 of the License, or (at your option) any later version.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	16	#
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	17	# This library is distributed in the hope that it will be useful,
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	18	# but WITHOUT ANY WARRANTY; without even the implied warranty of
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	19	# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	20	# Lesser General Public License for more details.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	21	#
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	22	# You should have received a copy of the GNU Lesser General Public
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	23	# License along with this library; if not, write to the Free Software
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	24	# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	25	# 02110-1301 USA
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	26	######################### END LICENSE BLOCK #########################
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	27
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	28	from . import constants
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	29
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	30	NUM_OF_CATEGORY = 6
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	31	DONT_KNOW = -1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	32	ENOUGH_REL_THRESHOLD = 100
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	33	MAX_REL_THRESHOLD = 1000
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	34	MINIMUM_DATA_THRESHOLD = 4
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	35
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	36	# This is hiragana 2-char sequence table, the number in each cell represents its frequency category
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	37	jp2CharContext = ( \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	38	(0,0,0,2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,1,0,0,0,0,0,0,0,0,0,0,1),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	39	(2,4,0,4,0,3,0,4,0,3,4,4,4,2,4,3,3,4,3,2,3,3,4,2,3,3,3,2,4,1,4,3,3,1,5,4,3,4,3,4,3,5,3,0,3,5,4,2,0,3,1,0,3,3,0,3,3,0,1,1,0,4,3,0,3,3,0,4,0,2,0,3,5,5,5,5,4,0,4,1,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	40	(0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,2),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	41	(0,4,0,5,0,5,0,4,0,4,5,4,4,3,5,3,5,1,5,3,4,3,4,4,3,4,3,3,4,3,5,4,4,3,5,5,3,5,5,5,3,5,5,3,4,5,5,3,1,3,2,0,3,4,0,4,2,0,4,2,1,5,3,2,3,5,0,4,0,2,0,5,4,4,5,4,5,0,4,0,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	42	(0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	43	(0,3,0,4,0,3,0,3,0,4,5,4,3,3,3,3,4,3,5,4,4,3,5,4,4,3,4,3,4,4,4,4,5,3,4,4,3,4,5,5,4,5,5,1,4,5,4,3,0,3,3,1,3,3,0,4,4,0,3,3,1,5,3,3,3,5,0,4,0,3,0,4,4,3,4,3,3,0,4,1,1,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	44	(0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	45	(0,4,0,3,0,3,0,4,0,3,4,4,3,2,2,1,2,1,3,1,3,3,3,3,3,4,3,1,3,3,5,3,3,0,4,3,0,5,4,3,3,5,4,4,3,4,4,5,0,1,2,0,1,2,0,2,2,0,1,0,0,5,2,2,1,4,0,3,0,1,0,4,4,3,5,4,3,0,2,1,0,4,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	46	(0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	47	(0,3,0,5,0,4,0,2,1,4,4,2,4,1,4,2,4,2,4,3,3,3,4,3,3,3,3,1,4,2,3,3,3,1,4,4,1,1,1,4,3,3,2,0,2,4,3,2,0,3,3,0,3,1,1,0,0,0,3,3,0,4,2,2,3,4,0,4,0,3,0,4,4,5,3,4,4,0,3,0,0,1,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	48	(1,4,0,4,0,4,0,4,0,3,5,4,4,3,4,3,5,4,3,3,4,3,5,4,4,4,4,3,4,2,4,3,3,1,5,4,3,2,4,5,4,5,5,4,4,5,4,4,0,3,2,2,3,3,0,4,3,1,3,2,1,4,3,3,4,5,0,3,0,2,0,4,5,5,4,5,4,0,4,0,0,5,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	49	(0,5,0,5,0,4,0,3,0,4,4,3,4,3,3,3,4,0,4,4,4,3,4,3,4,3,3,1,4,2,4,3,4,0,5,4,1,4,5,4,4,5,3,2,4,3,4,3,2,4,1,3,3,3,2,3,2,0,4,3,3,4,3,3,3,4,0,4,0,3,0,4,5,4,4,4,3,0,4,1,0,1,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	50	(0,3,1,4,0,3,0,2,0,3,4,4,3,1,4,2,3,3,4,3,4,3,4,3,4,4,3,2,3,1,5,4,4,1,4,4,3,5,4,4,3,5,5,4,3,4,4,3,1,2,3,1,2,2,0,3,2,0,3,1,0,5,3,3,3,4,3,3,3,3,4,4,4,4,5,4,2,0,3,3,2,4,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	51	(0,2,0,3,0,1,0,1,0,0,3,2,0,0,2,0,1,0,2,1,3,3,3,1,2,3,1,0,1,0,4,2,1,1,3,3,0,4,3,3,1,4,3,3,0,3,3,2,0,0,0,0,1,0,0,2,0,0,0,0,0,4,1,0,2,3,2,2,2,1,3,3,3,4,4,3,2,0,3,1,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	52	(0,4,0,4,0,3,0,3,0,4,4,4,3,3,3,3,3,3,4,3,4,2,4,3,4,3,3,2,4,3,4,5,4,1,4,5,3,5,4,5,3,5,4,0,3,5,5,3,1,3,3,2,2,3,0,3,4,1,3,3,2,4,3,3,3,4,0,4,0,3,0,4,5,4,4,5,3,0,4,1,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	53	(0,2,0,3,0,3,0,0,0,2,2,2,1,0,1,0,0,0,3,0,3,0,3,0,1,3,1,0,3,1,3,3,3,1,3,3,3,0,1,3,1,3,4,0,0,3,1,1,0,3,2,0,0,0,0,1,3,0,1,0,0,3,3,2,0,3,0,0,0,0,0,3,4,3,4,3,3,0,3,0,0,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	54	(2,3,0,3,0,2,0,1,0,3,3,4,3,1,3,1,1,1,3,1,4,3,4,3,3,3,0,0,3,1,5,4,3,1,4,3,2,5,5,4,4,4,4,3,3,4,4,4,0,2,1,1,3,2,0,1,2,0,0,1,0,4,1,3,3,3,0,3,0,1,0,4,4,4,5,5,3,0,2,0,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	55	(0,2,0,1,0,3,1,3,0,2,3,3,3,0,3,1,0,0,3,0,3,2,3,1,3,2,1,1,0,0,4,2,1,0,2,3,1,4,3,2,0,4,4,3,1,3,1,3,0,1,0,0,1,0,0,0,1,0,0,0,0,4,1,1,1,2,0,3,0,0,0,3,4,2,4,3,2,0,1,0,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	56	(0,1,0,4,0,5,0,4,0,2,4,4,2,3,3,2,3,3,5,3,3,3,4,3,4,2,3,0,4,3,3,3,4,1,4,3,2,1,5,5,3,4,5,1,3,5,4,2,0,3,3,0,1,3,0,4,2,0,1,3,1,4,3,3,3,3,0,3,0,1,0,3,4,4,4,5,5,0,3,0,1,4,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	57	(0,2,0,3,0,3,0,0,0,2,3,1,3,0,4,0,1,1,3,0,3,4,3,2,3,1,0,3,3,2,3,1,3,0,2,3,0,2,1,4,1,2,2,0,0,3,3,0,0,2,0,0,0,1,0,0,0,0,2,2,0,3,2,1,3,3,0,2,0,2,0,0,3,3,1,2,4,0,3,0,2,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	58	(2,4,0,5,0,4,0,4,0,2,4,4,4,3,4,3,3,3,1,2,4,3,4,3,4,4,5,0,3,3,3,3,2,0,4,3,1,4,3,4,1,4,4,3,3,4,4,3,1,2,3,0,4,2,0,4,1,0,3,3,0,4,3,3,3,4,0,4,0,2,0,3,5,3,4,5,2,0,3,0,0,4,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	59	(0,3,0,4,0,1,0,1,0,1,3,2,2,1,3,0,3,0,2,0,2,0,3,0,2,0,0,0,1,0,1,1,0,0,3,1,0,0,0,4,0,3,1,0,2,1,3,0,0,0,0,0,0,3,0,0,0,0,0,0,0,4,2,2,3,1,0,3,0,0,0,1,4,4,4,3,0,0,4,0,0,1,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	60	(1,4,1,5,0,3,0,3,0,4,5,4,4,3,5,3,3,4,4,3,4,1,3,3,3,3,2,1,4,1,5,4,3,1,4,4,3,5,4,4,3,5,4,3,3,4,4,4,0,3,3,1,2,3,0,3,1,0,3,3,0,5,4,4,4,4,4,4,3,3,5,4,4,3,3,5,4,0,3,2,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	61	(0,2,0,3,0,1,0,0,0,1,3,3,3,2,4,1,3,0,3,1,3,0,2,2,1,1,0,0,2,0,4,3,1,0,4,3,0,4,4,4,1,4,3,1,1,3,3,1,0,2,0,0,1,3,0,0,0,0,2,0,0,4,3,2,4,3,5,4,3,3,3,4,3,3,4,3,3,0,2,1,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	62	(0,2,0,4,0,3,0,2,0,2,5,5,3,4,4,4,4,1,4,3,3,0,4,3,4,3,1,3,3,2,4,3,0,3,4,3,0,3,4,4,2,4,4,0,4,5,3,3,2,2,1,1,1,2,0,1,5,0,3,3,2,4,3,3,3,4,0,3,0,2,0,4,4,3,5,5,0,0,3,0,2,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	63	(0,3,0,4,0,3,0,1,0,3,4,3,3,1,3,3,3,0,3,1,3,0,4,3,3,1,1,0,3,0,3,3,0,0,4,4,0,1,5,4,3,3,5,0,3,3,4,3,0,2,0,1,1,1,0,1,3,0,1,2,1,3,3,2,3,3,0,3,0,1,0,1,3,3,4,4,1,0,1,2,2,1,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	64	(0,1,0,4,0,4,0,3,0,1,3,3,3,2,3,1,1,0,3,0,3,3,4,3,2,4,2,0,1,0,4,3,2,0,4,3,0,5,3,3,2,4,4,4,3,3,3,4,0,1,3,0,0,1,0,0,1,0,0,0,0,4,2,3,3,3,0,3,0,0,0,4,4,4,5,3,2,0,3,3,0,3,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	65	(0,2,0,3,0,0,0,3,0,1,3,0,2,0,0,0,1,0,3,1,1,3,3,0,0,3,0,0,3,0,2,3,1,0,3,1,0,3,3,2,0,4,2,2,0,2,0,0,0,4,0,0,0,0,0,0,0,0,0,0,0,2,1,2,0,1,0,1,0,0,0,1,3,1,2,0,0,0,1,0,0,1,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	66	(0,3,0,3,0,5,0,1,0,2,4,3,1,3,3,2,1,1,5,2,1,0,5,1,2,0,0,0,3,3,2,2,3,2,4,3,0,0,3,3,1,3,3,0,2,5,3,4,0,3,3,0,1,2,0,2,2,0,3,2,0,2,2,3,3,3,0,2,0,1,0,3,4,4,2,5,4,0,3,0,0,3,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	67	(0,3,0,3,0,3,0,1,0,3,3,3,3,0,3,0,2,0,2,1,1,0,2,0,1,0,0,0,2,1,0,0,1,0,3,2,0,0,3,3,1,2,3,1,0,3,3,0,0,1,0,0,0,0,0,2,0,0,0,0,0,2,3,1,2,3,0,3,0,1,0,3,2,1,0,4,3,0,1,1,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	68	(0,4,0,5,0,3,0,3,0,4,5,5,4,3,5,3,4,3,5,3,3,2,5,3,4,4,4,3,4,3,4,5,5,3,4,4,3,4,4,5,4,4,4,3,4,5,5,4,2,3,4,2,3,4,0,3,3,1,4,3,2,4,3,3,5,5,0,3,0,3,0,5,5,5,5,4,4,0,4,0,1,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	69	(0,4,0,4,0,3,0,3,0,3,5,4,4,2,3,2,5,1,3,2,5,1,4,2,3,2,3,3,4,3,3,3,3,2,5,4,1,3,3,5,3,4,4,0,4,4,3,1,1,3,1,0,2,3,0,2,3,0,3,0,0,4,3,1,3,4,0,3,0,2,0,4,4,4,3,4,5,0,4,0,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	70	(0,3,0,3,0,3,1,2,0,3,4,4,3,3,3,0,2,2,4,3,3,1,3,3,3,1,1,0,3,1,4,3,2,3,4,4,2,4,4,4,3,4,4,3,2,4,4,3,1,3,3,1,3,3,0,4,1,0,2,2,1,4,3,2,3,3,5,4,3,3,5,4,4,3,3,0,4,0,3,2,2,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	71	(0,2,0,1,0,0,0,0,0,1,2,1,3,0,0,0,0,0,2,0,1,2,1,0,0,1,0,0,0,0,3,0,0,1,0,1,1,3,1,0,0,0,1,1,0,1,1,0,0,0,0,0,2,0,0,0,0,0,0,0,0,1,1,2,2,0,3,4,0,0,0,1,1,0,0,1,0,0,0,0,0,1,1),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	72	(0,1,0,0,0,1,0,0,0,0,4,0,4,1,4,0,3,0,4,0,3,0,4,0,3,0,3,0,4,1,5,1,4,0,0,3,0,5,0,5,2,0,1,0,0,0,2,1,4,0,1,3,0,0,3,0,0,3,1,1,4,1,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	73	(1,4,0,5,0,3,0,2,0,3,5,4,4,3,4,3,5,3,4,3,3,0,4,3,3,3,3,3,3,2,4,4,3,1,3,4,4,5,4,4,3,4,4,1,3,5,4,3,3,3,1,2,2,3,3,1,3,1,3,3,3,5,3,3,4,5,0,3,0,3,0,3,4,3,4,4,3,0,3,0,2,4,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	74	(0,1,0,4,0,0,0,0,0,1,4,0,4,1,4,2,4,0,3,0,1,0,1,0,0,0,0,0,2,0,3,1,1,1,0,3,0,0,0,1,2,1,0,0,1,1,1,1,0,1,0,0,0,1,0,0,3,0,0,0,0,3,2,0,2,2,0,1,0,0,0,2,3,2,3,3,0,0,0,0,2,1,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	75	(0,5,1,5,0,3,0,3,0,5,4,4,5,1,5,3,3,0,4,3,4,3,5,3,4,3,3,2,4,3,4,3,3,0,3,3,1,4,4,3,4,4,4,3,4,5,5,3,2,3,1,1,3,3,1,3,1,1,3,3,2,4,5,3,3,5,0,4,0,3,0,4,4,3,5,3,3,0,3,4,0,4,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	76	(0,5,0,5,0,3,0,2,0,4,4,3,5,2,4,3,3,3,4,4,4,3,5,3,5,3,3,1,4,0,4,3,3,0,3,3,0,4,4,4,4,5,4,3,3,5,5,3,2,3,1,2,3,2,0,1,0,0,3,2,2,4,4,3,1,5,0,4,0,3,0,4,3,1,3,2,1,0,3,3,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	77	(0,4,0,5,0,5,0,4,0,4,5,5,5,3,4,3,3,2,5,4,4,3,5,3,5,3,4,0,4,3,4,4,3,2,4,4,3,4,5,4,4,5,5,0,3,5,5,4,1,3,3,2,3,3,1,3,1,0,4,3,1,4,4,3,4,5,0,4,0,2,0,4,3,4,4,3,3,0,4,0,0,5,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	78	(0,4,0,4,0,5,0,1,1,3,3,4,4,3,4,1,3,0,5,1,3,0,3,1,3,1,1,0,3,0,3,3,4,0,4,3,0,4,4,4,3,4,4,0,3,5,4,1,0,3,0,0,2,3,0,3,1,0,3,1,0,3,2,1,3,5,0,3,0,1,0,3,2,3,3,4,4,0,2,2,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	79	(2,4,0,5,0,4,0,3,0,4,5,5,4,3,5,3,5,3,5,3,5,2,5,3,4,3,3,4,3,4,5,3,2,1,5,4,3,2,3,4,5,3,4,1,2,5,4,3,0,3,3,0,3,2,0,2,3,0,4,1,0,3,4,3,3,5,0,3,0,1,0,4,5,5,5,4,3,0,4,2,0,3,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	80	(0,5,0,4,0,4,0,2,0,5,4,3,4,3,4,3,3,3,4,3,4,2,5,3,5,3,4,1,4,3,4,4,4,0,3,5,0,4,4,4,4,5,3,1,3,4,5,3,3,3,3,3,3,3,0,2,2,0,3,3,2,4,3,3,3,5,3,4,1,3,3,5,3,2,0,0,0,0,4,3,1,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	81	(0,1,0,3,0,3,0,1,0,1,3,3,3,2,3,3,3,0,3,0,0,0,3,1,3,0,0,0,2,2,2,3,0,0,3,2,0,1,2,4,1,3,3,0,0,3,3,3,0,1,0,0,2,1,0,0,3,0,3,1,0,3,0,0,1,3,0,2,0,1,0,3,3,1,3,3,0,0,1,1,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	82	(0,2,0,3,0,2,1,4,0,2,2,3,1,1,3,1,1,0,2,0,3,1,2,3,1,3,0,0,1,0,4,3,2,3,3,3,1,4,2,3,3,3,3,1,0,3,1,4,0,1,1,0,1,2,0,1,1,0,1,1,0,3,1,3,2,2,0,1,0,0,0,2,3,3,3,1,0,0,0,0,0,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	83	(0,5,0,4,0,5,0,2,0,4,5,5,3,3,4,3,3,1,5,4,4,2,4,4,4,3,4,2,4,3,5,5,4,3,3,4,3,3,5,5,4,5,5,1,3,4,5,3,1,4,3,1,3,3,0,3,3,1,4,3,1,4,5,3,3,5,0,4,0,3,0,5,3,3,1,4,3,0,4,0,1,5,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	84	(0,5,0,5,0,4,0,2,0,4,4,3,4,3,3,3,3,3,5,4,4,4,4,4,4,5,3,3,5,2,4,4,4,3,4,4,3,3,4,4,5,5,3,3,4,3,4,3,3,4,3,3,3,3,1,2,2,1,4,3,3,5,4,4,3,4,0,4,0,3,0,4,4,4,4,4,1,0,4,2,0,2,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	85	(0,4,0,4,0,3,0,1,0,3,5,2,3,0,3,0,2,1,4,2,3,3,4,1,4,3,3,2,4,1,3,3,3,0,3,3,0,0,3,3,3,5,3,3,3,3,3,2,0,2,0,0,2,0,0,2,0,0,1,0,0,3,1,2,2,3,0,3,0,2,0,4,4,3,3,4,1,0,3,0,0,2,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	86	(0,0,0,4,0,0,0,0,0,0,1,0,1,0,2,0,0,0,0,0,1,0,2,0,1,0,0,0,0,0,3,1,3,0,3,2,0,0,0,1,0,3,2,0,0,2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,4,0,2,0,0,0,0,0,0,2),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	87	(0,2,1,3,0,2,0,2,0,3,3,3,3,1,3,1,3,3,3,3,3,3,4,2,2,1,2,1,4,0,4,3,1,3,3,3,2,4,3,5,4,3,3,3,3,3,3,3,0,1,3,0,2,0,0,1,0,0,1,0,0,4,2,0,2,3,0,3,3,0,3,3,4,2,3,1,4,0,1,2,0,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	88	(0,3,0,3,0,1,0,3,0,2,3,3,3,0,3,1,2,0,3,3,2,3,3,2,3,2,3,1,3,0,4,3,2,0,3,3,1,4,3,3,2,3,4,3,1,3,3,1,1,0,1,1,0,1,0,1,0,1,0,0,0,4,1,1,0,3,0,3,1,0,2,3,3,3,3,3,1,0,0,2,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	89	(0,0,0,0,0,0,0,0,0,0,3,0,2,0,3,0,0,0,0,0,0,0,3,0,0,0,0,0,0,0,3,0,3,0,3,1,0,1,0,1,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,0,2,0,2,3,0,0,0,0,0,0,0,0,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	90	(0,2,0,3,1,3,0,3,0,2,3,3,3,1,3,1,3,1,3,1,3,3,3,1,3,0,2,3,1,1,4,3,3,2,3,3,1,2,2,4,1,3,3,0,1,4,2,3,0,1,3,0,3,0,0,1,3,0,2,0,0,3,3,2,1,3,0,3,0,2,0,3,4,4,4,3,1,0,3,0,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	91	(0,2,0,1,0,2,0,0,0,1,3,2,2,1,3,0,1,1,3,0,3,2,3,1,2,0,2,0,1,1,3,3,3,0,3,3,1,1,2,3,2,3,3,1,2,3,2,0,0,1,0,0,0,0,0,0,3,0,1,0,0,2,1,2,1,3,0,3,0,0,0,3,4,4,4,3,2,0,2,0,0,2,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	92	(0,0,0,1,0,1,0,0,0,0,1,0,0,0,1,0,0,0,0,0,0,0,1,1,1,0,0,0,0,0,0,0,0,0,2,2,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,1,3,1,0,0,0,0,0,0,0,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	93	(0,3,0,3,0,2,0,3,0,3,3,3,2,3,2,2,2,0,3,1,3,3,3,2,3,3,0,0,3,0,3,2,2,0,2,3,1,4,3,4,3,3,2,3,1,5,4,4,0,3,1,2,1,3,0,3,1,1,2,0,2,3,1,3,1,3,0,3,0,1,0,3,3,4,4,2,1,0,2,1,0,2,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	94	(0,1,0,3,0,1,0,2,0,1,4,2,5,1,4,0,2,0,2,1,3,1,4,0,2,1,0,0,2,1,4,1,1,0,3,3,0,5,1,3,2,3,3,1,0,3,2,3,0,1,0,0,0,0,0,0,1,0,0,0,0,4,0,1,0,3,0,2,0,1,0,3,3,3,4,3,3,0,0,0,0,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	95	(0,0,0,1,0,0,0,0,0,0,2,0,1,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,3,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,2,1,0,0,1,0,0,0,0,0,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	96	(0,1,0,3,0,4,0,3,0,2,4,3,1,0,3,2,2,1,3,1,2,2,3,1,1,1,2,1,3,0,1,2,0,1,3,2,1,3,0,5,5,1,0,0,1,3,2,1,0,3,0,0,1,0,0,0,0,0,3,4,0,1,1,1,3,2,0,2,0,1,0,2,3,3,1,2,3,0,1,0,1,0,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	97	(0,0,0,1,0,3,0,3,0,2,2,1,0,0,4,0,3,0,3,1,3,0,3,0,3,0,1,0,3,0,3,1,3,0,3,3,0,0,1,2,1,1,1,0,1,2,0,0,0,1,0,0,1,0,0,0,0,0,0,0,0,2,2,1,2,0,0,2,0,0,0,0,2,3,3,3,3,0,0,0,0,1,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	98	(0,0,0,3,0,3,0,0,0,0,3,1,1,0,3,0,1,0,2,0,1,0,0,0,0,0,0,0,1,0,3,0,2,0,2,3,0,0,2,2,3,1,2,0,0,1,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,0,0,2,0,0,0,0,2,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	99	(2,4,0,5,0,5,0,4,0,3,4,3,3,3,4,3,3,3,4,3,4,4,5,4,5,5,5,2,3,0,5,5,4,1,5,4,3,1,5,4,3,4,4,3,3,4,3,3,0,3,2,0,2,3,0,3,0,0,3,3,0,5,3,2,3,3,0,3,0,3,0,3,4,5,4,5,3,0,4,3,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	100	(0,3,0,3,0,3,0,3,0,3,3,4,3,2,3,2,3,0,4,3,3,3,3,3,3,3,3,0,3,2,4,3,3,1,3,4,3,4,4,4,3,4,4,3,2,4,4,1,0,2,0,0,1,1,0,2,0,0,3,1,0,5,3,2,1,3,0,3,0,1,2,4,3,2,4,3,3,0,3,2,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	101	(0,3,0,3,0,1,0,0,0,1,4,3,3,2,3,1,3,1,4,2,3,2,4,2,3,4,3,0,2,2,3,3,3,0,3,3,3,0,3,4,1,3,3,0,3,4,3,3,0,1,1,0,1,0,0,0,4,0,3,0,0,3,1,2,1,3,0,4,0,1,0,4,3,3,4,3,3,0,2,0,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	102	(0,3,0,4,0,1,0,3,0,3,4,3,3,0,3,3,3,1,3,1,3,3,4,3,3,3,0,0,3,1,5,3,3,1,3,3,2,5,4,3,3,4,5,3,2,5,3,4,0,1,0,0,0,0,0,2,0,0,1,1,0,4,2,2,1,3,0,3,0,2,0,4,4,3,5,3,2,0,1,1,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	103	(0,5,0,4,0,5,0,2,0,4,4,3,3,2,3,3,3,1,4,3,4,1,5,3,4,3,4,0,4,2,4,3,4,1,5,4,0,4,4,4,4,5,4,1,3,5,4,2,1,4,1,1,3,2,0,3,1,0,3,2,1,4,3,3,3,4,0,4,0,3,0,4,4,4,3,3,3,0,4,2,0,3,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	104	(1,4,0,4,0,3,0,1,0,3,3,3,1,1,3,3,2,2,3,3,1,0,3,2,2,1,2,0,3,1,2,1,2,0,3,2,0,2,2,3,3,4,3,0,3,3,1,2,0,1,1,3,1,2,0,0,3,0,1,1,0,3,2,2,3,3,0,3,0,0,0,2,3,3,4,3,3,0,1,0,0,1,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	105	(0,4,0,4,0,4,0,0,0,3,4,4,3,1,4,2,3,2,3,3,3,1,4,3,4,0,3,0,4,2,3,3,2,2,5,4,2,1,3,4,3,4,3,1,3,3,4,2,0,2,1,0,3,3,0,0,2,0,3,1,0,4,4,3,4,3,0,4,0,1,0,2,4,4,4,4,4,0,3,2,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	106	(0,0,0,1,0,4,0,0,0,0,0,0,1,1,1,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,1,0,3,2,0,0,1,0,0,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,2),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	107	(0,2,0,3,0,4,0,4,0,1,3,3,3,0,4,0,2,1,2,1,1,1,2,0,3,1,1,0,1,0,3,1,0,0,3,3,2,0,1,1,0,0,0,0,0,1,0,2,0,2,2,0,3,1,0,0,1,0,1,1,0,1,2,0,3,0,0,0,0,1,0,0,3,3,4,3,1,0,1,0,3,0,2),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	108	(0,0,0,3,0,5,0,0,0,0,1,0,2,0,3,1,0,1,3,0,0,0,2,0,0,0,1,0,0,0,1,1,0,0,4,0,0,0,2,3,0,1,4,1,0,2,0,0,0,0,0,0,0,0,0,0,0,0,0,3,0,0,0,0,0,1,0,0,0,0,0,0,0,2,0,0,3,0,0,0,0,0,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	109	(0,2,0,5,0,5,0,1,0,2,4,3,3,2,5,1,3,2,3,3,3,0,4,1,2,0,3,0,4,0,2,2,1,1,5,3,0,0,1,4,2,3,2,0,3,3,3,2,0,2,4,1,1,2,0,1,1,0,3,1,0,1,3,1,2,3,0,2,0,0,0,1,3,5,4,4,4,0,3,0,0,1,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	110	(0,4,0,5,0,4,0,4,0,4,5,4,3,3,4,3,3,3,4,3,4,4,5,3,4,5,4,2,4,2,3,4,3,1,4,4,1,3,5,4,4,5,5,4,4,5,5,5,2,3,3,1,4,3,1,3,3,0,3,3,1,4,3,4,4,4,0,3,0,4,0,3,3,4,4,5,0,0,4,3,0,4,5),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	111	(0,4,0,4,0,3,0,3,0,3,4,4,4,3,3,2,4,3,4,3,4,3,5,3,4,3,2,1,4,2,4,4,3,1,3,4,2,4,5,5,3,4,5,4,1,5,4,3,0,3,2,2,3,2,1,3,1,0,3,3,3,5,3,3,3,5,4,4,2,3,3,4,3,3,3,2,1,0,3,2,1,4,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	112	(0,4,0,5,0,4,0,3,0,3,5,5,3,2,4,3,4,0,5,4,4,1,4,4,4,3,3,3,4,3,5,5,2,3,3,4,1,2,5,5,3,5,5,2,3,5,5,4,0,3,2,0,3,3,1,1,5,1,4,1,0,4,3,2,3,5,0,4,0,3,0,5,4,3,4,3,0,0,4,1,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	113	(1,3,0,4,0,2,0,2,0,2,5,5,3,3,3,3,3,0,4,2,3,4,4,4,3,4,0,0,3,4,5,4,3,3,3,3,2,5,5,4,5,5,5,4,3,5,5,5,1,3,1,0,1,0,0,3,2,0,4,2,0,5,2,3,2,4,1,3,0,3,0,4,5,4,5,4,3,0,4,2,0,5,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	114	(0,3,0,4,0,5,0,3,0,3,4,4,3,2,3,2,3,3,3,3,3,2,4,3,3,2,2,0,3,3,3,3,3,1,3,3,3,0,4,4,3,4,4,1,1,4,4,2,0,3,1,0,1,1,0,4,1,0,2,3,1,3,3,1,3,4,0,3,0,1,0,3,1,3,0,0,1,0,2,0,0,4,4),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	115	(0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	116	(0,3,0,3,0,2,0,3,0,1,5,4,3,3,3,1,4,2,1,2,3,4,4,2,4,4,5,0,3,1,4,3,4,0,4,3,3,3,2,3,2,5,3,4,3,2,2,3,0,0,3,0,2,1,0,1,2,0,0,0,0,2,1,1,3,1,0,2,0,4,0,3,4,4,4,5,2,0,2,0,0,1,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	117	(0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,1,1,1,0,0,1,1,0,0,0,4,2,1,1,0,1,0,3,2,0,0,3,1,1,1,2,2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,0,1,0,0,0,2,0,0,0,1,4,0,4,2,1,0,0,0,0,0,1),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	118	(0,0,0,0,0,0,0,0,0,1,0,1,0,0,0,0,1,0,0,0,0,0,0,1,0,1,0,0,0,0,3,1,0,0,0,2,0,2,1,0,0,1,2,1,0,1,1,0,0,3,0,0,0,0,0,0,0,0,0,0,0,1,3,1,0,0,0,0,0,1,0,0,2,1,0,0,0,0,0,0,0,0,2),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	119	(0,4,0,4,0,4,0,3,0,4,4,3,4,2,4,3,2,0,4,4,4,3,5,3,5,3,3,2,4,2,4,3,4,3,1,4,0,2,3,4,4,4,3,3,3,4,4,4,3,4,1,3,4,3,2,1,2,1,3,3,3,4,4,3,3,5,0,4,0,3,0,4,3,3,3,2,1,0,3,0,0,3,3),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	120	(0,4,0,3,0,3,0,3,0,3,5,5,3,3,3,3,4,3,4,3,3,3,4,4,4,3,3,3,3,4,3,5,3,3,1,3,2,4,5,5,5,5,4,3,4,5,5,3,2,2,3,3,3,3,2,3,3,1,2,3,2,4,3,3,3,4,0,4,0,2,0,4,3,2,2,1,2,0,3,0,0,4,1),
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	121	)
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	122
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	123	class JapaneseContextAnalysis:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	124	def __init__(self):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	125	self.reset()
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	126
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	127	def reset(self):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	128	self._mTotalRel = 0 # total sequence received
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	129	self._mRelSample = [0] * NUM_OF_CATEGORY # category counters, each interger counts sequence in its category
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	130	self._mNeedToSkipCharNum = 0 # if last byte in current buffer is not the last byte of a character, we need to know how many bytes to skip in next buffer
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	131	self._mLastCharOrder = -1 # The order of previous char
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	132	self._mDone = False # If this flag is set to True, detection is done and conclusion has been made
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	133
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	134	def feed(self, aBuf, aLen):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	135	if self._mDone: return
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	136
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	137	# The buffer we got is byte oriented, and a character may span in more than one
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	138	# buffers. In case the last one or two byte in last buffer is not complete, we
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	139	# record how many byte needed to complete that character and skip these bytes here.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	140	# We can choose to record those bytes as well and analyse the character once it
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	141	# is complete, but since a character will not make much difference, by simply skipping
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	142	# this character will simply our logic and improve performance.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	143	i = self._mNeedToSkipCharNum
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	144	while i < aLen:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	145	order, charLen = self.get_order(aBuf[i:i+2])
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	146	i += charLen
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	147	if i > aLen:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	148	self._mNeedToSkipCharNum = i - aLen
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	149	self._mLastCharOrder = -1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	150	else:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	151	if (order != -1) and (self._mLastCharOrder != -1):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	152	self._mTotalRel += 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	153	if self._mTotalRel > MAX_REL_THRESHOLD:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	154	self._mDone = True
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	155	break
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	156	self._mRelSample[jp2CharContext[self._mLastCharOrder][order]] += 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	157	self._mLastCharOrder = order
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	158
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	159	def got_enough_data(self):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	160	return self._mTotalRel > ENOUGH_REL_THRESHOLD
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	161
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	162	def get_confidence(self):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	163	# This is just one way to calculate confidence. It works well for me.
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	164	if self._mTotalRel > MINIMUM_DATA_THRESHOLD:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	165	return (self._mTotalRel - self._mRelSample[0]) / self._mTotalRel
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	166	else:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	167	return DONT_KNOW
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	168
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	169	def get_order(self, aBuf):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	170	return -1, 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	171
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	172	class SJISContextAnalysis(JapaneseContextAnalysis):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	173	def get_order(self, aBuf):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	174	if not aBuf: return -1, 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	175	# find out current char's byte length
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	176	if ((aBuf[0] >= 0x81) and (aBuf[0] <= 0x9F)) or \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	177	((aBuf[0] >= 0xE0) and (aBuf[0] <= 0xFC)):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	178	charLen = 2
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	179	else:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	180	charLen = 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	181
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	182	# return its order if it is hiragana
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	183	if len(aBuf) > 1:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	184	if (aBuf[0] == 202) and \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	185	(aBuf[1] >= 0x9F) and \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	186	(aBuf[1] <= 0xF1):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	187	return aBuf[1] - 0x9F, charLen
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	188
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	189	return -1, charLen
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	190
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	191	class EUCJPContextAnalysis(JapaneseContextAnalysis):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	192	def get_order(self, aBuf):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	193	if not aBuf: return -1, 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	194	# find out current char's byte length
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	195	if (aBuf[0] == 0x8E) or \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	196	((aBuf[0] >= 0xA1) and (aBuf[0] <= 0xFE)):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	197	charLen = 2
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	198	elif aBuf[0] == 0x8F:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	199	charLen = 3
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	200	else:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	201	charLen = 1
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	202
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	203	# return its order if it is hiragana
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	204	if len(aBuf) > 1:
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	205	if (aBuf[0] == 0xA4) and \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	206	(aBuf[1] >= 0xA1) and \
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	207	(aBuf[1] <= 0xF3):
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	208	return aBuf[1] - 0xA1, charLen
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	209
1d8dd9706f46 First commit after changing to Python 3.1. Detlev Offenbach <detlev@die-offenbachs.de> parents: 0 diff changeset	210	return -1, charLen