Text Processing in Python by David Mertz -- published by Addison Wesley Other publications by David Mertz  ---  Back to Text Processing in Python

Mon 07-18-2003

The below code samples are all of those that appear in the book, linked using the same description that appears in the text. These are suitable for downloading individually; only some of them are useful standalone scripts, however.

• Imperative style line selection
• Functional style line selection
• INSTALL.LOG sample data file
• Boolean "predicative" functions on lines
• Functional style predicates
• Select lines that fill predicate
• Find the RegDB lines
• Filter on two line predicates
• Multiple line transformations
• combinatorial.py
• Some examples using higher-order functions
• Limit nesting depth of map()/filter()
• Simple Boolean algebra of values
• Boolean algebra of return values
• Boolean algebra of composed functions
• Use of a compositional Boolean function
• C++ signature-based polymorphism
• Python "signature-based" polymorphism
• Python capability-based polymorphism
• Checking what numbers can do
• cachedlinelist.py
• randline.py
• Piping random lines to application
• Standard exceptions
• operator2.py
• Typical usage of sys.stderr and sys.stdout
• Typical usage of sys.stdin
• Naive overloading of argument
• "Quacks like a duck" overloading of argument
• Examples of 'cat' utility
• cat.py
• Modifying files in place with [fileinput]
• Formatting codes for struct module
• Use of time.clock() for benchmarking
• pprint2.py
• Round-tripping with pprint
• Custom Repr class
• schwartzian_sort.py
• reformat_para.py
• fields_stats.py
• wc.py
• encode_binary.py
• histogram.py
• read_backwards.py
• Self test of read_backwards()
• equivalent expression
• list_capwords.py
• gzip_file.py
• zipfile constants
• zipfile constants
• zlib_objs.py
• unichr_info.py
• Using unichr_info.py
• crc32.py
• sha.py
• hash_rotor.py
• hash_rotor at work
• findfile1.py
• findfile2.py
• Index dictionaries
• re_show.py
• re_new.py
• Regular expression modifiers
• flush_left.py
• show_services.py
• dupwords.py
• url_examine.py
• error_page.py
• Using ex_error_page.py
• Common continuation characters
• logical_lines.py
• find_urls.py
• pretty_nums.py
• Glob-style subpatterns
• Deprecation warning for regex
• Regular expression patterns
• EBNF-style description in a developerWorks DTD
• EBNF-style description of Python floating point
• Regular expression to identify a floating point
• EBNF description of "extended floating point
• Regular expression for option exponent
• IF/THEN/END examples
• EBNF grammar for IF/THEN/END structures
• Pencil-and-Paper Parsing examples
• IF/THEN/END examples
• IF/THEN/END/LOOP example
• IF/THEN/END example
• IF/THEN/END examples
• Python code line
• Python code line quoted
• File: hypothetical.ini
• Chunking Python code to process .ini file
• Parsed .ini structure
• Counting Python code to process .ini file
• Strongly functional code to process .ini file
• A simple state machine input loop in Python
• File: statemachine.py
• Sample Buyer/Order Report
• buyer_invoices.py
• Buyer state machine diagram
• pricing.py support data
• Creating end states for subgraphs
• ndiff.py report
• urldump.py
• typical tabnanny utility usage
• buyer_report.py
• buyer_report.py data structure
• taglist2xml() function
• mx.TextTools version of Typography()
• stray_punct successes and failures
• mxTypography.py infinite loop catcher
• tag table entry format
• Tuple in tag table with explicit branches
• Tuple in tag table with named branches
• Fail command and MatchFail branch
• Jump versus Fail for readability
• Skip and Move examples
• Equivalent AllIn and AllInSet tuples
• Equivalent AllNotIn and AllInSet tuples
• Match the character 'X'
• Match non-'X' character
• Equivalent IsIn and IsInSet tuples
• Equivalent IsNotIn and IsInSet tuples
• Word example
• EOF example
• Call example
• Call example
• CallTag example
• Function and method versions of find()
• Function and method versions of findall()
• typography.def
• Python regexes for smart ASCII markup
• simpleTypography.py
• simpleTypography20.py
• typo_html.py
• Test run of simpleTypography.py
• Input and output of simpleTypography run
• 3-to-7 quantification
• Improved 3-to-7 quantification
• How to create a SimpleParse parser
• How to create a SimpleParse v2 parser
• Reported and Unreported productions
• A character literal declaration
• A character class declaration
• Universal quantifier declaration
• Existential quantifier declaration
• Potentiality quantifier declaration
• Lookahead quantifier declaration
• Error on failure declaration
• Example error-on-failure exception
• Sequence declaration
• Declarations with negation
• Bad recursion in SimpleParse
• Good quantification in SimpleParse
• Quantified potentiality in SimpleParse
• No backtracking
• wordscanner.py
• Tokenization of smart ASCII text
• wordplusscanner.py
• Improved tokenization of smart ASCII text
• Assigning YaccSlice indices
• markupbuilder.py
• Parse list of smart ASCII text
• EBNF style plain declaration
• Recursive para declaration
• Importing lex.py
• Defining a 'tokens' list
• Defining token patterns
• Building the lexer
• Wrap token stream in iterator
• While loop with break token stream
• Importing yacc.py
• Importing the lexer
• Parser function with multiple productions
• Empty productions in yacc.py
• Assigning YaccSlice indices
• Building the lexer
• Underlying constructor
• Underlying constructor
• Standard email.Errors exceptions
• Default 'fmt' string
• write_payload_list.py
• check_imap_subjects.py
• new_email_subjects.py
• send_email.py
• Looping through a mailbox in 2.2+
• Looping through a mailbox in any version
• HTTP GET request
• simple.cgi
• http://gnosis.cx/simpleform.html
• Response from simple.cgi GET request
• Response from simple.cgi POST request
• Web bug link on a Web page
• visitor.cgi
• Using cgi.FieldStorage
• Checking the type of a query value
• File upload from HTML form
• Traceback enabled CGI script
• Debugging CGI script in Python
• Debugging/logging CGI script in Python
• Snippet of oddly nested HTML
• HTMLParser_stack.py
• HTMLParser_stack output
• TagStack class example
• Call back to .handle_data()
• Call back to .handle_data()
• Closed empty tag
• Opening URLs with a custom class
• specifying proxies and authentication
• Diagram of network location
• location_parse.py
• XML document with special nodes
• DTD for simple subelement XML document
• XML Schema "item" Element Definition
• Order info XML document
• xmlcat.py
• gnosis.xml.indexer search
• Limit matches to ones in a title element
• dissertation.dtd
• dissertation.py
• PYX format example
• Format code flags
• Format type codes
• Functional version of print statement
• Explicit 'for' loop
• List-application loop
• apply() as first-class function
• Telephone Number Report
• Run length encoding example
• Huffman encoding example
• Huffman translation example
• LZ77 Algorithm
• Word-based Huffman compression
• word_huffman.py
• Hex view of several character string encodings
• MIME Header
• HTTP Header
• Content-Type META tag
• XML Encoding Declaration
• mk_unicode_chart.py
• Use of book2html.py
• colorize.py
• book2html.py
• Common Big-O Complexities