assorted tools and recipes for dada (the boring kind)
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
|
|
|
# bigdada
|
|
|
|
|
|
|
|
|
|
assorted tools and recipes for dada (the boring kind)
|
|
|
|
|
|
|
|
|
|
## logparser_multiprocess.py
|
|
|
|
|
|
|
|
|
|
extract things from large quantities of weblogs 'quickly' using multiprocessing.
|
|
|
|
|
This script manages to go through 42.4M lines in 18 minutes on a 8 core machine.
|
