|
|
|
@ -1,3 +1,8 @@ |
|
|
|
# bigdada |
|
|
|
|
|
|
|
assorted tools and recipes for dada (the boring kind) |
|
|
|
assorted tools and recipes for dada (the boring kind) |
|
|
|
|
|
|
|
## logparser_multiprocess.py |
|
|
|
|
|
|
|
extract things from large quantities of weblogs 'quickly' using multiprocessing. |
|
|
|
This script manages to go through 42.4M lines in 18 minutes on a 8 core machine. |
