1 changed files with 6 additions and 1 deletions
@ -1,3 +1,8 @@ |
|||
# bigdada |
|||
|
|||
assorted tools and recipes for dada (the boring kind) |
|||
|
|||
## logparser_multiprocess.py |
|||
|
|||
extract things from large quantities of weblogs 'quickly' using multiprocessing. |
|||
This script manages to go through 42.4M lines in 18 minutes on a 8 core machine. |
|||
Loading…
Reference in new issue