assorted tools and recipes for dada (the boring kind)
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
rra 66a13bf353 Update 'README.md' 1 year ago
.gitignore Initial commit 1 year ago
README.md Update 'README.md' 1 year ago
logparser_multiprocess.py init commit of multiprocess log parser 1 year ago

README.md

bigdada

assorted tools and recipes for dada (the boring kind)

logparser_multiprocess.py

extract things from large quantities of weblogs 'quickly' using multiprocessing. This script manages to go through 42.4M lines in 18 minutes on a 8 core machine.