rra
/
bigdada
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
assorted tools and recipes for dada (the boring kind)
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
3 Commits
1 Branch
0 Tags
24 KiB
 
Branch: main
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'main'
${ noResults }
bigdada/README.md

258 B
Raw Permalink Blame History

bigdada

assorted tools and recipes for dada (the boring kind)

logparser_multiprocess.py

extract things from large quantities of weblogs 'quickly' using multiprocessing. This script manages to go through 42.4M lines in 18 minutes on a 8 core machine.