weblib.files

Miscellaneous utilities which are helpful sometime.

weblib.files.clear_directory(path)

Delete recursively all directories and files in specified directory.

weblib.files.unique_file(path)

Drop non-unique lines in the file. Return number of unique lines.

weblib.files.unique_host(path)

Filter out urls with duplicated hostnames.