Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /var/www/vhosts/shan.info/httpdocs/templates/gk_publisher/lib/menu/GKBase.class.php on line 114

Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /var/www/vhosts/shan.info/httpdocs/templates/gk_publisher/lib/menu/GKHandheld.php on line 76
sort very large file
Logo
Print this page

sort very large file

LC_ALL=C sort -u --buffer-size=2G --temporary-directory=/root/Desktop/tmp --output=joined_sorted.txt joined.txt 
uniq joined_sorted.txt joined_sorted_uniqed.txt
split bigFileName -l 按行分割
wc -l joined.txt 
split -l 10000000 joined.txt joined_split_
for f in joined_split_*; do
  sort -u "$f" > "$f"_sorted
done
sort -u -m joined_split_*_sorted > final.out

Warning: count(): Parameter must be an array or an object that implements Countable in /var/www/vhosts/shan.info/httpdocs/templates/gk_publisher/html/com_k2/templates/default/item.php on line 169

Notice: Only variables should be assigned by reference in /var/www/vhosts/shan.info/httpdocs/templates/gk_publisher/html/com_k2/templates/default/item.php on line 478
Template Design © Joomla Templates | GavickPro. All rights reserved.