Skip to content

Commit

Permalink
Add a crude audit function
Browse files Browse the repository at this point in the history
Identifies duplicate lines. Toward #7.
  • Loading branch information
waldoj committed Mar 15, 2023
1 parent 7e7d1ad commit 2b55171
Showing 1 changed file with 9 additions and 0 deletions.
9 changes: 9 additions & 0 deletions audit.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
#!/bin/bash

for file in transcripts/*
do
repeats=( $(grep -E ".{31,}" "$file" |sort |uniq -c |sort -nr |head -1 |sed 's/\"//g' |sed "s/\'//g" |xargs |cut -d " " -f 1) )
if [[ $repeats -gt 6 ]]; then
echo "$file $repeats duplicate lines"
fi
done

0 comments on commit 2b55171

Please sign in to comment.