How to filter Strings from a list in Haskell

Question

I am trying to create a program that reads a text file and splits the text into a list and then creates a tuple containing each would with how many times it occurs in the text. I then need to be able to remove certain words from the list and print the final list.

I have tried different ways to try and filter Strings from a list of Strings in Haskell with no success. I have found that the filter function is the best for what I want to do, but am not sure how to implement it.

The code that I have so far is that splits up text read from a file into a list of Strings:

toWords :: String -> [String]
toWords s = words s

I then added this to remove specific Strings from the list:

toWords :: String -> [String]
toWords s = words s
toWords s = filter (`elem` "an")
toWords s = filter (`elem` "the")
toWords s = filter (`elem` "for")

Which I know is wrong, but am unsure as to how to do it. Please can anyone help me with this.

Here is my full code so far:

main = do  
       contents <- readFile "testFile.txt"
       let lowContents = map toLower contents
       let outStr = countWords (lowContents)
       let finalStr = sortOccurrences (outStr)
       print outStr

-- Counts all the words.
countWords :: String -> [(String, Int)]
countWords fileContents = countOccurrences (toWords fileContents)

-- Splits words.
toWords :: String -> [String]
toWords s = words s
toWords s = filter (`elem` "an")
toWords s = filter (`elem` "the")
toWords s = filter (`elem` "for")

-- Counts, how often each string in the given list appears.
countOccurrences :: [String] -> [(String, Int)]
countOccurrences xs = map (\xs -> (head xs, length xs)) . group . sort $ xs

-- Sort list in order of occurrences.
sortOccurrences :: [(String, Int)] -> [(String, Int)]
sortOccurrences sort = sortBy comparing snd

@thefourtheye I have updated my question with what I am doing and the full code that I have so far. — James Meade
– James Meade, Commented May 7, 2015 at 12:09
What should toWords do? Please give some sample input and output. The way it is now toWords = words by the first line in toWords (the other lines are ignored) which makes no sense because then you could use words instead. BTW it won't even compile. — TobiMcNamobi
– TobiMcNamobi, Commented May 7, 2015 at 12:31
toWords splits a text file into a list of Strings. So 'hello my name is james' would be - [hello, my, name, is, james]. — James Meade
– James Meade, Commented May 7, 2015 at 12:39

chi · Accepted Answer · 2015-05-07 12:43:37Z

3

This will keep each word but for the forbidden ones:

toWords s = filter (\w -> w `notElem` ["an","the","for"]) (words s)

Equivalent variants:

-- explicit not
toWords s = filter (\w -> not (w `elem` ["an","the","for"])) (words s)
-- using and (&&) instead of elem
toWords s = filter (\w -> w/="an" && w/="the" && w/="for") (words s)
-- using where to define a custom predicate
toWords s = filter predicate (words s)
     where predicate w = w/="an" && w/="the" && w/="for") 
-- pointfree
toWords = filter (flip notElem ["an","the","for"]) . words

answered May 7, 2015 at 12:43

chi

117k4 gold badges143 silver badges230 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

James Meade Over a year ago

Thank you, that worked perfectly! The first function worked well and visually makes sense to me.

Diogo Cunha · Accepted Answer · 2015-05-07 12:07:51Z

0

Filter is what is known in Haskell as a higher-order function. You should read about it, that kind of functions can be very useful.

Maybe what you are looking for is something like this:

toWords s = filter (condition) s

That "condition" is a function too, that function must contain the filter you want to apply.

A little example would be if you have a lists of numbers and you wanted to take just the numbers >10, it would end up being something like this:

filterNUmbers n = filter (>10) n

answered May 7, 2015 at 12:07

Diogo Cunha

1,19411 silver badges23 bronze badges

3 Comments

James Meade Over a year ago

Thank you, I have just updated my question with what I am doing and the full code if that is more helpful for understanding what I want to do.

Diogo Cunha Over a year ago

Can you tell me what that to words is returning ? You shouldn't be appending to the list ?

James Meade Over a year ago

It's returning a list of Strings, so each word of the text from the .txt file in a list.

Collectives™ on Stack Overflow

How to filter Strings from a list in Haskell

2 Answers 2

1 Comment

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related