word frequency

[maganstephens]

I have a bunch of text that I'm interested in seeing if there is a trend in the words used. Word Cloud is great but I can't figure out how to count the words and the frequency of each word after Word Cloud removes the stop words. Is there a way to do this?

Thanks,
Magan

[Phil_Seamark]

Hi @maganstephens,

I think this is even better.  Use the following R-Script in the Query Editor to add a column that will have the count of words in another column that contains the wordcount from another column

I used a basic table and the column that this counts is called Words

# 'dataset' holds the input data for this script
dataset = within(dataset , {WordCount= sapply(gregexpr("\\b\\W+\\b", Words, perl=TRUE), function(x) sum(x>0) ) + 1 })
output <- dataset

[Phil_Seamark]

Hi @maganstephens,

You can use R to count words

I did a google for some scripts to count words using R and had success with a simple example.

This example uses a table with 1 row called Column1 and plotted the correct number of words to the screen.

str1 <- dataset$Column1
str2 <- gsub(' {2,}',' ',str1)
plot(length(strsplit(str2,' ')[[1]]))

[Greg_Deckler]

You can try the technique I used here:

https://social.technet.microsoft.com/wiki/contents/articles/31461.power-bi-text-analytics-and-the-un...