cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Display / Import Mixed Character Set

Hi all,

 

I'm trying to display some Twitter data that I've pulled off a MySQL server. The tweets include not only the 'standard' Western Latin character set, but also Russian cyrillic, Arabic and, just to confound things, emojis too!

 

When I pull these into PowerBI they coming out looking something this: ðŸ‡¨ðŸ‡·ðŸ†šðŸ‡®ðŸ‡· (I believe this is a flag emoji!)

 

Having looked at the data in MySQL I can see that the character sets are encoded correctly and the issue only occurs when I pull it into PowerBI.

 

Can anyone suggest how I might fix this problem?

 

TIA,

 

SamB

1 ACCEPTED SOLUTION

You'd have to do it in the Advanced Editor and the documentation on those functions is really lacking. Perhaps @ImkeF or @MarcelBeug might have some insight into the proper use of those functions. Here is another article that I found that might help. It doesn't use those functions but changes the encoding type on import:

 

https://social.technet.microsoft.com/Forums/en-US/7b29d033-6230-4fa0-aafc-8313ea771f24/change-encodi...

 


@ me in replies or I'll lose your thread!!!
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Learn Power BI 2nd Edition

View solution in original post

6 REPLIES 6
hongjyan
Helper II
Helper II

In short, adding code below in red blod in your advance editor and blame MS for their casual document.

MySQL.Database("10.181.165.202", "pobot", [ReturnSingleDatabase=true, Encoding=TextEncoding.Utf8])

In addition, the available encoding are

  TextEncoding.Utf8, TextEncoding.Utf16, TextEncoding.Ascii, TextEncoding.Unicode, TextEncoding.BigEndianUnicode, TextEncoding.Windows

Greg_Deckler
Super User
Super User

Check out the Text.Encoding functions in Power Query:

 

https://msdn.microsoft.com/en-us/library/mt826838.aspx

 


@ me in replies or I'll lose your thread!!!
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Learn Power BI 2nd Edition
Anonymous
Not applicable

Hi smoupre,

 

Thanks for the reply. I'm pretty new to PowerBI - how would I apply these functions to a column, and which one would I use - the help pages don't have a lot of info!

 

Thanks,

 

Sam

You'd have to do it in the Advanced Editor and the documentation on those functions is really lacking. Perhaps @ImkeF or @MarcelBeug might have some insight into the proper use of those functions. Here is another article that I found that might help. It doesn't use those functions but changes the encoding type on import:

 

https://social.technet.microsoft.com/Forums/en-US/7b29d033-6230-4fa0-aafc-8313ea771f24/change-encodi...

 


@ me in replies or I'll lose your thread!!!
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Learn Power BI 2nd Edition
Anonymous
Not applicable

Ah, OK - thanks for links and assists @Greg_Deckler - much appreciated!

Hello @Greg_Deckler, @Anonymous

I am also facing the similar problem.

The imported data from database is showing me some special characters as explained in the first post.

I am not able to understand how I can set character set to utf8 for this column of table in Advance query option.

Kindly help.

Helpful resources

Announcements
June 2022 update 768X460.jpg

Check it out!

Click here to read more about the June 2022 updates!

Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

Power BI Dev Camp Session 23 768x460.jpg

Check it Out!

Mark your calendars and join us on Thursday, June 30 at 11a PDT for a great session with Ted Pattison!

June 20 episode 7 with aka link 768x460.jpg

The Power BI Community Show

Join us on June 20 at 11 am PDT when Kim Manis shares the latest on Azure Synapse analytics, the Microsoft Intelligent Data Platform, and notable Power BI Updates from Microsoft Build 2022.

Top Solution Authors