Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
flintstone
Helper II
Helper II

Merging two data set

‎06-27-2020 11:45 AM

I have two dataset in data warehousing. Each dataset has 890K rows and 100 columns each.  Using a laptop with 40GB memory, I am merging both dataset into a new dataset using Directquery Inner Join using a Inquiry No. column that appears in both dataset. The intention is to continously stream the data from data warehousing on 10 minute interval to a real time visualistion and prediction in Power bi Pro. I am doing this remote from my house via forticlient VPN. However, either one of 2 outcomes happens. Firstly, the merging is not completed and stops when it consumes the entire memory. Secondly, a timeout server message appears. What should I do? Is powerbi pro is solution? Should I use Azure databricks or Apache Spark /Kafka?     

Labels:
Message 1 of 4
384 Views
0
3 REPLIES 3
parry2k
Super User
Super User

‎06-27-2020 12:18 PM

@flintstone why you are merging? Why not just set the relationship between two tables and create measures to achieve the result. 



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Message 2 of 4
376 Views
flintstone
Helper II
Helper II
In response to parry2k

‎06-28-2020 01:07 AM

I created the relationship between the 2 tables but there is a message saying that the relationship cannot be created because there are null values in the common column

Message 3 of 4
322 Views
0
flintstone
Helper II
Helper II
In response to flintstone

‎06-28-2020 01:08 AM

I used the merging because I wanted to create an inner join between the 2 tables. Isnt that the purpose of the merging? If no, what is the merging used for?

 

Message 4 of 4
321 Views
0

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

View All