cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
marekmarek Regular Visitor
Regular Visitor

Big Data Warehouse?

Hello Everyone,

 

I am looking for a tool (platform?) that will allow me to store huge amounts of data. The data will be coming either from ERP systems or from various excel files (same structure of the data, just different values every month).

 

For instance, something that will be able to handle more than 100k "excel rows" (+40 columns) each month. I was reading about "Hadoop". Is this a good solution? I saw that I can import data to PowerBI from Hadoop, so that would be cool.

 

If anyone can help to find a good comparison of various "data warehouse" (because I think that this is the correct naming) tools + your personal experience and preference, I would be very grateful.

 

thanks!

1 ACCEPTED SOLUTION

Accepted Solutions
Jayendran Established Member
Established Member

Re: Big Data Warehouse?

Hi @marekmarek ,

 

You are in luck , from the recent Microsoft Ignite 2019 , micorosft announced a great tool called Azure Synapse Analytics

 

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale.

 

Moreover it has a inbuild capability of PowerBI iteself 😊 

 

Reference: https://docs.microsoft.com/en-in/azure/sql-data-warehouse/sql-data-warehouse-overview-what-is

View solution in original post

5 REPLIES 5
Jayendran Established Member
Established Member

Re: Big Data Warehouse?

Hi @marekmarek ,

 

You are in luck , from the recent Microsoft Ignite 2019 , micorosft announced a great tool called Azure Synapse Analytics

 

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale.

 

Moreover it has a inbuild capability of PowerBI iteself 😊 

 

Reference: https://docs.microsoft.com/en-in/azure/sql-data-warehouse/sql-data-warehouse-overview-what-is

View solution in original post

marekmarek Regular Visitor
Regular Visitor

Re: Big Data Warehouse?

awesome, I will take a look. thanks a lot! 

Jayendran Established Member
Established Member

Re: Big Data Warehouse?

Cool, you can take a look into this video also

 

https://www.youtube.com/watch?v=xzxjpQSvDEA

marekmarek Regular Visitor
Regular Visitor

Re: Big Data Warehouse?

@Jayendran  - I would have one more question. As I am still learning Big Data... With this tool, I should be able to load a huge set of data (from excel files, ERP systems, etc.) and then I should be able to access this data with Power Query/Power BI/Tableau/Excel.

 

Could you confirm if my understanding below is correct? Do you know what are the other similar tools that I could deep dive in?

 

thank you

Jayendran Established Member
Established Member

Re: Big Data Warehouse?

Hi @marekmarek ,

 

I'm not exactly sure as I didn't try Azure Synapse Analytics

 

Here are the some Big Data tools which you can use in Azure.

 

  1. Azure HDInsights
  2. Azure Data Lake
  3. Azure Data Bricks

Helpful resources

Announcements
New Kudos Received Badges Coming

New Kudos Received Badges Coming

Kudos to you if you earned one of these! Check your inbox for a notification.

Microsoft Implementation for Communities Wins Award

Microsoft Implementation for Communities Wins Award

Learn about the award-winning innovation that was implemented across Microsoft’s Business Applications Communities.

Power Platform World Tour

Power Platform World Tour

Find out where you can attend!

Top Solution Authors
Top Kudoed Authors (Last 30 Days)
Users online (1,337)