connecting to a load of csv files (about 4 gb) and refresh is taking like 20 min.

[scree09]

Hey guys, I am currently connecting to a load of csv files (about 4 gb) and refresh is taking like 20 min. I’m trying to figure out why it’s taking so long but at which point would using a database be best?

[ray_ux · Accepted solution]

@scree09 
I'd expect it to be a lot faster if you import the CSV to SQL first. Text file connectors essentially don't have query folding

[scree09]

thanks!