Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
Matas
Advocate II
Advocate II

SSIS Skipping Data Rows Error

Hi,

 

I have tried to goole, went into a couple of forums and asked this question, but did not received any concrete answer relates SSIS error while skipping data rows. Hopefully someone from this community have SSIS knowledge and will be able to help out.

 

My Visual Studio version is: 16.11.17

My SSIS package version is: 4.0

 

I am having an issue while trying to load a data from the .csv file since it has something to do with my delimiter "¬¬".

While using this delimiter (and I need to use this one, since all the data comes in this format) I am getting error such as:

Matas_0-1657720917877.png

Matas_1-1657721177109.png

 

 

But if I change this files delimiter using excel, lets say to ";", the result:

Matas_2-1657721827591.png

 

 

 

My Flat File Connection Manager Editor properties looks like:

Matas_4-1657722052913.png

 

Matas_5-1657722193970.png

Matas_6-1657722220640.png

 

 

Regards,

Matas

 

 

 

 

4 REPLIES 4
JamesWick
Helper I
Helper I

I found the short answer for this,

Is the TextQualifier of the Flat File Connection Manaer is set to ‘’ (double simple quote), and there are open ‘’ without closure in the source file?

If so, this combination leads flat file connection manage to consider everything that appears after ‘’ as just text, without processing the double bars, or even the new line character. So, if there is a large amount of data after the ‘’ sign, the buffer overflows.

In this situation, we can use following methods to avoid this issue:

If the file can be modified, removing the ‘’ combination.
If the file cannot be modified, or it is preferred not to do so, we can change TextQualifier to any other character or even to <none>.

Regards,
J Wick

Hi @JamesWick ,

 

Have you looked at my post or just the title of this topic?

Since you are writing about "if TextQualifier" is set to something. I have uploaded the pictures of it, it is clearly visible that in my case the TextQualifier is set to <none> and I do not have any "" in my dataset but thank you for the response.

 

Regards,

Matas

v-jingzhang
Community Support
Community Support

Hi @Matas 

 

Can you please provide a sample file with some dummy data that can reproduce this problem? We can then use it for testing. Thanks. 

 

Best Regards,
Community Support Team _ Jing

Hi @v-jingzhang ,

 

Sure, thank you for clarification.
The link for dummy data: https://we.tl/t-GdxvYzOPom

 

Regards,

Matas

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel1

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.