Workflow Soluiton

 View Only
  • 1.  Query CSV like SQL query

    Posted Feb 22, 2012 05:42 PM

    I have a CSV file that is greater than 20MB.  When I try to use the readCSV component or create my own flat file csv generator to read this file, my workflow thread aborts when it tries to parse the file.  I assume this is because it is loading every single row, which I do not want.  I would like to simply query the CSV file using the first column as the key as if it was a SQL query.  This would prevent my workflow from crashing, but it doesn't seem like this is currently possible.  Is there any way to do this?  Or a workaround to prevent my thread from aborting?

     

    ~Mark



  • 2.  RE: Query CSV like SQL query
    Best Answer

    Posted Feb 22, 2012 07:14 PM

    As long as the CSV file is always in the same format - that is - always the same columns and in the same location, you can probably set up an ODBC entry on the comptuer, then connect to the ODBC entry with the standard SQL generators.

     

    this link has some info in how to set up the ODBC entry (it's got a lot of other stuff too, but it's the best one I've found):

    http://www.c-sharpcorner.com/UploadFile/mahesh/AccessTextDb12052005071306AM/AccessTextDb.aspx

    This should allow you to query the CSV, and let he ODBC driver on the PC/Server do all the work.

    Rob