Data Loss Prevention

 View Only

  • 1.  limit in csv file used with csv lookup plugin

    Trusted Advisor
    Posted Aug 23, 2012 08:06 AM

    Hello,

     

     did anyone already have some issue with csv plugin when you have a large csv file (over 400.000 entry using one key (email)) ?

    thanks for your feedback.

     regards.



  • 2.  RE: limit in csv file used with csv lookup plugin

    Broadcom Employee
    Posted Aug 27, 2012 04:16 AM

    I don't think there are some limition of the csv lookup. For you case, 400000 entry will be OK.

    But, actually:

    if a CSV plug-in is used, the entire CSV file and additional buffers are created in memory and can consume large memory sets.

    In order to minimize the memory usage due to the CSV plug-in it would be recommended to migrate the data to a  separate data source such as LDAP server or other DB environment.
     



  • 3.  RE: limit in csv file used with csv lookup plugin

    Posted Aug 27, 2012 07:46 AM

    Stephanie,

     

    is there a particular reason you canuse the live ldap?