 |
vtiger The Honest Open Source CRM
|
| Previous topic :: Next topic |
| Author |
Message |
Lukas
Joined: 22 Sep 2006
Posts: 408
Location: Czech rep.
|
| Posted: Thu Sep 28, 2006 5:27 am Post subject: import only for 500 entities |
|
|
I understand DB developers, why is existing this limit... seriously
But, i think, any users know too and want import more.
-
Real example.. vTiger is implemented too in Call Centrum.
vTiger is there for small projets (pilots) , where is need to customized simple, and extremly soon.
+ vtiger do this behind few hours, not for days ...
- vTiger havent good reproting for callcentrum (of course)
But, every users which one workin with vTiger are really happy, beacuse usability is good. Its not standard .
So, twenty operators work with vTiger. And many more with another system...
Avarage statistics for one operator is maebye 50 pcs relevant outbound calls per day.
Now, when i calculate, have 1000 leads in one day used. So this is that problem ...
Small project (for that callcentrum) have for one week, thousands usage leads...
with this continuous is admin usability good ? Solution is make import two-time at day = contraproductive
or in all but multiple = contraproductive.
Of course im ready for make some loading test on really users, for community . Maebye i can test it with few houndered tousnts contacts , when someone of Vtiger Team want... (now is in callcentrum 4.2.3 only for proposion , 5.0 i have not set-up ..)
Im just for usebility! and just testing vTiger for middle business...
Thanks
LN |
|
| Back to top |
|
mickie
Joined: 13 Jan 2005
Posts: 710
Location: Chennai, India
|
| Posted: Thu Sep 28, 2006 6:32 am Post subject: import only for 500 entities<br /><a href="vie |
|
|
Dear LN,
we don't have any restriction in import like we can import only 500 records and all.
when we try the import, if we save all the 10000 records in a single time then the page will be timedout and the process will be stopped in the middle. so that we have to submit the page before page timeout error occurs.
so what we have done is, set the record count as 500, if the csv file contains more than 500 records first we will store all the records in session. Then take the first 500 records and save. After saved these 500 records we will redirect the page to ImportStep3.php. Now the records from 501 to 1000 will be taken and will be saved. Like this we will redirect the page upto the final record and save. so there is no limit for the import. i know a customer Kevin who has successfully imported 60000 records at a single time.
For this you can try the following. so that you will be clear this
Open the file modules/Import/ImportStep2.php
change the $_SESSION['recordcount'] to 2 or 3
Now try to import a file which contains some 10 or 15 records. Now in the import for each and every 2 records the page will be redirected. In the import process if you look into the URL then you can know this process that how we are passing the record count and the process.
Please let me know if you need any further informations.
Thanks & Regards
Mickie |
|
| Back to top |
|
cronosxfiles
Joined: 30 May 2008
Posts: 2
Location: Barcelona, Spain
|
| Posted: Fri May 30, 2008 12:53 pm Post subject: Re: import only for 500 entities |
|
|
Hello mickie,
This is not working for me. I'm using vtiger version 5.0.4 and, when importing a file of about 1550 records, it loads only the first 500 (or anything set to variable $_SESSION['recordcount']) records; then it redirects to Step3 but it stops.
I've set, on ImportStep3.php:
Code: ini_set("display_errors",'0');
to
Code: ini_set("display_errors",'1');
then I've found function getPickList wasn't being found on file ImportSave.php. And also, there was a division by zero warning on line 310 of file ImportStep3.php:
Code: $loopcount = ($totalnoofrows/$RECORDCOUNT)+1;
I've moved this line (6-8 lines forward) to the one following initialisation of variable $RECORDCOUNT. So the code changes from:
Code: $loopcount = ($totalnoofrows/$RECORDCOUNT)+1;
if($_REQUEST['startval'] != '')
$START = $_REQUEST['startval'];
else
$START = $_SESSION['startval'];
if($_REQUEST['recordcount'] != '')
$RECORDCOUNT = $_REQUEST['recordcount'];
else
$RECORDCOUNT = $_SESSION['recordcount'];
to:
Code: if($_REQUEST['startval'] != '')
$START = $_REQUEST['startval'];
else
$START = $_SESSION['startval'];
if($_REQUEST['recordcount'] != '')
$RECORDCOUNT = $_REQUEST['recordcount'];
else
$RECORDCOUNT = $_SESSION['recordcount'];
// base code moved here to avoid division by zero or undefined value for $RECORDCOUNT
$loopcount = ($totalnoofrows/$RECORDCOUNT)+1;
As for the problem with function getPickList, I've added the line
// bug correction test: adding here to have function getPickList available
include("modules/Import/picklist_addition.php");
to file ImportSave.php.
With this, I've managed to get the redirection loop over the records loading blocks of 500. It takes a lot to show the list of imported records, but it works. Could you check if this is a feasible solution for this code. Is there a correction already available that I could apply without having to update the whole system.
Thanks in advance for any comments.
Regards, JM |
|
| Back to top |
|
pavani
Joined: 03 Sep 2007
Posts: 54
|
| Posted: Fri May 30, 2008 1:21 pm Post subject: Re: import only for 500 entities |
|
|
Hi,
Check out the link to get solution for this issue. Fix will come up with future release of VtigerCRM.
http://trac.vtiger.com/cgi-bin/trac.cgi/ticket/5255 |
|
| Back to top |
|
cronosxfiles
Joined: 30 May 2008
Posts: 2
Location: Barcelona, Spain
|
| Posted: Mon Jun 02, 2008 11:17 am Post subject: Re: import only for 500 entities |
|
|
Ok, thanks a lot. I've tested it and it works properly. The only problem comes when it tries to show all imported data to provide an "undo" option. I've disabled all code on file ImportSteplast.php from line 153 on, to avoid this.
Regards, JM |
|
| Back to top |
|
elmue
Joined: 17 Sep 2008
Posts: 72
|
| Posted: Thu Sep 25, 2008 3:45 pm Post subject: Re: import only for 500 entities |
|
|
Hello
There is a bug in vtiger 5.04 which stops to import after the first 500 rows in a CSV file.
In the link above (ticket5225) you can only download an ugly path file.
carloz in the italian forum has fixed uploaded a patch as entire files.
There are two files to be replaced.
http://forums.vtiger.com/viewtopic.php?t=19472&highlight=import+500
Elmue |
|
| Back to top |
|
james
Joined: 09 Oct 2008
Posts: 3
Location: Las Vegas, NV
|
| Posted: Thu Oct 09, 2008 10:04 pm Post subject: Re: import only for 500 entities |
|
|
| cronosxfiles had the complete solution (actually more than needed), unfortunately ticket #5255 DID NOT fix my problem as it did not correct the division by zero but did address the other related issues to this problem. I applied only the #5255 changes and still could not perform a successful import. After applying the change to ImportStep3.php that relocated the $loopcount variable until after $RECORDCOUNT definition (line 322 moved to ~333) then I had a working solution, I did not have to make any changes to ImportSave.php however as I did not receive any errors about missing or undefined functions. |
|
| Back to top |
|
| |
|