Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill 
Author Message
 Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill

Hello,
  I am loading a HUGE table from a database that has about 2.5 million
rows of data. I am using the SQLConnection,SQLDataAdapter and
SQLDataAdapter.Fill commands to get the data and "download" it. It
seems to take A HUGE amount of time that I am hoping can be shortened.
Is there any way in VB.Net to connect to a database other than this
that might be quicker? Just to give you some specs on the machine I am
using, it is a P2 350 MHz Dell with 256 MB of RAM, and I am connecting
to an SQL Server Database using VB.Net.

   Thanks,
     Jay



Thu, 29 Sep 2005 06:39:07 GMT  
 Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill
Two thoughts spring to mind.

Firstly, is it absolutely essential that you load 2.5 million records at
once!!!!?  Remember, you can only see what you load, and I doubt many people
would want to have 2.5 million records in front of them.  Can you not load
the data based on a criteria?

Secondly, have you thought about loading the information using paging
techniques?


Quote:
> Hello,
>   I am loading a HUGE table from a database that has about 2.5 million
> rows of data. I am using the SQLConnection,SQLDataAdapter and
> SQLDataAdapter.Fill commands to get the data and "download" it. It
> seems to take A HUGE amount of time that I am hoping can be shortened.
> Is there any way in VB.Net to connect to a database other than this
> that might be quicker? Just to give you some specs on the machine I am
> using, it is a P2 350 MHz Dell with 256 MB of RAM, and I am connecting
> to an SQL Server Database using VB.Net.

>    Thanks,
>      Jay




Thu, 29 Sep 2005 07:06:10 GMT  
 Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill
down loading 2.5 M records is a bad practice for many reasons, you should
change from a table command to a text command and create a SELECT statement
that retrieves only the records you need to work with at that time.


Quote:
> Hello,
>   I am loading a HUGE table from a database that has about 2.5 million
> rows of data. I am using the SQLConnection,SQLDataAdapter and
> SQLDataAdapter.Fill commands to get the data and "download" it. It
> seems to take A HUGE amount of time that I am hoping can be shortened.
> Is there any way in VB.Net to connect to a database other than this
> that might be quicker? Just to give you some specs on the machine I am
> using, it is a P2 350 MHz Dell with 256 MB of RAM, and I am connecting
> to an SQL Server Database using VB.Net.

>    Thanks,
>      Jay




Thu, 29 Sep 2005 14:32:04 GMT  
 Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill
And use a datareader.

--
Joan.

Quote:

> down loading 2.5 M records is a bad practice for many reasons, you should
> change from a table command to a text command and create a SELECT statement
> that retrieves only the records you need to work with at that time.



> > Hello,
> >   I am loading a HUGE table from a database that has about 2.5 million
> > rows of data. I am using the SQLConnection,SQLDataAdapter and
> > SQLDataAdapter.Fill commands to get the data and "download" it. It
> > seems to take A HUGE amount of time that I am hoping can be shortened.
> > Is there any way in VB.Net to connect to a database other than this
> > that might be quicker? Just to give you some specs on the machine I am
> > using, it is a P2 350 MHz Dell with 256 MB of RAM, and I am connecting
> > to an SQL Server Database using VB.Net.

> >    Thanks,
> >      Jay




Thu, 29 Sep 2005 19:10:22 GMT  
 Loading tables from a database via SQLDataAdapter and SQLDataAdapter.Fill
Hello,
  Yes, I actually need all 2.5 M records because operations are being
done on them all. The whole point of this was to load the records into
memory so that operation would be quicker there than doing them via
SQL Select statements. The tables are going to be parsed into
appropriate arrays so that the mathematical operations can be done
through the arrays.

-Jay

Quote:

> down loading 2.5 M records is a bad practice for many reasons, you should
> change from a table command to a text command and create a SELECT statement
> that retrieves only the records you need to work with at that time.



> > Hello,
> >   I am loading a HUGE table from a database that has about 2.5 million
> > rows of data. I am using the SQLConnection,SQLDataAdapter and
> > SQLDataAdapter.Fill commands to get the data and "download" it. It
> > seems to take A HUGE amount of time that I am hoping can be shortened.
> > Is there any way in VB.Net to connect to a database other than this
> > that might be quicker? Just to give you some specs on the machine I am
> > using, it is a P2 350 MHz Dell with 256 MB of RAM, and I am connecting
> > to an SQL Server Database using VB.Net.

> >    Thanks,
> >      Jay




Thu, 29 Sep 2005 22:03:55 GMT  
 
 [ 5 post ] 

 Relevant Pages 

1. SQLDataAdapter.Fill method progress

2. SqlDataAdapter.Fill() Errors

3. Help me: Update SQL Server table through sqlDataAdapter...

4. SqlDataAdapter modified query text

5. Named parameters in SQL- SQLDataAdapter vs. OleDBDataAdapter

6. Can Dataform wizard do sqldataadapters?

7. SqlDataAdapter Configuration Error!!

8. Grid update sqldataadapter dataset UpdateCommand Object Reference

9. Inserting records using sqldataadapter

10. SQLDataAdapter parameter not supplied during insert?

11. What is difference between SqlDataAdapter and DataSet ?

12. controling transaction using dataset and sqldataadapter

 

 
Powered by phpBB® Forum Software