Wish to donate BCP / INSERT BULK functionality

Brought to you by: ickzon

Wish to donate BCP / INSERT BULK functionality

Forum: Open Discussion

Creator: Simon Greatrix

Created: 2013-10-21

Updated: 2019-11-11

Simon Greatrix - 2013-10-21

Hi,

We have been using a pure Java BCP implementation based upon jTDS since 2009 to import data into SQLServer. We would like to donate it to the jTDS project so that everyone can benefit.

We do not use Sybase and therefore have never tested against that.

If someone with check-in authority for jTDS would like to review our code and hopefully add it to 1.3, I hope they will get in touch with me.

Looking forward to hearing from someone,

Dr Simon Greatrix

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

momo - 2013-10-22

Hi Simon,

thanks for your offering! I would like to take a look at your code, but I cannot promise anything ;-)

Cheers,
momo

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Simon Greatrix - 2013-10-23

Just to let you know I sent you an e-mail with details of the relevant source code.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

momo - 2013-11-07

Hi Simon,

just to let you know, I didn't receive an e-mail, yet ;-)

Cheers,
momo

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Simon Greatrix - 2013-11-09

Well that explains the lack of response. :)

I've just tried sending a message from sourceforge again, this time CCing myself. The CC hasn't arrived so I suspect it has failed a second time.

What I was trying to say in both e-mails was that I have placed a copy of our code here:

https://dl.dropboxusercontent.com/u/17237020/jtds/BCPImport.java

This file has everything referencing our own data types and schema removed. We developed it to sit safely beside the jTDS library without any need to change jTDS code. Hence it duplicates many constants from TdsCore and uses reflection to access key fields. Ideally these methods would sit inside TdsCore or the TdsCore would make them available to the package.

There are a few data-types that are not implemented, but many are.

I would like to see a version of this code adopted into the jTDS library and am happy to contribute my time towards that end. I just need to know my time won't be wasted :-)

If you could let me know what you think and how we can best take this forward, I'd be most interested.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

momo - 2013-11-11

Thank you! I'll take a look at your code.

Cheers,
momo

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Manikantan - 2015-02-03

Hello, Just checking if this code was reviewed. We are looking for bcp functionality. Thanks

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

anildarshanam - 2015-02-04

+1 . It will be great to have BCP working. Can this be reviewed please?
Thanks

Last edit: anildarshanam 2015-02-04

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Anupama - 2015-02-04

+1. We too are looking for BCP functionality.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Manikantan - 2015-02-06

Hi Momo, Can you please check this? I will be happy to spend time on this to take this forward.
Thanks

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

JerryPan - 2015-06-16

Hi, any words on BCP functionality?

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Jun Jiao - 2016-04-15

+1 Let's keep this thread alive!

We forked jTDS, implemented our own bulk insert, and have used it in production with SQL server for many years. Benchmark results show that the speed is an order of magnitude faster than the standard JDBC batch insert. Currently we're thinking about merging it with the latest jTDS (1.3). It would be great if we can do this and contribute it to the official jTDS master branch. Please let me know if anyone is interested in a discussion.

Last edit: Jun Jiao 2016-04-15

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Fernando - 2019-11-11
  
  Hi Jun!
  Can you provide the solution please?
  Thanks,
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

John Craig - 2016-04-19

Definitely would be worth making this available--as you're not getting any response, did you try posting to the developer list? Unfortunately, there hasn't been much activity on jTDS for a fair while. If you can't get a response, please make your work available somewhere other than here (not ideal, but better than not sharing it!).

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Log in to post a comment.