quickfixj-users — General mailing list for QuickFIX/J topics.

[Quickfixj-users] message validation ignored in message.fromString()

[Andrew M. <an...@nm...>]

It looks like the validation boolean on message.fromString is ignored.  I 
have to validate a 2nd time to see the exception. 

sessionDictionary = new DataDictionary("c:\\java\\FIX50SP2.modified.xml");
appDictionary = new DataDictionary("c:\\java\\FIXT11.xml");
// message.fromString: validation=true
message.fromString(m4, sessionDictionary, appDictionary, true); //passes
appDictionary.validate(message); // fails
        

Re: [Quickfixj-users] Quickfix - Adding field into message

[<tom...@up...>]

Hi J Loh,

You are mailing this to the QuickFIX/J mailing list, which is for Java.

Regards,
--
Tom Tempelaere

-----Original Message-----
From: J Loh <jlo...@gm...> 
Sent: Wednesday, 13 February 2019 09:45
To: qui...@li...
Subject: [Quickfixj-users] Quickfix - Adding field into message

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/

[Quickfixj-users] Quickfix - Adding field into message

[J L. <jlo...@gm...>]

I'm an initiator and am using C++ with quickfix.

Below are the parameters for FIX44.xml [did not make any changes actually]

<header>
  <field name='BeginString' required='Y' />
  <field name='BodyLength' required='Y' />
  <field name='MsgType' required='Y' />
  <field name='SenderCompID' required='Y' />
  <field name='TargetCompID' required='Y' />
  ...
  <field name='MsgSeqNum' required='Y' />
  ...
  <field name='SendingTime' required='Y' />
  ...
 </header>

Qn: Is MsgSeqNum and SendingTime is used for all FIX messages?

When I try to send MarketDataRequest, example from quickfix

  FIX::MDReqID mdReqID( "MARKETDATAID" );
  FIX::SubscriptionRequestType subType( FIX::SubscriptionRequestType_SNAPSHOT );
  FIX::MarketDepth marketDepth( 0 );

  FIX44::MarketDataRequest::NoMDEntryTypes marketDataEntryGroup;
  FIX::MDEntryType mdEntryType( FIX::MDEntryType_BID );
  marketDataEntryGroup.set( mdEntryType );

  FIX44::MarketDataRequest::NoRelatedSym symbolGroup;
  FIX::Symbol symbol( "EUR/USD" );
  symbolGroup.set( symbol );

  FIX44::MarketDataRequest message( mdReqID, subType, marketDepth );
  message.addGroup( marketDataEntryGroup );
  message.addGroup( symbolGroup );

However I notice the message did not include MsgSeqNum and SendingTime.

Message that was sent is:

8=FIX.4.4|9=73|35=V|49=A|56=B|146=1|55=EUR/USD|262=MARKETDATAID|263=0|264=0|267=1|269=0|10=001|

Intended message should be:


8=FIX.4.4|9=73|35=V|34=X|49=A|52=X|56=B|146=1|55=EUR/USD|262=MARKETDATAID|263=0|264=0|267=1|269=0|10=001|

Could someone help please.

Thank you

[Quickfixj-users] QF Code generator creating invalid ORDER arrays

[Andrew M. <an...@nm...>]

I'm seeing generated code generated like this:

public static class NoUnderlyings extends Group {
		static final long serialVersionUID = 20050617;
		private static final int[] ORDER = {311, 312, 974, 998 998, 1423 1423, 1424 1424, 1425 1425, 1437, 1441, 1453, 1454, 1455, 1456, 1459, 
1460, 20121, 944, 0};

Notice that some fields are dupes with no commas between.

[Quickfixj-users] How do the FIX 5.0 Service Packs work?

[Andrew M. <an...@nm...>]

Are service packs cumulative?  Do I need to build 5.0 and 5.0SP1 to use 
5.0SP2?  

I see that changes to the file FIX50SP2.modified.xml can cause errors like 
this in fix50sp1:

[ERROR] 
/C:/java/qf/quickfixj-core/target/generated-sources/quickfix/fix50sp1/component/QuotSetGrp.java:[741,39] 
cannot find symbol
  symbol:   class UnderlyingUnitOfMeasure
  location: package quickfix.field

I only plan to use fix50sp2.  Can I skip building fix50sp1?

Thanks

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

Please provide an update on my answers to your questions below at your convenience.

I am trying to use QuickFix/J to send prove I can send data from one machine on a virtual network to another machine. 

I was told this is a great product for that use. 
I received the demo product from https://www.quickfixj.org/ then downloads, then http://sourceforge.net/project/showfiles.php?group_id=163099 then https://sourceforge.net/projects/quickfixj/files/
And downloaded the latest version (org.quickfixj-2.1.1-bin.zip)

I retrieved the cfg files from support articles and the examples provided on the support page. 

If I can get this working remotely, it would be a good thing. A great thing. 

Most of the posts that I saw were from 2008 so I was not sure if they were even valid anymore. 

Any direction to get this working would be amazing. 

Thanks

-----Original Message-----
From: Colin DuPlantis <co...@ma...> 
Sent: Thursday, February 7, 2019 3:55 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


Well, I guess I should take a step back and say I have no idea what you're really trying to do.

What did you download from where and what instructions, if any, are you following?

QFJ is the engine inside these applications, not the applications themselves, as you may be aware.

On 2/7/19 12:52 PM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> I only get the output you discuss when I run it locally. I just made the changes and ran the application again. Still no output across the network on 2 different machines. Banzai has not connected. The submit button is grayed out, and to the left of that where you select the 4.0, 4.1, 4.2, etc. is blank.
>
> Please advise
>
> Thanks,
> Sherard
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Thursday, February 7, 2019 3:40 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> You don't need to specify the dictionary if you're not using a custom dictionary. Just indicate the BeginString you want to use for the session.
>
> However you run Banzai, there should be some output, I would think, in the console window or whatever.
>
> On 2/7/19 11:42 AM, Savage, Sherard wrote:
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>> I will make those changes, however, where do I retrieve the 41 dictionary from?
>> I downloaded what was on the site.
>>
>> How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator.
>>
>> Sherard
>>
>>
>> -----Original Message-----
>> From: Colin DuPlantis <co...@ma...>
>> Sent: Thursday, February 7, 2019 1:10 PM
>> To: qui...@li...
>> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>>
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>>
>>
>> _______________________________________________
>> Quickfixj-users mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
> --
> Colin DuPlantis
> Chief Architect, Marketcetera
> Download, Run, Trade
> 888.868.4884
> https://www.marketcetera.com
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

--
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com



_______________________________________________
Quickfixj-users mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] What are the dangers of FileStoreSync=N

[<tom...@up...>]

Hello,

I've encoutered two system crashes when running a FIX module based on
QuickFIX/J and having FileStoreSync=N. Both instances were on virtual
servers that crashed or terminated unexpectedly. 

After these crashes, starting sessions with QuickFIX/J no longer worked.
In these cases, the file with extension ".session" in the filestore
directory was corrupt. I simply removed all state files pertaining to the
session and then starting sessions started working again.

I've described this on the QuickFIX/J user list (mail title= Server crash
leaves QuickFIX/J engine (1.5.3) in corrupt state for
FileStorePath=filestore).

I've since turned on FileStoreSync=Y but have not experienced any server
crashes since. We do not have performance requirements like you mention
though. It has indeed been documented to be much slower with FileStoreSync=Y
and I suppose on SAN it's probably much worse. Perhaps optimizing the
connection to the SAN might help? Or having the SAN be more performant? (I
have no experience with either).

Regards,
--
Tom Tempelaere

-----Original Message-----
From: Kuhn, Simon <Sim...@si...> 
Sent: Friday, 8 February 2019 15:53
To: qui...@li...
Subject: [Quickfixj-users] What are the dangers of FileStoreSync=N

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/

Re: [Quickfixj-users] What are the dangers of FileStoreSync=N

[Colin D. <co...@ma...>]

Unfortunately, the answer is that, if you turn sync off, you have to 
come up with a way of making sure you don't process a message twice. On 
startup, your FIX engines will sync. If you have already processed a 
message but the file store was not yet updated when a system failure 
occurred, your engine will request the same message again. You will 
process this message twice.

We don't use file stores, but we do use async message processing, which 
causes the same sorts of issues. When we process a message, we make a 
record of that message being processed in the database. Before we 
process a message, we make sure we haven't already processed it. 
Obviously, the potential for a similar problem exists - if we've 
processed a message but not marked it so in the database. We try to 
address this by processing and marking in the same database transaction. 
If you keep drilling down, though, you cannot perfectly eliminate either 
failing to deliver a message or processing a message twice - you have to 
choose one or the other as your bias. If you're redelivering messages, 
you have the option of setting the posdup flag, but, that doesn't help 
if you're required to perform some business logic yourself.

The other option is to not worry about it, which only works if you don't 
care if you process all messages (like market data or price requests).

On 2/8/19 6:53 AM, Kuhn, Simon wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
> Hi
>
> Who has experience with FileStoreSync?
>
> We have learnt that FileStoreSync=Y is a good idea to avoid 
> inconsistencies after system crashes, network issues or stuff like 
> this. We have no issues with having the file-store synchronized on 
> local SSD disk, on Storage Area Network (SAN) disk however it becomes 
> a big performance issue for us. We have to use SAN disk to meet 
> Business Continuity Management (BCM) requirements. With the 
> requirements SAN disk and FileStoreSync=Y we are not able to meet the 
> performance goals (700 messages / second).
>
> It looks like we have two options:
>
> 1) FileStoreSync=N and to know how to deal with inconsistencies after 
> system issues
>
> 2) Implementing an own file-store in the hope that it is even possible 
> to achieve the performance goals
>
> We would really like to go with option 1 (FileStoreSync=N) but we are 
> not sure what problems we could face in case of system issues. What 
> are your experiences, could we end up in a state where we couldn't 
> proceed with doing business with our customers without manual 
> interventions (correcting generated QuickFixJ files) after a system 
> crash, network issues or stuff like that? What can happen with 
> FileStoreSync=N, what are the dangers?
>
> Just in case, has someone experience with implementing a file-store 
> with performance enhancements (option 2)?
>
> Greetings to the QuickFixJ community!
>
> Simon
>
> The content of this e-mail is intended only for the confidential use 
> of the person addressed.
> If you are not the intended recipient, please notify the sender and 
> delete this e-mail immediately.
> Thank you.
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com

[Quickfixj-users] What are the dangers of FileStoreSync=N

[Kuhn, S. <Sim...@si...>]

Hi

Who has experience with FileStoreSync?

We have learnt that FileStoreSync=Y is a good idea to avoid inconsistencies after system crashes, network issues or stuff like this. We have no issues with having the file-store synchronized on local SSD disk, on Storage Area Network (SAN) disk however it becomes a big performance issue for us. We have to use SAN disk to meet Business Continuity Management (BCM) requirements. With the requirements SAN disk and FileStoreSync=Y we are not able to meet the performance goals (700 messages / second).

It looks like we have two options:
1) FileStoreSync=N and to know how to deal with inconsistencies after system issues
2) Implementing an own file-store in the hope that it is even possible to achieve the performance goals

We would really like to go with option 1 (FileStoreSync=N) but we are not sure what problems we could face in case of system issues. What are your experiences, could we end up in a state where we couldn't proceed with doing business with our customers without manual interventions (correcting generated QuickFixJ files) after a system crash, network issues or stuff like that? What can happen with FileStoreSync=N, what are the dangers?

Just in case, has someone experience with implementing a file-store with performance enhancements (option 2)?

Greetings to the QuickFixJ community!
Simon

The content of this e-mail is intended only for the confidential use of the person addressed. 
If you are not the intended recipient, please notify the sender and delete this email immediately.
Thank you.

[Quickfixj-users] QFJ 2.1.1 mvn build error on windows

[Andrew M. <an...@nm...>]

Seeing these error messages on windows.  Probably they can be 
ignored?

[INFO] --- maven-assembly-plugin:3.1.0:single (sources-assembly) @ quickfixj-distribution ---
[INFO] Reading assembly descriptor: src/main/assembly/src.xml
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /
[INFO] Building zip: C:\java\org.quickfixj-2.1.1\org.quickfixj-2.1.1\quickfixj-distribution\target\org.quickfixj-2.1.1-src.zip
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (bin-assembly) @ quickfixj-distribution ---
[INFO] Reading assembly descriptor: src/main/assembly/distribution.xml
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /etc
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /doc
[ERROR] OS=Windows and the assembly descriptor contains a *nix-specific root-relative-reference (starting with slash) /doc/api

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

Ok. That works. Lets start from square one: 
I am trying to use QuickFix/J to send prove I can send data from one machine on a virtual network to another machine. 

I was told this is a great product for that use. 
I received the demo product from https://www.quickfixj.org/ then downloads, then http://sourceforge.net/project/showfiles.php?group_id=163099 then https://sourceforge.net/projects/quickfixj/files/
And downloaded the latest version (org.quickfixj-2.1.1-bin.zip)

I retrieved the cfg files from support articles and the examples provided on the support page. 

If I can get this working remotely, it would be a good thing. A great thing. 

Most of the posts that I saw were from 2008 so I was not sure if they were even valid anymore. 

Any direction to get this working would be amazing. 

Thanks

-----Original Message-----
From: Colin DuPlantis <co...@ma...> 
Sent: Thursday, February 7, 2019 3:55 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


Well, I guess I should take a step back and say I have no idea what you're really trying to do.

What did you download from where and what instructions, if any, are you following?

QFJ is the engine inside these applications, not the applications themselves, as you may be aware.

On 2/7/19 12:52 PM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> I only get the output you discuss when I run it locally. I just made the changes and ran the application again. Still no output across the network on 2 different machines. Banzai has not connected. The submit button is grayed out, and to the left of that where you select the 4.0, 4.1, 4.2, etc. is blank.
>
> Please advise
>
> Thanks,
> Sherard
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Thursday, February 7, 2019 3:40 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> You don't need to specify the dictionary if you're not using a custom dictionary. Just indicate the BeginString you want to use for the session.
>
> However you run Banzai, there should be some output, I would think, in the console window or whatever.
>
> On 2/7/19 11:42 AM, Savage, Sherard wrote:
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>> I will make those changes, however, where do I retrieve the 41 dictionary from?
>> I downloaded what was on the site.
>>
>> How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator.
>>
>> Sherard
>>
>>
>> -----Original Message-----
>> From: Colin DuPlantis <co...@ma...>
>> Sent: Thursday, February 7, 2019 1:10 PM
>> To: qui...@li...
>> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>>
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>>
>>
>> _______________________________________________
>> Quickfixj-users mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
> --
> Colin DuPlantis
> Chief Architect, Marketcetera
> Download, Run, Trade
> 888.868.4884
> https://www.marketcetera.com
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

--
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com



_______________________________________________
Quickfixj-users mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Colin D. <co...@ma...>]

Well, I guess I should take a step back and say I have no idea what 
you're really trying to do.

What did you download from where and what instructions, if any, are you 
following?

QFJ is the engine inside these applications, not the applications 
themselves, as you may be aware.

On 2/7/19 12:52 PM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> I only get the output you discuss when I run it locally. I just made the changes and ran the application again. Still no output across the network on 2 different machines. Banzai has not connected. The submit button is grayed out, and to the left of that where you select the 4.0, 4.1, 4.2, etc. is blank.
>
> Please advise
>
> Thanks,
> Sherard
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Thursday, February 7, 2019 3:40 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> You don't need to specify the dictionary if you're not using a custom dictionary. Just indicate the BeginString you want to use for the session.
>
> However you run Banzai, there should be some output, I would think, in the console window or whatever.
>
> On 2/7/19 11:42 AM, Savage, Sherard wrote:
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>> I will make those changes, however, where do I retrieve the 41 dictionary from?
>> I downloaded what was on the site.
>>
>> How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator.
>>
>> Sherard
>>
>>
>> -----Original Message-----
>> From: Colin DuPlantis <co...@ma...>
>> Sent: Thursday, February 7, 2019 1:10 PM
>> To: qui...@li...
>> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>>
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>>
>>
>> _______________________________________________
>> Quickfixj-users mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
> --
> Colin DuPlantis
> Chief Architect, Marketcetera
> Download, Run, Trade
> 888.868.4884
> https://www.marketcetera.com
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

I only get the output you discuss when I run it locally. I just made the changes and ran the application again. Still no output across the network on 2 different machines. Banzai has not connected. The submit button is grayed out, and to the left of that where you select the 4.0, 4.1, 4.2, etc. is blank. 

Please advise

Thanks,
Sherard

-----Original Message-----
From: Colin DuPlantis <co...@ma...> 
Sent: Thursday, February 7, 2019 3:40 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


You don't need to specify the dictionary if you're not using a custom dictionary. Just indicate the BeginString you want to use for the session.

However you run Banzai, there should be some output, I would think, in the console window or whatever.

On 2/7/19 11:42 AM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> I will make those changes, however, where do I retrieve the 41 dictionary from?
> I downloaded what was on the site.
>
> How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator.
>
> Sherard
>
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Thursday, February 7, 2019 1:10 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

--
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com



_______________________________________________
Quickfixj-users mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Colin D. <co...@ma...>]

You don't need to specify the dictionary if you're not using a custom 
dictionary. Just indicate the BeginString you want to use for the session.

However you run Banzai, there should be some output, I would think, in 
the console window or whatever.

On 2/7/19 11:42 AM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> I will make those changes, however, where do I retrieve the 41 dictionary from?
> I downloaded what was on the site.
>
> How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator.
>
> Sherard
>
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Thursday, February 7, 2019 1:10 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

I will make those changes, however, where do I retrieve the 41 dictionary from? 
I downloaded what was on the site. 

How to I get the initiator output? The way I understand it is Banzai I just open and there is no connection. What do I need to do to provide data from the initiator. 

Sherard


-----Original Message-----
From: Colin DuPlantis <co...@ma...> 
Sent: Thursday, February 7, 2019 1:10 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] FW: QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/

Re: [Quickfixj-users] FW: QuickFix Set up and usage

[Colin D. <co...@ma...>]

- you're using SocketAcceptProtocol in the initiator when you should be 
using SocketConnectProtocol, however, that shouldn't matter as the 
default is "TCP"

- you define the initiator session as FIX.4.0 (with the begin string 
statement), but you use the FIX41 dictionary. This probably shouldn't 
matter (much), but it's a potential problem. Also, I would use at least 4.2


Can you provide the initiator output, too?


On 2/7/19 9:58 AM, Savage, Sherard wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
> Try this again.
>
> Colin,
>
> In my search of a resolution to this issue, I decided to give more detail along with screenshots and output for more clarification. I spent a lot of time on the Nabble support site researching troubleshooting tips and found a few similar to the one I have. Here is the summary:
>
> 2 virtual machines - no internet access on a secure test environment
> 	Banzai (initiator): 	name: Win7_fix, IP: 10.10.10.116
> 	Executor (acceptor):  	name: Win7B, IP: 10.10.10.117
>
> Config files Respectively:
> Banzai
>
> # Machine A (name:7_Fix, IP: 10.10.10.116)
>
> [default]
>
> FileStorePath=examples/target/data/banzai
> ConnectionType=initiator
>
> SenderCompID=BANZAI
>
> TargetCompID=EXEC
> Socket
> ConnectHost=localhost
>
> StartTime=00:00:00
>
> EndTime=00:00:00
>
> HeartBtInt=30
>
> ReconnectInterval=5
>
>
> SocketConnectPort=9876
> #Host to connect to (Machine B)
> SocketConnectHost=10.10.10.117
>
> # session definition
> [SESSION]
> # inherit ConnectionType, ReconnectInterva and SenderCompID from Default
>
>
> BeginString=FIX.4.0
>
> TargetCompID=EXEC
> StartTime=12:30:00
> EndTime=23:30:00
> HeartBtInt=20
> SocketConnectPort=9876
>
>
> SocketConnectHost=10.0.0.117
> SocketAcceptProtocol=TCP
> DataDictionary=somewhere/FIX41.xml
>
>
> Executor
>
> #Machine B (name:Win7B, IP: 10.10.10.117)
>
>
> [default]
>
> FileStorePath=examples/target/data/executor
>
> ConnectionType=acceptor
>
> StartTime=00:00:00
>
> EndTime=00:00:00
> HeartBtInt=30
>
> ValidOrderTypes=1,2,F
>
> SenderCompID=EXEC
>
> TargetCompID=BANZAI
>
> UseDataDictionary=Y
>
> DefaultMarketPrice=12.30
>
> [session]
> BeginString=FIX.4.0
>
> SocketAcceptPort=9876
> SocketAcceptAddress=10.10.10.117
> SocketAcceptProtocol=TCP
>
>
> Per your original reply, I was successful in telnetting to the acceptor machine on port 9876 - pic attached Output on Executor: attached Banzai screenshot: attached
>
> Any further help would be greatly appreciated.
>
> Thanks,
> Sherard
>
>
>
>
>
>
>
>
> Sherard Savage | Business Development Technical Integrator Owl Cyber Defense
>
> P (203) 894-9342 ext. 309
> M (203) 500-0862
> W www.owlcyberdefense.com
> Connect with us!
> Facebook | LinkedIn | Twitter
> The information contained in this transmission is for the personal and confidential use of the individual or entity to which it is addressed. If the reader is not the intended recipient, you are hereby notified that any review, dissemination, or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify the sender immediately
>
> See us at the following 2019 events:
> DistribuTECH Convention & Exhibition, New Orleans, LA (Feb. 5th - 7th) ARC Industry Forum Orlando 2019, Orlando, FL (Feb. 4th - 7th) AFCEA West 2019, San Diego, CA (Feb. 13th - 15th) ISA Oman Section Event 2019, Muscat, Oman (Feb. 19th - 20th)
>
> -----Original Message-----
> From: Colin DuPlantis <co...@ma...>
> Sent: Wednesday, February 6, 2019 2:59 PM
> To: qui...@li...
> Subject: Re: [Quickfixj-users] QuickFix Set up and usage
>
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> If it works on one machine, but not across machines, I'm going to guess it's an addressing problem rather than config.
>
> Make sure you have the IP addresses correct, both machines can see the other IP address (especially important when using VM as you can go down a rabbithole of bridged connections), and you're not binding localhost for your acceptor (need to bind an addressable address).
>
>   From the initiator machine, make sure you can open a telnet session to the acceptor machine on the ip:port you've chosen. If you can't, that's your problem.
>
> On 2/6/19 11:38 AM, savages203 wrote:
>> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
>> QuickFIX/J Support: http://www.quickfixj.org/support/
>>
>>
>> Hi,
>>
>> My setup below is working across a virtual environment with 2 Windows
>> 7 machines. I am not getting QFJ to receive information from either
>> side and I am somewhat confused at to which is the sender and which is
>> the receiver. I have heard conflicting things. So I will list what I have so far:
>>
>> When I run quickfix on the same machine, i get the feedback/results
>> that i expect.
>> I cannot get this to work across a network.
>>
>> Banzai - Sender
>> Executor - receiver
>>    
>> win7 machine 1 - Sender
>> Win7 machine 2 - Receiver
>>
>> I have edited the config file - so that the sender (Banzai) is looking
>> to connect to the receiver (Executor).
>>
>> It seems to just be looking locally for the connection.
>>
>> Please advise thanks,
>> Sherard
>>
>>
>>
>> --
>> Sent from: http://quickfix-j.364392.n2.nabble.com/
>>
>>
>> _______________________________________________
>> Quickfixj-users mailing list
>> Qui...@li...
>> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
> --
> Colin DuPlantis
> Chief Architect, Marketcetera
> Download, Run, Trade
> 888.868.4884
> https://www.marketcetera.com
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com

[Quickfixj-users] FW: QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

Try this again.

Colin,

In my search of a resolution to this issue, I decided to give more detail along with screenshots and output for more clarification. I spent a lot of time on the Nabble support site researching troubleshooting tips and found a few similar to the one I have. Here is the summary:

2 virtual machines - no internet access on a secure test environment
	Banzai (initiator): 	name: Win7_fix, IP: 10.10.10.116
	Executor (acceptor):  	name: Win7B, IP: 10.10.10.117

Config files Respectively:
Banzai

# Machine A (name:7_Fix, IP: 10.10.10.116)

[default]

FileStorePath=examples/target/data/banzai
ConnectionType=initiator

SenderCompID=BANZAI

TargetCompID=EXEC
Socket
ConnectHost=localhost

StartTime=00:00:00

EndTime=00:00:00

HeartBtInt=30

ReconnectInterval=5


SocketConnectPort=9876
#Host to connect to (Machine B)
SocketConnectHost=10.10.10.117

# session definition
[SESSION]
# inherit ConnectionType, ReconnectInterva and SenderCompID from Default


BeginString=FIX.4.0

TargetCompID=EXEC
StartTime=12:30:00
EndTime=23:30:00
HeartBtInt=20
SocketConnectPort=9876


SocketConnectHost=10.0.0.117
SocketAcceptProtocol=TCP
DataDictionary=somewhere/FIX41.xml


Executor

#Machine B (name:Win7B, IP: 10.10.10.117)


[default]

FileStorePath=examples/target/data/executor

ConnectionType=acceptor

StartTime=00:00:00

EndTime=00:00:00
HeartBtInt=30

ValidOrderTypes=1,2,F

SenderCompID=EXEC

TargetCompID=BANZAI

UseDataDictionary=Y

DefaultMarketPrice=12.30

[session]
BeginString=FIX.4.0

SocketAcceptPort=9876
SocketAcceptAddress=10.10.10.117
SocketAcceptProtocol=TCP


Per your original reply, I was successful in telnetting to the acceptor machine on port 9876 - pic attached Output on Executor: attached Banzai screenshot: attached

Any further help would be greatly appreciated.

Thanks,
Sherard








Sherard Savage | Business Development Technical Integrator Owl Cyber Defense

P (203) 894-9342 ext. 309
M (203) 500-0862
W www.owlcyberdefense.com
Connect with us!
Facebook | LinkedIn | Twitter
The information contained in this transmission is for the personal and confidential use of the individual or entity to which it is addressed. If the reader is not the intended recipient, you are hereby notified that any review, dissemination, or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify the sender immediately

See us at the following 2019 events: 
DistribuTECH Convention & Exhibition, New Orleans, LA (Feb. 5th - 7th) ARC Industry Forum Orlando 2019, Orlando, FL (Feb. 4th - 7th) AFCEA West 2019, San Diego, CA (Feb. 13th - 15th) ISA Oman Section Event 2019, Muscat, Oman (Feb. 19th - 20th)

-----Original Message-----
From: Colin DuPlantis <co...@ma...>
Sent: Wednesday, February 6, 2019 2:59 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


If it works on one machine, but not across machines, I'm going to guess it's an addressing problem rather than config.

Make sure you have the IP addresses correct, both machines can see the other IP address (especially important when using VM as you can go down a rabbithole of bridged connections), and you're not binding localhost for your acceptor (need to bind an addressable address).

 From the initiator machine, make sure you can open a telnet session to the acceptor machine on the ip:port you've chosen. If you can't, that's your problem.

On 2/6/19 11:38 AM, savages203 wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> Hi,
>
> My setup below is working across a virtual environment with 2 Windows
> 7 machines. I am not getting QFJ to receive information from either 
> side and I am somewhat confused at to which is the sender and which is 
> the receiver. I have heard conflicting things. So I will list what I have so far:
>
> When I run quickfix on the same machine, i get the feedback/results 
> that i expect.
> I cannot get this to work across a network.
>
> Banzai - Sender
> Executor - receiver
>   
> win7 machine 1 - Sender
> Win7 machine 2 - Receiver
>
> I have edited the config file - so that the sender (Banzai) is looking 
> to connect to the receiver (Executor).
>
> It seems to just be looking locally for the connection.
>
> Please advise thanks,
> Sherard
>
>
>
> --
> Sent from: http://quickfix-j.364392.n2.nabble.com/
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

--
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com



_______________________________________________
Quickfixj-users mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] QuickFix Set up and usage

[Savage, S. <ss...@ow...>]

Thanks for the quick reply. 

The IPs are correct and I can ping between the two vms. I committed out the localhost on the acceptor.

I will try the telnet option. 

Thanks

Sherard Savage | Business Development Technical Integrator
Owl Cyber Defense

P (203) 894-9342 ext. 309 
M (203) 500-0862
W www.owlcyberdefense.com
Connect with us!
Facebook | LinkedIn | Twitter
The information contained in this transmission is for the personal and confidential use of the individual or entity to which it is addressed. If the reader is not the intended recipient, you are hereby notified that any review, dissemination, or copying of this communication is strictly prohibited. If you have received this transmission in error, please notify the sender immediately

See us at the following 2019 events: 
DistribuTECH Convention & Exhibition, New Orleans, LA (Feb. 5th - 7th)
ARC Industry Forum Orlando 2019, Orlando, FL (Feb. 4th - 7th)
AFCEA West 2019, San Diego, CA (Feb. 13th - 15th)
ISA Oman Section Event 2019, Muscat, Oman (Feb. 19th - 20th)

-----Original Message-----
From: Colin DuPlantis <co...@ma...> 
Sent: Wednesday, February 6, 2019 2:59 PM
To: qui...@li...
Subject: Re: [Quickfixj-users] QuickFix Set up and usage

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


If it works on one machine, but not across machines, I'm going to guess it's an addressing problem rather than config.

Make sure you have the IP addresses correct, both machines can see the other IP address (especially important when using VM as you can go down a rabbithole of bridged connections), and you're not binding localhost for your acceptor (need to bind an addressable address).

 From the initiator machine, make sure you can open a telnet session to the acceptor machine on the ip:port you've chosen. If you can't, that's your problem.

On 2/6/19 11:38 AM, savages203 wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> Hi,
>
> My setup below is working across a virtual environment with 2 Windows 
> 7 machines. I am not getting QFJ to receive information from either 
> side and I am somewhat confused at to which is the sender and which is 
> the receiver. I have heard conflicting things. So I will list what I have so far:
>
> When I run quickfix on the same machine, i get the feedback/results 
> that i expect.
> I cannot get this to work across a network.
>
> Banzai - Sender
> Executor - receiver
>   
> win7 machine 1 - Sender
> Win7 machine 2 - Receiver
>
> I have edited the config file - so that the sender (Banzai) is looking 
> to connect to the receiver (Executor).
>
> It seems to just be looking locally for the connection.
>
> Please advise thanks,
> Sherard
>
>
>
> --
> Sent from: http://quickfix-j.364392.n2.nabble.com/
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

--
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com



_______________________________________________
Quickfixj-users mailing list
Qui...@li...
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] QuickFix Set up and usage

[Colin D. <co...@ma...>]

If it works on one machine, but not across machines, I'm going to guess 
it's an addressing problem rather than config.

Make sure you have the IP addresses correct, both machines can see the 
other IP address (especially important when using VM as you can go down 
a rabbithole of bridged connections), and you're not binding localhost 
for your acceptor (need to bind an addressable address).

 From the initiator machine, make sure you can open a telnet session to 
the acceptor machine on the ip:port you've chosen. If you can't, that's 
your problem.

On 2/6/19 11:38 AM, savages203 wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
> Hi,
>
> My setup below is working across a virtual environment with 2 Windows 7
> machines. I am not getting QFJ to receive information from either side and I
> am somewhat confused at to which is the sender and which is the receiver. I
> have heard conflicting things. So I will list what I have so far:
>
> When I run quickfix on the same machine, i get the feedback/results that i
> expect.
> I cannot get this to work across a network.
>
> Banzai - Sender
> Executor - receiver
>   
> win7 machine 1 - Sender
> Win7 machine 2 - Receiver
>
> I have edited the config file - so that the sender (Banzai) is looking to
> connect to the receiver (Executor).
>
> It seems to just be looking locally for the connection.
>
> Please advise thanks,
> Sherard
>
>
>
> --
> Sent from: http://quickfix-j.364392.n2.nabble.com/
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Colin DuPlantis
Chief Architect, Marketcetera
Download, Run, Trade
888.868.4884
https://www.marketcetera.com

[Quickfixj-users] QuickFix Set up and usage

[savages203 <ss...@ow...>]

Hi, 

My setup below is working across a virtual environment with 2 Windows 7
machines. I am not getting QFJ to receive information from either side and I
am somewhat confused at to which is the sender and which is the receiver. I
have heard conflicting things. So I will list what I have so far: 

When I run quickfix on the same machine, i get the feedback/results that i
expect. 
I cannot get this to work across a network.

Banzai - Sender
Executor - receiver 
 
win7 machine 1 - Sender
Win7 machine 2 - Receiver

I have edited the config file - so that the sender (Banzai) is looking to
connect to the receiver (Executor).

It seems to just be looking locally for the connection. 

Please advise thanks,
Sherard



--
Sent from: http://quickfix-j.364392.n2.nabble.com/

[Quickfixj-users] building only FIX 5.0

[Andrew M. <an...@nm...>]

I'm currently build like this:

mvn -DskipTests -Dmaven.javadoc.skip=true clean install

what can I pass to maven so only the 5.0 stuff is built?

Re: [Quickfixj-users] Issue with quickfixj 2.1.0, SSLException, proxy and NTLM

[Christoph J. <chr...@ma...>]

Hi Andrew,

just curious if you made some progress that you could share?

Thanks,
Chris.

On 14/01/2019 11:12, Christoph John via Quickfixj-users wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
> Hi,
>
> hmm, to be fair: in QFJ-949 there isn't mentioned anything about NTLM or even a proxy?! So what 
> makes you think it is the same issue?
> However, did you try to use ProxyDomain and ProxyWorkstation as suggested here? 
> https://github.com/quickfix-j/quickfixj/pull/92
> Re MINA: QFJ already uses the most recent version 2.0.19.
>
> As you said it might be a bug in MINA. It could of course also be a bug in QFJ (not using MINA's 
> proxy classes correctly) but without a concise, reproducable unit test we cannot do much about it. 
> And even with a reproducer, we still would need somebody who can analyse and fix this issue. 
> Someone who has access to a proxy with NTLM authentication. Hmm, who could that be? ;)
>
> Cheers,
> Chris.
>
> On 13/01/2019 16:17, Andrew Marlow wrote:
>> QuickFIX/J Documentation:http://www.quickfixj.org/documentation/
>> QuickFIX/J Support:http://www.quickfixj.org/support/
>>
>>
>>
>> Hello everyone,
>>
>> I am using quickfixj to talk to a remote service that uses SSL encryption. I can get to the web 
>> landing page using curl but I get an SSLException with quickfixj during the handshake. I think 
>> this must be an issue with the quickfixj code. Let me explain some more:
>>
>> The remote service cannot be accessed directly because of a corporate firewall. The corporation 
>> is a heavy user of Microsoft software/environments so the corporate proxy uses NTLM for 
>> authentication. This works fine for web users from their windows workstations. However, it causes 
>> problems for some other software. An example is the python pip command. That fails with a proxy 
>> authentication error even when the correct credentials are supplied. This was reported as a 
>> problem to the python/pip developers. They refused to fix the issue. They said it was because the 
>> corporate proxy had been misconfigured and they were not going to change their code to cope with 
>> corporate misconfiguration. So the problem remains. To get around this problem I use a windows 
>> service called CNTLM. It is basically a proxy for a proxy. I enter my credentials into that and 
>> it sorts out the traffic forwarding to the pypi website. So when I hit a similar problem with 
>> quickfixj I eventually hit on the idea of using CNTLM. I did and the quickfixj communication now 
>> works. This is how I can get things to work on windows but unfortunately the software has to be 
>> run in a RHEL environment where CNTLM is not available. I do not know what I am going to be able 
>> to do about that.
>>
>> I've heard that other software gets hit by the same issue. There was a problem in chrome some 
>> years ago apparently. There is a recently logged issue with talend, as can be seen at 
>> https://community.talend.com/t5/Design-and-Development/tRest-with-NTLM-Proxy-Authorization/td-p/95066. 
>> There was also (and still might be) a problem with postman, as you can see here: 
>> https://github.com/postmanlabs/postman-app-support/issues/3692. Other examples include ArcEarth, 
>> https://community.esri.com/thread/189903-web-proxy-ntlm-authentication-error, and gradle, see 
>> https://stackoverflow.com/questions/14434101/gradle-not-working-behind-proxy-with-ntlm-on-windows. 
>> But there is one bit of software that I am able to connect with ok and that's curl. I am using a 
>> very recent version, 2.57. I cannot help thinking that curl has put in a workaround of the kind 
>> requested by python pip users. I hope to do some investigation to see if earlier versions of curl 
>> have the issue. That might shed some light on where the fix (if any) was supplied. It might be in 
>> the curl code or it might be in openssl. I am really not sure. But I am fairly convinced that 
>> apps that experience the issue must employ some sort of workaround.
>>
>> I note that a bug report was raised against quickfixj that might be the same issue, see 
>> https://www.quickfixj.org/jira/browse/QFJ-949 . It was closed with the statement ". I doubt that 
>> this is a bug since many people are using SSL with Java 8.". I am using JDK8 and I see the issue 
>> unless I use CNTLM. So perhaps this bug report should be re-opened. I admit it might be a bug in 
>> mina, since that is the component that quickfixj uses for the SSL handling. Could a version be 
>> built with the most recent version of mina please?
>>
>> -- 
>> Regards,
>>
>> Andrew Marlow
>> http://www.andrewpetermarlow.co.uk
>>
>>

-- 
Christoph John
Software Engineering
T +49 241 557080-28
chr...@ma...

MACD GmbH
Oppenhoffallee 103
52066 Aachen, Germany
www.macd.com

Amtsgericht Aachen: HRB 8151
Ust.-Id: DE 813021663
Geschäftsführer: George Macdonald

Re: [Quickfixj-users] Issue with quickfixj 2.1.0, SSLException, proxy and NTLM

[Christoph J. <chr...@ma...>]

Hi,

hmm, to be fair: in QFJ-949 there isn't mentioned anything about NTLM or even a proxy?! So what 
makes you think it is the same issue?
However, did you try to use ProxyDomain and ProxyWorkstation as suggested here? 
https://github.com/quickfix-j/quickfixj/pull/92
Re MINA: QFJ already uses the most recent version 2.0.19.

As you said it might be a bug in MINA. It could of course also be a bug in QFJ (not using MINA's 
proxy classes correctly) but without a concise, reproducable unit test we cannot do much about it. 
And even with a reproducer, we still would need somebody who can analyse and fix this issue. Someone 
who has access to a proxy with NTLM authentication. Hmm, who could that be? ;)

Cheers,
Chris.

On 13/01/2019 16:17, Andrew Marlow wrote:
> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J Support: http://www.quickfixj.org/support/
>
>
>
> Hello everyone,
>
> I am using quickfixj to talk to a remote service that uses SSL encryption. I can get to the web 
> landing page using curl but I get an SSLException with quickfixj during the handshake. I think 
> this must be an issue with the quickfixj code. Let me explain some more:
>
> The remote service cannot be accessed directly because of a corporate firewall. The corporation is 
> a heavy user of Microsoft software/environments so the corporate proxy uses NTLM for 
> authentication. This works fine for web users from their windows workstations. However, it causes 
> problems for some other software. An example is the python pip command. That fails with a proxy 
> authentication error even when the correct credentials are supplied. This was reported as a 
> problem to the python/pip developers. They refused to fix the issue. They said it was because the 
> corporate proxy had been misconfigured and they were not going to change their code to cope with 
> corporate misconfiguration. So the problem remains. To get around this problem I use a windows 
> service called CNTLM. It is basically a proxy for a proxy. I enter my credentials into that and it 
> sorts out the traffic forwarding to the pypi website. So when I hit a similar problem with 
> quickfixj I eventually hit on the idea of using CNTLM. I did and the quickfixj communication now 
> works. This is how I can get things to work on windows but unfortunately the software has to be 
> run in a RHEL environment where CNTLM is not available. I do not know what I am going to be able 
> to do about that.
>
> I've heard that other software gets hit by the same issue. There was a problem in chrome some 
> years ago apparently. There is a recently logged issue with talend, as can be seen at 
> https://community.talend.com/t5/Design-and-Development/tRest-with-NTLM-Proxy-Authorization/td-p/95066. 
> There was also (and still might be) a problem with postman, as you can see here: 
> https://github.com/postmanlabs/postman-app-support/issues/3692. Other examples include ArcEarth, 
> https://community.esri.com/thread/189903-web-proxy-ntlm-authentication-error, and gradle, see 
> https://stackoverflow.com/questions/14434101/gradle-not-working-behind-proxy-with-ntlm-on-windows. 
> But there is one bit of software that I am able to connect with ok and that's curl. I am using a 
> very recent version, 2.57. I cannot help thinking that curl has put in a workaround of the kind 
> requested by python pip users. I hope to do some investigation to see if earlier versions of curl 
> have the issue. That might shed some light on where the fix (if any) was supplied. It might be in 
> the curl code or it might be in openssl. I am really not sure. But I am fairly convinced that apps 
> that experience the issue must employ some sort of workaround.
>
> I note that a bug report was raised against quickfixj that might be the same issue, see 
> https://www.quickfixj.org/jira/browse/QFJ-949 . It was closed with the statement ". I doubt that 
> this is a bug since many people are using SSL with Java 8.". I am using JDK8 and I see the issue 
> unless I use CNTLM. So perhaps this bug report should be re-opened. I admit it might be a bug in 
> mina, since that is the component that quickfixj uses for the SSL handling. Could a version be 
> built with the most recent version of mina please?
>
> -- 
> Regards,
>
> Andrew Marlow
> http://www.andrewpetermarlow.co.uk
>
>
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users

-- 
Christoph John
Software Engineering
T +49 241 557080-28
chr...@ma...

MACD GmbH
Oppenhoffallee 103
52066 Aachen, Germany
www.macd.com

Amtsgericht Aachen: HRB 8151
Ust.-Id: DE 813021663
Geschäftsführer: George Macdonald

Re: [Quickfixj-users] Issue with quickfixj 2.1.0, SSLException, proxy and NTLM

[Philip W. <Phi...@fl...>]

Hi.

NTLM is a different protocol to SSL/TLS. Trying to use SSL to talk to a NTLM authenticated proxy will not work. You will get an SSL exception which might look similar to other SSL protocol errors but won’t  be solved by fixing bugs in the SSL engine. No matter how well we talk SSL the NTLM proxy won’t understand.

Next you say CNTLM works fine on Windows. Good. You then say it’s not available on RedHat. But it is, it’s right here - there’s an RPM and everything - you don’t even need to build from source: https://sourceforge.net/projects/cntlm/files/cntlm/cntlm%200.92.3/

I mean it’s on SourceForge which is not ideal these days but it does exist!

I suspect Python / PIP are mis understanding your problem. If you don’t use cntlm, then yes your requests will fail. This is not PIPs fault - they just don’t speak the proxy protocol - that’s why cNTLM exists - to tunnel through NTLM. Expecting every app developers to implement closed source protocols is just onerous. Hence a proxy.

You will need to use CNTLM for everything that needs to go through this Windows monstrosity.

Best regards,

Philip Whitehouse
Technical Lead
FIXHub Team

On 13 Jan 2019, at 16:20, Colin DuPlantis <co...@ma...<mailto:co...@ma...>> wrote:

QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J Support: http://www.quickfixj.org/support/


It seems you gave a long list of software that doesn't work in this configuration unless there's a Microsoft helper in the loop. I am not sure how you come to the conclusion that QFJ must be the problem despite all the other packages that don't work in a similar configuration.

I know that's not helpful, and that's not the reason I'm writing. Have you tried stunnel? I have had very good luck getting stunnel configured to just about anything

On Sun, Jan 13, 2019, 7:18 AM Andrew Marlow <mar...@gm...<mailto:mar...@gm...> wrote:
QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
QuickFIX/J<http://www.quickfixj.org/documentation/QuickFIX/J> Support: http://www.quickfixj.org/support/


Hello everyone,

I am using quickfixj to talk to a remote service that uses SSL encryption. I can get to the web landing page using curl but I get an SSLException with quickfixj during the handshake. I think this must be an issue with the quickfixj code. Let me explain some more:

The remote service cannot be accessed directly because of a corporate firewall. The corporation is a heavy user of Microsoft software/environments so the corporate proxy uses NTLM for authentication. This works fine for web users from their windows workstations. However, it causes problems for some other software. An example is the python pip command. That fails with a proxy authentication error even when the correct credentials are supplied. This was reported as a problem to the python/pip developers. They refused to fix the issue. They said it was because the corporate proxy had been misconfigured and they were not going to change their code to cope with corporate misconfiguration. So the problem remains. To get around this problem I use a windows service called CNTLM. It is basically a proxy for a proxy. I enter my credentials into that and it sorts out the traffic forwarding to the pypi website. So when I hit a similar problem with quickfixj I eventually hit on the idea of using CNTLM. I did and the quickfixj communication now works. This is how I can get things to work on windows but unfortunately the software has to be run in a RHEL environment where CNTLM is not available. I do not know what I am going to be able to do about that.

I've heard that other software gets hit by the same issue. There was a problem in chrome some years ago apparently. There is a recently logged issue with talend, as can be seen at https://community.talend.com/t5/Design-and-Development/tRest-with-NTLM-Proxy-Authorization/td-p/95066. There was also (and still might be) a problem with postman, as you can see here: https://github.com/postmanlabs/postman-app-support/issues/3692. Other examples include ArcEarth, https://community.esri.com/thread/189903-web-proxy-ntlm-authentication-error, and gradle, see https://stackoverflow.com/questions/14434101/gradle-not-working-behind-proxy-with-ntlm-on-windows. But there is one bit of software that I am able to connect with ok and that's curl. I am using a very recent version, 2.57. I cannot help thinking that curl has put in a workaround of the kind requested by python pip users. I hope to do some investigation to see if earlier versions of curl have the issue. That might shed some light on where the fix (if any) was supplied. It might be in the curl code or it might be in openssl. I am really not sure. But I am fairly convinced that apps that experience the issue must employ some sort of workaround.

I note that a bug report was raised against quickfixj that might be the same issue, see https://www.quickfixj.org/jira/browse/QFJ-949 . It was closed with the statement ". I doubt that this is a bug since many people are using SSL with Java 8.". I am using JDK8 and I see the issue unless I use CNTLM. So perhaps this bug report should be re-opened. I admit it might be a bug in mina, since that is the component that quickfixj uses for the SSL handling. Could a version be built with the most recent version of mina please?

--
Regards,

Andrew Marlow
http://www.andrewpetermarlow.co.uk

_______________________________________________
Quickfixj-users mailing list
Qui...@li...<mailto:Qui...@li...>
https://lists.sourceforge.net/lists/listinfo/quickfixj-users
_______________________________________________
Quickfixj-users mailing list
Qui...@li...<mailto:Qui...@li...>
https://lists.sourceforge.net/lists/listinfo/quickfixj-users

Re: [Quickfixj-users] Issue with quickfixj 2.1.0, SSLException, proxy and NTLM

[Colin D. <co...@ma...>]

It seems you gave a long list of software that doesn't work in this
configuration unless there's a Microsoft helper in the loop. I am not sure
how you come to the conclusion that QFJ must be the problem despite all the
other packages that don't work in a similar configuration.

I know that's not helpful, and that's not the reason I'm writing. Have you
tried stunnel? I have had very good luck getting stunnel configured to just
about anything

On Sun, Jan 13, 2019, 7:18 AM Andrew Marlow <mar...@gm... wrote:

> QuickFIX/J Documentation: http://www.quickfixj.org/documentation/
> QuickFIX/J <http://www.quickfixj.org/documentation/QuickFIX/J> Support:
> http://www.quickfixj.org/support/
>
>
> Hello everyone,
>
> I am using quickfixj to talk to a remote service that uses SSL encryption.
> I can get to the web landing page using curl but I get an SSLException with
> quickfixj during the handshake. I think this must be an issue with the
> quickfixj code. Let me explain some more:
>
> The remote service cannot be accessed directly because of a corporate
> firewall. The corporation is a heavy user of Microsoft
> software/environments so the corporate proxy uses NTLM for authentication.
> This works fine for web users from their windows workstations. However, it
> causes problems for some other software. An example is the python pip
> command. That fails with a proxy authentication error even when the correct
> credentials are supplied. This was reported as a problem to the python/pip
> developers. They refused to fix the issue. They said it was because the
> corporate proxy had been misconfigured and they were not going to change
> their code to cope with corporate misconfiguration. So the problem remains.
> To get around this problem I use a windows service called CNTLM. It is
> basically a proxy for a proxy. I enter my credentials into that and it
> sorts out the traffic forwarding to the pypi website. So when I hit a
> similar problem with quickfixj I eventually hit on the idea of using CNTLM.
> I did and the quickfixj communication now works. This is how I can get
> things to work on windows but unfortunately the software has to be run in a
> RHEL environment where CNTLM is not available. I do not know what I am
> going to be able to do about that.
>
> I've heard that other software gets hit by the same issue. There was a
> problem in chrome some years ago apparently. There is a recently logged
> issue with talend, as can be seen at
> https://community.talend.com/t5/Design-and-Development/tRest-with-NTLM-Proxy-Authorization/td-p/95066.
> There was also (and still might be) a problem with postman, as you can see
> here: https://github.com/postmanlabs/postman-app-support/issues/3692.
> Other examples include ArcEarth,
> https://community.esri.com/thread/189903-web-proxy-ntlm-authentication-error,
> and gradle, see
> https://stackoverflow.com/questions/14434101/gradle-not-working-behind-proxy-with-ntlm-on-windows.
> But there is one bit of software that I am able to connect with ok and
> that's curl. I am using a very recent version, 2.57. I cannot help thinking
> that curl has put in a workaround of the kind requested by python pip
> users. I hope to do some investigation to see if earlier versions of curl
> have the issue. That might shed some light on where the fix (if any) was
> supplied. It might be in the curl code or it might be in openssl. I am
> really not sure. But I am fairly convinced that apps that experience the
> issue must employ some sort of workaround.
>
> I note that a bug report was raised against quickfixj that might be the
> same issue, see https://www.quickfixj.org/jira/browse/QFJ-949 . It was
> closed with the statement ". I doubt that this is a bug since many people
> are using SSL with Java 8.". I am using JDK8 and I see the issue unless I
> use CNTLM. So perhaps this bug report should be re-opened. I admit it might
> be a bug in mina, since that is the component that quickfixj uses for the
> SSL handling. Could a version be built with the most recent version of mina
> please?
>
> --
> Regards,
>
> Andrew Marlow
> http://www.andrewpetermarlow.co.uk
>
> _______________________________________________
> Quickfixj-users mailing list
> Qui...@li...
> https://lists.sourceforge.net/lists/listinfo/quickfixj-users
>