Re: [Openbts-discuss] SMS "text/plain" Failed.

[Kurtis H. <khe...@cs...>]

Oh, I've got it. You haven't defined openbts_db_loc correctly, as
specified on the wiki. It should be throwing a better error though,
and I'll fix that tonight.

On Tue, Feb 7, 2012 at 7:21 PM, Kurtis Heimerl <khe...@cs...> wrote:
> You're very close, you've managed to massage some bug I haven't seen
> before. I'll make sure to take a look at it tonight.
>
> On Tue, Feb 7, 2012 at 2:59 PM, Arghyadip Paul <arg...@gm...> wrote:
>> Hi,
>>
>> I installed the packet python_messaging
>>
>> by using the setup.py present.
>>
>> Now, the python scripts
>>
>>> OpenBTS_Parse_SMS
>>> OpenBTS_DB
>>> OpenBTS_DB
>>
>> are crashing as follows:
>>
>> 012-02-07 14:55:48.349108 [INFO] switch_time.c:423 Clock synchronized to
>> system time.
>> 2012-02-07 14:57:36.734120 [INFO] mod_sms.c:300 Processing text message
>> IMSI404864430002302->smsc in context default
>> 2012-02-07 14:57:36.734120 [NOTICE] mod_python.c:212 Invoking py module:
>> OpenBTS_Parse_SMS
>> 4af45a0d2012-02-07 14:57:36.754118 [NOTICE] mod_python.c:212 Invoking py
>> module: OpenBTS_DB
>> SELECT callerid FROM sip_buddies WHERE name="IMSI404864430002302"
>> 2012-02-07 14:57:36.754118 [ERR] mod_python.c:293 Error calling python
>> script
>> 2012-02-07 14:57:36.754118 [ERR] mod_python.c:164 Python Error by calling
>> script "OpenBTS_DB": <type 'exceptions.UnboundLocalError'>
>> Message: local variable 'err' referenced before assignment
>> Exception: None
>>
>> Traceback (most recent call last)
>> File: "/usr/local/freeswitch/scripts/OpenBTS_DB.py", line 63, in chat
>> File: "/usr/local/freeswitch/scripts/OpenBTS_DB.py", line 53, in
>> parse_and_op
>> Traceback (most recent call last):
>>   File "<string>", line 1, in <module>
>> NameError: name 'python_makes_sense' is not defined
>> 2012-02-07 14:57:36.754118 [NOTICE] mod_python.c:212 Invoking py module:
>> OpenBTS_Send_SMS
>> 2012-02-07 14:57:36.774096 [ERR] mod_python.c:293 Error calling python
>> script
>> 2012-02-07 14:57:36.774096 [ERR] mod_python.c:164 Python Error by calling
>> script "OpenBTS_Send_SMS": <type 'exceptions.TypeError'>
>> Message: cannot concatenate 'str' and 'NoneType' objects
>> Exception: None
>>
>> Traceback (most recent call last)
>> File: "/usr/local/freeswitch/scripts/OpenBTS_Send_SMS.py", line 99, in chat
>> File: "/usr/local/freeswitch/scripts/OpenBTS_Send_SMS.py", line 78, in
>> send_smqueue_message
>> Traceback (most recent call last):
>>   File "<string>", line 1, in <module>
>> NameError: name 'python_makes_sense' is not defined
>>
>>
>> Any catch?
>>
>> Arghyadip
>>
>> On Tue, Feb 7, 2012 at 2:53 PM, Arghyadip Paul <arg...@gm...> wrote:
>>>
>>> Hi Kurtis,
>>>
>>> Any installation note for python_messaging..?? Can't find any
>>> references...!!
>>>
>>> Arghyadip
>>>
>>>
>>> On Tue, Feb 7, 2012 at 2:07 PM, Kurtis Heimerl <khe...@cs...>
>>> wrote:
>>>>
>>>> Ah yes! You're quite close. You have to install python-messaging. If
>>>> that's not in the documentation, I have to add it:
>>>>
>>>> https://github.com/pmarti/python-messaging
>>>>
>>>> On Tue, Feb 7, 2012 at 2:03 PM, Arghyadip Paul <arg...@gm...>
>>>> wrote:
>>>> > Hi Kurtis,
>>>> >
>>>> > Some progress. It seems that one has to delete the default chatplan and
>>>> > replace the one given in opentbts/freeswitchconfig. Else the things
>>>> > dont
>>>> > work.
>>>> >
>>>> > Now, I am able to hit the intended chat plan after one MS sends an SMS
>>>> > to
>>>> > another.Call flow is as follows:
>>>> >
>>>> > 1. MS1 and MS2  successfully registers to subscriber registry.
>>>> > 2. MS1 sends SMS to MS2.
>>>> > 3. OpenBTS sends SIP MESSAGE to Freeswitch.
>>>> > 4. FS replies back with 2xx
>>>> > 5. FS invokes the openbts_chatplan.
>>>> > 6. Following scripts are getting invoked by mod_python in FS.
>>>> >
>>>> > OpenBTS_Parse_SMS
>>>> > OpenBTS_DB
>>>> > OpenBTS_DB
>>>> >
>>>> > 7. Something got screwed up in mod_python and it's crashing right
>>>> > there.[NOT
>>>> > OK]
>>>> >
>>>> > I suspect some configuration may be missing. I am printing the debug
>>>> > logs I
>>>> > got from FS CLI. If you have gone through the similar thing before, it
>>>> > would
>>>> > definitely help me to fasten up the recovery of mod_python. I am also
>>>> > trying parallely..
>>>> >
>>>> > FS Logs:
>>>> > -------------
>>>> > 2012-02-07 13:54:56.714103 [INFO] mod_sms.c:300 Processing text message
>>>> > IMSI404864430002302->smsc in context default
>>>> > 2012-02-07 13:54:56.714103 [NOTICE] mod_python.c:212 Invoking py
>>>> > module:
>>>> > OpenBTS_Parse_SMS
>>>> > 2012-02-07 13:54:56.774146 [ERR] mod_python.c:231 Error importing
>>>> > module
>>>> > 2012-02-07 13:54:56.774146 [ERR] mod_python.c:164 Python Error by
>>>> > calling
>>>> > script "OpenBTS_Parse_SMS": <type 'exceptions.ImportError'>
>>>> > Message: No module named messaging.utils
>>>> > Exception: None
>>>> >
>>>> > Traceback (most recent call last)
>>>> > File: "/usr/local/freeswitch/scripts/OpenBTS_Parse_SMS.py", line 30, in
>>>> > <module>
>>>> > 2012-02-07 13:54:56.774146 [NOTICE] mod_python.c:212 Invoking py
>>>> > module:
>>>> > OpenBTS_DB
>>>> > SELECT callerid FROM sip_buddies WHERE name="IMSI404864430002302"
>>>> > 2012-02-07 13:54:56.834458 [ERR] mod_python.c:293 Error calling python
>>>> > script
>>>> > 2012-02-07 13:54:56.834458 [ERR] mod_python.c:164 Python Error by
>>>> > calling
>>>> > script "OpenBTS_DB": <type 'exceptions.UnboundLocalError'>
>>>> > Message: local variable 'err' referenced before assignment
>>>> > Exception: None
>>>> >
>>>> > Traceback (most recent call last)
>>>> > File: "/usr/local/freeswitch/scripts/OpenBTS_DB.py", line 63, in chat
>>>> > File: "/usr/local/freeswitch/scripts/OpenBTS_DB.py", line 53, in
>>>> > parse_and_op
>>>> > Traceback (most recent call last):
>>>> >   File "<string>", line 1, in <module>
>>>> > NameError: name 'python_makes_sense' is not defined
>>>> > 2012-02-07 13:54:56.834458 [NOTICE] mod_python.c:212 Invoking py
>>>> > module:
>>>> > OpenBTS_Send_SMS
>>>> > 2012-02-07 13:54:56.834458 [ERR] mod_python.c:231 Error importing
>>>> > module
>>>> > 2012-02-07 13:54:56.834458 [ERR] mod_python.c:164 Python Error by
>>>> > calling
>>>> > script "OpenBTS_Send_SMS": <type 'exceptions.ImportError'>
>>>> > Message: No module named messaging.sms.submit
>>>> > Exception: None
>>>> >
>>>> > Traceback (most recent call last)
>>>> > File: "/usr/local/freeswitch/scripts/OpenBTS_Send_SMS.py", line 31, in
>>>> > <module>
>>>> >
>>>> >
>>>> > Thanks in advance,
>>>> > Arghya
>>>> >
>>>> > On Mon, Feb 6, 2012 at 7:48 PM, Arghyadip Paul <arg...@gm...>
>>>> > wrote:
>>>> >>
>>>> >> Hi All,
>>>> >>
>>>> >> This time I tried to use the available chat plan and dial plan. I
>>>> >> copied
>>>> >> the openbts-chatplan to the chatplan folder in Freeswitch installation
>>>> >> directory. I could see one existing config default there which I did
>>>> >> not
>>>> >> delete.
>>>> >>
>>>> >> My freeswtich.xml in conf folder has the following entry for mod_sms
>>>> >>
>>>> >>
>>>> >> <section name="chatplan" description="Regex/XML Chatplan">
>>>> >> <X-PRE-PROCESS
>>>> >> cmd="include" data="chatplan/*.xml"/> </section>
>>>> >>
>>>> >> which is done as per directions given in
>>>> >> http://wiki.freeswitch.org/wiki/Mod_sms
>>>> >>
>>>> >> As of now I am interested only in SMS routing so I did not try much
>>>> >> for
>>>> >> Call.
>>>> >>
>>>> >> Following Test is performed:
>>>> >>
>>>> >> 1. To MS Registered.
>>>> >> 2. MS 1 sends an SMS to MS2.
>>>> >> 3. Freeswitch replies back with 200OK ( I have not applied the recent
>>>> >> patch yet  )
>>>> >> 4. But Freeswitch failed to forward the SMS to Smqueue.
>>>> >>
>>>> >> Freeswitch logs are as follows:
>>>> >> 2012-02-06 17:02:26.447289 [INFO] mod_sms.c:300 Processing text
>>>> >> message
>>>> >> IMSI404864430002302->smsc in context default
>>>> >> 2012-02-06 17:02:26.447289 [WARNING] sofia_presence.c:193 Not sending
>>>> >> to
>>>> >> local box for IMSI404864430002302@192.168.2.131
>>>> >> 2012-02-06 17:02:26.447289 [ERR] sofia_presence.c:242 Chat proto
>>>> >> [GLOBAL_SMS]
>>>> >> from ["smsc" <sip:smsc@192.168.2.131>]
>>>> >> to [IMSI404864430002302@192.168.2.131]
>>>> >> Hello, you said:
>>>> >> 000100079119896800454411118f0a8169904869600000ff04d077ba0e
>>>> >> Nobody to send to: Profile internal
>>>> >>
>>>> >> Which means that, freeswitch failed to hit the intended chat plan
>>>> >> named
>>>> >> "openbts-chatplan" and hitting the default chat plan.
>>>> >>
>>>> >> Any catch what are the possible way to deal with this. Am I missing
>>>> >> any
>>>> >> configuration? I hope not as I have triple checked most of them.
>>>> >>
>>>> >> Regards,
>>>> >> Arghyadip
>>>> >>
>>>> >>
>>>> >> On Thu, Feb 2, 2012 at 6:27 PM, Kurtis Heimerl
>>>> >> <khe...@cs...>
>>>> >> wrote:
>>>> >>>
>>>> >>> Firstly, David, the 200->202 issue has been fixed in FS:
>>>> >>> http://jira.freeswitch.org/browse/FS-3864?focusedCommentId=29946
>>>> >>> (you're the pedantic telco guy btw)
>>>> >>>
>>>> >>> Arghyadip, yes, you need to install those scripts. The chatplan is
>>>> >>> exactly like an asterisk dialplan; it needs to be connected to the
>>>> >>> subscriber registry (as well as other things). The scripts decode and
>>>> >>> encode the SMS as well. FreeSWITCH won't work as an SMS router
>>>> >>> without
>>>> >>> them. I should clear that up on the wiki.
>>>> >>>
>>>> >>> Feel free to contact me directly about this install. You're the first
>>>> >>> person (aside from myself, on multiple occasions) to try this out.
>>>> >>> I'd
>>>> >>> be happy to support you.
>>>> >>>
>>>> >>> On Thu, Feb 2, 2012 at 3:58 PM, Arghyadip Paul <arg...@gm...>
>>>> >>> wrote:
>>>> >>> > I have some question regarding the configuration of Freeswitch and
>>>> >>> > OpenBTS:
>>>> >>> >
>>>> >>> > In the https://wush.net/trac/rangepublic/wiki/freeswitchConfig
>>>> >>> >
>>>> >>> > In last section "Using FreeSWITCH with OpenBTS" a couple of tools
>>>> >>> > and
>>>> >>> > examples given:
>>>> >>> >
>>>> >>> > To configure OpenBTS to work with Freeswitch are those tools and
>>>> >>> > examples
>>>> >>> > mandatory to be applied or run. From this page its not clear what
>>>> >>> > needs
>>>> >>> > to
>>>> >>> > be done after this patch of text:
>>>> >>> >
>>>> >>> > "Lastly, there are a few utility scripts we've written that should
>>>> >>> > be
>>>> >>> > made
>>>> >>> > accessible to FreeSWITCH. These are located in
>>>> >>> > (openbtsdir)/FreeswitchConfig/scripts/. Copy all of those to
>>>> >>> > (freeswitchInstallDir)/scripts. Their functions are detailed below.
>>>> >>> >
>>>> >>> > Restart FreeSWITCH and your system should be receiving and handing
>>>> >>> > OpenBTS
>>>> >>> > traffic."
>>>> >>> >
>>>> >>> >
>>>> >>> > In my set up I have not run any of the tools nor I have updates the
>>>> >>> > chatplans according to the example.
>>>> >>> >
>>>> >>> > Waiting for your responses. May be I am missing only these final
>>>> >>> > steps
>>>> >>> > to be
>>>> >>> > applied and these are not done , currently set up is not working.
>>>> >>> >
>>>> >>> >
>>>> >>> > On Wed, Feb 1, 2012 at 6:49 PM, Kurtis Heimerl
>>>> >>> > <khe...@cs...>
>>>> >>> > wrote:
>>>> >>> >>
>>>> >>> >> Though I'd really like the dialplan to give me the option of
>>>> >>> >> responding with what I see fit (as perhaps I am the end point or
>>>> >>> >> can
>>>> >>> >> confirm the delivery to the endpoint). I'll poke those folks and
>>>> >>> >> see
>>>> >>> >> what happens.
>>>> >>> >>
>>>> >>> >> On Wed, Feb 1, 2012 at 6:48 PM, Kurtis Heimerl
>>>> >>> >> <khe...@cs...>
>>>> >>> >> wrote:
>>>> >>> >> > Sounds like having FS respond with a 202 is sufficient to meet
>>>> >>> >> > the
>>>> >>> >> > spec. That should be easy to do.
>>>> >>> >> >
>>>> >>> >> > On Wed, Feb 1, 2012 at 6:41 PM, David Burgess
>>>> >>> >> > <da...@ra...>
>>>> >>> >> > wrote:
>>>> >>> >> >> Kurtis -
>>>> >>> >> >>
>>>> >>> >> >> It's in RFC-3428 Section 4.  It includes this paragraph:
>>>> >>> >> >>
>>>> >>> >> >> """
>>>> >>> >> >>   If the UAC receives a 200 OK response to a MESSAGE request,
>>>> >>> >> >> it
>>>> >>> >> >> may
>>>> >>> >> >>   assume the message has been delivered to the final
>>>> >>> >> >> destination.
>>>> >>> >> >>  It
>>>> >>> >> >>   MUST NOT assume that the recipient has actually read the
>>>> >>> >> >> instant
>>>> >>> >> >>   message.  If the UAC receives a 202 Accepted response, the
>>>> >>> >> >> message
>>>> >>> >> >>   has been delivered to a gateway, store and forward server, or
>>>> >>> >> >> some
>>>> >>> >> >>   other service that may eventually deliver the message.  In
>>>> >>> >> >> this
>>>> >>> >> >> case,
>>>> >>> >> >>   the UAC MUST NOT assume the message has been delivered to the
>>>> >>> >> >> final
>>>> >>> >> >>   destination.  If confirmation of delivery is required for a
>>>> >>> >> >> message
>>>> >>> >> >>   that has been responded to with a 202 Accepted, that
>>>> >>> >> >> confirmation
>>>> >>> >> >>   must be delivered via some other mechanism, which is beyond
>>>> >>> >> >> the
>>>> >>> >> >> scope
>>>> >>> >> >>   of this specification.
>>>> >>> >> >> """
>>>> >>> >> >>
>>>> >>> >> >> It sounds like the only way to get truly reliable delivery at
>>>> >>> >> >> the
>>>> >>> >> >> user
>>>> >>> >> >> level is to implement SMS delivery reports in the transfer
>>>> >>> >> >> layer
>>>> >>> >> >> (layer 5).
>>>> >>> >> >>
>>>> >>> >> >> -- David
>>>> >>> >> >>
>>>> >>> >> >>
>>>> >>> >> >>
>>>> >>> >> >>
>>>> >>> >> >> On Feb 1, 2012, at 6:30 PM, Kurtis Heimerl wrote:
>>>> >>> >> >>
>>>> >>> >> >>> If you can give the specific spec being violated, I'll submit
>>>> >>> >> >>> a
>>>> >>> >> >>> bug
>>>> >>> >> >>> fix to Anthony on FS. The SIP MESSAGE stuff is not as mature
>>>> >>> >> >>> (having
>>>> >>> >> >>> come around 6 months ago) and so you're going to find issues
>>>> >>> >> >>> like
>>>> >>> >> >>> this.
>>>> >>> >> >>>
>>>> >>> >> >>> At the same time, I think it's reasonable to say that FS is
>>>> >>> >> >>> potentially the "endpoint" in this instance. For short-codes,
>>>> >>> >> >>> for
>>>> >>> >> >>> instance, it's the right response.
>>>> >>> >> >>>
>>>> >>> >> >>> On Wed, Feb 1, 2012 at 6:03 PM, David Burgess
>>>> >>> >> >>> <da...@ra...> wrote:
>>>> >>> >> >>>>
>>>> >>> >> >>>> Note that step #3 is a violation of the SPI spec.  A 200 OK
>>>> >>> >> >>>> response
>>>> >>> >> >>>> to SIP
>>>> >>> >> >>>> MESSAGE means that the message was delivered to the endpoint.
>>>> >>> >> >>>>  A
>>>> >>> >> >>>> 202
>>>> >>> >> >>>> Queued
>>>> >>> >> >>>> response to SIP MESSAGE means that the message is stored for
>>>> >>> >> >>>> reliable
>>>> >>> >> >>>> delivery.  Only OpenBTS itself is in a position to give a 200
>>>> >>> >> >>>> OK
>>>> >>> >> >>>> response
>>>> >>> >> >>>> and FS has no storage function and therefore has no business
>>>> >>> >> >>>> answering with
>>>> >>> >> >>>> 202 Queued.  The result here is worse than a simple failure,
>>>> >>> >> >>>> since
>>>> >>> >> >>>> there is
>>>> >>> >> >>>> not feedback to the handset that something is wrong.
>>>> >>> >> >>>>
>>>> >>> >> >>>> I'm not anti-FS.  I like the idea of using the same component
>>>> >>> >> >>>> for
>>>> >>> >> >>>> SMS
>>>> >>> >> >>>> and
>>>> >>> >> >>>> telephone number resolution.  But this looks like a problem
>>>> >>> >> >>>> that
>>>> >>> >> >>>> needs
>>>> >>> >> >>>> worked around somehow.
>>>> >>> >> >>>>
>>>> >>> >> >>>> On Feb 1, 2012, at 4:06 PM, Arghyadip Paul wrote:
>>>> >>> >> >>>>
>>>> >>> >> >>>>
>>>> >>> >> >>>> 1. MS1 and MS2 registered to OpenBTS.
>>>> >>> >> >>>> 2. MS1 sends sms to MS2
>>>> >>> >> >>>> 3. OpenBTS sends the SIP MESSAGE to Freeswitch and gets 200Ok
>>>> >>> >> >>>> response.
>>>> >>> >> >>>> 4. Freeswith is supposed to forward the SMS to smqueue but
>>>> >>> >> >>>> Failed.[Not Ok]
>>>> >>> >> >>>>
>>>> >>> >> >>>>
>>>> >>> >> >>>> David A. Burgess
>>>> >>> >> >>>> Range Networks, Inc.
>>>> >>> >> >>>> 560 Brannan St.
>>>> >>> >> >>>> San Francisco, CA 94107
>>>> >>> >> >>>> USA
>>>> >>> >> >>>> cell +1 707 208 2622
>>>> >>> >> >>>>
>>>> >>> >> >>>>
>>>> >>> >> >>>>
>>>> >>> >> >>>
>>>> >>> >> >>
>>>> >>> >> >> David A. Burgess
>>>> >>> >> >> Range Networks, Inc.
>>>> >>> >> >> 560 Brannan St.
>>>> >>> >> >> San Francisco, CA 94107
>>>> >>> >> >> USA
>>>> >>> >> >> cell +1 707 208 2622
>>>> >>> >> >>
>>>> >>> >> >>
>>>> >>> >> >>
>>>> >>> >
>>>> >>> >
>>>> >>> >
>>>> >>> >
>>>> >>> > --
>>>> >>> > Arghyadip Paul
>>>> >>> > Graduate Student
>>>> >>> > Department of Computer Science
>>>> >>> > University of California Santa Barbara
>>>> >>> > Santa Barbara , CA 93106 USA
>>>> >>> >
>>>> >>
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >> Arghyadip Paul
>>>> >> Graduate Student
>>>> >> Department of Computer Science
>>>> >> University of California Santa Barbara
>>>> >> Santa Barbara , CA 93106 USA
>>>> >>
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Arghyadip Paul
>>>> > Graduate Student
>>>> > Department of Computer Science
>>>> > University of California Santa Barbara
>>>> > Santa Barbara , CA 93106 USA
>>>> >
>>>
>>>
>>>
>>>
>>> --
>>> Arghyadip Paul
>>> Graduate Student
>>> Department of Computer Science
>>> University of California Santa Barbara
>>> Santa Barbara , CA 93106 USA
>>>
>>
>>
>>
>> --
>> Arghyadip Paul
>> Graduate Student
>> Department of Computer Science
>> University of California Santa Barbara
>> Santa Barbara , CA 93106 USA
>>