dbfpy-users Mailing List for dbfpy

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Hi Jeff ,

This is Shuo who loves your Python dbfpy&nbsp;program. May I ask a question? Do you know how to convert CSV or DataFrame to DBF?

Thank you very much!

Shuo
On 31.10.2019 3:12, 雷蕾 wrote:
> Do dbfpy support python 3.7？

Not at the moment, no.

A patch adding compatibility with Python3 is highly welcome, provided 
that support for Python2 is not dropped.

Your error message is about switching print from statement to function. 
That would be the easiest part.  The main problem is porting the code 
from 8-bit strings to the bytes type.

Sincerely yours,
alex.

Do dbfpy support python 3.7？
Greetings,

First i want to say thank you for making this library port for python.
Anyhow, i started learning python a month ago and i need to help him
transfer data from one dbf to another since flush method doesn't remove
data from dbf, it only flags them. I need to do this:
https://stackoverflow.com/questions/15147983/how-to-obtain-the-field-type-using-dbfpy

But answer to that question was 5 years ago in not ported version of
library. I would be very happy if anyone can write that code to work with
current ( readme.md says version 2.2.5) version of dbfpy3-master.

Thank you in advance for your help,

Djordje Djelic

Alex,

Version 2.3 allowed my scripts to run without errors and the csv files seem okay. I’ll know more when I move into the validation stage, but this is a huge step forward.  

Thank you!

Tim

On Jun 29, 2014, at 6:39 AM, alexander smishlajev <al...@go...> wrote:

> On 29.06.2014 0:20, Tim Rohrer wrote:
>> 
>> I’m using this library in a simple implementation to convert old DBF files to CSV. I’m getting errors with DBF files that appear to implement memos.
> 
> If you need help with errors you get, you should have shown error details.
> 
>> In reading the source code, it appears the reading of memos was not fully implemented.
> 
> Well, it was at the end of 2010.  But it appears that version with Memo 
> file support has never been released, probably for a lack of proper 
> testing.  I have uploaded the distros now.
> 
> Best wishes,
> alex.
> 
> 
> ------------------------------------------------------------------------------
> Open source business process management suite built on Java and Eclipse
> Turn processes into business applications with Bonita BPM Community Edition
> Quickly connect people, data, and systems into organized workflows
> Winner of BOSSIE, CODIE, OW2 and Gartner awards
> http://p.sf.net/sfu/Bonitasoft
> _______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users

On 29.06.2014 0:20, Tim Rohrer wrote:
>
> I’m using this library in a simple implementation to convert old DBF files to CSV. I’m getting errors with DBF files that appear to implement memos.

If you need help with errors you get, you should have shown error details.

> In reading the source code, it appears the reading of memos was not fully implemented.

Well, it was at the end of 2010.  But it appears that version with Memo 
file support has never been released, probably for a lack of proper 
testing.  I have uploaded the distros now.

Best wishes,
alex.

Chad,

I just looked closer and there are .fpt files associated with each of the tables that I could not read fully. So, I’ll experiment with those.

Tim

On Jun 28, 2014, at 8:57 PM, Tim Rohrer <ti...@it...> wrote:

> Thank you Chad.
> 
> These files do not have .dbt versions. The developer could not remember what he had used (FoxPro?). So I’ll dig deeper and see if I can find the docs for FoxPro (DBase II?)
> 
> Cheers, Tim
> 
> On Jun 28, 2014, at 4:09 PM, Chad Spratt <int...@gm...> wrote:
> 
>> According to http://ulisse.elettra.trieste.it/services/doc/dbase/DBFstruct.htm#C1.5 the values are in a separate .dbt file
>> 
>> I think the easiest approach would be to have DBFMemoFieldDef.decodeValue() in fields.py return value, which should be the block number. Also uncomment line 54 in dbfnew.py that adds "M" to FLD_TYPES.
>> Then in your script you'd need to read in the dbt file with something like this
>> memofile = open('tablename.dbt')
>> memos = []
>> block = memofile.read(512)
>> while (block)
>>     memos.append(block)
>>     block = memofile.read(512)
>> 
>> Then where you read the records, convert memo values to their strings with memos[value].
>> 
>> I also wrote a utility for converting between csv and dbf, but I've never had any files with memo fields so I haven't tested any of this. Hopefully it's some help though.
>> 
>> 
>> On Sat, Jun 28, 2014 at 4:20 PM, Tim Rohrer <ti...@it...> wrote:
>> Hello,
>> 
>> I’m using this library in a simple implementation to convert old DBF files to CSV. I’m getting errors with DBF files that appear to implement memos. In reading the source code, it appears the reading of memos was not fully implemented. Has anyone figured this out or found another workaround?
>> 
>> Thanks!
>> 
>> Tim
>> 
>> ------------------------------------------------------------------------------
>> Open source business process management suite built on Java and Eclipse
>> Turn processes into business applications with Bonita BPM Community Edition
>> Quickly connect people, data, and systems into organized workflows
>> Winner of BOSSIE, CODIE, OW2 and Gartner awards
>> http://p.sf.net/sfu/Bonitasoft
>> _______________________________________________
>> Dbfpy-users mailing list
>> Dbf...@li...
>> https://lists.sourceforge.net/lists/listinfo/dbfpy-users
>> 
>> 
>> ------------------------------------------------------------------------------
>> Open source business process management suite built on Java and Eclipse
>> Turn processes into business applications with Bonita BPM Community Edition
>> Quickly connect people, data, and systems into organized workflows
>> Winner of BOSSIE, CODIE, OW2 and Gartner awards
>> http://p.sf.net/sfu/Bonitasoft_______________________________________________
>> Dbfpy-users mailing list
>> Dbf...@li...
>> https://lists.sourceforge.net/lists/listinfo/dbfpy-users
> 
> ------------------------------------------------------------------------------
> Open source business process management suite built on Java and Eclipse
> Turn processes into business applications with Bonita BPM Community Edition
> Quickly connect people, data, and systems into organized workflows
> Winner of BOSSIE, CODIE, OW2 and Gartner awards
> http://p.sf.net/sfu/Bonitasoft_______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users

Thank you Chad.

These files do not have .dbt versions. The developer could not remember what he had used (FoxPro?). So I’ll dig deeper and see if I can find the docs for FoxPro (DBase II?)

Cheers, Tim

On Jun 28, 2014, at 4:09 PM, Chad Spratt <int...@gm...> wrote:

> According to http://ulisse.elettra.trieste.it/services/doc/dbase/DBFstruct.htm#C1.5 the values are in a separate .dbt file
> 
> I think the easiest approach would be to have DBFMemoFieldDef.decodeValue() in fields.py return value, which should be the block number. Also uncomment line 54 in dbfnew.py that adds "M" to FLD_TYPES.
> Then in your script you'd need to read in the dbt file with something like this
> memofile = open('tablename.dbt')
> memos = []
> block = memofile.read(512)
> while (block)
>     memos.append(block)
>     block = memofile.read(512)
> 
> Then where you read the records, convert memo values to their strings with memos[value].
> 
> I also wrote a utility for converting between csv and dbf, but I've never had any files with memo fields so I haven't tested any of this. Hopefully it's some help though.
> 
> 
> On Sat, Jun 28, 2014 at 4:20 PM, Tim Rohrer <ti...@it...> wrote:
> Hello,
> 
> I’m using this library in a simple implementation to convert old DBF files to CSV. I’m getting errors with DBF files that appear to implement memos. In reading the source code, it appears the reading of memos was not fully implemented. Has anyone figured this out or found another workaround?
> 
> Thanks!
> 
> Tim
> 
> ------------------------------------------------------------------------------
> Open source business process management suite built on Java and Eclipse
> Turn processes into business applications with Bonita BPM Community Edition
> Quickly connect people, data, and systems into organized workflows
> Winner of BOSSIE, CODIE, OW2 and Gartner awards
> http://p.sf.net/sfu/Bonitasoft
> _______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users
> 
> 
> ------------------------------------------------------------------------------
> Open source business process management suite built on Java and Eclipse
> Turn processes into business applications with Bonita BPM Community Edition
> Quickly connect people, data, and systems into organized workflows
> Winner of BOSSIE, CODIE, OW2 and Gartner awards
> http://p.sf.net/sfu/Bonitasoft_______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users

According to
http://ulisse.elettra.trieste.it/services/doc/dbase/DBFstruct.htm#C1.5 the
values are in a separate .dbt file

I think the easiest approach would be to have DBFMemoFieldDef.decodeValue()
in fields.py return value, which should be the block number. Also uncomment
line 54 in dbfnew.py that adds "M" to FLD_TYPES.
Then in your script you'd need to read in the dbt file with something like
this
memofile = open('tablename.dbt')
memos = []
block = memofile.read(512)
while (block)
    memos.append(block)
    block = memofile.read(512)

Then where you read the records, convert memo values to their strings with
memos[value].

I also wrote a utility for converting between csv and dbf, but I've never
had any files with memo fields so I haven't tested any of this. Hopefully
it's some help though.

On Sat, Jun 28, 2014 at 4:20 PM, Tim Rohrer <ti...@it...> wrote:

> Hello,
>
> I’m using this library in a simple implementation to convert old DBF files
> to CSV. I’m getting errors with DBF files that appear to implement memos.
> In reading the source code, it appears the reading of memos was not fully
> implemented. Has anyone figured this out or found another workaround?
>
> Thanks!
>
> Tim
>
>
> ------------------------------------------------------------------------------
> Open source business process management suite built on Java and Eclipse
> Turn processes into business applications with Bonita BPM Community Edition
> Quickly connect people, data, and systems into organized workflows
> Winner of BOSSIE, CODIE, OW2 and Gartner awards
> http://p.sf.net/sfu/Bonitasoft
> _______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users
>
>

Hello,

I’m using this library in a simple implementation to convert old DBF files to CSV. I’m getting errors with DBF files that appear to implement memos. In reading the source code, it appears the reading of memos was not fully implemented. Has anyone figured this out or found another workaround?

Thanks!

Tim

Hi,
I used this library to make a utility for working with dbf files that lets
you do a lot of stuff. Originally it only worked with dbf files, but now it
can use csv and sqlite as well, with more coming.

You can add/remove/reorder/rename fields, join multiple files together, and
perform field calculations. A sample of the output is shown as you
configure everything.

The only requirement, beyond python, is pygtk. I want to have a portable
version available, but I don't yet.

A more detailed description, with screenshots and download, is at
http://dogtato.github.io/AveryDB/
Hopefully a lot of people find it as useful as I do.

-Chad

On 25.05.2012 11:58, Mohan Sindhe wrote:
>
> I am using the dbfpy2.2.5 on windows system with python 2.6.7.
> In dbfpy how to delete a record. I have used the below code but no use.
>
> /*
>
> db = dbf.Dbf("test.dbf")
> rec = db[0]
> rec.delete()
> rec.store()
> del rec
> db.close()
>
> */
>
> After this when i Open the test.dbf file its not showing the deleted
> record, but when i read it using pydbf its printing the deleted record.
>
> /*
>
> db = dbf.Dbf("test.dbf")
> # should be 3 records, printing 4
> print 'count elements: ', len(db)
>
> */

Should be 4.  The record is still in the file, and that is the way how 
DBF works.

If you want to purge deleted records, you have to copy all records that 
are not deleted to a new file.

Cheers,
alex.

Hi,

 I am using the dbfpy2.2.5 on windows system with python 2.6.7.

In dbfpy how to delete a record. I have used the below code but no use.

/*
db = dbf.Dbf("test.dbf")

rec = db[0]
rec.delete()
rec.store()
del rec
db.close()
*/

After this when i Open the test.dbf file its not showing the deleted record, but when i read it using pydbf its printing  the deleted record.

/*
db = dbf.Dbf("test.dbf")

# should be 3 records, printing 4
print 'count elements: ', len(db)
                                                                                */

Regards,
Mohan

________________________________

DISCLAIMER:

This email may contain confidential information and is intended only for the use of the specific individual(s) to which it is addressed. If you are not the intended recipient of this email, you are hereby notified that any unauthorized use, dissemination or copying of this email or the information contained in it or attached to it is strictly prohibited. If you received this message in error, please immediately notify the sender at Infotech or Mai...@in... and delete the original message.

Is there a way to load this on windows 7-64 bit?

Justin Whipple

GIS Analyst

OIR-GIS Services

914 N Highland Dr

Jackson, TN 38301

Office: 731-423-3911

Cell: 731-267-0807

Hello,

I am working on GRASS GIS which stores geographical information in dbf-files. Now I want to aceess these entries row per row.

I wrote a GRASS_GIS-Python processing code and want to get the input value from the dbf-file. This calculation should run several times and every time value from the next row should be used. As I am quite new to python how can that be solved. I think with a "for rec in" loop or so.

And there is another question: I don't know which module to install, there is the dbf0.88.16 and the dbfpy? whats the difference?

cheers
johannes
-- 
GMX DSL Doppel-Flat ab 19,99 Euro/mtl.! Jetzt mit 
gratis Handy-Flat! http://portal.gmx.net/de/go/dsl

Hi there,
  I was just wondering if you have a version of dbfpy for 64bit windows?
Or if there is any other way I can install dbfpy on 64bit windows?

Thanks.

-- 
M.Q. Yelena Wu
Computer Science Engineering
University of California, Davis

Hey,

You can find simple examples @ http://dbfpy.sf.net/ and in dbfpy/dbf.py

And yes, seems that README is quite out of date. Thnx for pointing.

--
Best regards,
Yaroslav

On 05.01.2011, at 22:11, M.Q. Yelena Wu wrote:

> Hi there,
>   I was wondering how to load dbf files and extract data from them  
> by using dbfpy.
>   In the README file it says that there are two ways to load dbf  
> files, dbf.py && dbfload.py.
> Would you please give me more detailed procedures on how to use them?
> Thank you.
>
> -- 
> M.Q. Yelena Wu
> Computer Science Engineering
> University of California, Davis
> ------------------------------------------------------------------------------
> Learn how Oracle Real Application Clusters (RAC) One Node allows  
> customers
> to consolidate database storage, standardize their database  
> environment, and,
> should the need arise, upgrade to a full multi-node Oracle RAC  
> database
> without downtime or disruption
> http://p.sf.net/sfu/oracle-sfdevnl_______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users

Hi there,
  I was wondering how to load dbf files and extract data from them by using
dbfpy.
  In the README file it says that there are two ways to load dbf files,
dbf.py && dbfload.py.
Would you please give me more detailed procedures on how to use them?
Thank you.

-- 
M.Q. Yelena Wu
Computer Science Engineering
University of California, Davis

Косолапов Дмитрий wrote, at 18.11.2010 12:19:
>
> I can not remove record in dbf file. For details see attachment

that's not a bug, that is expected behaviour.

"deleted" in DBF file is a record marker.  your dbf still contains 4 
records, and one of them is deleted.

if your want to physically remove deleted records, you have to create 
new file and copy to it only those records that are not deleted.

best wishes,
alex.

Hi!
I can not remove record in dbf file. For details see attachment
-- 
Best regards, Kosolapov Dmitry
Hi, Dmitry,

What cache are you talking about? Can you please describe your case?

  - If you want to ensure changes are flushed to the stream, you can  
use Dbf.flush() method.
  - If your table could be changed externally, then a proper locking  
stuff should be used, which isn't implemented in Dbfpy. But you can  
try to re-open your table. Only header is re-read when you open an  
existing table, so it isn't too slow.

--
Best regards,
Jaroslavs

On 17.11.2010, at 07:32, Косолапов Дмитрий wrote:

> Hi!
> How to disable or reset cache?
> -- 
> С уважением, Дмитрий.
>
> ------------------------------------------------------------------------------
> Beautiful is writing same markup. Internet Explorer 9 supports
> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
> Spend less time writing and  rewriting code and more time creating  
> great
> experiences on the web. Be a part of the beta today
> http://p.sf.net/sfu/msIE9-sfdev2dev
> _______________________________________________
> Dbfpy-users mailing list
> Dbf...@li...
> https://lists.sourceforge.net/lists/listinfo/dbfpy-users

Hi!
How to disable or reset cache?
-- 
С уважением, Дмитрий.

Jason McPheron wrote, at 22.10.2010 23:01:
>
> Apparently VFP 9 introduced an optional feature that adds a hidden field
> to a DBF file called "_nullFlags".
> More information:
> http://www.matrixlist.com/pipermail/harbour/2007-October/004290.html
> I was working with a DBF file that had this and caused dbfpy to fail.
> The typeCode for _nullFlags is 0 (zero), so I tied adding a news class
> to fields.py with the same properties as the class
> "DbfCharacterFieldDef", with the exception of the typeCode. That seemed
> to fix it, at least for the file I was working with.

thank you for bringing the issue to attention.

however, true support for nullable and/or variable length fields would 
require more than simple ignoring of the flag bits.

> class DbfNullFlagsFieldDef(DbfFieldDef):
> """Definition of the _nullFlags field."""
>
>      typeCode = "0"
>      defaultValue = ""
>
>      def decodeValue(self, value):
> """Return string object.
>
>          Return value is a ``value`` argument with stripped right spaces.
>
> """
>          return value.rstrip(" ")
>
>      def encodeValue(self, value):
> """Return raw data string encoded from a ``value``."""
>          return str(value)[:self.length].ljust(self.length)

i am sorry, stripping or padding with spaces do not look like a sensible 
operations for bit masks stored in the null flags field.

besides, i think that the flags should be somehow handled at the record 
level and not as an extra field in a record, totally unrelated to the 
fields that are flagged by the null/variable length bits.

best wishes,
alex.

Katie Carbonari wrote, at 22.10.2010 23:27:
> Hi there. I'm trying to read some bdf files using dbfpy. The code I'm
> using is here:
>
> infiles = ['SWATOutput_Current_2ndtime.mdb','SWATOutput_Future_2ndTime.mdb']

>    File "/usr/local/lib/python2.5/site-packages/dbfpy/utils.py", line
> 75, in getDate
>      return datetime.date(*date[:3])
> ValueError: month must be in 1..12
>
> Any ideas on what is causing this error?

the error is caused by invalid file contents.

i think that the files you are trying to read are not dbf files: their 
names suggest they are ms access databases.

best wishes,
alex.

Hi there. I'm trying to read some bdf files using dbfpy. The code I'm
using is here:

***************************************************************
#!/usr/local/bin/python

import os, sys
import dbfpy
from dbfpy import dbf

infiles = ['SWATOutput_Current_2ndtime.mdb','SWATOutput_Future_2ndTime.mdb']

for file in infiles:
    print file
    db = dbf.Dbf(file)
    #db.openFile(file,readOnly=1)
    names = []
    print "%s contents: " % (file)
    for field in db.header.fileds:
        names.append(field.name)
        print field
    for rec in db:
            print '%s:' % (rec)
            print rec.fieldData

    db.close()
*************************************************
gives this error: ./process_SWAT_output.py
SWATOutput_Current_2ndtime.mdb
Traceback (most recent call last):
  File "./process_SWAT_output.py", line 13, in <module>
    db = dbf.Dbf(file)
  File "/usr/local/lib/python2.5/site-packages/dbfpy/dbf.py", line
135, in __init__
    self.header = self.HeaderClass.fromStream(self.stream)
  File "/usr/local/lib/python2.5/site-packages/dbfpy/header.py", line
120, in fromStream
    (_year, ord(_data[2]), ord(_data[3])))
  File "/usr/local/lib/python2.5/site-packages/dbfpy/header.py", line
89, in __init__
    self.lastUpdate = getDate(lastUpdate)
  File "/usr/local/lib/python2.5/site-packages/dbfpy/utils.py", line
75, in getDate
    return datetime.date(*date[:3])
ValueError: month must be in 1..12

Any ideas on what is causing this error?

Thanks!
katie

2009	Jan	Feb	Mar (2)	Apr	May (1)	Jun	Jul	Aug (2)	Sep	Oct	Nov	Dec
2010	Jan	Feb	Mar	Apr	May	Jun	Jul (4)	Aug	Sep	Oct (4)	Nov (4)	Dec
2011	Jan (2)	Feb (2)	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct (1)	Nov	Dec
2012	Jan	Feb	Mar	Apr	May (2)	Jun	Jul	Aug	Sep	Oct	Nov	Dec
2013	Jan	Feb	Mar	Apr	May	Jun	Jul	Aug	Sep (1)	Oct	Nov	Dec
2014	Jan	Feb	Mar	Apr	May	Jun (6)	Jul	Aug	Sep	Oct	Nov	Dec
2018	Jan	Feb	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct (1)	Nov	Dec
2019	Jan	Feb	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct (2)	Nov	Dec
2024	Jan	Feb	Mar (1)	Apr	May	Jun	Jul	Aug	Sep	Oct	Nov	Dec