Search Results for "json csv"

aws-sdk-pandas (formerly AWS Data Wrangler) bridges pandas with the AWS analytics stack so DataFrames flow seamlessly to and from cloud services. With a few lines of code, you can read from and write to Amazon S3 in Parquet/CSV/JSON/ORC, register tables in the AWS Glue Data Catalog, and query with Amazon Athena directly into pandas. The library abstracts efficient patterns like partitioning, compression, and vectorized I/O so you get performant data lake operations without hand-rolling boilerplate. It also supports Redshift, OpenSearch, and other services, enabling ETL tasks that blend SQL engines and Python transformations. ...

...It combines the clarity of a spreadsheet, the efficiency of the terminal, and the power of Python, into a lightweight utility that can handle millions of rows with ease. A terminal interface for exploring and arranging tabular data. VisiData supports tsv, CSV, SQLite, JSON, xlsx (Excel), hdf5, and many other formats. Requires Linux, OS/X, or Windows (with WSL). Hundreds of other commands and options are also available; see the documentation. Code in the stable branch of this repository, including the main vd application, loaders, and plugins, is available for use and redistribution under GPLv3. ...

...Next, get ready for some awesome, free, realtime finance data. Your API key may also be stored in the environment variable ALPHAVANTAGE_API_KEY. The library supports giving its results as json dictionaries (default), pandas dataframe (if installed) or csv, simply pass the parameter output_format='pandas' to change the format of the output for all the API calls in the given class.

...Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON, and EXCEL). Built on top of other open-source projects like Pandas, Apache Arrow and Boto3, it offers abstracted functions to execute usual ETL tasks like load/unload data from Data Lakes, Data Warehouses, and Databases. Convert the column name to be compatible with Amazon Athena and the AWS Glue Catalog. Run a query against AWS CloudWatchLogs Insights and convert the results to Pandas DataFrame. ...

Bots-ediint is a file translator for EDI (Electronic Data Interchange). Translate files and databases data format to another one: edifact, x12, tradacoms, xml, json, raw, database (postgres, sqlite, mysql, oracle, ...) and more. Bots-ediint is based on Bots https://bots.sourceforge.net Support Python 2 and Python 3 AS2 communications are carried out with my external software that could work in standalone and/or in a Bots channel to send and receive AS2 messages (SYNC and...

DATAGERRY is a flexible OpenSource CMDB & Assetmanagement Tool, which completely leaves the definition of a data model to the user. Simply define your own object types (like servers, routers, leased lines, locations and whatever you want) in an easy to use webfrontend. With our Export API, the CMDB objects stored in DATAGERRY can be easily exported to external systems, like monitoring systems, ticket systems, configuration management, and many many more.

Project has moved to: https://github.com/OptimalBPM/qal QAL is a collection of libraries for mining, transforming and writing data from and to a number of places. Sources and destinations include different SQL and NoSQL backends, file formats like .csv, XML and excel. Even untidy HTML web pages. It has a database abstraction layer that supports connectivity to Postgres, MySQL, DB2, Oracle, MS SQL server. JSON and MongoDB is coming. It uses XML/JSON formats(self-generated SQL schemas) for representing queries, transformation and merging, making it scriptable. This means that QAL can be backend agnostic about a subset of SQL features and data types. ...

pyMantis is a data-management system for (systems) biology build on the web2py framework. It features: tree based file explorer, relational db table wizzard with automated creation of user interfaces, internal and external access management, wiki, ..