Search Results for "s3"

...Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON, and EXCEL). Built on top of other open-source projects like Pandas, Apache Arrow and Boto3, it offers abstracted functions to execute usual ETL tasks like load/unload data from Data Lakes, Data Warehouses, and Databases. Convert the column name to be compatible with Amazon Athena and the AWS Glue Catalog. Run a query against AWS CloudWatchLogs Insights and convert the results to Pandas DataFrame. ...

aws-sdk-pandas (formerly AWS Data Wrangler) bridges pandas with the AWS analytics stack so DataFrames flow seamlessly to and from cloud services. With a few lines of code, you can read from and write to Amazon S3 in Parquet/CSV/JSON/ORC, register tables in the AWS Glue Data Catalog, and query with Amazon Athena directly into pandas. The library abstracts efficient patterns like partitioning, compression, and vectorized I/O so you get performant data lake operations without hand-rolling boilerplate. It also supports Redshift, OpenSearch, and other services, enabling ETL tasks that blend SQL engines and Python transformations. ...

DocsGPT is an open-source (MIT) platform for private AI agents, assistants and enterprise search over your own documents, built by Arc53. It ingests PDFs, Office files, scanned pages (OCR), web pages and repositories, syncs Google Drive, SharePoint, Confluence, GitHub and S3, and answers with citations to the source passage. Agents call tools, APIs and MCP servers with per-action approval; a visual builder chains AI steps, conditions and code into workflows; agents can produce DOCX, XLSX, PPTX and PDF files. Models: OpenAI, Anthropic, Google and others, or local via Ollama, llama.cpp or vLLM. Vectors: pgvector, Qdrant, Milvus, Elasticsearch, MongoDB Atlas or FAISS. ...

The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the...