Search Results for "sync software"

Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Clean API. Fast (>1k request/sec on a single core) Manages request delays and maximum concurrency per domain. Automatic cookie and session handling. Sync/async/parallel scraping. Distributed scraping. Caching, automatic encoding of non-unicode...

Simple command-line snippet manager, written in Go. You can use variables (param or param=default_value ) in snippets. pet is written in Go, and therefore you can just grab the binary releases and drop it in your $PATH. pet is a simple command-line snippet manager (inspired by memo). I always forget commands that I rarely use. Moreover, it is difficult to search them from shell history. There are many similar commands, but they are all different. Register your command snippets easily. Use...

Steampipe is the zero-ETL solution for getting data directly from APIs and services. We offer these Steampipe engines. SQL has been the data access standard for decades. It levels the playing field for your team, easily integrates with other systems, and accelerates delivery. Painlessly join live cloud configuration data with internal or external data sets to create new insights. Your cloud is a live database that changes fast. Don't wait on ETL to sync, or rely on old data. Crunch it where...

Compose Transporter helps with database transformations from one store to another. It can also sync from one to another or several stores. This version officially only supports the mongodb and postgresql adaptors. Support for other DBs will be added later on. Other adaptors may or may not work. You're encouraged to still use v0.5.2 for non mongo/postgres migrations. Transporter allows the user to configure a number of data adaptors as sources or sinks. These can be databases, files or other...