Search Results for "collect"

DouK-Downloader is a fully open-source data acquisition and media downloading tool designed to extract, collect, and download content from TikTok and its Chinese counterpart Douyin at scale. Built using Python and modern asynchronous networking libraries such as HTTPX, it enables batch downloading of videos, images, live streams, and metadata from accounts, playlists, and individual links. The software goes beyond simple downloading by offering comprehensive data collection features, including comments, user statistics, and trending data such as hot boards and search results. ...

RisingWave is a cloud-native streaming database that uses SQL as the interface. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results in its own storage so that users can access data efficiently. RisingWave accepts data from sources like Apache Kafka, Apache Pulsar, Amazon Kinesis, Redpanda, and materialized CDC...

TwitchDropsMiner is a desktop application that automates earning timed Twitch Drops by simulating “watch” activity without actually streaming video, letting users collect rewards while saving bandwidth and attention. It works by periodically fetching stream metadata to advance Drops progress, while maintaining a websocket connection to monitor which channels are online, offline, or changing status. The app is designed to reduce manual babysitting by switching channels automatically when a stream goes offline or when a higher-priority opportunity becomes available. ...

TubeKit is a toolkit for creating YouTube crawlers. It allows one to build one's own crawler that can crawl YouTube based on a set of seed queries and collect up to 17 different attributes.