Search Results for "python web crawler" - Page 26
Sort By:
Showing 2706 open source projects for "python web crawler"
View related business solutions-
AI-powered service management for IT and enterprise teamsGive your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
-
Crowdtesting That Delivers | TesteumTesteum connects your software, app, or website to a worldwide network of testers, delivering detailed feedback in under 48 hours. Ensure functionality and refine UX on real devices, all at a fraction of traditional costs. Trusted by startups and enterprises alike, our platform streamlines quality assurance with actionable insights. Click to perfect your product now.
-
1
Python Taint
Static Analysis Tool for Detecting Security Vulnerabilities in Python
Static analysis of Python web applications based on theoretical foundations (Control flow graphs, fixed point, dataflow analysis) Detect command injection, SSRF, SQL injection, XSS, directory traveral etc. A lot of customization is possible. For functions from builtins or libraries, e.g. url_for or os.path.join, use the -m option to specify whether or not they return tainted values given tainted inputs, by default this file is used. -
2
Music + Video + Animation Maker & App
Why Music + Video + Animation Maker & App is Fun?
Javaimagephp All-in-one video/film editor or maker makes sense as simple to use app for video/film or movie editing and animations/slideshows. It gets most of your imagination of an All-in-one video/film Animation editor / maker App. Video editing is made intuitive and simple. Lots of Special Effects ( > 55) ! For example this one http://ogena.ridoua.nu Formats supported are mp4, avi, flv, mov, flv and more. Description given image animation which seeks audio given a description.... -
3
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but... -
4
Trigger Happy
Automate the exchanges of the data between applications
Automate the exchanges of the data between the applications and services you use on the web. Make Twitter talk to Mastodon, make Github talk to Mattermost, store your favorite tweets by creating notes in Evernote, follow RSS feeds and post each news in Wallabag, Pocket or Evernote. The possibilities are too numerous to name all of them, but with that project you won't have to raise your little finger at all: automate everything and make your life easier. And last but not least, as this is your... -
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Pikon-Stelarium interface
Pikon-Stelarium interface to use with azimuthal mount
This is a full project to make an software-drived azimuthal mount for the Pikon telescope, it can be use for others telescope. This project include : . Some other parts to print to adapt to the Pikon . Python code for raspberry Needed parts for "as it" use : . 1 Raspberry (model A suit well) . 3 motors steppers . 3 steppers drivers . 1 BNO055 (the one from adafruit was used) . 1 Pikon driver . 1 GPS module Sofware requirement : . raspbian . python 3 . some python libraries -
6
Tera
An Internet-scale database
Tera is a high-performance distributed NoSQL database, which is inspired by google's BigTable and designed for real-time applications. Tera can easily scale to petabytes of data across thousands of commodity servers. Besides, Tera is widely used in many Baidu products with varied demands， which range from throughput-oriented applications to latency-sensitive services, including web indexing, WebPage DB, LinkBase DB, etc. Tera is the collection of many sparse, distributed, multidimensional... -
7
photogallery
Simple django project for upload image and views
Simple django project for upload image and views. It is a simple photo gallery with registration -
8
Jupyter Server Proxy
Jupyter notebook server extension to proxy web services.
Jupyter Server Proxy lets you run arbitrary external processes (such as RStudio, Shiny Server, Syncthing, PostgreSQL, Code Server, etc) alongside your notebook server and provide authenticated web access to them using a path like /rstudio next to others like /lab. Alongside the Python package that provides the main functionality, the JupyterLab extension (@jupyterhub/jupyter-server-proxy) provides buttons in the JupyterLab launcher window to get to RStudio for example. -
9
YouTube Video Downloader
Allows you to download youtube videos into a video/audio format.
YouTube Video Downloader By Chase, This is a tool developed in python, by web scraping I can get the videos from YouTube and download it on my machine in a video/audio format, easy-to-use GUI for your needs, dark theme. -
Test your software product anywhere in the worldGlobal App Testing is a managed pool of freelancers used by Google, Meta, Microsoft, and other world-beating software companies.
-
10
CODESH
Automatic persistent logbooks for Linux shell sessions (bash, tcsh...)
The CODESH (COllaborative DEvelopment SHell) project provides an automatic persistent logbook for sessions of personal command-line work by recording what and how is being done: for private use/reuse and for sharing selected parts with collaborators. -
11
Functional, Data Science Intro To Python
[tutorial]A functional, Data Science focused introduction to Python
The first section is an intentionally brief, functional, data science-centric introduction to Python. The assumption is a someone with zero experience in programming can follow this tutorial and learn Python with the smallest amount of information possible. The sections after that, involve varying levels of difficulty and cover topics as diverse as Machine Learning, Linear Optimization, build systems, command line tools, recommendation engines, Sentiment Analysis and Cloud Computing. -
12
Bowtie
Create a dashboard with python!
Bowtie is a library for writing dashboards in Python. No need to know web frameworks or JavaScript, focus on building functionality in Python. Interactively explore your data in new ways! Deploy and share with others! Bowtie uses Yarn to manage node packages. If you installed Bowtie through conda, Yarn was also installed as a dependency. Yarn can be installed through conda. An early integration with Jupyter has been prototyped. I encourage you to try it out and share feedback. I hope... -
13
Xplico
Xplico is a Network Forensic Analysis Tool (NFAT)
Xplico is a Network Forensic Analysis Tool (NFAT). The goal of Xplico is extract from an internet traffic capture the applications data contained. For example, from a pcap file Xplico extracts each email (POP, IMAP, and SMTP protocols), all HTTP contents, each VoIP call (SIP, MGCP, MEGACO, RTP), IRC, WhatsApp... Xplico is able to classify more than 140 (application) protocols. Xplico cam be used as sniffer-decoder if used in "live mode" or in conjunction with netsniff-ng. Xplico is used... -
14
Ljudmiljö i Stationssamhällen
Simulering av åtgärder mot buller från järnväg
En demonstrator av ett verktyg som simulerar åtgärder mot buller från järnväg. Demonstratorn är utvecklad inom projektet "God ljudmiljö i stationssamhällen - Verktygslåda och exempel till nytta för klimat, hälsa och resurseffektivitet" som bedrevs inom ramen för MISTRA Urban Futures med finansiering från programkontoret inom det strategiska innovationsprogrammet InfraSweden2030 genom Vinnova, samt från Västra Götalands regionen och Trafikverket. Projektet utfördes av RISE, Chalmers och VTI... -
15
Stationsnara
Simulering av åtgärder mot buller från järnväg
En demonstratar av ett verktyg som simulerar åtgärder mot buller från järnväg. -
16
This program is an email antivirus/antispam gateway. It is an interface to the postfix or sendmail (or any other smtpd), which runs antivirus and/or spamchecker. Its modular architecture can use any combination of antivirus/spamchecker according to co
-
17
ManagerSheet
A one-page investment portfolio report
ManagerSheet is a one-page investment portfolio report, that analyses and presents an investment portfolio with respect to: - Performance - Investment style - Risk More information on the report concept and instructions on how to create one's own portfolio reports can be found at the ManagerSheet Web Site under the "Documentation" section. Please note that the project is in alpha stage. -
18
Aptana Studio 3
The professional, open source development tool for the open web
Build and test your web applications all in one environment with Aptana Studio 3, the industry’s leading web application IDE. A powerful web development engine, Aptana Studio enables you to build, edit, preview and debug with support for HTML5, CSS3, JavaScript, Python, PHP and Ruby on Rails. -
19
JPykotaGUI
Interface gráfica para PyKota / Graphical interface for PyKota
Projeto destinado a ser uma interface gráfica web para o software de controle de impressão PyKota (www.pykota.com). Não possui vinculo algum com projeto oficial. Para novas instalações com Ubuntu 12.04 server use o script install.sh. -- Para FreeBSD veja https://www.vivaolinux.com.br/artigo/Configurando-o-FreeBSD-e-PyKota-para-receber-o-JPyKotaGUI/?pagina=5 https://sourceforge.net/projects/jpykotagui-freebsd/ -- Project to be a GUI for the print control software PyKota... -
20
BrowserServices
Provide browser services such as downloading to Python programs.
Provide browser services such as downloading files using the Python webbrowser library and specially constructed URLs. The webRequest api from Web Extensions is used to generate an onErrorOccurred event in a background script. The script then reads the URL and extracts on or more download requests encoded in the URL. It then does the requests. Two types of download services are provided; conventional and masked. A masked download is done by first doing a normal page request and then, after... -
21
OSRFramework
OSRFramework, the Open Sources Research Framework is a AGPLv3+ project
OSRFramework is a GNU AGPLv3+ set of libraries developed by i3visio to perform Open Source Intelligence collection tasks. They include references to a bunch of different applications related to username checking, DNS lookups, information leaks research, deep web search, regular expressions extraction and many others. At the same time, by means of ad-hoc Maltego transforms, OSRFramework provides a way of making these queries graphically as well as several interfaces to interact with like... -
22
Bots open source edi translator
Bots is a complete translator for edi: edifact, x12, xml, tradacoms
Bots is a complete translator for edi (Electronic Data Interchange). EDI data formats eg: edifact, x12, tradacoms, xml. Mail: http://groups.google.com/group/botsmail Web-site: http://bots.sourceforge.net Wiki: http://bots.readthedocs.io Develop: https://github.com/eppye-bots/bots -
23
Twitter Intelligence
Twitter Intelligence OSINT project performs tracking and analysis
A project written in Python for Twitter tracking and analysis without using Twitter API. This project is a Python 3.x application. The package dependencies are in the file requirements.txt. Run that command to install the dependencies. SQLite is used as the database. Tweet data is stored on the Tweet, User, Location, Hashtag, HashtagTweet tables. The database is created automatically. analysis.py performs analysis processing. User, hashtag, and location analyzes are performed. You must write... -
24
CloverDX
Design, automate, operate and publish data pipelines at scale
.... Simple data manipulation jobs can be created visually. More complex business logic can be implemented using Clover's domain-specific-language CTL, in Java or languages like Python or JavaScript. Through its DataServices functionality, it allows to quickly turn data pipelines into REST API endpoints. The platform allows to easily scale your data job across multiple cores or nodes/machines. Supports Docker/Kubernetes deployments and offers AWS/Azure images in their respective marketplace -
25
Mobile Cursor
No need to install from your phone. It uses browser as a controller.
Control your mouse cursor from your phone, and you only need your web browser! No additional app required.
