Search Results for "python web crawler" - Page 5
Sort By:
Showing 228 open source projects for "python web crawler"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
1
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but... -
2
Trigger Happy
Automate the exchanges of the data between applications
Automate the exchanges of the data between the applications and services you use on the web. Make Twitter talk to Mastodon, make Github talk to Mattermost, store your favorite tweets by creating notes in Evernote, follow RSS feeds and post each news in Wallabag, Pocket or Evernote. The possibilities are too numerous to name all of them, but with that project you won't have to raise your little finger at all: automate everything and make your life easier. And last but not least, as this is your... -
3
Bowtie
Create a dashboard with python!
Bowtie is a library for writing dashboards in Python. No need to know web frameworks or JavaScript, focus on building functionality in Python. Interactively explore your data in new ways! Deploy and share with others! Bowtie uses Yarn to manage node packages. If you installed Bowtie through conda, Yarn was also installed as a dependency. Yarn can be installed through conda. An early integration with Jupyter has been prototyped. I encourage you to try it out and share feedback. I hope... -
4
Grab Framework Project
Web Scraping Framework
Grab is a python framework for building web scrapers. With Grab you can build web scrapers of various complexity, from simple 5-line scripts to complex asynchronous website crawlers processing millions of web pages. Grab provides an API for performing network requests and for handling the received content e.g. interacting with DOM tree of the HTML document. The single request/response API that allows you to build network request, perform it and work with the received content. The API is built... -
Your top-rated shield against malware and online scams | Avast Free AntivirusOur antivirus software scans for security and performance issues and helps you to fix them instantly. It also protects you in real time by analyzing unknown files before they reach your desktop PC or laptop — all for free.
-
5
Django Material
Material Design for Django
Material Design for Django. Django web framework solves only technical problems related to the client-server interaction on top of the stateless HTTP protocol. Model-View-Template separation pattern helps to maintain simple CRUD based logic. Viewflow is the library that offers an additional layer of django web framework, allows explicitly specify people's workflow and extracts collaboration logic from django views. Strong python/html code separation. Easy redefinition of particular fields... -
6
A Complete Beginner's Guide to Django
A Complete Beginner's Guide to Django - Code Samples
... be easy to follow, informative and fun to read. That was when I came up with the idea to create some comics along the text to illustrate some concepts and scenarios. I hope you enjoy the reading! Django is a Web framework written in Python. A Web framework is a software that supports the development of dynamic Web sites, applications, and services. It provides a set of tools and functionalities that solves many common problems associated with Web development. -
7
Crow
Crow is very fast and easy to use C++ micro web framework
Crow is C++ microframework for web. (inspired by Python Flask). If you just want to use crow, copy amalgamate/crow_all.h and include it. C++ compiler with good C++11 support (tested with g++>=4.8). Provide an amalgamated header file crow_all.h with every features. Handler arguments type check at compile time. Now supporting VS2013 with limited functionality (only run-time check for url is available.) Out-of-source build with CMake is recommended. -
8
Pootle Django
Online translation tool
Pootle is written in Python using the Django framework and therefore can be installed on any web server that supports serving WSGI applications. Key localization file formats are supported, including Gettext PO, XLIFF, Java .properties, PHP arrays and many more supported by the Translate Toolkit. Ensures the best quality localizations by automatically detecting common errors made by translators. Integrates user suggestions, terminology, Translation Memory, Machine Translation, and more... -
9
REST framework JWT Auth
JSON Web Token Authentication support for Django REST Framework
JSON Web Token Authentication support for Django REST Framework. This package provides JSON Web Token Authentication support for Django REST framework. Unlike some more typical uses of JWTs, this module only generates authentication tokens that will verify the user who is requesting one of your DRF protected API resources. The actual request parameters themselves are not included in the JWT claims which means they are not signed and may be tampered with. You should only expose your API... -
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Flask JSONDash
Build complex dashboards without any front-end code
Build complex dashboards without any front-end code. Use your own endpoints. JSON config only. Ready to go. Easily configurable, chart dashboards from any arbitrary API endpoint. JSON config only. Ready to go. This project is a flask blueprint that allows you to create sleek dashboards without writing any front-end (or backend) code. Everything is powered through simple JSON configurations for declaring arbitrary charts. Leveraging popular libraries like C3.js and D3.js, and much more. Also... -
11
omegalib
Hybrid visualization framework for desktops, large immersive displays
A hybrid visualization framework for desktops, large immersive displays and the web. A framework for virtual reality and cluster-driven display systems. Requires Python (the pre-installed 2.7 version on OSX and most linux distros works fine, on Windows omegalib comes with python bundled so you don't need this). C++ Build tools for your platform (g++, clang/XCode, Visual Studio 2012/2013 depending on the OS). On windows, the free Visual Studio editions work fine. Modules are optional components... -
12
Catberry
Catberry is an isomorphic framework
Catberry is an isomorphic framework for building universal front-end apps using components, Flux architecture and progressive rendering. Catberry builds a bundle for running the application in a browser as a Single Page Application. Cat-Components – similar to web-components but organized as directories, can be rendered on the server and published/installed as NPM packages. The entire architecture of the framework is built using the Service Locator pattern, which helps to manage module... -
13
Note: latest version can be found at https://github.com/targeted/pythomnic3k Pythomnic3k is a Python 3 framework for service-oriented middleware with hot reloading and fault tolerance. It is used for integrating various systems in enterprise network or writing standalone network services.
-
14
SIGAR (System Information Gatherer and Reporter) is a cross-platform, cross-language library and command-line tool for accessing operating system and hardware level information in Java, Perl and .NET.
-
15
Perfect: Server-Side Swift
The Perfect core toolset and framework for Swift Developers
... language: Swift - instead of having multiple languages to contend with, like JavaScript (Node.js), Java, Ruby or Python. Use Apple’s open source Swift programming language throughout your entire development process. Whether you’re building iOS and OS X apps, or backend support for web apps, wearable technologies, and games, you don’t need to learn another programming language when you use Perfect on the server-side. -
16
Quokka
Quokka is a Content Management System - `docker run
Quokka is a Content Management Framework written in Python. A lightweight framework to build CMS (Content Management System) as websites, portals, blogs, applications and anything related to publishing content to the web. Quokka is not limited to CMS area, it is also possible to create Quokka extensions to provide any kind of web application based on Python and Flask. Quokka can also (optionally) generate a static website from the contents generated in its admin interface. Web-based content... -
17
MaeBlok
Rapid web development tool for business applications
You assemble *blocks* in your django template, with each block wired to a tastypie resource, which in turn is mapped to a django model. Each *block* will reside in a dijit ContentPane which you must define in your template. You have a choice of 2 layouts for each *block*, Form or Grid based. Form displays a single record in either a 1, 2 or 3 column layout while Grid displays many rows in a spreadsheet like grid. You can perform edits in place on fields in both layouts. You can... -
18
z9
a simple client-server ERP system
z9 is a simple client-server ERP framework, based on a Python/PyQt modular smartclient and a PHP+SQL RESTful web service, created for the "opificio zeronove" bike shop application. -
19
dotCODES_Source_Control_for_VS
The dotCODES Source Control Maintenance Mainframe (SCM2)
The dotCODES Source Control Maintenance Mainframe for Visual Studio is an administrator console application for developing dotCODES components. Built upon a Python foundation, the program is used to create data center routines (Unix packages) and maintain enterprise cloud services (CGI scripts/Apache) by means of building dotCODES runtimes and deploying them to and from the client server. -
20
Belay Device
Automated Provisioning and Testing Framework
Belay Device has moved! https://github.com/BelayTechnologies/Belay-Device -
21
-
22
TurboGears 1
Python web framework and development toolkit
TurboGears 1 is a Python web framework and development toolkit based on CherryPy as server, Genshi (or Kid) for templating, SQLAlchemy (or SQLObject) as ORM and MochiKit for AJAX and other client side sugar. It also includes a fancy widget library. Note that TurboGears 1 has been superseded by TurboGears 2 and is no longer maintained. -
23
Protein SDK
Web. Desktop. Best of both worlds.
Protein SDK is an easy to learn and adapt python software development kit for excellent GUI desktop applications. You can create a desktop application using python, html, css, javascript or jquery in minutes! The SDK allows you to: - Run python code, on any javascript event. - Render result of python function dynamically - Create HTML User Interfaces, using standard HTML. The SDK is powered by: - Google Chrome apps - Python anywhere - Cherrypy Web Framework Though... -
24
Joe SDK
Web. Desktop. Best of both worlds.
Joe SDK is an easy to learn and adapt python software development kit for excellent GUI desktop applications. You can create a desktop application using python, html, css, javascript or jquery in minutes! The SDK allows you to: - Run python code, on any javascript event. - Render result of python function dynamically - Create HTML User Interfaces, using standard HTML. The SDK is powered by: - Google Chrome apps - Python anywhere - Cherrypy Web Framework Though it is a desktop... -
25
ReArch Database Project
Code Repository for the Recursive Relational Archaeological DBMS
... for analyzing and formally expressing the chains of qualifications and associations that fundamentally characterize excavation contexts, artifact descriptions, geographical information, and the secondary and tertiary materials analyses derived from archaeological materials. ReArch is a stable, portable, and scalable system of open source software components, including PostgreSQL, the Django web framework, GRASS open source GIS, R statistical software, and Python scripting language.
