Download Latest Version endpoint-rule-set-1.json.gz (1.3 kB)
Email in envelope

Get an email when there's a new version of aws

Home / ShadowClone / env / lib / python3.8 / site-packages
Name Modified Size InfoDownloads / Week
Parent folder
matplotlib 2023-09-02
markdown_it 2023-09-02
lxml 2023-09-02
lithops 2023-09-02
keyring 2023-09-02
kiwisolver 2023-09-02
kubernetes 2023-09-02
jmespath 2023-09-02
jwt 2023-09-02
jeepney 2023-09-02
jaraco 2023-09-02
jedi 2023-09-02
invoke 2023-09-02
importlib_metadata 2023-09-02
importlib_resources 2023-09-02
ibm_vpc 2023-09-02
idna 2023-09-02
ibm_s3transfer 2023-09-02
ibm_cloud_sdk_core 2023-09-02
ibm_botocore 2023-09-02
ibm_boto3 2023-09-02
html5lib 2023-09-02
google 2023-09-02
executing 2023-09-02
fontTools 2023-09-02
docutils 2023-09-02
dateutil 2023-09-02
deprecated 2023-09-02
docker 2023-09-02
cryptography 2023-09-02
colorama 2023-09-02
colorama-0.4.6.dist-info 2023-09-02
contourpy 2023-09-02
click 2023-09-02
cloudpickle 2023-09-02
cffi 2023-09-02
charset_normalizer 2023-09-02
cachetools 2023-09-02
certifi 2023-09-02
botocore 2023-09-02
_yaml 2023-09-02
asttokens 2023-09-02
async_timeout 2023-09-02
backcall 2023-09-02
bcrypt 2023-09-02
bleach 2023-09-02
boto3 2023-09-02
PIL 2023-09-02
IPython 2023-09-02
jedi-0.19.0.dist-info 2023-09-02
jeepney-0.8.0.dist-info 2023-09-02
jmespath-1.0.1.dist-info 2023-09-02
keyring-24.2.0.dist-info 2023-09-02
kiwisolver-1.4.4.dist-info 2023-09-02
kubernetes-27.2.0.dist-info 2023-09-02
lithops-2.8.0.dist-info 2023-09-02
lxml-4.9.3.dist-info 2023-09-02
markdown_it_py-3.0.0.dist-info 2023-09-02
matplotlib-3.7.2.dist-info 2023-09-02
matplotlib_inline 2023-09-02
matplotlib_inline-0.1.6.dist-info 2023-09-02
mdurl 2023-09-02
mdurl-0.1.2.dist-info 2023-09-02
mechanize 2023-09-02
mechanize-0.4.8.dist-info 2023-09-02
more_itertools 2023-09-02
more_itertools-10.1.0.dist-info 2023-09-02
mpl_toolkits 2023-09-02
nacl 2023-09-02
numpy 2023-09-02
numpy-1.24.4.dist-info 2023-09-02
numpy.libs 2023-09-02
oauthlib 2023-09-02
oauthlib-3.2.2.dist-info 2023-09-02
packaging 2023-09-02
packaging-23.1.dist-info 2023-09-02
pandas 2023-09-02
pandas-2.0.3.dist-info 2023-09-02
paramiko 2023-09-02
paramiko-3.3.1.dist-info 2023-09-02
parso 2023-09-02
parso-0.8.3.dist-info 2023-09-02
pexpect 2023-09-02
pexpect-4.8.0.dist-info 2023-09-02
pickleDB-0.9.2.dist-info 2023-09-02
pickleshare-0.7.5.dist-info 2023-09-02
pika 2023-09-02
pika-1.3.2.dist-info 2023-09-02
pip 2023-09-02
pip-20.0.2.dist-info 2023-09-02
pkg_resources 2023-09-02
pkg_resources-0.0.0.dist-info 2023-09-02
pkginfo 2023-09-02
pkginfo-1.9.6.dist-info 2023-09-02
prompt_toolkit 2023-09-02
prompt_toolkit-3.0.39.dist-info 2023-09-02
ps_mem-3.14.dist-info 2023-09-02
ptyprocess 2023-09-02
ptyprocess-0.7.0.dist-info 2023-09-02
pure_eval 2023-09-02
pure_eval-0.2.2.dist-info 2023-09-02
pyasn1 2023-09-02
pyasn1-0.5.0.dist-info 2023-09-02
pyasn1_modules 2023-09-02
pyasn1_modules-0.3.0.dist-info 2023-09-02
pycparser 2023-09-02
pycparser-2.21.dist-info 2023-09-02
pygments 2023-09-02
pyparsing 2023-09-02
pyparsing-3.1.1.dist-info 2023-09-02
python_dateutil-2.8.2.dist-info 2023-09-02
pytz 2023-09-02
pytz-2023.3.dist-info 2023-09-02
readme_renderer 2023-09-02
readme_renderer-41.0.dist-info 2023-09-02
redis 2023-09-02
redis-4.6.0.dist-info 2023-09-02
regex 2023-09-02
regex-2023.8.8.dist-info 2023-09-02
requests 2023-09-02
requests-2.27.1.dist-info 2023-09-02
requests_oauthlib 2023-09-02
requests_oauthlib-1.3.1.dist-info 2023-09-02
requests_toolbelt 2023-09-02
requests_toolbelt-1.0.0.dist-info 2023-09-02
rfc3986 2023-09-02
rfc3986-2.0.0.dist-info 2023-09-02
rich 2023-09-02
rich-13.5.2.dist-info 2023-09-02
rsa 2023-09-02
rsa-4.9.dist-info 2023-09-02
s3transfer 2023-09-02
s3transfer-0.6.1.dist-info 2023-09-02
scipy 2023-09-02
scipy-1.10.1.dist-info 2023-09-02
scipy.libs 2023-09-02
seaborn 2023-09-02
seaborn-0.12.2.dist-info 2023-09-02
secretstorage 2023-09-02
setuptools 2023-09-02
setuptools-44.0.0.dist-info 2023-09-02
six-1.16.0.dist-info 2023-09-02
stack_data 2023-09-02
stack_data-0.6.2.dist-info 2023-09-02
tblib 2023-09-02
tblib-2.0.0.dist-info 2023-09-02
test 2023-09-02
test_integration 2023-09-02
tqdm 2023-09-02
tqdm-4.66.1.dist-info 2023-09-02
traitlets 2023-09-02
traitlets-5.9.0.dist-info 2023-09-02
twine 2023-09-02
twine-4.0.2.dist-info 2023-09-02
typing_extensions-4.7.1.dist-info 2023-09-02
tzdata 2023-09-02
tzdata-2023.3.dist-info 2023-09-02
urllib3 2023-09-02
urllib3-1.26.15.dist-info 2023-09-02
wcwidth 2023-09-02
wcwidth-0.2.6.dist-info 2023-09-02
webencodings 2023-09-02
webencodings-0.5.1.dist-info 2023-09-02
websocket 2023-09-02
websocket_client-1.6.1.dist-info 2023-09-02
wheel 2023-09-02
wheel-0.41.2.dist-info 2023-09-02
wrapt 2023-09-02
wrapt-1.15.0.dist-info 2023-09-02
yaml 2023-09-02
zipp 2023-09-02
zipp-3.16.2.dist-info 2023-09-02
__pycache__ 2023-09-02
argparse-1.4.0.dist-info 2023-09-02
asttokens-2.2.1.dist-info 2023-09-02
async_timeout-4.0.3.dist-info 2023-09-02
backcall-0.2.0.dist-info 2023-09-02
bcrypt-4.0.1.dist-info 2023-09-02
bleach-6.0.0.dist-info 2023-09-02
boto3-1.28.25.dist-info 2023-09-02
botocore-1.31.25.dist-info 2023-09-02
cachetools-5.3.1.dist-info 2023-09-02
certifi-2023.7.22.dist-info 2023-09-02
cffi-1.15.1.dist-info 2023-09-02
charset_normalizer-2.0.12.dist-info 2023-09-02
click-8.1.6.dist-info 2023-09-02
cloudpickle-2.2.1.dist-info 2023-09-02
contourpy-1.1.0.dist-info 2023-09-02
cryptography-41.0.3.dist-info 2023-09-02
cycler-0.11.0.dist-info 2023-09-02
decorator-5.1.1.dist-info 2023-09-02
delegator.py-0.1.1.dist-info 2023-09-02
Deprecated-1.2.14.dist-info 2023-09-02
docker-6.1.3.dist-info 2023-09-02
docutils-0.20.1.dist-info 2023-09-02
executing-1.2.0.dist-info 2023-09-02
fonttools-4.42.0.dist-info 2023-09-02
google_auth-2.22.0.dist-info 2023-09-02
html5lib-1.1.dist-info 2023-09-02
ibm_cloud_sdk_core-3.16.7.dist-info 2023-09-02
ibm_cos_sdk-2.13.1.dist-info 2023-09-02
ibm_cos_sdk_core-2.13.1.dist-info 2023-09-02
ibm_cos_sdk_s3transfer-2.13.1.dist-info 2023-09-02
ibm_vpc-0.18.0.dist-info 2023-09-02
idna-3.4.dist-info 2023-09-02
importlib_metadata-6.8.0.dist-info 2023-09-02
importlib_resources-6.0.1.dist-info 2023-09-02
invoke-2.2.0.dist-info 2023-09-02
ipython-8.12.2.dist-info 2023-09-02
jaraco.classes-3.3.0.dist-info 2023-09-02
Pillow-10.0.0.dist-info 2023-09-02
Pillow.libs 2023-09-02
Pygments-2.16.1.dist-info 2023-09-02
PyJWT-2.8.0.dist-info 2023-09-02
PyNaCl-1.5.0.dist-info 2023-09-02
PyYAML-6.0.1.dist-info 2023-09-02
SecretStorage-3.3.3.dist-info 2023-09-02
argparse.py 2023-08-29 89.2 kB
delegator.py 2023-08-12 8.9 kB
pickledb.py 2023-08-12 8.5 kB
ps_mem.py 2023-08-12 23.8 kB
matplotlib-3.7.2-py3.8-nspkg.pth 2023-08-12 569 Bytes
pylab.py 2023-08-12 90 Bytes
pickleshare.py 2023-08-12 9.9 kB
typing_extensions.py 2023-08-12 111.1 kB
cycler.py 2023-08-12 14.5 kB
decorator.py 2023-08-12 16.8 kB
_cffi_backend.cpython-38-x86_64-linux-gnu.so 2023-08-12 994.9 kB
six.py 2023-08-12 34.5 kB
easy_install.py 2023-08-12 126 Bytes
Totals: 230 Items   1.3 MB 0

ShadowClone

ShadowClone allows you to distribute your long running tasks dynamically across thousands of serverless functions and gives you the results within seconds where it would have taken hours to complete.

You can make full use of the Free Tiers provided by cloud providers and supercharge your mundane cli tools with shadow clone jutsu (Naruto style)!

Installation

Please visit the wiki for installation and intial configuration instructions

Usage

⚡ python shadowclone.py -h
usage: shadowclone.py [-h] -i INPUT [-s SPLITNUM] [-o OUTPUT] -c COMMAND

optional arguments:
  -h, --help            show this help message and exit
  -i INPUT, --input INPUT
  -s SPLITNUM, --split SPLITNUM
                        Number of lines per chunk of file
  -o OUTPUT, --output OUTPUT
  -c COMMAND, --command COMMAND
                        command to execute
  --no-split NOSPLIT    File to be used without splitting

How it works

We create a container image during the initial setup and register it as a runtime for our function in AWS/GCP/Azure whatever. When you execute ShadowClone on your computer, instances of that container are activated automatically and are only active for the duration of its execution. How many instances to activate is dynamically decided at runtime depending on the size of the input file provided and the split factor. The input is then split into chunks and equally distributed between all the instances to execute in parallel. For example, if your input file has 10,000 lines and you set the split factor to 100 lines, then it will be split into 100 chunks of 100 lines each and 100 instances will be run in parallel!

Features

  • Extremely fast
  • No need to maintain a VPS (or a fleet of it :))
  • Costs almost nothing per month
    • Compatible with free tiers of most cloud services
  • Cloud agnostic
    • Same script works with AWS, GCP, Azure etc.
  • Supports upto 1000 parallel invocations
  • Dynamically decide the number of invocations
  • Run any tool in parallel on the cloud
  • Pipe output to other tools

Comparison

This tool was inspired by the awesome Axiom and Fleex projects and goes beyond the concept of VPS for running the tools by using serverless functions and containers.

Features Axiom/Fleex ShadowClone
Instances 10-100s* 1000s
Cost Per instance/per minute Mostly Free**
Startup Time 4-5 minutes 2-3 seconds
Max Execution Time Unlimited 15 minutes
Idle Cost $++ Free
On Demand Scalability No

*Most cloud providers do not allow spinning up too many instances by default, so you are limited to around 10-15 instances at max. You have to make a request to the support to increase this number.

** AWS & Azure allow 1 million invocations per month for free. Google allows 2 million invocations per month for free. You will be charged only if you go above these limits

Demo

DNS Bruteforcing using a 43mb file - 34 seconds

asciicast

Running httpx on 94K subdomains in 1 min

asciicast

References

Lithops documentation

Free Tiers

Cloud Provider Free Allowance Link
Google Functions 2 Million invocations, 400,000 GB-seconds per month Google Cloud Free Program
AWS Lambda 1 Million invocations, Up to 3.2 million seconds of compute time per month Free Cloud Computing Services - AWS Free Tier
Azure Functions 1 Million invocations Microsoft Azure Free Services

Obviously, you can make any number of function invocations per month. The table above only shows how many invocations are free.

Similar Tools

Support

If you like ShadowClone and would like to show some appreciation, send me the bugs you find using this tool ;)

Or you can buy me a coffee :)

Buy Me A Coffee

Disclaimer

This tool is designed as a proof-of-concept implementation and it's usage is intended for educational purpose only. Usage for attacking targets without prior mutual consent is illegal. It's the end user's responsibility to obey all applicable local, state and federal laws. Developers assume no liability and are not responsible for any misuse or damage caused by this program.

Source: README.md, updated 2023-08-10