Links

Landing zone for all things..loosley categorized!

API Tools

Artificial Intelligence / Machine Learning

Agenic AI

  • AI Agent RnD : Research page on AI Agenets
  • Langroid : An intuitive, lightweight, extensible and principled Python framework to easily build LLM-powered applications
  • monoid : Build AI Agents directly on top of your APIs
  • Open Agents

General

  • AIPRM : ChatGPT prompt management
  • Haystack : End-to-end framework that enables you to build powerful and production-ready pipelines for different search use cases
  • HuggingFace : My profile on HuggingFace
  • MidJourney : Incredible AI generated art
  • Poe : multi ChatBot interface
  • SudoLang : LLM modeling language
  • fabric : open-source framework for augmenting humans using AI
  • n8n.io Automation software
  • axolotl : LLM fine-tuning
  • deepmark : Enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data
  • LM Studio : Excellent LLM IDE/Workbench. Integrates with HuggingFace. Provides API
  • ollama : A toolkit for working with LLMs. Bindings for python on js.
  • OWASP LLM Top 10. Top vulnerability for LLMs. 2025 report.

AI Cyber Security

  • Arsenal : CALDERA plugin for adversary emulation of AI-enabled systems
  • MITRE Atlas Data : Datasets and code from MITRE Atlas Project

Asset Management

  • OSQuery : a SQL powered operating system instrumentation, monitoring, and analytics framework.

Authentication

  • Auth0 : Best in class Authentication as a service. Great value!
  • jwt.io : Fantastic JWT inspector
  • jwt builder : Webbased tool for constucting custom JWTs. Great for learning.
  • JWT Inspector : Chrome Plugin to Harvest and inspect JWT

Block Chain

Cloud

  • Cartography : Cartography is a Python tool that consolidates infrastructure assets and the relationships between them in an intuitive graph view powered by a Neo4j database.
  • Cascade: Key/Value API for data manipulation in distributed memory and persistent storage. Very fast. C++
  • CloudCraft : Visualize your cloud infra automatically via introspection. AWS, GCP, Azure, more
  • LocalStack : Fully functional cloud stack (AWS)
  • minio : A High Performance Object Storage for Cloud Storage and Kubernetes
  • rclone : Clone data from Cloud Storage X to Cloud Storage Y. Supports Google GCS, AWS S3, Azure, and more!
  • Cloudflare R2 : Object storage for all your data
  • FluxCloud : Web3 compute and storage

Cloud Filesystems

  • s3ql : A full featured file system for online data storage. Backed by S3, GCP, Azure… Supports end to end encyption and may other features
  • SeaweedFS : SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files!

Google Cloud Platform

Google Cloud Public Certs

Console Tools

Google Cloud Forum

Google Issue Trackers

Coding

Diff Tools

  • Meld : Meld Diff Tool

Go Tools

VSCode & Extensions

  • VSCode : Fantastic, portable, and fast IDE – supports most languages.
  • Tab Groups : Save open tabs as a group

Code Signing

Coding Support

CI/CD

Packer

  • Packer Documentation : Packer lets you create identical machine images for multiple platforms from a single source configuration

Collaboration

  • Miro: Amazing whiteboarding and collaboration tool
  • Whimsical : Excellent graphical diagramming tool, rivals visio, insanely collaborative

Communications

  • Riot : Open-source chat, video, filesharing
  • Matrix : An open-source standard for communications

Cryptography

Cybersecurity

Continuous Attack Surface Management (CASM)

  • Axionius: Connects to hundreds of data sources; comprehensive inventory, uncovers gaps, and triggers automated response actions whenever devices, users, and SaaS apps deviate from policies, controls, and expectations.
  • JupyterOne : A centralized view of your cyber assets; Cyber Asset Attack Surface Management, Cloud Security Posture, Security Operations, and Compliance.

Cyber Intel

Cyber Operations

General

Malware

  • FAME : FAME Automates Malware Evaluation

Security Information Event Monitoring (SIEM)

  • Arkime : Large scale, open source, indexed packet capture and search syste. Verizon-created
  • Armis : Network and asset visibility and monitoring
  • ExtraHop : Security SaaS with a very nice interface
  • Gravwell : Impressive and massivley scalable SEIM with powerful DSL
  • Devo : Cyber Platform
  • Grafana with InfluxDB Docker : Quick stack for monitoring and testing
  • Hive : A scalable, open source and free Security Incident Response Platform
  • JupiterOne : Identify, map, analyze
  • Net Witness : Netwitness XDR ans SIEM
  • Sagan: Log Analysis Engine
  • Scribl : A Splunk historical index export tool
  • SIGMA : Generic Signature Format for SIEM Systems
  • Sigma Rule Converter : Convert Sigma Rules to various detection pipelines
  • Splunk : Best in class SIEM
  • Phantom Community Playbooks : Splunk SOAR Playbooks. Good source of inspiration even if you can’t afford Splunk

Threat Emulation

  • Caldera : MITRE Threat Emulation Platform
  • Scythe: Emulates real-worl adversarial campaigns. Commercial product.
  • PurpleSharp: adversary simulation tool that executes adversary techniques with the purpose of generating attack telemetry in monitored Windows environments

Vulnerability Testing / Pentesting Practice

Data Engineering

  • Airbyte : Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes. Open source and SaaS. 300+ input and output connectors
  • AirFlow : Programmatically author, schedule and monitor workflows
  • Beam : Open source, unified model for defining both batch and streaming data-parallel processing pipelines
  • chdb : chDB is an embedded OLAP SQL Engine 🚀 powered by ClickHouse. Supports many backend and file formats.
  • Cribl: Cribl Stream is an observability and data streaming platform for real-time processing of logs, metrics, traces, and data
  • croc : File xfer all the things peer to peer
  • cube : A powerful middleware between your data source and your data application. Handles modeling, security, cache, API
  • dagster: Orchestrator that’s designed for developing and maintaining data assets, such as tables, data sets, machine learning models, and reports
  • DB Fiddle : Database Fiddle and prototyping
  • DataGrip : SQL + more client
  • datastation : open-source data IDE for developers. Front end for dsq.
  • dsq : Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.
  • duckdb : Exceptional in-process SQL OLAP database management system. SQL on many backends
  • octosq : CLI tool which lets you query a plethora of databases and file formats using SQL through a unified interface, even do JOINs between them
  • EverSQL : AI-based system to optimize database queries
  • Flowable : Light-weight business process engine written in Java
  • Gaffer : Gaffer is a graph database framework
  • GigaSheet : Mass tables and pivots as a service
  • Apache Nifi : Powerful and scalable directed graphs of data routing, transformation, and system mediation logic
  • orchest : Sweet data pipeline and jupyter notebook tool
  • pgAdmin : Capable, mature and free* Postgres Client
  • Polarity : Fuses disparate data, tools, and knowledge into one unified view
  • Steampipe : Dynamically query APIs, code and more with SQL. Zero-ETL from 140 data sources. Another SQL all the stuff.
  • Spring Cloud Data Flow : A microservices-based toolkit for building streaming and batch data processing pipelines in Cloud Foundry and Kubernetes
  • DeltaLake : Provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing on top of existing data lakes, such as S3, ADLS, GCS, and HDFS.
  • delight : A free, amazing Spark UI from DataMechanics
  • Querybuilder : Query Builder is a javascript library for building SQL
  • rql: RQL is a resource query language for REST (written in go). It provides a simple and light-weight API for adding dynamic querying capabilities to web-applications that use SQL-based database
  • milvus : Vector database built for scalable similarity search
  • planetscale : Serveless MySQL. Generous free tier
  • Sleeper : Sleeper is a serverless, cloud-native, log-structured merge tree based, scalable key-value store.

Data Systems

Data Models

  • brim : A novel data lake based on super-structured data

Databases

  • Database of databases : fantastic taxonomy of database management systems
  • GUN : Distributed Graph database. Technically, GUN is a graph synchronization protocol with a lightweight embedded engine, capable of doing 20M+ API ops/sec in just ~9KB gzipped size.

Data Lakes

  • zed : Zed offers a new approach to data that makes it easier to manipulate and manage your data.

Data Sources

Documentation / Doc Management

  • Pandoc : Very capable document translator. Markdown to pdf and more.
  • Joplin : Joplin Notetaking SaaS. Markdown / opensource / Latex.
  • Notion : Notion team collaboration and documentation
  • Obsidian : Powerful markdown based second brain.

Email Tools

GPU & GPU Programmming

Hosting

  • CoLoco : Coloco colacation services (USA)
  • Equinix : Cloud Infrastructure Provider. Best in Class
  • OVH : Cloud Infrastructure Provider. Best in Class
  • Vultr : Instantly deploy High Performance Cloud Servers, Cloud GPUs, Bare Metal, and Cloud Storage worldwide.

Infrastructure as Code

  • BrainBoard : Create Terraform from CloudAPI
  • pulumi : Build infrastructure intuitively on any cloud using familiar languages

Infrastructure as Service

  • runpod.io : Globally distributed GPU containers. Pay as you go.
  • fly.io : Deploy containers anywhere in the world. K8s IaaS
  • LimaCharlie : Security Infrastructure as a Service. Handles collection, streaming analytics, and moving data

Interplanetary File System (IPFS)

Kubernetes

Autoscaling

General

K8s Management as a Service

  • plural.sh : Deploy, secure, and scale open-source applications on your cloud in minutes. Slick interface

Rancher Kubernetes Engine

Languages, Parsers, and Translators

*elvish: Powerful scripting language & versatile interactive shell written in go

  • grule: go-based rule engine
  • gval : Go-based evaluator pkg. Gval can evaluate expressions with parameters, arimethetic, logical, and string operations
  • tengo : an embedding script language for Go. Usecases: rule engine, state management, CI/CD.

Linux Essential

Malware

Networking

  • bird : BIRD Internet Routing Daemon. A dynamic router that works across Internet
  • brightdata : Award-winning proxy networks, AI-powered web scrapers, and business-ready datasets for download. The internet’s most trusted web data platform.
  • openziti : open source ZeroTrust overlay network
  • sniffer : Analyze which processes are generating what traffic
  • wiregasm : Wireshark in the browser. See demo
  • iodine : ip4 tunneling over DNS
  • netcat : Networking Swiss army knife
  • tailscale : Mesh netowork VPN SaaS
  • wireguard : Simple, fast, secure VPN
  • Twingate : Twingate secure remote network bridge. Like a VPN.
  • Mullvad : Mullvad VPN service. Cheap with support for Wireguard and OpenVPN

DNS Discovery

  • Cloudmare : Cloudmare is a simple tool to find the origin servers of websites protected by Cloudflare, Sucuri, or Incapsula with a misconfiguration DNS.

DNS Firewall

DNS IP Resolvers:

Proxies

  • gost : Simple proxy written in go. Essential

Network Analysis

  • APackets : Online pcap file analyzer
  • CloudShark : Cloud-based Wireshark
  • Cloud-PCAP : A cloudshark clone (github)
  • PacketTotal : Simple, free, high-quality PCAP analysis
  • Shodan : Powerful IoC, IoT, crawler, search engine
  • tcpdump : Home web site of tcpdump, a powerful command-line packet analyzer; and libpcap, a portable C/C++ library for network traffic capture.
  • Teleseer : Best-in-class network visualization and analysis
  • kismet : Kismet is a sniffer, WIDS, and wardriving tool for Wi-Fi, Bluetooth, Zigbee, RF, and more, which runs on Linux and macOS
  • PacketStreamer : Distributed tcpdump

Network Security

  • CloudFlare : Fantastic batteries-included network as-a-service. DNS, WAF, Bot Detection, Firewall and more. Massive free capabiliies.
  • Malcom : Malcolm is a powerful, easily deployable network traffic analysis tool suite for full packet capture artifacts (PCAP files), Zeek logs and Suricata alerts.
  • OpenSnitch : Free opensource selfhosted outbound application firewall made for Linux
  • pfSense : Leading opensource firewall
  • RockNSM : opensource security stack
  • Selks : Turn-key Suricata-based IDS/NSM and Threat Hunting System

Operating Systems

OSINT / Enrichment

Pentest

  • Hak5 : Incredible HW and USB based devices for pentesting
  • hcxdumptool “ Command line tool to collect data from and pentest wifi networks

Packet Capture

  • cloud-probe : A Software Probe for network packet capturing and forwarding in Cloud/Kubernetes and Virtualized environment
  • etl2pcapng : Utility that converts an .etl file containing a Windows network packet capture into .pcapng format.
  • hcxdumptool “ Command line tool to collect data from and pentest wifi networks
  • PcaketStreamer : Distributed tcpdump for cloud native environments
  • PCAPdriod : No-root network monitor, firewall and PCAP dumper for Android
  • rvi_capture : Capture packets sents via ios devices
  • WirePenguin : Packet Sniffer in golang

Privacy

  • Invidious : an open source alternative front-end to YouTube.

Office Productivity

  • EtherPad : An open source alternative to Google Docs
  • Grist : An open source alternative to Google Sheets
  • LibreOffice : An open-source alternative to MS Orffice. Has an unsupported online version
  • OwnCloud : an open source alternative for Google Drive

Publications

Robotics

Simulation

Software Development

IDEs

  • Retool : Interesting tool builder for fast custom UIs on data lakes

GraphQL

  • graphqlEditor : Nice graphql editor SaaS platform; good for collaboration
  • graphJin : Create graphql from REST APIs
  • Hasura : Phenom GraphQL GW tool with many features

PlantUML

Testing

  • artillery.io : Cloud-scale performance testing
  • k6.io : Exceptional load testing framework.

Training

Video/Audio Tools

Virtualization

Visualization

  • d3js : Phenom js graphic and diagraming library
  • gephi: Network graph visualization application
  • GraphViz : Open source visualization framework in code
  • yEd Live : Another fantastic diagramming tool. Online and desktop versions.

Web Assembly

Web3

  • ARWeave : The first protocol that enables permanent data storage. Its design allows anyone to preserve data forever with just a single, one-time fee.
  • FluxCloud : Decentralized, distributed compute and storage. Affordable!
  • GagaNode : Gaga Node is a decentralized residential IP + Bandwidth marketplace
  • Meson Network: the foundation of data transmission for decentralized storage, computation, and the emerging Web3 Dapp ecosystem
  • FileCoin : A Web3 distributed filesystem and related ecosystem. Linked to crypto currency economics

Window Essential

  • CygWin: Linux like environment on Windows
  • MobaXterm : Enhanced terminal for Windows with X11 server, tabbed SSH client, network tools and much more
  • WSL : Windows Subsystem for Linux

Workflow Automation / Management

  • Hunchly: Automatically collects, documents, and annotates every web page you visit.
  • WalkOFF: Automatically gather data, analyze data, or visualize data customized to your requirements.
  • Airflow : Fantastic workflow/service automation orchestrator
  • Argo : Workflow execution engine for Kubernetes.
  • Node-Red : A browser-based flow editor that makes it easy to wire together flows using the wide range of nodes in the palette
  • ReactFlow : A highly customizable React component for building node-based editors and interactive diagrams
  • Snakemake : Python workflow management system to create reproducible and scalable data analyses.
  • Concorse : an open-source continuous thing-doer.
  • control-tower : Self-healing IaaS for Concorse
  • Navattic : Clone a website and build a stand alone demo. DOM in a box