aws-pdf-textract-pipeline
:mag: Data pipeline for crawling PDFs from the Web and transforming their conten
TypeScript147mit
4 months ago
awsaws-cdkaws-textract
awesome-pipeline
A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
5836
2 months ago
awesome-listworkflow
ios-twitter-image-pipeline
Twitter Image Pipeline is a robust and performant image loading and caching fram
C1852apache-2.0
3 months ago
cacheimage-pipelineios
aws-codepipeline-plugin-for-jenkins
Use this plugin to integrate your Jenkins project with a pipeline in AWS CodePip
Java83apache-2.0
6 months ago
aws-codepipeline-s3-codedeploy-linux
Use this sample when creating a simple pipeline in AWS CodePipeline while follow
HTML154apache-2.0
6 months ago
dynamic_robot_localization
Point cloud registration pipeline for robot localization and 3D perception
C++753bsd-3-clause
6 months ago
3d-perceptionicplidar
BlenderProc
A procedural Blender pipeline for photorealistic training image generation
Python2560gpl-3.0
24 days ago
3d-engines3d-front-dataset3d-graphics
image_pipeline
An image processing pipeline for ROS.
C++754other
7 days ago
c-plus-plusimage-processingpython
mongo-connector
MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Python1873apache-2.0
last month
aws-codepipeline-jenkins-aws-codedeploy_linux
Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo
Ruby48apache-2.0
11 months ago
scispacy
A full spaCy pipeline and models for scientific/biomedical documents.
Python1617apache-2.0
last month
bioinformaticsbiomedicalcustom-pipes
broccoli
Browser compilation library β an asset pipeline for applications that run in the
JavaScript3330mit
15 days ago
bacannot
Generic but comprehensive pipeline for prokaryotic genome annotation and interro
Nextflow88gpl-3.0
2 months ago
annotationantimicrobial-genes-annotationbarrnap
lineapy
Move fast from data science prototype to pipeline. Capture, analyze, and transfo
Jupyter Notebook641apache-2.0
9 months ago
drake
An R-focused pipeline toolkit for reproducibility and high-performance computing
R1330gpl-3.0
7 months ago
data-sciencedrakehigh-performance-computing
PhotoSauce
MagicScaler high-performance, high-quality image processing pipeline for .NET
C#514mit
4 months ago
csharpdotnetimage-processing
vector
A high-performance observability data pipeline.
Rust15644mpl-2.0
2 months ago
eventsforwarderlogs
ngs-preprocess
A pipeline for preprocessing NGS data from Illumina, Nanopore and PacBio technol
Nextflow23gpl-3.0
3 months ago
bax2bambioinformaticsillumina
Multilingual-Latent-Dirichlet-Allocation-LDA
A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Remova
Python79mit
3 months ago
clusteringenglishfrench
bactopia
A flexible pipeline for complete analysis of bacterial genomes
Nextflow334mit
2 months ago
bacterial-genomesbiocondaconda
bridgetown-lit-renderer
Simple pipeline for SSR + hydration of Lit components.
Ruby13mit
11 months ago
bridgetownbridgetown-pluginlit-element
cyclone
Powerful workflow engine and end-to-end pipeline solutions implemented with nati
Go1061apache-2.0
7 months ago
ai-pipelineci-cdcontinuous-delivery
deepvariant
DeepVariant is an analysis pipeline that uses a deep neural network to call gene
Python3034bsd-3-clause
3 months ago
bioinformaticsdeep-learningdeep-neural-network
vdp
π§ Instill VDP (Versatile Data Pipeline) is an open-source tool to seamlessly in
Makefile1451other
4 months ago
aiapicli
pyslam
pySLAM contains a monocular Visual Odometry (VO) pipeline in Python. It supports
Python1705gpl-3.0
3 months ago
NexClipper
Metrics Pipeline for interoperability and Enterprise Prometheus
Go563apache-2.0
last year
cloud-nativecncfcontainer
react-rails
Integrate React.js with Rails views and controllers, the asset pipeline, or webp
JavaScript6704apache-2.0
3 months ago
jsxrailsreact
gulp-debug
Debug Vinyl file streams to see what files are run through your Gulp pipeline
JavaScript221mit
6 months ago
debuggulp-pluginjavascript
tinymce-rails
Integration of TinyMCE with the Rails asset pipeline
JavaScript814mit
3 months ago
railsrubytinymce
upgini
Data search & enrichment library for Machine Learning β Easily find and add rele
Python261bsd-3-clause
4 months ago
automated-feature-engineeringautomlautoml-pipeline
k6-example-azure-pipelines
How to run k6 load tests as part of a Azure Pipelines build
JavaScript18apache-2.0
5 months ago
azure-pipelinescdci
github-actions
This repository contains github actions for usage in our build pipeline.
JavaScript6other
16 days ago
substation
Substation is a cloud-native, event-driven data pipeline toolkit built for secur
Go261mit
2 months ago
awsdata-engineeringdata-processing
angular-rails-templates
Use your angular templates with rails' asset pipeline
Ruby565mit
6 months ago
angularangular-rails-templatesangular-template
slog-multi
π¨ Design workflows of slog handlers: pipeline, middleware, fanout, routing, fai
Go218mit
4 months ago
attributeerrorerrors
machine
Machine is a workflow/pipeline library for processing data
Go142mit
3 months ago
codespacesgithub-actionsgolang
mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apach
Python2043mit
5 months ago
datadata-integrationetl
jenkinsfile-runner-github-actions
Jenkins single-shot pipeline execution in a GitHub Action POC
Shell199apache-2.0
last month
github-actionshacktoberfestjenkins
aws-codepipeline-custom-job-worker
Use this sample to help you develop your own job worker when creating a custom a
Java33other
7 months ago
aws-delivlib
setup and manage continuous delivery pipelines for code libraries in multiple la
TypeScript361apache-2.0
4 months ago
rnaseq_tutorial
Informatics for RNA-seq: A web resource for analysis on the cloud. Educational t
R1299other
11 months ago
rust-subprocess
Execution of and interaction with external processes and pipelines
Rust408apache-2.0
12 months ago
pluggable
Elixir library to build Plug-like pipelines
Elixir13apache-2.0
2 months ago
elixirpipelineplug
draftjs_exporter
Convert Draft.js ContentState to HTML
Python80mit
4 months ago
draft-jsdraftaildraftjs-exporter
vast
Easy data pipelines for security teams.
C++500bsd-3-clause
11 months ago
actor-modelbitmap-indexdataops
gaia
Build powerful pipelines in any programming language.
Go5151apache-2.0
9 months ago
automationbuildcontinuous-delivery
haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM ap
Python13059apache-2.0
2 months ago
aibertchatgpt
tpot
A Python Automated Machine Learning tool that optimizes machine learning pipelin
Python9429lgpl-3.0
3 months ago
adspag066833aiml
rockpool
A machine learning library for spiking neural networks. Supports training with b
Python39agpl-3.0
4 months ago
deploymentjaxmachine-learning
redix
Fast, pipelined, resilient Redis driver for Elixir. π
Elixir1058mit
2 months ago
elixirelixir-libraryredis
Mediator.Net
A simple mediator for .Net for sending command, publishing event and request res
C#349apache-2.0
6 months ago
buscqrscsharp
nextflow
A DSL for data-driven computational pipelines
Groovy2539apache-2.0
13 days ago
awsbioinformaticscloud
orchest
Build data pipelines, the easy way π οΈ
TypeScript3875apache-2.0
11 months ago
airflowclouddag
pipelight
Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Li
Rust198gpl-2.0
5 months ago
automationbashcicd
ploomber
The fastest β‘οΈ way to build data pipelines. Develop iteratively, deploy anywhere
Python3334apache-2.0
3 months ago
data-engineeringdata-sciencejupyter
scipipe
Robust, flexible and resource-efficient pipelines using Go and the commandline
Go1048mit
10 months ago
bioinformaticsbioinformatics-pipelinecheminformatics
spikeinterface
A Python-based module for creating flexible and robust spike sorting pipelines.
Python413mit
6 days ago
electrophysiologyneurosciencespike-sorting
luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. I
Python17120apache-2.0
3 months ago
hadoopluigiorchestration-framework
tenzir
Open source security data pipelines.
C++612bsd-3-clause
2 days ago
dataopsincident-responseinvestigation
mleap
MLeap: Deploy ML Pipelines to Production
Scala1494apache-2.0
6 months ago
data-pipelinespythonscala
couler
Unified Interface for Constructing and Managing Workflows on different workflow
Python874apache-2.0
3 months ago
apache-airflowargo-workflowscloud-native
hamilton
Your single tool to express data, ML, and LLM pipelines with simple python funct
Jupyter Notebook1063bsd-3-clause-clear
5 months ago
dagdata-analysisdata-engineering
laminas-stratigility
PSR-7 middleware foundation for building and dispatching middleware pipelines
PHP54bsd-3-clause
2 months ago
middlewarepsr-7
open-metric-learning
Library for metric learning pipelines and models.
Jupyter Notebook737apache-2.0
3 months ago
computer-visiondata-sciencedeep-learning
prefect
Prefect is a workflow orchestration tool empowering developers to build, observe
Python13490apache-2.0
5 months ago
automationdatadata-engineering
kedro
Kedro is a toolbox for production-ready data science. It uses software engineeri
Python9073apache-2.0
4 months ago
experiment-trackinghacktoberfestkedro
towhee
Towhee is a framework that is dedicated to making neural data processing pipelin
Python2906apache-2.0
5 months ago
computer-visionconvolutional-networksembedding-vectors
Neuraxle
The world's cleanest AutoML library β¨ - Do hyperparameter tuning with the right
Python595apache-2.0
last year
deep-learningframeworkhyperparameter-optimization
AWSCodePipeline-Jenkins-AWSCodeDeploy_Windows
Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo
Ruby13apache-2.0
4 years ago
Pipeline-Performance-Monitor
Simple solution for measuring the duration of Sitecore pipeline execution
C#4apache-2.0
10 years ago
GTFS-Data-Pipeline-TfNSW-Bus
GTFS Data Pipeline for TfNSW Bus Datasets
Jupyter Notebook7
2 years ago
data-pipelinedatapipelinegtfs
AWSCodePipeline-S3-AWSCodeDeploy_Windows
Use this sample when creating a simple pipeline in AWS CodePipeline while follow
HTML9apache-2.0
6 years ago
cra-pipeline
Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.
TypeScript42mit
4 years ago
aws-cdkaws-codepipelinecra
ember-pipeline
Railway oriented programming in Ember
JavaScript17mit
6 years ago
emberember-addonexperimental
helix-publishing-pipeline
Unified publishing for Sitecore Helix solutions that extends existing Visual Stu
PowerShell68mit
3 years ago
lambdacd
a library to define a continuous delivery pipeline in code
Clojure671apache-2.0
last year
build-pipelinescdci
insider
Static Application Security Testing (SAST) engine focused on covering the OWASP
Go487mit
2 years ago
androidandroid-securitycli
GlobalExceptionHandlerDotNet
Exception handling as a convention in the ASP.NET Core request pipeline
C#269mit
last year
net-corewebapi
p-pipe
Compose promise-returning & async functions into a reusable pipeline
TypeScript118mit
3 years ago
collective.transmogrifier
A configurable pipeline, aimed at transforming content for import and export
Python5other
last year
sitecore-processor-dependency-injection
π A simple project to demonstrate dependency injection in @Sitecore pipeline pr
C#0
4 years ago
dependency-injectionsitecore
Knapsack
Collection pipeline library for PHP
PHP537mit
2 years ago
collectioncollection-pipelinecollections
ngx-filter-pipe
π© Angular 5+ pipeline for array filtering.
TypeScript142mit
last year
angular-2array-filterfilter
datajob
Build and deploy a serverless data pipeline on AWS with no effort.
Python107apache-2.0
last year
awsaws-cdkdata-pipeline
java-meme-generator-sample
Sample code for a java application that uses Elastic Beanstalk, S3, DynamoDB, an
Java55apache-2.0
6 years ago
jmeter-aci-terraform
Scalable cloud load/stress testing pipeline solution with Apache JMeter and Terr
HCL119mit
2 years ago
azureazure-containerazure-container-instances
cookbook
Cookbook for Node on FHIR and the clinical Meteor.js build pipeline. Create FDA
Shell1674
2 years ago
es6_module_transpiler-rails
Transpile ES6 Modules in the Rails Asset Pipeline
JavaScript87mit
9 years ago
surging
Surging is a micro-service engine that provides a lightweight, high-performance,
C#3210mit
last year
apigatewayapolloconsul
open-covid-19-data
Open source aggregation pipeline for public COVID-19 data, including hospitaliza
Python116apache-2.0
3 years ago
LaubPlusCo.Common.ContentSearch
Common extensions to Sitecore contentSearch. Hereunder PopulateSolrSchema pipeli
0
5 years ago
contentsearchsitecoresitecore9
dna-transcription-kata
Bioinformatics-themed kata for practicing string manipulation in a data transfor
8mit
2 years ago
bioinformaticsbiologychallenge
nigiri-travis
Travis template for adding π£ Nigiri Bitcoin to your CI pipeline.
Shell2mit
2 years ago
AudioTK
An audio digital processing toolbox based on a workflow/pipeline principle
C++248bsd-3-clause
3 years ago
sitecore-organize-insert-options-rules
β A pipeline processor to organize Insert Options Rules in @Sitecore's content t
C#1
4 years ago
sitecoresitecore-helix
sitecore-web-api-session
β± Sitecore pipeline processor and extensions to the HttpRouteCollection to enabl
C#0
2 years ago
sitecoreweb-api-2
PipelinR
PipelinR is a lightweight command processing pipeline β β’ β β’ β for your Java aw
Java365mit
last year
androidarchitecturecqrs
ember-cli-deploy
A deployment pipeline for Ember CLI apps
JavaScript562mit
last year
ember-cliember-cli-deploy
Kata-Clean-Machine-Learning-From-Dirty-Code
A coding exercise: let's convert dirty machine learning code into clean code usi
Jupyter Notebook14apache-2.0
2 years ago
ecs-refarch-continuous-deployment
ECS Reference Architecture for creating a flexible and scalable deployment pipel
Shell843apache-2.0
last year
awscontinuous-deploymentdevops
logstash-input-dynamodb
This input plugin for Logstash scans a specified DynamoDB table and then reads c
Ruby105apache-2.0
2 years ago
resty
Little command line REST client that you can use in pipelines (bash or zsh).
Shell2646mit
last year
SPQR
Spooker is a dynamic framework for processing high volume data streams via proce
Java29apache-2.0
8 years ago
sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
Scala525apache-2.0
5 years ago
analyticshdfskafka
scrapy-mongodb
MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone set
Python355other
3 years ago
prodmodel
Build, test, deploy, iterate - Dev and prod tool for data science pipelines
Python55other
2 years ago
build-automationbuild-systembuild-tool
ruffus
CGAT-ruffus is a lightweight python module for running computational pipelines
Python171mit
3 years ago
ramda-cli
:ram: A CLI tool for processing data with functional pipelines
LiveScript571isc
last year
clijsonlivescript
go-command-chain
A go library for easy configure and run command chains. Such like pipelining in
Go57mit
last year
commandgogolang
composable_operations
Composable Operations is a tool set for creating operations and assembling multi
Ruby48mit
8 years ago
FluentMediator
:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows
C#187apache-2.0
4 years ago
chain-methodschain-of-responsibilitycraftmanship
Streams
A lightweight F#/C# library for efficient functional-style pipelines on streams
F#382other
4 years ago
mongo-go-pagination
Golang Mongodb Pagination for official mongodb/mongo-go-driver package which sup
Go128mit
last year
aggregateaggregationdatabase