k6-example-azure-pipelines

k6-example-azure-pipelines

How to run k6 load tests as part of a Azure Pipelines build

JavaScript18apache-2.0

4 months ago

azure-pipelinescdci

mara-pipelines

mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apach

Python2043mit

4 months ago

datadata-integrationetl

Neuraxle

Neuraxle

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right

Python595apache-2.0

12 months ago

deep-learningframeworkhyperparameter-optimization

data-pipeline-samples

data-pipeline-samples

This repository hosts sample pipelines

Python460mit-0

4 years ago

ChEMBL_Structure_Pipeline

ChEMBL database structure pipelines

Python173mit

6 months ago

pipes

Compositional pipelines

Haskell481bsd-3-clause

2 years ago

rnaseq_tutorial

Informatics for RNA-seq: A web resource for analysis on the cloud. Educational t

R1299other

11 months ago

rust-subprocess

Execution of and interaction with external processes and pipelines

Rust408apache-2.0

11 months ago

resty

Little command line REST client that you can use in pipelines (bash or zsh).

Shell2646mit

last year

pluggable

Elixir library to build Plug-like pipelines

Elixir13apache-2.0

last month

elixirpipelineplug

SPQR

SPQR

Spooker is a dynamic framework for processing high volume data streams via proce

Java29apache-2.0

8 years ago

MonadEx

Upgrade your pipelines with monads.

Elixir300mit

2 years ago

conform

Policy enforcement for your pipelines.

Go408mpl-2.0

3 days ago

build-automationdockergo

sparta

sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

Scala525apache-2.0

5 years ago

analyticshdfskafka

vast

vast

Easy data pipelines for security teams.

C++500bsd-3-clause

10 months ago

actor-modelbitmap-indexdataops

gaia

gaia

Build powerful pipelines in any programming language.

Go5151apache-2.0

8 months ago

automationbuildcontinuous-delivery

prodmodel

Build, test, deploy, iterate - Dev and prod tool for data science pipelines

Python55other

2 years ago

build-automationbuild-systembuild-tool

haystack

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM ap

Python13059apache-2.0

last month

aibertchatgpt

tpot

tpot

A Python Automated Machine Learning tool that optimizes machine learning pipelin

Python9429lgpl-3.0

2 months ago

adspag066833aiml

pipeline

Pipelines using goroutines

Go55mit

2 years ago

concurrencygopipeline

factotum

A system to programmatically run data pipelines

Rust215

3 years ago

crondagjob

rockpool

rockpool

A machine learning library for spiking neural networks. Supports training with b

Python39agpl-3.0

3 months ago

deploymentjaxmachine-learning

ModularPipelines

Write your pipelines in C# !

C#88mit

4 months ago

buildbuild-systembuild-tool

ruffus

CGAT-ruffus is a lightweight python module for running computational pipelines

Python171mit

3 years ago

Mediator.Net

Mediator.Net

A simple mediator for .Net for sending command, publishing event and request res

C#349apache-2.0

6 months ago

buscqrscsharp

nextflow

nextflow

A DSL for data-driven computational pipelines

Groovy2492apache-2.0

2 months ago

awsbioinformaticscloud

orchest

orchest

Build data pipelines, the easy way πŸ› οΈ

TypeScript3875apache-2.0

11 months ago

airflowclouddag

pdpipe

pdpipe

Easy pipelines for pandas DataFrames.

Jupyter Notebook715mit

last year

datadata-sciencedataframe

pipelight

pipelight

Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Li

Rust198gpl-2.0

4 months ago

automationbashcicd

ploomber

The fastest ⚑️ way to build data pipelines. Develop iteratively, deploy anywhere

Python3334apache-2.0

2 months ago

data-engineeringdata-sciencejupyter

ramda-cli

ramda-cli

:ram: A CLI tool for processing data with functional pipelines

LiveScript571isc

last year

clijsonlivescript

scipipe

scipipe

Robust, flexible and resource-efficient pipelines using Go and the commandline

Go1048mit

9 months ago

bioinformaticsbioinformatics-pipelinecheminformatics

spikeinterface

A Python-based module for creating flexible and robust spike sorting pipelines.

Python405mit

6 hours ago

electrophysiologyneurosciencespike-sorting

luigi

luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. I

Python17120apache-2.0

2 months ago

hadoopluigiorchestration-framework

draftjs_exporter

draftjs_exporter

Convert Draft.js ContentState to HTML

Python80mit

4 months ago

draft-jsdraftaildraftjs-exporter

composable_operations

Composable Operations is a tool set for creating operations and assembling multi

Ruby48mit

8 years ago

tenzir

tenzir

Open source security data pipelines.

C++609bsd-3-clause

3 days ago

dataopsincident-responseinvestigation

pipeline

pipeline

League\Pipeline

PHP921mit

10 months ago

django-pipeline

django-pipeline

Pipeline is an asset packaging library for Django.

Python1483mit

5 months ago

vue-pipeline

A pipeline component like jenkins blue ocean plugin.

JavaScript322mit

last year

mleap

mleap

MLeap: Deploy ML Pipelines to Production

Scala1490apache-2.0

5 months ago

data-pipelinespythonscala

couler

couler

Unified Interface for Constructing and Managing Workflows on different workflow

Python874apache-2.0

2 months ago

apache-airflowargo-workflowscloud-native

hamilton

hamilton

Your single tool to express data, ML, and LLM pipelines with simple python funct

Jupyter Notebook1063bsd-3-clause-clear

5 months ago

dagdata-analysisdata-engineering

FluentMediator

FluentMediator

:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows

C#187apache-2.0

4 years ago

chain-methodschain-of-responsibilitycraftmanship

laminas-stratigility

PSR-7 middleware foundation for building and dispatching middleware pipelines

PHP54bsd-3-clause

last month

middlewarepsr-7

Streams

Streams

A lightweight F#/C# library for efficient functional-style pipelines on streams

F#382other

4 years ago

open-metric-learning

open-metric-learning

Library for metric learning pipelines and models.

Jupyter Notebook737apache-2.0

3 months ago

computer-visiondata-sciencedeep-learning

prefect

prefect

Prefect is a workflow orchestration tool empowering developers to build, observe

Python13490apache-2.0

5 months ago

automationdatadata-engineering

bpipe

Bpipe - a tool for running and managing bioinformatics pipelines

Groovy222other

2 months ago

AWSCodePipeline-Jenkins-AWSCodeDeploy_Windows

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby13apache-2.0

4 years ago

aurelia-view-pipeline

A plugin for loading any Markdown into custom element

JavaScript2

8 years ago

pipeline-ui

PIPELINE Design System

HTML30mit

2 years ago

Pipeline-Performance-Monitor

Simple solution for measuring the duration of Sitecore pipeline execution

C#4apache-2.0

10 years ago

pipeline

PipelineAI

Jsonnet4160apache-2.0

7 days ago

airflowartificial-intelligencecassandra

GTFS-Data-Pipeline-TfNSW-Bus

GTFS-Data-Pipeline-TfNSW-Bus

GTFS Data Pipeline for TfNSW Bus Datasets

Jupyter Notebook6

last year

data-pipelinedatapipelinegtfs

kedro

kedro

Kedro is a toolbox for production-ready data science. It uses software engineeri

Python9073apache-2.0

4 months ago

experiment-trackinghacktoberfestkedro

towhee

towhee

Towhee is a framework that is dedicated to making neural data processing pipelin

Python2906apache-2.0

5 months ago

computer-visionconvolutional-networksembedding-vectors

mongo-go-pagination

Golang Mongodb Pagination for official mongodb/mongo-go-driver package which sup

Go128mit

last year

aggregateaggregationdatabase

AWSCodePipeline-S3-AWSCodeDeploy_Windows

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML9apache-2.0

6 years ago

ember-pipeline

Railway oriented programming in Ember

JavaScript17mit

6 years ago

emberember-addonexperimental

aws-pdf-textract-pipeline

aws-pdf-textract-pipeline

:mag: Data pipeline for crawling PDFs from the Web and transforming their conten

TypeScript147mit

4 months ago

awsaws-cdkaws-textract

awesome-pipeline

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

5836

2 months ago

awesome-listworkflow

cra-pipeline

cra-pipeline

Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.

TypeScript42mit

4 years ago

aws-cdkaws-codepipelinecra

ios-twitter-image-pipeline

Twitter Image Pipeline is a robust and performant image loading and caching fram

C1851apache-2.0

3 months ago

cacheimage-pipelineios

html-pipeline

HTML processing filters and utilities

Ruby2253mit

2 months ago

helix-publishing-pipeline

Unified publishing for Sitecore Helix solutions that extends existing Visual Stu

PowerShell68mit

3 years ago

conduit

conduit

Algorand's data pipeline framework.

Go34mit

6 days ago

aws-codepipeline-plugin-for-jenkins

Use this plugin to integrate your Jenkins project with a pipeline in AWS CodePip

Java83apache-2.0

6 months ago

dynamic_robot_localization

dynamic_robot_localization

Point cloud registration pipeline for robot localization and 3D perception

C++750bsd-3-clause

5 months ago

3d-perceptionicplidar

BlenderProc

BlenderProc

A procedural Blender pipeline for photorealistic training image generation

Python2544gpl-3.0

9 days ago

3d-engines3d-front-dataset3d-graphics

lambdacd

lambdacd

a library to define a continuous delivery pipeline in code

Clojure671apache-2.0

last year

build-pipelinescdci

resin

Make your plug pipeline act more enterprisey...

Elixir4mit

5 years ago

redo

pipelined erlang redis client

Erlang19

5 years ago

insider

insider

Static Application Security Testing (SAST) engine focused on covering the OWASP

Go484mit

2 years ago

androidandroid-securitycli

GlobalExceptionHandlerDotNet

Exception handling as a convention in the ASP.NET Core request pipeline

C#269mit

last year

net-corewebapi

camus

LinkedIn's previous generation Kafka to HDFS pipeline.

Java880

4 years ago

aleph

An Open Source Malware Analysis Pipeline System

CSS154

3 years ago

parapipe

Paralleling pipeline

Go25mit

3 years ago

suro

Netflix's distributed Data Pipeline

Java787apache-2.0

last year

VkHLF

Experimental High Level Framework for Vulkan

C++326bsd-3-clause

5 years ago

kiss-icp

kiss-icp

A LiDAR odometry pipeline that just works

Python1353mit

6 days ago

3d-mappingicplidar-slam

pipeR

Multi-Paradigm Pipeline Implementation

R164other

8 years ago

image_pipeline

An image processing pipeline for ROS.

C++751other

2 days ago

c-plus-plusimage-processingpython

p-pipe

Compose promise-returning & async functions into a reusable pipeline

TypeScript118mit

3 years ago

mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)

Python1875apache-2.0

29 days ago

aws-codepipeline-s3-codedeploy-linux

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML154apache-2.0

6 months ago

collective.transmogrifier

A configurable pipeline, aimed at transforming content for import and export

Python5other

last year

htcat

Parallel and Pipelined HTTP GET Utility

Go552bsd-2-clause

5 years ago

scispacy

scispacy

A full spaCy pipeline and models for scientific/biomedical documents.

Python1614apache-2.0

25 days ago

bioinformaticsbiomedicalcustom-pipes

broccoli

broccoli

Browser compilation library – an asset pipeline for applications that run in the

JavaScript3330mit

6 hours ago

Knapsack

Knapsack

Collection pipeline library for PHP

PHP537mit

2 years ago

collectioncollection-pipelinecollections

bacannot

bacannot

Generic but comprehensive pipeline for prokaryotic genome annotation and interro

Nextflow88gpl-3.0

2 months ago

annotationantimicrobial-genes-annotationbarrnap

drake

drake

An R-focused pipeline toolkit for reproducibility and high-performance computing

R1330gpl-3.0

7 months ago

data-sciencedrakehigh-performance-computing

PhotoSauce

PhotoSauce

MagicScaler high-performance, high-quality image processing pipeline for .NET

C#514mit

3 months ago

csharpdotnetimage-processing

ngx-filter-pipe

ngx-filter-pipe

𝗩 Angular 5+ pipeline for array filtering.

TypeScript142mit

last year

angular-2array-filterfilter

vector

vector

A high-performance observability data pipeline.

Rust15644mpl-2.0

2 months ago

eventsforwarderlogs

datajob

datajob

Build and deploy a serverless data pipeline on AWS with no effort.

Python107apache-2.0

last year

awsaws-cdkdata-pipeline

redix

redix

Fast, pipelined, resilient Redis driver for Elixir. πŸ›

Elixir1058mit

last month

elixirelixir-libraryredis

Multilingual-Latent-Dirichlet-Allocation-LDA

A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Remova

Python79mit

3 months ago

clusteringenglishfrench

aws-codepipeline-jenkins-aws-codedeploy_linux

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby48apache-2.0

11 months ago

java-meme-generator-sample

Sample code for a java application that uses Elastic Beanstalk, S3, DynamoDB, an

Java55apache-2.0

6 years ago

jmeter-aci-terraform

jmeter-aci-terraform

Scalable cloud load/stress testing pipeline solution with Apache JMeter and Terr

HCL119mit

2 years ago

azureazure-containerazure-container-instances

bactopia

bactopia

A flexible pipeline for complete analysis of bacterial genomes

Nextflow334mit

2 months ago

bacterial-genomesbiocondaconda

bridgetown-lit-renderer

Simple pipeline for SSR + hydration of Lit components.

Ruby13mit

10 months ago

bridgetownbridgetown-pluginlit-element

cyclone

cyclone

Powerful workflow engine and end-to-end pipeline solutions implemented with nati

Go1061apache-2.0

6 months ago

ai-pipelineci-cdcontinuous-delivery

cookbook

cookbook

Cookbook for Node on FHIR and the clinical Meteor.js build pipeline. Create FDA

Shell1674

2 years ago

ace-rails-ap

The Ajax.org Cloud9 Editor (Ace) for the Rails 3.1+ asset pipeline.

Ruby134mit

last year

sitecore-processor-dependency-injection

πŸ’‰ A simple project to demonstrate dependency injection in @Sitecore pipeline pr

C#0

4 years ago

dependency-injectionsitecore

es6_module_transpiler-rails

es6_module_transpiler-rails

Transpile ES6 Modules in the Rails Asset Pipeline

JavaScript87mit

9 years ago

surging

surging

Surging is a micro-service engine that provides a lightweight, high-performance,

C#3210mit

last year

apigatewayapolloconsul

deepvariant

deepvariant

DeepVariant is an analysis pipeline that uses a deep neural network to call gene

Python3034bsd-3-clause

3 months ago

bioinformaticsdeep-learningdeep-neural-network

open-covid-19-data

open-covid-19-data

Open source aggregation pipeline for public COVID-19 data, including hospitaliza

Python116apache-2.0

3 years ago

golem-ci

golem-ci

Task pipeline on top of Golem.network

Python5gpl-3.0

3 years ago

vdp

vdp

πŸ’§ Instill VDP (Versatile Data Pipeline) is an open-source tool to seamlessly in

Makefile1451other

4 months ago

aiapicli

LaubPlusCo.Common.ContentSearch

Common extensions to Sitecore contentSearch. Hereunder PopulateSolrSchema pipeli

0

5 years ago

contentsearchsitecoresitecore9

pyslam

pyslam

pySLAM contains a monocular Visual Odometry (VO) pipeline in Python. It supports

Python1697gpl-3.0

3 months ago

NexClipper

NexClipper

Metrics Pipeline for interoperability and Enterprise Prometheus

Go563apache-2.0

12 months ago

cloud-nativecncfcontainer

dna-transcription-kata

dna-transcription-kata

Bioinformatics-themed kata for practicing string manipulation in a data transfor

8mit

2 years ago

bioinformaticsbiologychallenge

k6-boilerplate

k6-boilerplate

k6 integration with Bitbucket pipeline

JavaScript3

3 years ago

go-command-chain

A go library for easy configure and run command chains. Such like pipelining in

Go57mit

12 months ago

commandgogolang

react-rails

react-rails

Integrate React.js with Rails views and controllers, the asset pipeline, or webp

JavaScript6704apache-2.0

3 months ago

jsxrailsreact

gulp-debug

gulp-debug

Debug Vinyl file streams to see what files are run through your Gulp pipeline

JavaScript221mit

6 months ago

debuggulp-pluginjavascript

tinymce-rails

Integration of TinyMCE with the Rails asset pipeline

JavaScript814mit

3 months ago

railsrubytinymce

upgini

upgini

Data search & enrichment library for Machine Learning β†’ Easily find and add rele

Python261bsd-3-clause

4 months ago

automated-feature-engineeringautomlautoml-pipeline

nigiri-travis

Travis template for adding 🍣 Nigiri Bitcoin to your CI pipeline.

Shell2mit

2 years ago

jquery-ui-rails

jQuery UI for the Rails asset pipeline

Ruby1129other

6 months ago

AudioTK

An audio digital processing toolbox based on a workflow/pipeline principle

C++248bsd-3-clause

3 years ago

typescript-rails

An asset pipeline wrapper for the TypeScript language

Ruby256mit

7 years ago

github-actions

This repository contains github actions for usage in our build pipeline.

JavaScript6other

21 days ago

select2-rails

Integrate Select2 javascript library with Rails asset pipeline

Ruby964

last year

substation

substation

Substation is a cloud-native, event-driven data pipeline toolkit built for secur

Go261mit

last month

awsdata-engineeringdata-processing

sitecore-organize-insert-options-rules

sitecore-organize-insert-options-rules

βž• A pipeline processor to organize Insert Options Rules in @Sitecore's content t

C#1

4 years ago

sitecoresitecore-helix

sitecore-web-api-session

sitecore-web-api-session

⏱ Sitecore pipeline processor and extensions to the HttpRouteCollection to enabl

C#0

2 years ago

sitecoreweb-api-2

ngs-preprocess

ngs-preprocess

A pipeline for preprocessing NGS data from Illumina, Nanopore and PacBio technol

Nextflow23gpl-3.0

2 months ago

bax2bambioinformaticsillumina

angular-rails-templates

Use your angular templates with rails' asset pipeline

Ruby565mit

6 months ago

angularangular-rails-templatesangular-template

slog-multi

slog-multi

🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, fai

Go218mit

3 months ago

attributeerrorerrors

PipelinR

PipelinR is a lightweight command processing pipeline ❍ β‡’ ❍ β‡’ ❍ for your Java aw

Java365mit

last year

androidarchitecturecqrs

machine

Machine is a workflow/pipeline library for processing data

Go142mit

2 months ago

codespacesgithub-actionsgolang

ember-cli-deploy

A deployment pipeline for Ember CLI apps

JavaScript562mit

last year

ember-cliember-cli-deploy

jenkinsfile-runner-github-actions

jenkinsfile-runner-github-actions

Jenkins single-shot pipeline execution in a GitHub Action POC

Shell199apache-2.0

20 days ago

github-actionshacktoberfestjenkins

Kata-Clean-Machine-Learning-From-Dirty-Code

A coding exercise: let's convert dirty machine learning code into clean code usi

Jupyter Notebook14apache-2.0

last year

ecs-refarch-continuous-deployment

ECS Reference Architecture for creating a flexible and scalable deployment pipel

Shell843apache-2.0

last year

awscontinuous-deploymentdevops

logstash-input-dynamodb

This input plugin for Logstash scans a specified DynamoDB table and then reads c

Ruby105apache-2.0

2 years ago

aws-codepipeline-custom-job-worker

Use this sample to help you develop your own job worker when creating a custom a

Java33other

7 months ago

scrapy-mongodb

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone set

Python355other

3 years ago

k6-example-azure-pipelines

k6-example-azure-pipelines

How to run k6 load tests as part of a Azure Pipelines build

JavaScript18apache-2.0

4 months ago

azure-pipelinescdci

mara-pipelines

mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apach

Python2043mit

4 months ago

datadata-integrationetl

Neuraxle

Neuraxle

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right

Python595apache-2.0

12 months ago

deep-learningframeworkhyperparameter-optimization

data-pipeline-samples

data-pipeline-samples

This repository hosts sample pipelines

Python460mit-0

4 years ago

aws-delivlib

setup and manage continuous delivery pipelines for code libraries in multiple la

TypeScript361apache-2.0

4 months ago

ChEMBL_Structure_Pipeline

ChEMBL database structure pipelines

Python173mit

6 months ago

pipes

Compositional pipelines

Haskell481bsd-3-clause

2 years ago

rnaseq_tutorial

Informatics for RNA-seq: A web resource for analysis on the cloud. Educational t

R1299other

11 months ago

rust-subprocess

Execution of and interaction with external processes and pipelines

Rust408apache-2.0

11 months ago

resty

Little command line REST client that you can use in pipelines (bash or zsh).

Shell2646mit

last year

pluggable

Elixir library to build Plug-like pipelines

Elixir13apache-2.0

last month

elixirpipelineplug

SPQR

SPQR

Spooker is a dynamic framework for processing high volume data streams via proce

Java29apache-2.0

8 years ago

MonadEx

Upgrade your pipelines with monads.

Elixir300mit

2 years ago

conform

Policy enforcement for your pipelines.

Go408mpl-2.0

3 days ago

build-automationdockergo

sparta

sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

Scala525apache-2.0

5 years ago

analyticshdfskafka

vast

vast

Easy data pipelines for security teams.

C++500bsd-3-clause

10 months ago

actor-modelbitmap-indexdataops

gaia

gaia

Build powerful pipelines in any programming language.

Go5151apache-2.0

8 months ago

automationbuildcontinuous-delivery

prodmodel

Build, test, deploy, iterate - Dev and prod tool for data science pipelines

Python55other

2 years ago

build-automationbuild-systembuild-tool

haystack

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM ap

Python13059apache-2.0

last month

aibertchatgpt

tpot

tpot

A Python Automated Machine Learning tool that optimizes machine learning pipelin

Python9429lgpl-3.0

2 months ago

adspag066833aiml

pipeline

Pipelines using goroutines

Go55mit

2 years ago

concurrencygopipeline

lineapy

lineapy

Move fast from data science prototype to pipeline. Capture, analyze, and transfo

Jupyter Notebook641apache-2.0

9 months ago

factotum

A system to programmatically run data pipelines

Rust215

3 years ago

crondagjob

rockpool

rockpool

A machine learning library for spiking neural networks. Supports training with b

Python39agpl-3.0

3 months ago

deploymentjaxmachine-learning

ModularPipelines

Write your pipelines in C# !

C#88mit

4 months ago

buildbuild-systembuild-tool

ruffus

CGAT-ruffus is a lightweight python module for running computational pipelines

Python171mit

3 years ago

Mediator.Net

Mediator.Net

A simple mediator for .Net for sending command, publishing event and request res

C#349apache-2.0

6 months ago

buscqrscsharp

nextflow

nextflow

A DSL for data-driven computational pipelines

Groovy2492apache-2.0

2 months ago

awsbioinformaticscloud

orchest

orchest

Build data pipelines, the easy way πŸ› οΈ

TypeScript3875apache-2.0

11 months ago

airflowclouddag

pdpipe

pdpipe

Easy pipelines for pandas DataFrames.

Jupyter Notebook715mit

last year

datadata-sciencedataframe

pipelight

pipelight

Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Li

Rust198gpl-2.0

4 months ago

automationbashcicd

ploomber

The fastest ⚑️ way to build data pipelines. Develop iteratively, deploy anywhere

Python3334apache-2.0

2 months ago

data-engineeringdata-sciencejupyter

ramda-cli

ramda-cli

:ram: A CLI tool for processing data with functional pipelines

LiveScript571isc

last year

clijsonlivescript

scipipe

scipipe

Robust, flexible and resource-efficient pipelines using Go and the commandline

Go1048mit

9 months ago

bioinformaticsbioinformatics-pipelinecheminformatics

spikeinterface

A Python-based module for creating flexible and robust spike sorting pipelines.

Python405mit

6 hours ago

electrophysiologyneurosciencespike-sorting

luigi

luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. I

Python17120apache-2.0

2 months ago

hadoopluigiorchestration-framework

draftjs_exporter

draftjs_exporter

Convert Draft.js ContentState to HTML

Python80mit

4 months ago

draft-jsdraftaildraftjs-exporter

composable_operations

Composable Operations is a tool set for creating operations and assembling multi

Ruby48mit

8 years ago

tenzir

tenzir

Open source security data pipelines.

C++609bsd-3-clause

3 days ago

dataopsincident-responseinvestigation

pipeline

pipeline

League\Pipeline

PHP921mit

10 months ago

django-pipeline

django-pipeline

Pipeline is an asset packaging library for Django.

Python1483mit

5 months ago

vue-pipeline

A pipeline component like jenkins blue ocean plugin.

JavaScript322mit

last year

mleap

mleap

MLeap: Deploy ML Pipelines to Production

Scala1490apache-2.0

5 months ago

data-pipelinespythonscala

couler

couler

Unified Interface for Constructing and Managing Workflows on different workflow

Python874apache-2.0

2 months ago

apache-airflowargo-workflowscloud-native

hamilton

hamilton

Your single tool to express data, ML, and LLM pipelines with simple python funct

Jupyter Notebook1063bsd-3-clause-clear

5 months ago

dagdata-analysisdata-engineering

FluentMediator

FluentMediator

:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows

C#187apache-2.0

4 years ago

chain-methodschain-of-responsibilitycraftmanship

laminas-stratigility

PSR-7 middleware foundation for building and dispatching middleware pipelines

PHP54bsd-3-clause

last month

middlewarepsr-7

Streams

Streams

A lightweight F#/C# library for efficient functional-style pipelines on streams

F#382other

4 years ago

open-metric-learning

open-metric-learning

Library for metric learning pipelines and models.

Jupyter Notebook737apache-2.0

3 months ago

computer-visiondata-sciencedeep-learning

prefect

prefect

Prefect is a workflow orchestration tool empowering developers to build, observe

Python13490apache-2.0

5 months ago

automationdatadata-engineering

bpipe

Bpipe - a tool for running and managing bioinformatics pipelines

Groovy222other

2 months ago

AWSCodePipeline-Jenkins-AWSCodeDeploy_Windows

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby13apache-2.0

4 years ago

aurelia-view-pipeline

A plugin for loading any Markdown into custom element

JavaScript2

8 years ago

pipeline-ui

PIPELINE Design System

HTML30mit

2 years ago

Pipeline-Performance-Monitor

Simple solution for measuring the duration of Sitecore pipeline execution

C#4apache-2.0

10 years ago

pipeline

PipelineAI

Jsonnet4160apache-2.0

7 days ago

airflowartificial-intelligencecassandra

GTFS-Data-Pipeline-TfNSW-Bus

GTFS-Data-Pipeline-TfNSW-Bus

GTFS Data Pipeline for TfNSW Bus Datasets

Jupyter Notebook6

last year

data-pipelinedatapipelinegtfs

kedro

kedro

Kedro is a toolbox for production-ready data science. It uses software engineeri

Python9073apache-2.0

4 months ago

experiment-trackinghacktoberfestkedro

towhee

towhee

Towhee is a framework that is dedicated to making neural data processing pipelin

Python2906apache-2.0

5 months ago

computer-visionconvolutional-networksembedding-vectors

mongo-go-pagination

Golang Mongodb Pagination for official mongodb/mongo-go-driver package which sup

Go128mit

last year

aggregateaggregationdatabase

AWSCodePipeline-S3-AWSCodeDeploy_Windows

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML9apache-2.0

6 years ago

ember-pipeline

Railway oriented programming in Ember

JavaScript17mit

6 years ago

emberember-addonexperimental

aws-pdf-textract-pipeline

aws-pdf-textract-pipeline

:mag: Data pipeline for crawling PDFs from the Web and transforming their conten

TypeScript147mit

4 months ago

awsaws-cdkaws-textract

awesome-pipeline

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

5836

2 months ago

awesome-listworkflow

cra-pipeline

cra-pipeline

Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.

TypeScript42mit

4 years ago

aws-cdkaws-codepipelinecra

ios-twitter-image-pipeline

Twitter Image Pipeline is a robust and performant image loading and caching fram

C1851apache-2.0

3 months ago

cacheimage-pipelineios

html-pipeline

HTML processing filters and utilities

Ruby2253mit

2 months ago

helix-publishing-pipeline

Unified publishing for Sitecore Helix solutions that extends existing Visual Stu

PowerShell68mit

3 years ago

conduit

conduit

Algorand's data pipeline framework.

Go34mit

6 days ago

aws-codepipeline-plugin-for-jenkins

Use this plugin to integrate your Jenkins project with a pipeline in AWS CodePip

Java83apache-2.0

6 months ago

dynamic_robot_localization

dynamic_robot_localization

Point cloud registration pipeline for robot localization and 3D perception

C++750bsd-3-clause

5 months ago

3d-perceptionicplidar

BlenderProc

BlenderProc

A procedural Blender pipeline for photorealistic training image generation

Python2544gpl-3.0

9 days ago

3d-engines3d-front-dataset3d-graphics

resin

Make your plug pipeline act more enterprisey...

Elixir4mit

5 years ago

redo

pipelined erlang redis client

Erlang19

5 years ago

GlobalExceptionHandlerDotNet

Exception handling as a convention in the ASP.NET Core request pipeline

C#269mit

last year

net-corewebapi

camus

LinkedIn's previous generation Kafka to HDFS pipeline.

Java880

4 years ago

aleph

An Open Source Malware Analysis Pipeline System

CSS154

3 years ago

parapipe

Paralleling pipeline

Go25mit

3 years ago

suro

Netflix's distributed Data Pipeline

Java787apache-2.0

last year

VkHLF

Experimental High Level Framework for Vulkan

C++326bsd-3-clause

5 years ago

kiss-icp

kiss-icp

A LiDAR odometry pipeline that just works

Python1353mit

6 days ago

3d-mappingicplidar-slam

pipeR

Multi-Paradigm Pipeline Implementation

R164other

8 years ago

image_pipeline

An image processing pipeline for ROS.

C++751other

2 days ago

c-plus-plusimage-processingpython

p-pipe

Compose promise-returning & async functions into a reusable pipeline

TypeScript118mit

3 years ago

mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)

Python1875apache-2.0

29 days ago

aws-codepipeline-s3-codedeploy-linux

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML154apache-2.0

6 months ago

collective.transmogrifier

A configurable pipeline, aimed at transforming content for import and export

Python5other

last year

htcat

Parallel and Pipelined HTTP GET Utility

Go552bsd-2-clause

5 years ago

scispacy

scispacy

A full spaCy pipeline and models for scientific/biomedical documents.

Python1614apache-2.0

25 days ago

bioinformaticsbiomedicalcustom-pipes

broccoli

broccoli

Browser compilation library – an asset pipeline for applications that run in the

JavaScript3330mit

6 hours ago

Knapsack

Knapsack

Collection pipeline library for PHP

PHP537mit

2 years ago

collectioncollection-pipelinecollections

bacannot

bacannot

Generic but comprehensive pipeline for prokaryotic genome annotation and interro

Nextflow88gpl-3.0

2 months ago

annotationantimicrobial-genes-annotationbarrnap

drake

drake

An R-focused pipeline toolkit for reproducibility and high-performance computing

R1330gpl-3.0

7 months ago

data-sciencedrakehigh-performance-computing

PhotoSauce

PhotoSauce

MagicScaler high-performance, high-quality image processing pipeline for .NET

C#514mit

3 months ago

csharpdotnetimage-processing

ngx-filter-pipe

ngx-filter-pipe

𝗩 Angular 5+ pipeline for array filtering.

TypeScript142mit

last year

angular-2array-filterfilter

vector

vector

A high-performance observability data pipeline.

Rust15644mpl-2.0

2 months ago

eventsforwarderlogs

datajob

datajob

Build and deploy a serverless data pipeline on AWS with no effort.

Python107apache-2.0

last year

awsaws-cdkdata-pipeline

redix

redix

Fast, pipelined, resilient Redis driver for Elixir. πŸ›

Elixir1058mit

last month

elixirelixir-libraryredis

Multilingual-Latent-Dirichlet-Allocation-LDA

A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Remova

Python79mit

3 months ago

clusteringenglishfrench

aws-codepipeline-jenkins-aws-codedeploy_linux

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby48apache-2.0

11 months ago

jmeter-aci-terraform

jmeter-aci-terraform

Scalable cloud load/stress testing pipeline solution with Apache JMeter and Terr

HCL119mit

2 years ago

azureazure-containerazure-container-instances

bactopia

bactopia

A flexible pipeline for complete analysis of bacterial genomes

Nextflow334mit

2 months ago

bacterial-genomesbiocondaconda

bridgetown-lit-renderer

Simple pipeline for SSR + hydration of Lit components.

Ruby13mit

10 months ago

bridgetownbridgetown-pluginlit-element

cyclone

cyclone

Powerful workflow engine and end-to-end pipeline solutions implemented with nati

Go1061apache-2.0

6 months ago

ai-pipelineci-cdcontinuous-delivery

cookbook

cookbook

Cookbook for Node on FHIR and the clinical Meteor.js build pipeline. Create FDA

Shell1674

2 years ago

ace-rails-ap

The Ajax.org Cloud9 Editor (Ace) for the Rails 3.1+ asset pipeline.

Ruby134mit

last year

sitecore-processor-dependency-injection

πŸ’‰ A simple project to demonstrate dependency injection in @Sitecore pipeline pr

C#0

4 years ago

dependency-injectionsitecore

es6_module_transpiler-rails

es6_module_transpiler-rails

Transpile ES6 Modules in the Rails Asset Pipeline

JavaScript87mit

9 years ago

surging

surging

Surging is a micro-service engine that provides a lightweight, high-performance,

C#3210mit

last year

apigatewayapolloconsul

deepvariant

deepvariant

DeepVariant is an analysis pipeline that uses a deep neural network to call gene

Python3034bsd-3-clause

3 months ago

bioinformaticsdeep-learningdeep-neural-network

open-covid-19-data

open-covid-19-data

Open source aggregation pipeline for public COVID-19 data, including hospitaliza

Python116apache-2.0

3 years ago

golem-ci

golem-ci

Task pipeline on top of Golem.network

Python5gpl-3.0

3 years ago

vdp

vdp

πŸ’§ Instill VDP (Versatile Data Pipeline) is an open-source tool to seamlessly in

Makefile1451other

4 months ago

aiapicli

LaubPlusCo.Common.ContentSearch

Common extensions to Sitecore contentSearch. Hereunder PopulateSolrSchema pipeli

0

5 years ago

contentsearchsitecoresitecore9

pyslam

pyslam

pySLAM contains a monocular Visual Odometry (VO) pipeline in Python. It supports

Python1697gpl-3.0

3 months ago

NexClipper

NexClipper

Metrics Pipeline for interoperability and Enterprise Prometheus

Go563apache-2.0

12 months ago

cloud-nativecncfcontainer

dna-transcription-kata

dna-transcription-kata

Bioinformatics-themed kata for practicing string manipulation in a data transfor

8mit

2 years ago

bioinformaticsbiologychallenge

k6-boilerplate

k6-boilerplate

k6 integration with Bitbucket pipeline

JavaScript3

3 years ago

go-command-chain

A go library for easy configure and run command chains. Such like pipelining in

Go57mit

12 months ago

commandgogolang

react-rails

react-rails

Integrate React.js with Rails views and controllers, the asset pipeline, or webp

JavaScript6704apache-2.0

3 months ago

jsxrailsreact

gulp-debug

gulp-debug

Debug Vinyl file streams to see what files are run through your Gulp pipeline

JavaScript221mit

6 months ago

debuggulp-pluginjavascript

tinymce-rails

Integration of TinyMCE with the Rails asset pipeline

JavaScript814mit

3 months ago

railsrubytinymce

upgini

upgini

Data search & enrichment library for Machine Learning β†’ Easily find and add rele

Python261bsd-3-clause

4 months ago

automated-feature-engineeringautomlautoml-pipeline

nigiri-travis

Travis template for adding 🍣 Nigiri Bitcoin to your CI pipeline.

Shell2mit

2 years ago

jquery-ui-rails

jQuery UI for the Rails asset pipeline

Ruby1129other

6 months ago

AudioTK

An audio digital processing toolbox based on a workflow/pipeline principle

C++248bsd-3-clause

3 years ago

typescript-rails

An asset pipeline wrapper for the TypeScript language

Ruby256mit

7 years ago

github-actions

This repository contains github actions for usage in our build pipeline.

JavaScript6other

21 days ago

select2-rails

Integrate Select2 javascript library with Rails asset pipeline

Ruby964

last year

substation

substation

Substation is a cloud-native, event-driven data pipeline toolkit built for secur

Go261mit

last month

awsdata-engineeringdata-processing

sitecore-organize-insert-options-rules

sitecore-organize-insert-options-rules

βž• A pipeline processor to organize Insert Options Rules in @Sitecore's content t

C#1

4 years ago

sitecoresitecore-helix

sitecore-web-api-session

sitecore-web-api-session

⏱ Sitecore pipeline processor and extensions to the HttpRouteCollection to enabl

C#0

2 years ago

sitecoreweb-api-2

ngs-preprocess

ngs-preprocess

A pipeline for preprocessing NGS data from Illumina, Nanopore and PacBio technol

Nextflow23gpl-3.0

2 months ago

bax2bambioinformaticsillumina

angular-rails-templates

Use your angular templates with rails' asset pipeline

Ruby565mit

6 months ago

angularangular-rails-templatesangular-template

slog-multi

slog-multi

🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, fai

Go218mit

3 months ago

attributeerrorerrors

PipelinR

PipelinR is a lightweight command processing pipeline ❍ β‡’ ❍ β‡’ ❍ for your Java aw

Java365mit

last year

androidarchitecturecqrs

machine

Machine is a workflow/pipeline library for processing data

Go142mit

2 months ago

codespacesgithub-actionsgolang

ember-cli-deploy

A deployment pipeline for Ember CLI apps

JavaScript562mit

last year

ember-cliember-cli-deploy

jenkinsfile-runner-github-actions

jenkinsfile-runner-github-actions

Jenkins single-shot pipeline execution in a GitHub Action POC

Shell199apache-2.0

20 days ago

github-actionshacktoberfestjenkins

ecs-refarch-continuous-deployment

ECS Reference Architecture for creating a flexible and scalable deployment pipel

Shell843apache-2.0

last year

awscontinuous-deploymentdevops

logstash-input-dynamodb

This input plugin for Logstash scans a specified DynamoDB table and then reads c

Ruby105apache-2.0

2 years ago

aws-codepipeline-custom-job-worker

Use this sample to help you develop your own job worker when creating a custom a

Java33other

7 months ago

scrapy-mongodb

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone set

Python355other

3 years ago