GeezerVisonThe World Wide Web, restored to 800 pixels of glory. |
| Home|About|Gaming cabinet|Archives|How it works|Starter sites |
GeezerVison is showing github.com — Build software better, together
#
data-opsDataOps is an automated, process-oriented methodology, used by analytic and data teams, to improve the quality and reduce the cycle time of data analytics. While DataOps began as a set of best practices, it has now matured to become a new and independent approach to data analytics. DataOps applies to the entire data lifecycle from data preparation to reporting, and recognizes the interconnected nature of the data analytics team and information technology operations. Here are 48 public repositories matching this topic...Language: All
Filter by language
Sort: Most stars
Sort options
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
python infrastructure workflow data-science data automation pipeline workflow-engine orchestration data-engineering observability prefect data-ops ml-ops
Turns Data and AI algorithms into production-ready web applications in no time.
python workflow automation pipeline job-scheduler pipelines data-visualization orchestration datascience data-engineering developer-tools data-integration scenario hacktoberfest mlops data-ops scenario-analysis hacktoberfest2023 taipy-core taipy-gui
Fancy stream processing made operationally mundane
go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops
Maestro: Netflix’s Workflow Orchestrator
java workflow data-science machine-learning automation etl analytics workflow-engine scheduler orchestration data-engineering elt data-pipelines batch-processing dag mlops data-ops workflow-orchestration data-orchestrator agentic-workflow
Collect, aggregate, and visualize a data ecosystem's metadata
metadata data-discovery data-dictionary data-governance data-lineage data-ops data-provenance metadata-service marquez data-ecosystem-metadata
Polyglot workflows without leaving the comfort of your technology stack.
workflow scheduler scheduling orchestration-framework self-hosted data-engineering event-driven ifttt agents data-ops services-platform activeworkflow
Snowflake CLI is an open-source command-line tool explicitly designed for developer-centric workloads in addition to SQL operations.
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
monitoring data-quality-checks data-quality data-profiling data-ops data-quality-measurement data-quality-monitoring data-quality-report data-observability
Opt-Out tool to check Copyright reservations in a way that even machines can understand.
Open Source Data Quality Monitoring.
mysql python elasticsearch postgres sql database monitoring etl metrics data-validation postgresql data-engineering dataops dataquality data-governance mlops data-ops data-quality-monitoring data-quality-monitor data-observability
Github Action enabling easy use of Snowflake CLI in your CI/CD workflows
funsies is a lightweight workflow engine 🔧
Manage Redshift/Postgres privileges in GitOps style written in Rust
A data lineage tool detects table dependencies from rendered SQL statements.
bigquery sql s3 gcs data-engineering data-catalog data-discovery redash data-management dbt lineage data-governance data-lineage data-ops
Efficient streaming data ingestion, transformation & activation
pubsub data-engineering dataflow apache-beam google-cloud-platform streaming-data data-ops ml-ops cloud-run vertex-ai
Open source data infrastructure platform. Designed for developers, built for speed.
Collect, aggregate, and visualize a data ecosystem's metadata
metadata data-science data-catalog data-discovery data-dictionary data-governance data-lineage data-ops data-provenance metadata-service marquez data-ecosystem-metadata
Data analytics library for Python and suite of open source, command line based data ops tools.
A next-generation open source orchestration platform for the development, production, and observation of data assets.
infrastructure workflow airflow schedule pipeline workflow-engine orchestration-framework scheduled-tasks orchestration workflows dag observability taskflow data-ops orchestration-engine guinsoolab
Related topicsopen-data |
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |