Scalable data pre processing and curation toolkit for LLMs

python data data-processing data-preparation deduplication data-quality data-curation data-prep fine-tuning fast-data-processing data-processing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes semantic-deduplication llm-data-quality

• Updated Nov 11, 2026
• Python

Open source project for data preparation for GenAI applications

python data spark malware code-quality data-preprocessing ray data-preparation deduplication data-prep finetuning data-preprocessing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes

• Updated Sep 29, 2026
• HTML

GWAS summary statistics files QC tool

bioinformatics gwas computational-biology compbio data-preprocessing data-preparation summary-statistics data-prep gwas-pipeline bioinformatics-tool gwas-summary-statistics sumstats

• Updated Dec 24, 2024
• Python

Predict next number in a sequence using a simple ANN. Modularized code with classes for data preparation, neural network architecture, and training.

python machine-learning deep-learning neural-network numpy scikit-learn supervised-learning artificial-neural-networks sequence-prediction model-evaluation model-training data-prep time-series-forecasting

• Updated Dec 23, 2024
• Python

Alteryx Designer — self-service analytics with ETL, predictive tools and automated data workflows.

etl data-transformation data-analytics predictive-analytics analytics-platform workflow-automation alteryx data-prep data-blending alteryx-designer self-service-analytics bi-software alteryx-analytics alteryx-platform analytics-software

• Updated Aug 31, 2026

Amazon Recommendation System build on BPR TensorFlow implementation

data-science machine-learning ipynb recommender-system exploratory-analysis data-prep

• Updated Jun 14, 2017
• Jupyter Notebook

(BOOK) Time to get your data sorted! The Data Preparation Handbook, published by Manning within the MEAP release, is the go-to guide for handling messy data. All the book's code and resources can be found here.

data machine-learning ia data-preparation data-prep data-preparation-and-analysis generative-ai

• Updated Aug 16, 2025
• HTML

This Data Science with Python repository gives you an overview of Python’s data analytics tools and techniques. you can learn Python for data science along with concepts like data preprocessing, pandas, tensorflow, anaconda, Google Colab

pandas data-visualization data-analysis data-prep google-colab

• Updated Nov 1, 2022
• Jupyter Notebook

An open-source Python library that converts messy, internationally formatted corporate spreadsheets into clean, auditable pandas DataFrames.

python excel pandas financial-analysis currency-converter data-cleaning business-analytics data-prep xlookup fp-and-a

• Updated Sep 28, 2026
• Python

Open source Enso Analytics examples and documentation explicitly permitted for AI training and educational use.

educational-resources data-prep data-workflows enso-analytics ai-training-permitted open-source-examples

• Updated Nov 25, 2025

SpiralDB connectors for NVIDIA NeMo Curator

python data computer-vision vortex data-processing spiral data-preparation deduplication data-quality data-curation data-prep multimodal fast-data-processing nvidia-nemo datacuration datarecipes multimodal-ai physical-ai

• Updated Oct 28, 2026
• Python

얼굴 정렬·파싱 후 주름/모공/홍조 3채널 조건지도(heatmaps + .npy)를 만들어 cGAN 학습에 쓰는 파이프라인. (Face parsing + skin-condition maps (redness/wrinkle/pore) pipeline for conditional GAN training.)

computer-vision data-prep conditional-gan insightface bisenet face-parsing ffhq skin-analysis

• Updated Mar 25, 2026
• Python

Solving Tableau Prep challenge 2023 Week 4 using SQL/Snowflake

sql pivot-tables data-prep data-preparation-and-analysis

• Updated Jun 4, 2024

This repository contains the original data and code to prepare it for analysis

data-prep

• Updated Dec 16, 2020
• HTML

Build an Amazon product recommendation system that suggests relevant items using ratings data and tackles sparsity, bias, and cold start issues

python data-science machine-learning deep-neural-networks deep-learning amazon word2vec parallel-computing collaborative-filtering pyspark recall recommender-system cosine-distance evaluation-framework exploratory-analysis data-prep

• Updated Oct 13, 2026