preprocessing

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

a delightful machine learning tool that allows you to train, test, and use models without writing code

An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)

A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

MLBox is a powerful Automated Machine Learning python library.

Automated Time Series Forecasting

Collection of various algorithms implemented in R.

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

Audio processing by using pytorch 1D convolution network

Fast Multimodal Semantic Deduplication & Filtering

High performance model preprocessing library on PyTorch

A curated list of awesome CAE frameworks, libraries and software.

✔️Contextual word checker for better suggestions (not actively maintained)

Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!

Just some tool repackers like to use...

🎯 Personal data science and machine learning toolbox

A full pipeline AutoML tool for tabular data

Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku

DeepTab is a Python package that simplifies tabular deep learning by providing a suite of models for regression, classification, and distributional regression tasks. It includes models such as Mambular, TabM, FT-Transformer, TabulaRNN, TabTransformer, and tabular ResNets.