Data preprocessing
Technique
Data preprocessing can refer to manipulation, filtration or augmentation of data before it is analyzed, and is often an important step in the data mining process. Data collection methods are often loosely controlled, resulting in out-of-range values, impossible data combinations, and missing values, amongst other issues. Preprocessing is the process by which unstructured data is transformed into intelligible representations suitable for machine-learning models. This phase of model deals with noise in order to arrive at better and improved results from the original data set which was noisy. This dataset also has some level of missing value present in it.
Related work
- Intro to machine learning Dec 2024
Each Jupyter notebook covers one preprocessing technique in Python: filling in missing values (imputation); one-hot encoding and label encoding of categories; normalisation and standardisation of numbers; discretisation, turning numbers into bins.
As data
Everything on this page is read from triples in the knowledge graph. These are the 7 it states about Data preprocessing, and 1 more its ontology implies; the console runs SPARQL over the whole graph, here in your browser.
@prefix id: <https://ask.chaipat.cc/id/> . @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> . @prefix cj: <https://ask.chaipat.cc/ns#> . @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> . @prefix skos: <http://www.w3.org/2004/02/skos/core#> . @prefix schema: <https://schema.org/> . id:DataPreprocessing a cj:Technique ; rdfs:label "Data preprocessing" ; skos:altLabel "imputation" , "one-hot encoding" , "standardisation" , "normalisation" ; schema:sameAs <https://en.wikipedia.org/wiki/Data_preprocessing> .