标准化数据-StandardScaler
StandardScaler----计算训练集的平均值和标准差,以便测试数据集使用相同的变换
官方文档:
class sklearn.preprocessing.
StandardScaler
(copy=True, with_mean=True, with_std=True)
Standardize features by removing the mean and scaling to unit variance
通过删除平均值和缩放到单位方差来标准化特征
The standard score of a sample x is calculated as:
样本x的标准分数计算如下:
z = (x - u) / s
where u is the mean of the training samples or zero if with_mean=False, and s is the standard deviation of the training samples or one if with_std=False.
其中u是训练样本的均值,如果with_mean=False,则为0
s是训练样本的标准偏差,如果with_std=False,则为1
Centering and scaling happen independently on each feature by computing the relevant statistics on the samples in the training set. Mean and standard deviation are then stored to be used on later data using the transform method.
Standardization of a dataset is a common requirement for many machine learning estimators: they might behave badly if the individual features do not more or less look like standard normally distributed data (e.g. Gaussian with 0 mean and unit variance).
For instance many elements used in the objective function of a learning algorithm (such as the RBF kernel of Support Vector Machines or the L1 and L2 regularizers of linear models) assume that all features are centered around 0 and have variance in the same order. If a feature has a variance that is orders of magnitude larger that others, it might dominate the objective function and make the estimator unable to learn from other features correctly as expected.
This scaler can also be applied to sparse CSR or CSC matrices by passing with_mean=False to avoid breaking the sparsity structure of the data.
Read more in the User Guide.
Parameters: |
|
---|---|
Attributes: |
|
See also
scale
- Equivalent function without the estimator API.
sklearn.decomposition.PCA
- Further removes the linear correlation across features with ‘whiten=True’.
Notes
NaNs are treated as missing values: disregarded in fit, and maintained in transform.
For a comparison of the different scalers, transformers, and normalizers, see examples/preprocessing/plot_all_scaling.py.
Examples
>>> from sklearn.preprocessing import StandardScaler
>>> data = [[0, 0], [0, 0], [1, 1], [1, 1]]
>>> scaler = StandardScaler()
>>> print(scaler.fit(data))
StandardScaler(copy=True, with_mean=True, with_std=True)
>>> print(scaler.mean_)
[0.5 0.5]
>>> print(scaler.transform(data))
[[-1. -1.]
[-1. -1.]
[ 1. 1.]
[ 1. 1.]]
>>> print(scaler.transform([[2, 2]]))
[[3. 3.]]
Methods方法
fit (X[, y]) |
Compute the mean and std to be used for later scaling. 计算用于以后缩放的mean和std |
fit_transform (X[, y]) |
Fit to data, then transform it. 适合数据,然后转换它 |
get_params ([deep]) |
Get parameters for this estimator. |
inverse_transform (X[, copy]) |
Scale back the data to the original representation |
partial_fit (X[, y]) |
Online computation of mean and std on X for later scaling. |
set_params (**params) |
Set the parameters of this estimator. |
transform (X[, y, copy]) |
Perform standardization by centering and scaling 通过居中和缩放执行标准化 |
__init__
(copy=True, with_mean=True, with_std=True)[source]
fit
(X, y=None)[source]-
Compute the mean and std to be used for later scaling.
Parameters: - X : {array-like, sparse matrix}, shape [n_samples, n_features]
-
The data used to compute the mean and standard deviation used for later scaling along the features axis.
- y
-
Ignored
fit_transform
(X, y=None, **fit_params)[source]-
Fit to data, then transform it.
Fits transformer to X and y with optional parameters fit_params and returns a transformed version of X.
使用可选参数fit_params是变换器适合X和Y,并返回X的变换版本
Parameters: - X : numpy array of shape [n_samples, n_features]
-
Training set.
- y : numpy array of shape [n_samples]
-
Target values.
Returns: - X_new : numpy array of shape [n_samples, n_features_new]
-
Transformed array.
get_params
(deep=True)[source]-
Get parameters for this estimator.
Parameters: - deep : boolean, optional
-
If True, will return the parameters for this estimator and contained subobjects that are estimators.
Returns: - params : mapping of string to any
-
Parameter names mapped to their values.
inverse_transform
(X, copy=None)[source]-
Scale back the data to the original representation
Parameters: - X : array-like, shape [n_samples, n_features]
-
The data used to scale along the features axis.
- copy : bool, optional (default: None)
-
Copy the input X or not.
Returns: - X_tr : array-like, shape [n_samples, n_features]
-
Transformed array.
partial_fit
(X, y=None)[source]-
Online computation of mean and std on X for later scaling. All of X is processed as a single batch. This is intended for cases when fit is not feasible due to very large number of n_samples or because X is read from a continuous stream.
The algorithm for incremental mean and std is given in Equation 1.5a,b in Chan, Tony F., Gene H. Golub, and Randall J. LeVeque. “Algorithms for computing the sample variance: Analysis and recommendations.” The American Statistician 37.3 (1983): 242-247:
Parameters: - X : {array-like, sparse matrix}, shape [n_samples, n_features]
-
The data used to compute the mean and standard deviation used for later scaling along the features axis.
- y
-
Ignored
set_params
(**params)[source]-
Set the parameters of this estimator.
The method works on simple estimators as well as on nested objects (such as pipelines). The latter have parameters of the form
<component>__<parameter>
so that it’s possible to update each component of a nested object.Returns: - self
transform
(X, y=’deprecated’, copy=None)[source]-
Perform standardization by centering and scaling
Parameters: - X : array-like, shape [n_samples, n_features]
-
The data used to scale along the features axis.
- y : (ignored)
-
Deprecated since version 0.19: This parameter will be removed in 0.21.
- copy : bool, optional (default: None)
-
Copy the input X or not.
标准化数据-StandardScaler的更多相关文章
- numpy数组-标准化数据
标准化数据的公式: (数据值 - 平均数) / 标准差 import numpy as np employment = np.array([ 55.70000076, 51.40000153, 50. ...
- sklearn 标准化数据的方法
Sklearn 标准化数据 from __future__ import print_function from sklearn import preprocessing import numpy a ...
- pytorch torchversion标准化数据
新旧标准差的关系
- 利用 pandas 进行数据的预处理——离散数据哑编码、连续数据标准化
数据的标准化 数据标准化就是将不同取值范围的数据,在保留各自数据相对大小顺序不变的情况下,整体映射到一个固定的区间中.根据具体的实现方法不同,有的时候会映射到 [ 0 ,1 ],有时映射到 0 附近的 ...
- TGCA数据的标准化以及差异分析--转载
转载果子学生信 https://mp.weixin.qq.com/s/Ph1O6V5RkxkyrKpVmB5ODA 前面我们从GDC下载了TCGA肿瘤数据库的数据,也能够把GDC下载的多个TCGA文 ...
- Matlab数据标准化——mapstd、mapminmax
Matlab神经网络工具箱中提供了两个自带的数据标准化处理的函数——mapstd和mapminmax,本文试图解析一下这两个函数的用法. 一.mapstd mapstd对应我们数学建模中常使用的Z-S ...
- Scikit-Learn模块学习笔记——数据预处理模块preprocessing
preprocessing 模块提供了数据预处理函数和预处理类,预处理类主要是为了方便添加到 pipeline 过程中. 数据标准化 标准化预处理函数: preprocessing.scale(X, ...
- 使用sklearn进行数据挖掘-房价预测(4)—数据预处理
在使用机器算法之前,我们先把数据做下预处理,先把特征和标签拆分出来 housing = strat_train_set.drop("median_house_value",axis ...
- Scikit-learn数据变换
转载自:https://blog.csdn.net/Dream_angel_Z/article/details/49406573 本文主要是对照scikit-learn的preprocessing章节 ...
随机推荐
- smbclient和mount -t cifs共享win的共享文件夹? autocad小记
插入U盘没有反应? 首先,打开设备管理器, 发现usb大容量设备为黄色感叹号 其次, 将这个usb大容量设备先卸载, 然后点击"自动扫描硬件变化",就可以重新自动安装usb的驱动. ...
- 【系列教程1】Gradle入门系列二:第一个Java项目
这篇教程的主要内容是讲解如何用Gradle编译和打包一个简单的Java项目. 该Java项目只有一个需求:我们的构建脚本必须创建一个可执行的Jar文件,换句话说,我们必须能够使用命令java -jar ...
- CentOS 7.3 上安装docker
Docker,分为社区版CE和企业版EE.社区版是免费提供给个人开发者和小型团体使用的,企业版会提供额外的收费服务. 一.安装docker 1.Docker 要求 CentOS 系统的内核版本高于 3 ...
- Tutorials on Inverse Reinforcement Learning
Tutorials on Inverse Reinforcement Learning 2018-07-22 21:44:39 1. Papers: Inverse Reinforcement Le ...
- Nand flash code
(1)流水灯 1>我们来看原理图 2>datasheet 3> ...
- 洛谷P2637第一次,第二次,成交! 模拟?DP?
今天水来一天,就贴道水吧.. 原题>>https://www.luogu.org/problem/show?pid=2637<< 题目描述 因为奶牛们的节食运动(奶牛还节食?) ...
- maven . mac
编辑文件 .bash_profile 1.vim .bash_profile 输入: M2_HOME=/Users/lizhimin/Documents/maven/apache-maven-3.3. ...
- Windows系统零开始前端开发环境配置
1. 安装nodejs 国内下载页面(推荐) 官网下载页面 现在的nodejs自带NPM,只需点击下一步下一步安装即可. 为了加速国内NPM包下载,可配置淘宝NPM镜像 2. 安装git 国内下载页面 ...
- JqGrid 自定义子表格 及 自定义Json 格式数据不展示
项目第一次使用JqGrid ,发现功能强大,但由于对他不熟悉,也没有少走弯路,记录一下. 1.引用 <link href="~/Scripts/JqGrid/jqgrid/css/ui ...
- oracle 新建用户
create user username identified by password; grant dba to username; 授权 或 grant connect, resource to ...