vastorbit.machine_learning.vast.preprocessing.OneHotEncoder¶
- class vastorbit.machine_learning.vast.preprocessing.OneHotEncoder(name: str = None, overwrite_model: bool = False, extra_levels: dict | None = None, drop_first: bool = True, ignore_null: bool = True, separator: str = '_', column_naming: str = 'indices', null_column_name: str = 'null', **kwargs)¶
Creates a VAST OneHotEncoder object.
- Parameters:
name (str, optional) – Name of the model.
overwrite_model (bool, optional) – If set to
True, training a model with the same name as an existing model overwrites the existing model.**kwargs (
scikit-learnmodel parameters.)rubric: (..) – Attributes:
created (Many attributes are)
phase. (during the fitting)
categories_ (numpy.array) – ArrayLike of the categories of the different features.
column_naming_ (str) – Method used to name the model’s outputs.
drop_first_ (bool) – If False, the first dummy of each category was dropped.
note:: (..) – All attributes can be accessed using the
get_attributes()method.note:: – Several other attributes can be accessed by using the
get_attributes()method.
Examples
The following examples provide a basic understanding of usage. For more detailed examples, please refer to the Machine Learning or the Examples section on the website.
Load data for machine learning¶
We import
vastorbit:import vastorbit as vo
Hint
By assigning an alias to
vastorbit, we mitigate the risk of code collisions with other libraries. This precaution is necessary because vastorbit uses commonly known function names like “average” and “median”, which can potentially lead to naming conflicts. The use of an alias ensures that the functions fromvastorbitare used as intended without interfering with functions from other libraries.For this example, we will use the Titanic dataset.
import vastorbit.datasets as vod data = vod.load_titanic()
123pclassInteger123survivedIntegerAbcnameVarchar(164)AbcsexVarchar(20)123ageDouble123sibspInteger123parchIntegerAbcticketVarchar(36)123fareDoubleAbccabinVarchar(30)AbcembarkedVarchar(20)AbcboatVarchar(100)123bodyIntegerAbchome.destVarchar(100)1 3 1 McCormack, Mr. Thomas Joseph male [null] 0 0 367228 7.75 [null] Q [null] [null] [null] 2 3 1 McCoy, Miss. Agnes female [null] 2 0 367226 23.25 [null] Q 16 [null] [null] 3 3 1 McCoy, Miss. Alicia female [null] 2 0 367226 23.25 [null] Q 16 [null] [null] 4 3 1 McCoy, Mr. Bernard male [null] 2 0 367226 23.25 [null] Q 16 [null] [null] 5 3 1 McDermott, Miss. Brigdet Delia female [null] 0 0 330932 7.7875 [null] Q 13 [null] [null] 6 3 0 McEvoy, Mr. Michael male [null] 0 0 36568 15.5 [null] Q [null] [null] [null] 7 3 1 McGovern, Miss. Mary female [null] 0 0 330931 7.8792 [null] Q 13 [null] [null] 8 3 1 McGowan, Miss. Anna "Annie" female 15.0 0 0 330923 8.0292 [null] Q [null] [null] [null] 9 3 0 McGowan, Miss. Katherine female 35.0 0 0 9232 7.75 [null] Q [null] [null] [null] 10 3 0 McMahon, Mr. Martin male [null] 0 0 370372 7.75 [null] Q [null] [null] [null] 11 3 0 McNamee, Mr. Neal male 24.0 1 0 376566 16.1 [null] S [null] [null] [null] 12 3 0 McNamee, Mrs. Neal (Eileen O'Leary) female 19.0 1 0 376566 16.1 [null] S [null] 53 [null] 13 3 0 McNeill, Miss. Bridget female [null] 0 0 370368 7.75 [null] Q [null] [null] [null] 14 3 0 Meanwell, Miss. (Marion Ogden) female [null] 0 0 SOTON/O.Q. 392087 8.05 [null] S [null] [null] [null] 15 3 0 Meek, Mrs. Thomas (Annie Louise Rowley) female [null] 0 0 343095 8.05 [null] S [null] [null] [null] 16 3 0 Meo, Mr. Alfonzo male 55.5 0 0 A.5. 11206 8.05 [null] S [null] 201 [null] 17 3 0 Mernagh, Mr. Robert male [null] 0 0 368703 7.75 [null] Q [null] [null] [null] 18 3 1 Midtsjo, Mr. Karl Albert male 21.0 0 0 345501 7.775 [null] S 15 [null] [null] 19 3 0 Miles, Mr. Frank male [null] 0 0 359306 8.05 [null] S [null] [null] [null] 20 3 0 Mineff, Mr. Ivan male 24.0 0 0 349233 7.8958 [null] S [null] [null] [null] 21 3 0 Minkoff, Mr. Lazar male 21.0 0 0 349211 7.8958 [null] S [null] [null] [null] 22 3 0 Mionoff, Mr. Stoytcho male 28.0 0 0 349207 7.8958 [null] S [null] [null] [null] 23 3 0 Mitkoff, Mr. Mito male [null] 0 0 349221 7.8958 [null] S [null] [null] [null] 24 3 1 Mockler, Miss. Helen Mary "Ellie" female [null] 0 0 330980 7.8792 [null] Q 16 [null] [null] 25 3 0 Moen, Mr. Sigurd Hansen male 25.0 0 0 348123 7.65 F G73 S [null] 309 [null] 26 3 1 Moor, Master. Meier male 6.0 0 1 392096 12.475 E121 S 14 [null] [null] 27 3 1 Moor, Mrs. (Beila) female 27.0 0 1 392096 12.475 E121 S 14 [null] [null] 28 3 0 Moore, Mr. Leonard Charles male [null] 0 0 A4. 54510 8.05 [null] S [null] [null] [null] 29 3 1 Moran, Miss. Bertha female [null] 1 0 371110 24.15 [null] Q 16 [null] [null] 30 3 0 Moran, Mr. Daniel J male [null] 1 0 371110 24.15 [null] Q [null] [null] [null] 31 3 0 Moran, Mr. James male [null] 0 0 330877 8.4583 [null] Q [null] [null] [null] 32 3 0 Morley, Mr. William male 34.0 0 0 364506 8.05 [null] S [null] [null] [null] 33 3 0 Morrow, Mr. Thomas Rowan male [null] 0 0 372622 7.75 [null] Q [null] [null] [null] 34 3 1 Moss, Mr. Albert Johan male [null] 0 0 312991 7.775 [null] S B [null] [null] 35 3 1 Moubarek, Master. Gerios male [null] 1 1 2661 15.2458 [null] C C [null] [null] 36 3 1 Moubarek, Master. Halim Gonios ("William George") male [null] 1 1 2661 15.2458 [null] C C [null] [null] 37 3 1 Moubarek, Mrs. George (Omine "Amenia" Alexander) female [null] 0 2 2661 15.2458 [null] C C [null] [null] 38 3 1 Moussa, Mrs. (Mantoura Boulos) female [null] 0 0 2626 7.2292 [null] C [null] [null] [null] 39 3 0 Moutal, Mr. Rahamin Haim male [null] 0 0 374746 8.05 [null] S [null] [null] [null] 40 3 1 Mullens, Miss. Katherine "Katie" female [null] 0 0 35852 7.7333 [null] Q 16 [null] [null] 41 3 1 Mulvihill, Miss. Bertha E female 24.0 0 0 382653 7.75 [null] Q 15 [null] [null] 42 3 0 Murdlin, Mr. Joseph male [null] 0 0 A./5. 3235 8.05 [null] S [null] [null] [null] 43 3 1 Murphy, Miss. Katherine "Kate" female [null] 1 0 367230 15.5 [null] Q 16 [null] [null] 44 3 1 Murphy, Miss. Margaret Jane female [null] 1 0 367230 15.5 [null] Q 16 [null] [null] 45 3 1 Murphy, Miss. Nora female [null] 0 0 36568 15.5 [null] Q 16 [null] [null] 46 3 0 Myhrman, Mr. Pehr Fabian Oliver Malkolm male 18.0 0 0 347078 7.75 [null] S [null] [null] [null] 47 3 0 Naidenoff, Mr. Penko male 22.0 0 0 349206 7.8958 [null] S [null] [null] [null] 48 3 1 Najib, Miss. Adele Kiamie "Jane" female 15.0 0 0 2667 7.225 [null] C C [null] [null] 49 3 1 Nakid, Miss. Maria ("Mary") female 1.0 0 2 2653 15.7417 [null] C C [null] [null] 50 3 1 Nakid, Mr. Sahid male 20.0 1 1 2653 15.7417 [null] C C [null] [null] 51 3 1 Nakid, Mrs. Said (Waika "Mary" Mowad) female 19.0 1 1 2653 15.7417 [null] C C [null] [null] 52 3 0 Nancarrow, Mr. William Henry male 33.0 0 0 A./5. 3338 8.05 [null] S [null] [null] [null] 53 3 0 Nankoff, Mr. Minko male [null] 0 0 349218 7.8958 [null] S [null] [null] [null] 54 3 0 Nasr, Mr. Mustafa male [null] 0 0 2652 7.2292 [null] C [null] [null] [null] 55 3 0 Naughton, Miss. Hannah female [null] 0 0 365237 7.75 [null] Q [null] [null] [null] 56 3 0 Nenkoff, Mr. Christo male [null] 0 0 349234 7.8958 [null] S [null] [null] [null] 57 3 1 Nicola-Yarred, Master. Elias male 12.0 1 0 2651 11.2417 [null] C C [null] [null] 58 3 1 Nicola-Yarred, Miss. Jamila female 14.0 1 0 2651 11.2417 [null] C C [null] [null] 59 3 0 Nieminen, Miss. Manta Josefina female 29.0 0 0 3101297 7.925 [null] S [null] [null] [null] 60 3 0 Niklasson, Mr. Samuel male 28.0 0 0 363611 8.05 [null] S [null] [null] [null] 61 3 1 Nilsson, Miss. Berta Olivia female 18.0 0 0 347066 7.775 [null] S D [null] [null] 62 3 1 Nilsson, Miss. Helmina Josefina female 26.0 0 0 347470 7.8542 [null] S 13 [null] [null] 63 3 0 Nilsson, Mr. August Ferdinand male 21.0 0 0 350410 7.8542 [null] S [null] [null] [null] 64 3 0 Nirva, Mr. Iisakki Antino Aijo male 41.0 0 0 SOTON/O2 3101272 7.125 [null] S [null] [null] Finland Sudbury, ON 65 3 1 Niskanen, Mr. Juha male 39.0 0 0 STON/O 2. 3101289 7.925 [null] S 9 [null] [null] 66 3 0 Nosworthy, Mr. Richard Cater male 21.0 0 0 A/4. 39886 7.8 [null] S [null] [null] [null] 67 3 0 Novel, Mr. Mansouer male 28.5 0 0 2697 7.2292 [null] C [null] 181 [null] 68 3 1 Nysten, Miss. Anna Sofia female 22.0 0 0 347081 7.75 [null] S 13 [null] [null] 69 3 0 Nysveen, Mr. Johan Hansen male 61.0 0 0 345364 6.2375 [null] S [null] [null] [null] 70 3 0 O'Brien, Mr. Thomas male [null] 1 0 370365 15.5 [null] Q [null] [null] [null] 71 3 0 O'Brien, Mr. Timothy male [null] 0 0 330979 7.8292 [null] Q [null] [null] [null] 72 3 1 O'Brien, Mrs. Thomas (Johanna "Hannah" Godfrey) female [null] 1 0 370365 15.5 [null] Q [null] [null] [null] 73 3 0 O'Connell, Mr. Patrick D male [null] 0 0 334912 7.7333 [null] Q [null] [null] [null] 74 3 0 O'Connor, Mr. Maurice male [null] 0 0 371060 7.75 [null] Q [null] [null] [null] 75 3 0 O'Connor, Mr. Patrick male [null] 0 0 366713 7.75 [null] Q [null] [null] [null] 76 3 0 Odahl, Mr. Nils Martin male 23.0 0 0 7267 9.225 [null] S [null] [null] [null] 77 3 0 O'Donoghue, Ms. Bridget female [null] 0 0 364856 7.75 [null] Q [null] [null] [null] 78 3 1 O'Driscoll, Miss. Bridget female [null] 0 0 14311 7.75 [null] Q D [null] [null] 79 3 1 O'Dwyer, Miss. Ellen "Nellie" female [null] 0 0 330959 7.8792 [null] Q [null] [null] [null] 80 3 1 Ohman, Miss. Velin female 22.0 0 0 347085 7.775 [null] S C [null] [null] 81 3 1 O'Keefe, Mr. Patrick male [null] 0 0 368402 7.75 [null] Q B [null] [null] 82 3 1 O'Leary, Miss. Hanora "Norah" female [null] 0 0 330919 7.8292 [null] Q 13 [null] [null] 83 3 1 Olsen, Master. Artur Karl male 9.0 0 1 C 17368 3.1708 [null] S 13 [null] [null] 84 3 0 Olsen, Mr. Henry Margido male 28.0 0 0 C 4001 22.525 [null] S [null] 173 [null] 85 3 0 Olsen, Mr. Karl Siegwart Andreas male 42.0 0 1 4579 8.4042 [null] S [null] [null] [null] 86 3 0 Olsen, Mr. Ole Martin male [null] 0 0 Fa 265302 7.3125 [null] S [null] [null] [null] 87 3 0 Olsson, Miss. Elina female 31.0 0 0 350407 7.8542 [null] S [null] [null] [null] 88 3 0 Olsson, Mr. Nils Johan Goransson male 28.0 0 0 347464 7.8542 [null] S [null] [null] [null] 89 3 1 Olsson, Mr. Oscar Wilhelm male 32.0 0 0 347079 7.775 [null] S A [null] [null] 90 3 0 Olsvigen, Mr. Thor Anderson male 20.0 0 0 6563 9.225 [null] S [null] 89 Oslo, Norway Cameron, WI 91 3 0 Oreskovic, Miss. Jelka female 23.0 0 0 315085 8.6625 [null] S [null] [null] [null] 92 3 0 Oreskovic, Miss. Marija female 20.0 0 0 315096 8.6625 [null] S [null] [null] [null] 93 3 0 Oreskovic, Mr. Luka male 20.0 0 0 315094 8.6625 [null] S [null] [null] [null] 94 3 0 Osen, Mr. Olaf Elon male 16.0 0 0 7534 9.2167 [null] S [null] [null] [null] 95 3 1 Osman, Mrs. Mara female 31.0 0 0 349244 8.6833 [null] S [null] [null] [null] 96 3 0 O'Sullivan, Miss. Bridget Mary female [null] 0 0 330909 7.6292 [null] Q [null] [null] [null] 97 3 0 Palsson, Master. Gosta Leonard male 2.0 3 1 349909 21.075 [null] S [null] 4 [null] 98 3 0 Palsson, Master. Paul Folke male 6.0 3 1 349909 21.075 [null] S [null] [null] [null] 99 3 0 Palsson, Miss. Stina Viola female 3.0 3 1 349909 21.075 [null] S [null] [null] [null] 100 3 0 Palsson, Miss. Torborg Danira female 8.0 3 1 349909 21.075 [null] S [null] [null] [null] Rows: 1-100 | Columns: 14Note
vastorbit offers a wide range of sample datasets that are ideal for training and testing purposes. You can explore the full list of available datasets in the Datasets, which provides detailed information on each dataset and how to use them effectively. These datasets are invaluable resources for honing your data analysis and machine learning skills within the vastorbit environment.
Model Initialization¶
First we import the
OneHotEncodermodel:from vastorbit.machine_learning.vast import OneHotEncoder
Then we can create the model:
model = OneHotEncoder( drop_first = False, column_naming = "values", )
Important
The model name is crucial for the model management system and versioning. It’s highly recommended to provide a name if you plan to reuse the model later.
Model Training¶
We can now fit the model:
model.fit(data, ["sex", "parch"])
Important
To train a model, you can directly use the
VastFrameor the name of the relation stored in the database.Classes¶
To have a look at the identified classes/categories you can use:
model.categories_
Conversion/Transformation¶
To get the transformed dataset in the form that is encoded, we can use the
transformfunction. Let us transform the data and display the first datapoints.model.transform(data)
123pclassInteger123survivedIntegerAbcnameVarchar(164)123ageDouble123sibspIntegerAbcticketVarchar(36)123fareDoubleAbccabinVarchar(30)AbcembarkedVarchar(20)AbcboatVarchar(100)123bodyIntegerAbchome.destVarchar(100)123sex_femaleInteger123sex_maleInteger123parch_0Integer123parch_1Integer123parch_2Integer123parch_3Integer123parch_4Integer123parch_5Integer123parch_6Integer123parch_9Integer1 3 1 McCormack, Mr. Thomas Joseph [null] 0 367228 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 2 3 1 McCoy, Miss. Agnes [null] 2 367226 23.25 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 3 3 1 McCoy, Miss. Alicia [null] 2 367226 23.25 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 4 3 1 McCoy, Mr. Bernard [null] 2 367226 23.25 [null] Q 16 [null] [null] 0 1 1 0 0 0 0 0 0 0 5 3 1 McDermott, Miss. Brigdet Delia [null] 0 330932 7.7875 [null] Q 13 [null] [null] 1 0 1 0 0 0 0 0 0 0 6 3 0 McEvoy, Mr. Michael [null] 0 36568 15.5 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 7 3 1 McGovern, Miss. Mary [null] 0 330931 7.8792 [null] Q 13 [null] [null] 1 0 1 0 0 0 0 0 0 0 8 3 1 McGowan, Miss. Anna "Annie" 15.0 0 330923 8.0292 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 9 3 0 McGowan, Miss. Katherine 35.0 0 9232 7.75 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 10 3 0 McMahon, Mr. Martin [null] 0 370372 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 11 3 0 McNamee, Mr. Neal 24.0 1 376566 16.1 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 12 3 0 McNamee, Mrs. Neal (Eileen O'Leary) 19.0 1 376566 16.1 [null] S [null] 53 [null] 1 0 1 0 0 0 0 0 0 0 13 3 0 McNeill, Miss. Bridget [null] 0 370368 7.75 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 14 3 0 Meanwell, Miss. (Marion Ogden) [null] 0 SOTON/O.Q. 392087 8.05 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 15 3 0 Meek, Mrs. Thomas (Annie Louise Rowley) [null] 0 343095 8.05 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 16 3 0 Meo, Mr. Alfonzo 55.5 0 A.5. 11206 8.05 [null] S [null] 201 [null] 0 1 1 0 0 0 0 0 0 0 17 3 0 Mernagh, Mr. Robert [null] 0 368703 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 18 3 1 Midtsjo, Mr. Karl Albert 21.0 0 345501 7.775 [null] S 15 [null] [null] 0 1 1 0 0 0 0 0 0 0 19 3 0 Miles, Mr. Frank [null] 0 359306 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 20 3 0 Mineff, Mr. Ivan 24.0 0 349233 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 21 3 0 Minkoff, Mr. Lazar 21.0 0 349211 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 22 3 0 Mionoff, Mr. Stoytcho 28.0 0 349207 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 23 3 0 Mitkoff, Mr. Mito [null] 0 349221 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 24 3 1 Mockler, Miss. Helen Mary "Ellie" [null] 0 330980 7.8792 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 25 3 0 Moen, Mr. Sigurd Hansen 25.0 0 348123 7.65 F G73 S [null] 309 [null] 0 1 1 0 0 0 0 0 0 0 26 3 1 Moor, Master. Meier 6.0 0 392096 12.475 E121 S 14 [null] [null] 0 1 0 1 0 0 0 0 0 0 27 3 1 Moor, Mrs. (Beila) 27.0 0 392096 12.475 E121 S 14 [null] [null] 1 0 0 1 0 0 0 0 0 0 28 3 0 Moore, Mr. Leonard Charles [null] 0 A4. 54510 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 29 3 1 Moran, Miss. Bertha [null] 1 371110 24.15 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 30 3 0 Moran, Mr. Daniel J [null] 1 371110 24.15 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 31 3 0 Moran, Mr. James [null] 0 330877 8.4583 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 32 3 0 Morley, Mr. William 34.0 0 364506 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 33 3 0 Morrow, Mr. Thomas Rowan [null] 0 372622 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 34 3 1 Moss, Mr. Albert Johan [null] 0 312991 7.775 [null] S B [null] [null] 0 1 1 0 0 0 0 0 0 0 35 3 1 Moubarek, Master. Gerios [null] 1 2661 15.2458 [null] C C [null] [null] 0 1 0 1 0 0 0 0 0 0 36 3 1 Moubarek, Master. Halim Gonios ("William George") [null] 1 2661 15.2458 [null] C C [null] [null] 0 1 0 1 0 0 0 0 0 0 37 3 1 Moubarek, Mrs. George (Omine "Amenia" Alexander) [null] 0 2661 15.2458 [null] C C [null] [null] 1 0 0 0 1 0 0 0 0 0 38 3 1 Moussa, Mrs. (Mantoura Boulos) [null] 0 2626 7.2292 [null] C [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 39 3 0 Moutal, Mr. Rahamin Haim [null] 0 374746 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 40 3 1 Mullens, Miss. Katherine "Katie" [null] 0 35852 7.7333 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 41 3 1 Mulvihill, Miss. Bertha E 24.0 0 382653 7.75 [null] Q 15 [null] [null] 1 0 1 0 0 0 0 0 0 0 42 3 0 Murdlin, Mr. Joseph [null] 0 A./5. 3235 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 43 3 1 Murphy, Miss. Katherine "Kate" [null] 1 367230 15.5 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 44 3 1 Murphy, Miss. Margaret Jane [null] 1 367230 15.5 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 45 3 1 Murphy, Miss. Nora [null] 0 36568 15.5 [null] Q 16 [null] [null] 1 0 1 0 0 0 0 0 0 0 46 3 0 Myhrman, Mr. Pehr Fabian Oliver Malkolm 18.0 0 347078 7.75 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 47 3 0 Naidenoff, Mr. Penko 22.0 0 349206 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 48 3 1 Najib, Miss. Adele Kiamie "Jane" 15.0 0 2667 7.225 [null] C C [null] [null] 1 0 1 0 0 0 0 0 0 0 49 3 1 Nakid, Miss. Maria ("Mary") 1.0 0 2653 15.7417 [null] C C [null] [null] 1 0 0 0 1 0 0 0 0 0 50 3 1 Nakid, Mr. Sahid 20.0 1 2653 15.7417 [null] C C [null] [null] 0 1 0 1 0 0 0 0 0 0 51 3 1 Nakid, Mrs. Said (Waika "Mary" Mowad) 19.0 1 2653 15.7417 [null] C C [null] [null] 1 0 0 1 0 0 0 0 0 0 52 3 0 Nancarrow, Mr. William Henry 33.0 0 A./5. 3338 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 53 3 0 Nankoff, Mr. Minko [null] 0 349218 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 54 3 0 Nasr, Mr. Mustafa [null] 0 2652 7.2292 [null] C [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 55 3 0 Naughton, Miss. Hannah [null] 0 365237 7.75 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 56 3 0 Nenkoff, Mr. Christo [null] 0 349234 7.8958 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 57 3 1 Nicola-Yarred, Master. Elias 12.0 1 2651 11.2417 [null] C C [null] [null] 0 1 1 0 0 0 0 0 0 0 58 3 1 Nicola-Yarred, Miss. Jamila 14.0 1 2651 11.2417 [null] C C [null] [null] 1 0 1 0 0 0 0 0 0 0 59 3 0 Nieminen, Miss. Manta Josefina 29.0 0 3101297 7.925 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 60 3 0 Niklasson, Mr. Samuel 28.0 0 363611 8.05 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 61 3 1 Nilsson, Miss. Berta Olivia 18.0 0 347066 7.775 [null] S D [null] [null] 1 0 1 0 0 0 0 0 0 0 62 3 1 Nilsson, Miss. Helmina Josefina 26.0 0 347470 7.8542 [null] S 13 [null] [null] 1 0 1 0 0 0 0 0 0 0 63 3 0 Nilsson, Mr. August Ferdinand 21.0 0 350410 7.8542 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 64 3 0 Nirva, Mr. Iisakki Antino Aijo 41.0 0 SOTON/O2 3101272 7.125 [null] S [null] [null] Finland Sudbury, ON 0 1 1 0 0 0 0 0 0 0 65 3 1 Niskanen, Mr. Juha 39.0 0 STON/O 2. 3101289 7.925 [null] S 9 [null] [null] 0 1 1 0 0 0 0 0 0 0 66 3 0 Nosworthy, Mr. Richard Cater 21.0 0 A/4. 39886 7.8 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 67 3 0 Novel, Mr. Mansouer 28.5 0 2697 7.2292 [null] C [null] 181 [null] 0 1 1 0 0 0 0 0 0 0 68 3 1 Nysten, Miss. Anna Sofia 22.0 0 347081 7.75 [null] S 13 [null] [null] 1 0 1 0 0 0 0 0 0 0 69 3 0 Nysveen, Mr. Johan Hansen 61.0 0 345364 6.2375 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 70 3 0 O'Brien, Mr. Thomas [null] 1 370365 15.5 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 71 3 0 O'Brien, Mr. Timothy [null] 0 330979 7.8292 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 72 3 1 O'Brien, Mrs. Thomas (Johanna "Hannah" Godfrey) [null] 1 370365 15.5 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 73 3 0 O'Connell, Mr. Patrick D [null] 0 334912 7.7333 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 74 3 0 O'Connor, Mr. Maurice [null] 0 371060 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 75 3 0 O'Connor, Mr. Patrick [null] 0 366713 7.75 [null] Q [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 76 3 0 Odahl, Mr. Nils Martin 23.0 0 7267 9.225 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 77 3 0 O'Donoghue, Ms. Bridget [null] 0 364856 7.75 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 78 3 1 O'Driscoll, Miss. Bridget [null] 0 14311 7.75 [null] Q D [null] [null] 1 0 1 0 0 0 0 0 0 0 79 3 1 O'Dwyer, Miss. Ellen "Nellie" [null] 0 330959 7.8792 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 80 3 1 Ohman, Miss. Velin 22.0 0 347085 7.775 [null] S C [null] [null] 1 0 1 0 0 0 0 0 0 0 81 3 1 O'Keefe, Mr. Patrick [null] 0 368402 7.75 [null] Q B [null] [null] 0 1 1 0 0 0 0 0 0 0 82 3 1 O'Leary, Miss. Hanora "Norah" [null] 0 330919 7.8292 [null] Q 13 [null] [null] 1 0 1 0 0 0 0 0 0 0 83 3 1 Olsen, Master. Artur Karl 9.0 0 C 17368 3.1708 [null] S 13 [null] [null] 0 1 0 1 0 0 0 0 0 0 84 3 0 Olsen, Mr. Henry Margido 28.0 0 C 4001 22.525 [null] S [null] 173 [null] 0 1 1 0 0 0 0 0 0 0 85 3 0 Olsen, Mr. Karl Siegwart Andreas 42.0 0 4579 8.4042 [null] S [null] [null] [null] 0 1 0 1 0 0 0 0 0 0 86 3 0 Olsen, Mr. Ole Martin [null] 0 Fa 265302 7.3125 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 87 3 0 Olsson, Miss. Elina 31.0 0 350407 7.8542 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 88 3 0 Olsson, Mr. Nils Johan Goransson 28.0 0 347464 7.8542 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 89 3 1 Olsson, Mr. Oscar Wilhelm 32.0 0 347079 7.775 [null] S A [null] [null] 0 1 1 0 0 0 0 0 0 0 90 3 0 Olsvigen, Mr. Thor Anderson 20.0 0 6563 9.225 [null] S [null] 89 Oslo, Norway Cameron, WI 0 1 1 0 0 0 0 0 0 0 91 3 0 Oreskovic, Miss. Jelka 23.0 0 315085 8.6625 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 92 3 0 Oreskovic, Miss. Marija 20.0 0 315096 8.6625 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 93 3 0 Oreskovic, Mr. Luka 20.0 0 315094 8.6625 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 94 3 0 Osen, Mr. Olaf Elon 16.0 0 7534 9.2167 [null] S [null] [null] [null] 0 1 1 0 0 0 0 0 0 0 95 3 1 Osman, Mrs. Mara 31.0 0 349244 8.6833 [null] S [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 96 3 0 O'Sullivan, Miss. Bridget Mary [null] 0 330909 7.6292 [null] Q [null] [null] [null] 1 0 1 0 0 0 0 0 0 0 97 3 0 Palsson, Master. Gosta Leonard 2.0 3 349909 21.075 [null] S [null] 4 [null] 0 1 0 1 0 0 0 0 0 0 98 3 0 Palsson, Master. Paul Folke 6.0 3 349909 21.075 [null] S [null] [null] [null] 0 1 0 1 0 0 0 0 0 0 99 3 0 Palsson, Miss. Stina Viola 3.0 3 349909 21.075 [null] S [null] [null] [null] 1 0 0 1 0 0 0 0 0 0 100 3 0 Palsson, Miss. Torborg Danira 8.0 3 349909 21.075 [null] S [null] [null] [null] 1 0 0 1 0 0 0 0 0 0 Rows: 1-100 | Columns: 22Please refer to
transform()for more details on transforming aVastFrame.Similarly, you can perform the inverse transform to get the original features using:
model.inverse_transform(data_transformed)
The variable
data_transformedincludes theOneHotEncodercomponents.Model Exporting¶
To Memmodel
model.to_memmodel()
Note
MemModelobjects serve as in-memory representations of machine learning models. They can be used for both in-database and in-memory prediction tasks. These objects can be pickled in the same way that you would pickle ascikit-learnmodel.The preceding methods for exporting the model use
MemModel, and it is recommended to useMemModeldirectly.SQL
To get the SQL query use below:
model.to_sql()
To Python
To obtain the prediction function in Python syntax, use the following code:
X = [['1', '3']] model.to_python()(X)
Hint
The
to_python()method is used to transform the data and compute the different categories. For specific details on how to use this method for different model types, refer to the relevant documentation for each model.- __init__(name: str = None, overwrite_model: bool = False, extra_levels: dict | None = None, drop_first: bool = True, ignore_null: bool = True, separator: str = '_', column_naming: str = 'indices', null_column_name: str = 'null', **kwargs) None¶
Methods
__init__([name, overwrite_model, ...])contour([nbins, chart])Draws the model's contour plot.
deployInverseSQL([key_columns, ...])Returns the SQL code needed to deploy the inverse model.
deploySQL([X, key_columns, exclude_columns])Returns the SQL code needed to deploy the model.
drop()Drops the model from the VAST DataBase.
export_models(name, path[, kind])Exports machine learning models.
fit(input_relation[, X, return_report])Trains the model.
get_attributes([attr_name])Returns the model attributes.
get_match_index(x, col_list[, str_check])Returns the matching index.
Returns the parameters of the model.
get_plotting_lib([class_name, chart, ...])Returns the first available library (Plotly, Matplotlib) to draw a specific graphic.
import_models(path[, schema, kind])Imports machine learning models.
inverse_transform(vdf[, X])Applies the Inverse Model on a
VastFrame.set_params([parameters])Sets the parameters of the model.
Summarizes the model.
to_binary(path)Exports the model to the VAST Binary format.
Converts the model to an InMemory object that can be used for different types of predictions.
to_python([return_proba, ...])Returns the Python function needed for in-memory scoring without using built-in VAST functions.
to_sql([X, return_proba, ...])Returns the SQL code needed to deploy the model without using built-in VAST functions.
transform([vdf, X])Applies the model on a
VastFrame.Attributes