Fitting data into types¶
The base feature of typefit is to fit data into Python data structures. By example:
from typing import NamedTuple, Text
from typefit import typefit
class Item(NamedTuple):
id: int
title: Text
item = typefit(Item, {"id": 42, "title": "Item title yay"})
assert item.title == "Item title yay"
It will use typing annotations in order to understand what kind of data structure you expect and then it will create an instance of the specified type based on the provided data.
Fitting Enum¶
Typefit can also be used to fit data to an Enum.
from typefit import typefit
class Color(Enum):
RED = 1
GREEN = 2
BLUE = 3
item = typefit(Color, 2)
assert item == Color.GREEN
typefit will return the attribute of the enum class if the value is valid or else it will raise a ValueError exception.
Fitting mappings¶
The concept is as simple as that but it can become pretty powerful. Firstly, typing definitions can be recursive, so this would work:
from dataclasses import dataclass, field
from typing import List, Text
from typefit import typefit
@dataclass
class Comment:
text: Text
children: List["Comment"] = field(default_factory=list)
data = {
"text": "Hello",
"children": [
{
"text": "Howdy",
},
{
"text": "Hello to you too",
},
]
}
comment = typefit(Comment, data)
You’ll notice that we switched from typing.NamedTuple
to a
dataclass. Both approaches work, that’s up to you to decide which fits your
needs most.
Note
This example uses a forward reference as type because the Comment
is not defined at the time we need it. This means that Python will have to
be able to resolve this reference later, meaning that this class has to be
importable. If hidden inside a 2-nd order function it won’t work.
Custom field names¶
If you don’t want your fields to bear the exact name as they have in the JSON that you are deserializing, you can specify customized names:
from dataclasses import dataclass, field
from typing import Text
from typefit import typefit, meta, other_field
@dataclass
class Info:
some_thing: Text = field(metadata=meta(source=other_field('someThing')))
x: Info = typefit(Info, {"someThing": "foo"})
assert x.some_thing == "foo"
Parsing narrow types¶
This system also allows you to parse input and coerce it into a more pythonic
object. A typical example for that would be to parse a date. Typefit uses
pendulum
in order to parse dates and will return a Pendulum date time
object.
from typefit import narrows, typefit
data = "2019-01-01T00:00:00Z"
date = typefit(narrows.DateTime, data)
assert date.month == 1
Note
Date narrow types depend on the pendulum
package, however Typefit
doesn’t list it as a dependency. If you want to be able to use those, you
need to install pendulum
for your project.
Narrows are types that will help narrow-down the data you are parsing to a Python function. Of course, you might not want to limit yourself to builtin narrow types.
Custom type¶
You can provide a custom narrow type simply by creating a type whose
constructor will have exactly a single argument which is properly annotated
(with a simple type like int
or Text
but not a generic like Union
or List
).
from typing import Text
from typefit import typefit
class Name:
def __init__(self, full_name: Text):
split = full_name.split(' ')
if len(split) != 2:
raise ValueError('Too many names')
self.first_name, self.last_name = split
name = typefit(Name, "Rémy Sanchez")
print(name.first_name)
print(name.last_name)
Wrapper type¶
However sometimes you just want to wrap a type that already exists but doesn’t have the right arguments in its constructor. That’s the case of the date-related narrows described above. Let’s dissect one.
import pendulum
class TimeStamp(pendulum.DateTime):
def __new__(cls, date: int):
return pendulum.from_timestamp(date)
You’ll probably ask why is there some funny business with __new__
instead
of just created a function that will parse and return the desired value. The
answer is that you’re doing type annotations so you must provide valid types
otherwise you’ll confuse your static type checker, which loses the interest of
annotating types in a first place.
Reference¶
You’ll find here the reference of the public API. Private function are documented in the source code but might change or disappear without notice. The current API is not stable but will try to change as little as possible before version 1.
Typefit¶
The core typefit module only exposes one function.
- typefit.typefit(t: Type[typefit.nodes.T], value: Any) → typefit.nodes.T¶
Fits a JSON-decoded value into native Python type-annotated objects.
This uses the default sane settings but it might not be up to your taste. By example, errors will be reported in the logging module using ANSI escape codes for syntactical coloration, however depending on the situation you might not want that.
If you want more flexibility and configuration, you can use the
Fitter
directly.- Parameters
t –
Type to fit the value into. Currently supported types are:
Simple builtins like
int
,float
,typing.Text
,typing.bool
Enumerations which are subclass of
enum.Enum
.Custom types. The constructor needs to accept exactly one parameter and that parameter should have a typing annotation.
typing.Union
to define several possible typestyping.List
to declare a list and the type of list values
value – Value to be fit into the type
- Returns
If the value fits, a value of the right type is returned.
- Return type
T
- Raises
ValueError – When the fitting cannot be done, a
ValueError
is raised.
See also
- class typefit.Fitter(no_unwanted_keys: bool = False, error_reporter: Optional[typefit.reporting.ErrorReporter] = None)¶
Core class responsible for the fitting of objects.
Create an instance with the configuration you want
Use the
fit()
method to do your fittings
Notes
Overall orchestrator of the fitting. A lot of the logic happens in the nodes, but this class is responsible for executing the logic in the right order and also holds configuration.
- __init__(no_unwanted_keys: bool = False, error_reporter: Optional[typefit.reporting.ErrorReporter] = None)¶
Constructs the instance.
- Parameters
no_unwanted_keys – If set to
True
, it will not be allowed to have unwanted keys when fitting mappings into dataclasses/named tuples.error_reporter – Error reporting for when a validation fails. By default no report is made but you might want to arrange reporting for your needs, otherwise you’re going to be debugging in the blind.
- fit(t: Type[typefit.nodes.T], value: Any) → typefit.nodes.T¶
Fits data into a type. The data is expected to be JSON-decoded values (strings, ints, bools, etc).
On failure a ValueError will arise and if an error reporter is set it will be sent the node to generate the error report.
- Parameters
t – Type you want to fit the value into
value – Value you want to fit into a type
- Raises
ValueError –
Narrows¶
Narrows are data types that integrate some form of parsing to generate Python objects from more generic types like strings. All those classes accept exactly one argument to their constructor which is the data structure to convert.
- class typefit.narrows.Date(date: str)¶
Parses a date and returns a standard pendulum Date.
- class typefit.narrows.DateTime(date: str)¶
Parses a date/time and returns a standard pendulum DateTime.
- class typefit.narrows.TimeStamp(date: int)¶
Parses a Unix timestamp and returns a standard pendulum DateTime.
Meta¶
The meta module allows to specify meta-information on fields and types in order to affect the way that typefit will deal with them.
- class typefit.meta.Source(value_from_json: Callable[[Dict[str, Any]], Any], value_to_json: Callable[[str, Any], Dict])¶
Provides a way back and forth to convert the data from and to a JSON structure. Since the conversion from JSON is able to dig into any number of fields from the original mapping, the conversion to JSON will have to produce a dictionary as output, even if it has only one key.
- property value_from_json¶
Alias for field number 0
- property value_to_json¶
Alias for field number 1
- typefit.meta.meta(source: Optional[typefit.meta.Source] = None)¶
Generates the field metadata for a field based on what arguments are provided. By example, to source a field into a field with another name in the JSON data, you can do something like:
>>> @dataclass >>> class Foo: >>> x: int = field(metadata=meta(source=other_field('x')))
See also
- Parameters
source – Source function, that given the mapping as input will provide the value as output. If the value isn’t found in the mapping, a KeyError should arise.
- typefit.meta.other_field(name: str) → typefit.meta.Source¶
Looks for the value in a field named name.
- Parameters
name – Name of the field to look for the value into.