All posts tagged with 'BERT'
Combining text with numerical and categorical features for classification
Classification with transformer models A common approach for classification tasks with text data is to fine-tune a pre-trained transformer model on domain-specific data. At FreeAgent we apply this approach to automatically categorise bank transactions, using raw inputs that are a mixture of text, numerical and categorical data types. The current approach is to concatenate the input features for each transaction into a single string before passing to the model. For… Continue reading
Training Hugging Face models in parallel with SageMaker
In this post I'll describe how we train our Hugging Face models in a fraction of the time with a data parallel approach. Continue reading
Fine-Tuning BERT for multiclass categorisation with Amazon SageMaker
This post describes our approach to fine-tuning a BERT model for multiclass categorisation with Hugging Face and Amazon SageMaker. Continue reading