Size no longer matters for large language models

Size no longer matters for large language models!

Lingua Custodia’s new compact open-source language model Fin-Pythia-1.4B outperforms larger language models.

The French Fintech company Lingua Custodia, a specialist in Natural Language Processing (NLP) applied to Finance since 2011, releases its first open source model on the Hugging Face Hub specifically trained for sentiment analysis of financial text.

Fin-Pythia-1.4B is a language model that’s been fine-tuned on financial documents and instructions. It can understand complex financial jargon and terminology. It is compact in size, which makes it fast to run without compromising the quality of the output.

Lingua Custodia’s language model is extremely accurate in analyzing financial sentiment and outperforms well-known models like GPT-4 and BloombergGPT.

Raheel Qader, The head of Lingua Custodia’s Research and Development lab highlights “to produce accurate language models, the essential bases are data, expertise and experience. Following 4 months of research, we were delighted to find that our open source language model outperformed both GPT-4 and and BloombergGPT in various financial NLP tasks. This demonstrates clearly that size is not necessary to create powerful models and I am delighted that the research team here at Lingua Custodia was able to bring the model to the open source community so rapidly. This places Lingua Custodia firmly at the forefront of generative ai technologies”

Lingua Custodia’s new compact open-source language model Fin-Pythia-1.4B outperforms larger language models

Fin-Pythia-1.4B model card is available at this linkhttps://huggingface.co/LinguaCustodia/fin-pythia-1.4b

Lingua Custodia plan to release further language models, all focused on the financial domain.

As part of their research efforts, Lingua Custodia will be releasing a series of other large language models targeting various financial tasks including machine translation.
About Lingua Custodia

Lingua Custodia is a Fintech company leader in Natural Language Processing (NLP) for Finance. It was created in 2011 by finance professionals to initially offer specialised machine translation.

 

 

About Lingua Custodia:

Lingua Custodia is a Fintech company leader in Natural Language Processing (NLP) for Finance. It was created in 2011 by finance professionals to initially offer specialised machine translation.

Leveraging its state-of-the-art NLP expertise, the company now offers a growing range of applications: Speech-to-Text automation, Linguistic data extraction from unstructured documents, etc. and achieves superior quality thanks to highly domain-focused machine learning algorithms.

Its cutting-edge technology has been regularly rewarded and recognised by both the industry and clients: Investment houses, global investment banks, private banks, financial divisions within major corporations and service providers for financial institutions.

Share This Story!

White Paper

The AI Revolution In Financial Services

Read More