IIT Gandhinagar Researchers Unveil Ganga-1B, an LLM for Hindi Language
- IIT Gandhinagar researchers launched Ganga-1B, an AI language model for Hindi that outperforms existing models.
- The research group spent almost 1.5 years developing the model using open-source data from various websites.
- The team is also developing AI models for other Indian languages and exploring applications in e-governance and education.
The Lingo Research Group at the Indian Institute of Technology Gandhinagar (IITGN) has announced the first product of Project Unity, an initiative that aims to celebrate and harness India's rich linguistic diversity by creating a comprehensive resource for the country's major languages.
They have developed an artificial intelligence (AI) model called “Ganga-1B,” a pre-trained language learning model (LLM) for the Hindi language.
Ganga-1B is an AI language model for Hindi
The Ganga-1B model has been trained on a large collection of public domain Hindi language data, including news articles, web documents, books, government publications, educational materials, and selected social media conversations.
Native Indian speakers have also reviewed the dataset to ensure its high quality.
Releasing the first product of the #Unity project @lingoiitgn , Ganga-1B , a pretrained LLM for Hindi. Created from Scratch using the largest curated Hindi Dataset. Ganga-1B is outperforming all open-source LLMs supporting Hindi with sizes till 7B.
— Mayank (@mayank_iitgn) July 3, 2024
Ganga-1B performance and development
Ganga-1B performs better than existing open-source models for Indian languages, including models with up to 7 billion parameters.
Newsletter
The corridor, every morning.
Funding rounds and cross-border capital moves, one email, five minutes.
The research group spent almost 1.5 years developing the Ganga-1B model using open-source data from various websites.
The model was downloaded by over 600 people within 48 hours of its release.
Project Unity’s other language models
The research team is also creating models for Tamil, Telugu, Marathi, Gujarati, and Urdu.
In addition, the group is exploring the use of AI in e-governance for regional languages. It is also working on an education LLM for school students and teachers.
Edited by Harshajit Sarmah
More in News
