Post-training data · Reward signals · RL

Post-training data for Indic language models.

Most of India speaks Hindi, Hinglish and a dozen other languages that LLMs still handle poorly, because the post-training data does not exist. Bhabha AI builds it, layer by layer: instruction data for SFT, scored data for reward models, verifiable tasks for RL, and the open-source tooling to generate more.

BhabhaAI/openhermes-2.5-hindiexample record
source · en
Explain photosynthesis in simple words and write its equation.
translated · hi
प्रकाश संश्लेषण को सरल शब्दों में समझाइए और उसका समीकरण लिखिए।
romanized · hinglish
Prakash sanshleshan ko saral shabdon mein samjhaiye aur uska samikaran likhiye.
✓ translate-safe✓ repetition-checked✓ de-duplicated
240K+
dataset downloads on Hugging Face
3.9M
rows of open training data
12K+
downloads of Gajendra-v0.1
150+
GitHub stars on Dataformer

Source: Hugging Face & GitHub public stats

Post-training & RL

Data for every stage of post-training, from SFT to reward.

Capabilities come from post-training: supervised data first, then preference and reward signals, then reinforcement learning against tasks that can be checked. For Indic languages, almost none of that data exists. We build each layer and release it openly.

10 से विभाजित संख्या 6 है। योंगी ने एक निश्चित संख्या से 15 घटाकर परिणाम प्राप्त किया। उसे क्या परिणाम मिला?

gold answer 45 · checked by exact match

#sampled rolloutansr
  • 1x / 10 = 6 → x = 60 → 60 − 15451.0
  • 26 − 15−90.0
  • 310 × 6 = 60, परिणाम = 60 − 15451.0
  • 460 + 15750.0
group mean reward 0.50rollouts shown are illustrative
  1. 01Released

    SFT data

    Instruction and chat data in Hindi, Hinglish and English to teach the base behaviour.

    1.1M+ rows

  2. 02Released

    Reward signals

    Instructions and responses scored for complexity and quality, ready for training reward models and data filters.

    160K scored

  3. 03Released

    Verifiable tasks

    Problems with checkable answers (math word problems with worked solutions, RAG questions with gold answers) to seed RL with verifiable rewards.

    200K+ tasks

  4. 04For partners

    RL environments

    Custom environments, graders and rollouts for Indic-language tasks, built with teams post-training their own models.

    Custom builds

How we work

A pipeline from raw text to reward signal.

Translation alone produces noisy data. Our edge is everything around it: deciding what to translate, catching what breaks, and measuring what is worth training on.

  1. 01

    Source & translate

    We take the strongest open English instruction, math and RAG corpora and translate them into Hindi and Hinglish with IndicTrans2 — skipping code, formulas and names that must stay untouched.

  2. 02

    Filter & score

    Every row is checked against its English source. We drop prompts that break under translation (code, wordplay, spelling tasks) and degenerate, repetitive output, then score what remains for quality and complexity, DEITA-style.

  3. 03

    Generate

    Where no source exists, we generate native Hindi data synthetically with Dataformer, our open-source engine for research-backed synthetic data at scale.

  4. 04

    Train & close the loop

    We fine-tune models on the result, like Gajendra, then score their outputs and put them in front of real users. What fails becomes the next round of data.

Open source

What we have shipped.

Dataformer

Open-source library · Python

150+ ★

A framework for creating high-quality synthetic datasets. One async API across OpenAI, Groq, Together, DeepInfra and OpenRouter, with rate-limit handling, response caching and implementations of published data-generation methods.

Gajendra

Model · 7B

12K+ downloads

Our Hindi-Hinglish-English instruction-tuned chat model, released openly on Hugging Face and quantized by the community for local inference.

Indic Chat

Open-source app

Open source

A chat interface for serving Indic LLMs side by side, built to collect real-world, openly licensed conversation data and to benchmark Indic models arena-style.

Open datasets

16 datasets, free on Hugging Face.

SFT data, scored data for reward models, verifiable math and retrieval tasks, and summarization, in Hindi, Hinglish and English. Used by researchers and builders training Indic models.

All datasets on Hugging Face ↗

Models

Trained on our own data, released in the open.

Sample output · Gajendra-v0.1

User: Explain the concept of ‘Photosynthesis’ in Hindi and also write the equation.

Gajendra: प्रकाश संश्लेषण एक ऐसी प्रक्रिया है जिसके द्वारा पौधे, शैवाल और कुछ बैक्टीरिया सूर्य के प्रकाश, कार्बन डाइऑक्साइड और पानी का उपयोग करके ग्लूकोज और ऑक्सीजन का उत्पादन करते हैं।6 CO₂ + 6 H₂O + प्रकाश ऊर्जा → C₆H₁₂O₆ + 6 O₂

Work with us

Post-training an Indic model?

We build custom SFT and preference data, reward signals, and RL environments with verifiable rewards for teams post-training LLMs for Indian users.