Job Details

Where You Come In

This is a rare opportunity to help define the future of large-scale language models. You will work across the entire lifecycle of model development - from large-scale pre-training, to targeted mid-training, to post-training alignment and capability refinement.

You will operate at the frontier of scaling laws, reasoning, and alignment, directly shaping how foundation models learn, generalize, and behave in real-world deployments.

What You'll Do

This role spans both the "science" and "engineering" dimensions of research - two aspects that are equally important.

You will work across modeling, data, systems, and evaluation.

Modeling

• Architect and scale large autoregressive language models.
• Design improved pre-training objectives to enhance reasoning, knowledge retention, and compositional generalization.
• Develop mid-training strategies such as continued pre-training, domain adaptation, curriculum learning, and synthetic data integration.
• Advance post-training techniques, including instruction tuning, preference optimization, reinforcement learning, distillation, and inference-time compute scaling.
• Study and improve long-context modeling, planning depth, and multi-step reasoning behavior.

Data

• Curate and construct massive, high-quality text corpora for pre-training.
• Design synthetic data pipelines for reasoning, tool use, mathematics, coding, and structured problem solving.
• Develop filtering, mixture weighting, and curriculum strategies that shape emergent capabilities.
• Formulate new tasks that improve coherence, logical consistency, factual grounding, and robustness.

Systems

• Train frontier-scale language models across large GPU clusters.
• Optimize distributed training (data, tensor, pipeline parallelism), mixed precision, and memory efficiency.
• Build infrastructure for large-scale experimentation, ablations, and reproducibility.
• Improve inference efficiency and support scalable deployment.

Evaluation: define and build evaluation frameworks for language intelligence, including:

• Multi-step reasoning and mathematical problem solving
• Coding and structured generation
• Knowledge grounding and factuality
• Planning and agentic behavior
• Instruction following and alignment
• Track capability development across pre-training, mid-training, and post-training.
• Close the loop between evaluation signals and data/model improvements.

Who You Are

• Strong foundation in machine learning and large language models.
• Deep understanding of autoregressive transformers and large-scale training dynamics.
• Experience with pre-training large models and/or post-training techniques such as instruction tuning, RLHF, preference optimization, or distillation.
• Hands-on experience with PyTorch and distributed training at scale.
• Comfortable operating across research and production environments.

What Sets You Apart (Bonus Points)

• Experience training frontier-scale language models from scratch.
• Research contributions in scaling laws, reasoning, alignment, or inference-time compute.
• Experience designing large-scale synthetic reasoning data.
• Expertise in long-context modeling or structured reasoning systems.
• Experience optimizing models for real-world deployment constraints.

Your application are reviewed by real people.

Compensation

The base pay range for this role is $250,000 - $450,000 per year.

About Luma

Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world.

We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.