Senior AI Software Engineer, GenAI Framework Job at NVIDIA, Remote

SGJSamtxMDhKT3pKaSsvYmpqamZQemNoTXc9PQ==
  • NVIDIA
  • Remote

Job Description

We are now looking for AI Software Engineers for NeMo! NVIDIA NeMo is an open-source, scalable and cloud-native framework built for researchers and developers working on Large Language Models (LLM), Multimodal (MM), and Speech AI. NeMo provides end-to-end model training, including data curation, alignment, customization, evaluation, deployment and tooling to optimize performance and user experience. In this role you will craft and implement new model development features, optimizations, define APIs, analyze and tune performance, expand functionality coverage to build larger, coherent toolsets and libraries. You will collaborate with internal partners, users, and members of the open source community to analyze, define and implement highly optimized solutions.

What you’ll be doing:

  • Develop the GenAI open source NeMo framework and Megatron Core.

  • Solve large-scale, end-to-end AI training and inference-deployment challenges (data curation, pre-processing, orchestrate and run model training and tuning, model serving).

  • Work at the intersection of deep learning applications, libraries, frameworks, and the entire software stack.

  • Performance tuning and optimizations of deep learning framework & software components.

  • Research, prototype and develop effective AI tools and pipelines.

What we need to see:

  • MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related field and 5+ years of industry experience.

  • Experience with AI Frameworks (e.g. PyTorch, JAX), and/or inference and deployment environments (e.g. TRT, ONNX, Triton).

  • Proficient in Python programming, software design, debugging, performance analysis, test design and documentation.

  • Consistent record of working effectively across multiple engineering initiatives and improving AI libraries with new innovations.

  • Solid understanding of deep learning fundamentals and techniques.

Ways to stand out from the crowd:

  • Experience with large scale AI training and understanding of the compute system concepts (latency/throughput bottlenecks, pipelining, multiprocessing), related performance analysis and tuning.

  • Prior experience with Generative AI techniques applied to LLM and MM learning (Image, Video, Speech).

  • Knowledge of GPU/CPU architecture and related numerical software.

  • Experience with cloud computing (e.g. end-to-end pipelines for AI training and inference on CSP (AWS/Azure/GCP).

  • Contributions to open source deep learning frameworks.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working with us. If you're creative and autonomous, we want to hear from you!

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. NVIDIA

Job Tags

Remote job,

Similar Jobs

Aramark

EVS Worker - BSWH College Station Job at Aramark

 ...assigned area(s) to meet customer, client, and patient satisfaction. Essential functions and responsibilities of the position may vary by Aramark location based on client requirements and business needs. Job Responsibilities Adheres to established procedures to... 

Fedex

Seasonal Package Handler Job at Fedex

 ...*Job Description:****Position Overview:** FedEx is seeking enthusiastic individuals to join our...  ...Handlers. This role is crucial for ensuring timely delivery of packages during the peak holiday season. Full-time and part-time positions are available to suit your schedule... 

Harrison Gray Search & Consulting

Private Wealth Associate Job at Harrison Gray Search & Consulting

 ...Job Description Job Description Harrison Gray Search has partnered with a premier investment management firm seeking their next Private Wealth Associate in Los Angeles. Associates are client service professionals who exhibit drive, ambition, and exceptional communication... 

Get It Recruit - Finance

Tax Manager, CPA - Remote Job at Get It Recruit - Finance

Position: Tax Manager (Full-Time, Remote) We're excited to welcome a Tax Manager to our team! If you have a passion for tax and a commitment...  ...for hybrid schedules. Award-Winning Team: Join a recognized CPA firm that values its employees and has been named a top... 

Jamba

Shift Lead Job at Jamba

 ...Working in a Jamba store as a Team Lead is different from any other job. You are creating memories of connection with our guests every...  ...store manager in executing store operations during scheduled shifts. This job deploys team members and delegates tasks so that team...