get a rust job
JobsSalary guideJob alertsPost a job

Details

All Rust jobs.

Details

get a rust job

A curated job board for Rust engineers. Manually reviewed, Rust-only.

Browse

  • All jobs
  • Remote Rust jobs
  • Senior Rust jobs
  • Rust jobs in Europe
  • Rust jobs in LATAM
  • Worldwide Rust jobs
  • Rust jobs in United States
  • Rust jobs in Germany
  • Post a job
  • Job alerts
  • Salary guide
  • About
  • Contact

© 2026 getarustjob. All rights reserved.

  • Terms
  • Privacy
  • Refund Policy
  • Legal Notice

Details

Details

Back to jobs

Details

Senior Software Engineer, Inference Performance

Tensordyne·Senior·Remote · Munich·$120k–$180k USD

Posted Nov 13, 2026·tensordyne.com

Apply

About Tensordyne

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

The role

You'll build the software stack that takes a model from code down to the hardware: the abstractions, kernels, libraries, and tools that engineers and agents use to reach peak performance. Help optimize the latest AI models on our silicon.

Our hardware is designed to be straightforward to program, so the goal is not to hide it. The goal is to expose the right level of control at each layer, from our compiler-driven Python SDK to our low-level Rust programming stack, and to make every performance gap measurable and every fix permanent.

We're looking for a builder who understands hardware deeply and develops with agents by default. You'll own substantial parts of one of these layers and work closely with engineers across models, compilers, runtime, and hardware. Your focus is performance: where cycles, bandwidth, and communication go, and how to win them back. Number formats and model accuracy are owned by our conversion and emulation team; you'll partner with them where precision and speed meet.

What you'll do

  • Build the stack. Design APIs, kernel abstractions, and libraries in our Python SDK or Rust stack so model engineers and agents can reach high performance at the layer that fits their problem.
  • Make models fast. Take priority workloads, from LLMs to multimodal models, to peak performance on real silicon. Profile, find the bottleneck across kernels, compiler, runtime, and parallelism, and fix it at the right layer.
  • Close the gap between model and measurement. Compare measured performance against analytical models and simulation. Explain every material gap, and turn the explanation into a fix or a better model.
  • Build the agentic performance loop. Give agents the profilers, traces, counters, and benchmark harnesses to form a hypothesis, change code, and measure the result in minutes. Make the results trustworthy enough to act on.
  • Set the bar for performance. Define how we measure, track regressions, and report results.
  • Build for the next chip. Design abstractions that carry forward to future hardware generations. Work with hardware architects to test how architectural choices affect real workloads.

What we need from you

  • You understand hardware performance. You've optimized AI workloads on GPUs or custom accelerators and can reason about compute utilization, memory hierarchy, latency hiding, synchronization, and multi-chip scaling.
  • You build excellent software. You've owned substantial systems from design through production. You're strong in Python and/or at least one systems language such as Rust, C++, or C, and rigorous about interfaces, abstractions, and testing. We care about engineering quality more than a specific language.
  • You understand LLM inference end to end. You can read a new model's implementation and reason about prefill, decode, attention variants, KV caches, MoE, and parallelism, and how they map to compute, memory, and communication.
  • You build with agents. Agentic development is how you work, not an experiment. You'd rather build the loop that finds the optimization than find it by hand, and you know when the loop still needs a human.
  • You build things others succeed with. You've designed APIs, libraries, or performance tooling that other engineers adopted.
  • You drive problems to resolution. You form clear hypotheses, measure, and follow the evidence across software and hardware boundaries. You take ownership of the result.

About Tensordyne

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

The role

You'll build the software stack that takes a model from code down to the hardware: the abstractions, kernels, libraries, and tools that engineers and agents use to reach peak performance. Help optimize the latest AI models on our silicon.

Our hardware is designed to be straightforward to program, so the goal is not to hide it. The goal is to expose the right level of control at each layer, from our compiler-driven Python SDK to our low-level Rust programming stack, and to make every performance gap measurable and every fix permanent.

We're looking for a builder who understands hardware deeply and develops with agents by default. You'll own substantial parts of one of these layers and work closely with engineers across models, compilers, runtime, and hardware. Your focus is performance: where cycles, bandwidth, and communication go, and how to win them back. Number formats and model accuracy are owned by our conversion and emulation team; you'll partner with them where precision and speed meet.

What you'll do

  • Build the stack. Design APIs, kernel abstractions, and libraries in our Python SDK or Rust stack so model engineers and agents can reach high performance at the layer that fits their problem.
  • Make models fast. Take priority workloads, from LLMs to multimodal models, to peak performance on real silicon. Profile, find the bottleneck across kernels, compiler, runtime, and parallelism, and fix it at the right layer.
  • Close the gap between model and measurement. Compare measured performance against analytical models and simulation. Explain every material gap, and turn the explanation into a fix or a better model.
  • Build the agentic performance loop. Give agents the profilers, traces, counters, and benchmark harnesses to form a hypothesis, change code, and measure the result in minutes. Make the results trustworthy enough to act on.
  • Set the bar for performance. Define how we measure, track regressions, and report results.
  • Build for the next chip. Design abstractions that carry forward to future hardware generations. Work with hardware architects to test how architectural choices affect real workloads.

What we need from you

  • You understand hardware performance. You've optimized AI workloads on GPUs or custom accelerators and can reason about compute utilization, memory hierarchy, latency hiding, synchronization, and multi-chip scaling.
  • You build excellent software. You've owned substantial systems from design through production. You're strong in Python and/or at least one systems language such as Rust, C++, or C, and rigorous about interfaces, abstractions, and testing. We care about engineering quality more than a specific language.
  • You understand LLM inference end to end. You can read a new model's implementation and reason about prefill, decode, attention variants, KV caches, MoE, and parallelism, and how they map to compute, memory, and communication.
  • You build with agents. Agentic development is how you work, not an experiment. You'd rather build the loop that finds the optimization than find it by hand, and you know when the loop still needs a human.
  • You build things others succeed with. You've designed APIs, libraries, or performance tooling that other engineers adopted.
  • You drive problems to resolution. You form clear hypotheses, measure, and follow the evidence across software and hardware boundaries. You take ownership of the result.
Apply
Back to jobs

Details

Senior Software Engineer, Inference Performance

Tensordyne·Senior·Remote · Munich·$120k–$180k USD

Posted Nov 13, 2026·tensordyne.com

Apply

About Tensordyne

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

The role

You'll build the software stack that takes a model from code down to the hardware: the abstractions, kernels, libraries, and tools that engineers and agents use to reach peak performance. Help optimize the latest AI models on our silicon.

Our hardware is designed to be straightforward to program, so the goal is not to hide it. The goal is to expose the right level of control at each layer, from our compiler-driven Python SDK to our low-level Rust programming stack, and to make every performance gap measurable and every fix permanent.

We're looking for a builder who understands hardware deeply and develops with agents by default. You'll own substantial parts of one of these layers and work closely with engineers across models, compilers, runtime, and hardware. Your focus is performance: where cycles, bandwidth, and communication go, and how to win them back. Number formats and model accuracy are owned by our conversion and emulation team; you'll partner with them where precision and speed meet.

What you'll do

  • Build the stack. Design APIs, kernel abstractions, and libraries in our Python SDK or Rust stack so model engineers and agents can reach high performance at the layer that fits their problem.
  • Make models fast. Take priority workloads, from LLMs to multimodal models, to peak performance on real silicon. Profile, find the bottleneck across kernels, compiler, runtime, and parallelism, and fix it at the right layer.
  • Close the gap between model and measurement. Compare measured performance against analytical models and simulation. Explain every material gap, and turn the explanation into a fix or a better model.
  • Build the agentic performance loop. Give agents the profilers, traces, counters, and benchmark harnesses to form a hypothesis, change code, and measure the result in minutes. Make the results trustworthy enough to act on.
  • Set the bar for performance. Define how we measure, track regressions, and report results.
  • Build for the next chip. Design abstractions that carry forward to future hardware generations. Work with hardware architects to test how architectural choices affect real workloads.

What we need from you

  • You understand hardware performance. You've optimized AI workloads on GPUs or custom accelerators and can reason about compute utilization, memory hierarchy, latency hiding, synchronization, and multi-chip scaling.
  • You build excellent software. You've owned substantial systems from design through production. You're strong in Python and/or at least one systems language such as Rust, C++, or C, and rigorous about interfaces, abstractions, and testing. We care about engineering quality more than a specific language.
  • You understand LLM inference end to end. You can read a new model's implementation and reason about prefill, decode, attention variants, KV caches, MoE, and parallelism, and how they map to compute, memory, and communication.
  • You build with agents. Agentic development is how you work, not an experiment. You'd rather build the loop that finds the optimization than find it by hand, and you know when the loop still needs a human.
  • You build things others succeed with. You've designed APIs, libraries, or performance tooling that other engineers adopted.
  • You drive problems to resolution. You form clear hypotheses, measure, and follow the evidence across software and hardware boundaries. You take ownership of the result.

About Tensordyne

AI is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

The role

You'll build the software stack that takes a model from code down to the hardware: the abstractions, kernels, libraries, and tools that engineers and agents use to reach peak performance. Help optimize the latest AI models on our silicon.

Our hardware is designed to be straightforward to program, so the goal is not to hide it. The goal is to expose the right level of control at each layer, from our compiler-driven Python SDK to our low-level Rust programming stack, and to make every performance gap measurable and every fix permanent.

We're looking for a builder who understands hardware deeply and develops with agents by default. You'll own substantial parts of one of these layers and work closely with engineers across models, compilers, runtime, and hardware. Your focus is performance: where cycles, bandwidth, and communication go, and how to win them back. Number formats and model accuracy are owned by our conversion and emulation team; you'll partner with them where precision and speed meet.

What you'll do

  • Build the stack. Design APIs, kernel abstractions, and libraries in our Python SDK or Rust stack so model engineers and agents can reach high performance at the layer that fits their problem.
  • Make models fast. Take priority workloads, from LLMs to multimodal models, to peak performance on real silicon. Profile, find the bottleneck across kernels, compiler, runtime, and parallelism, and fix it at the right layer.
  • Close the gap between model and measurement. Compare measured performance against analytical models and simulation. Explain every material gap, and turn the explanation into a fix or a better model.
  • Build the agentic performance loop. Give agents the profilers, traces, counters, and benchmark harnesses to form a hypothesis, change code, and measure the result in minutes. Make the results trustworthy enough to act on.
  • Set the bar for performance. Define how we measure, track regressions, and report results.
  • Build for the next chip. Design abstractions that carry forward to future hardware generations. Work with hardware architects to test how architectural choices affect real workloads.

What we need from you

  • You understand hardware performance. You've optimized AI workloads on GPUs or custom accelerators and can reason about compute utilization, memory hierarchy, latency hiding, synchronization, and multi-chip scaling.
  • You build excellent software. You've owned substantial systems from design through production. You're strong in Python and/or at least one systems language such as Rust, C++, or C, and rigorous about interfaces, abstractions, and testing. We care about engineering quality more than a specific language.
  • You understand LLM inference end to end. You can read a new model's implementation and reason about prefill, decode, attention variants, KV caches, MoE, and parallelism, and how they map to compute, memory, and communication.
  • You build with agents. Agentic development is how you work, not an experiment. You'd rather build the loop that finds the optimization than find it by hand, and you know when the loop still needs a human.
  • You build things others succeed with. You've designed APIs, libraries, or performance tooling that other engineers adopted.
  • You drive problems to resolution. You form clear hypotheses, measure, and follow the evidence across software and hardware boundaries. You take ownership of the result.
Apply
Prev
Next
Prev
Next

Browse

All Rust jobs

Open roles. Featured listings appear first; each card shows whether it is featured.

  • Senior Machine Learning Engineer — Rust, Models & Agent Systems

    Loci·On-site · New York · $200k–$200k USD

    Oct 6, 2026

  • Anduril Industries logo

    MSE, Vehicle Software

    Anduril Industries·On-site · Costa Mesa · $166k–$220k USD

    Oct 6, 2026

  • Serokell logo

    Senior Rust Software Engineer

    Serokell·Remote · Worldwide

    Oct 6, 2026

  • Proton logo

    Senior Software Engineer (Inbox Desktop)

    Proton·Hybrid · London

    Oct 6, 2026

  • Kraken logo

    Senior Software Engineer - Rust - Consumer

    Kraken·Remote · Poland

    Oct 4, 2026

  • Nodveta logo

    Rust and Solana Infrastructure Engineer

    Nodveta·Remote · Worldwide · $120k–$160k USD

    Sep 18, 2026

  • Kraken logo

    Senior Software Engineer - Rust - Consumer

    Kraken·Remote · Romania, Argentina, Brazil, Bulgaria, Chile, Colombia, Cyprus, Hungary, Mexico, Peru, Poland, South Africa

    Nov 13, 2026

  • Kraken logo

    Senior Software Engineer - Rust - Backend - Pro

    Kraken·Remote · Romania, Argentina, Brazil, Bulgaria, Chile, Colombia, Cyprus, Hungary, Mexico, Peru, Poland, South Africa

    Nov 13, 2026

  • Kraken logo

    Senior Software Engineer - Rust - Payward Services

    Kraken·Remote · Poland, Argentina, Brazil, Bulgaria, Chile, Colombia, Cyprus, Hungary, Mexico, Peru, Romania, South Africa

    Nov 13, 2026

  • Kraken logo

    Software Engineer II - Rust - Pro

    Kraken·Remote · Brazil, Argentina, Bulgaria, Chile, Colombia, Cyprus, Hungary, Lithuania, Mexico, Peru, Poland, Romania

    Nov 13, 2026

  • Kraken logo

    Senior Software Engineer - Rust - Core Services

    Kraken·Remote · Romania, Argentina, Brazil, Bulgaria, Chile, Colombia, Cyprus, Hungary, Mexico, Peru, Poland, South Africa

    Nov 13, 2026

  • Synmatch AI logo

    Detection Logic Engineer

    Synmatch AI·Remote · Europe · $50k–$70k EUR

    Nov 13, 2026

  • Intelic logo

    Senior Backend Engineer (Rust)

    Intelic·Hybrid · Amsterdam

    Nov 13, 2026

  • Nebius logo

    Staff Software Engineer (Agentic Search) - Runtime

    Nebius·On-site · Amsterdam

    Nov 13, 2026

  • Massive logo

    Rust Engineer - Foundational Platform

    Massive·Remote · United States

    Nov 13, 2026

12…16