The AWS Membrain team is seeking an exceptional software engineer to help develop a distributed in-memory data store for high-throughput, high-volume data processing in big data analytics and Artificial Intelligence (AI) model training.
Membrain is an innovative platform designed to solve unique challenges in data exchange, processing, and handling for large-volume datasets. As an engineer on the Membrain team, you will be responsible for building core features of an in-memory data store, leveraging the Rust programming language's advanced memory safety and concurrency capabilities. Your role will involve developing efficient, scalable data persistent APIs that can adapt to various use cases. You will contribute to foundational protocols and communication mechanisms that enable seamless data sharing across distributed systems. Performance optimization will be a critical aspect of your work, requiring you to continuously improve CPU, memory, and disk utilization at the node level.
On the Membrain platform control side, you will build and maintain high-throughput, high-availability microservices to manage and control the Membrain cluster lifecycle. Your system will efficiently manage Membrain cluster deployments on Kubernetes, with the ability to dynamically scale services and safely roll out software updates.
We are seeking a self-motivated individual who is passionate about learning new technologies and can adapt to a fast-paced development environment. Our goal is to build a strong engineering team characterized by exceptional collaboration and communication. We expect strong ownership, the ability to work independently, and consistent delivery of results. You should be comfortable communicating effectively with peers, management, and stakeholders about projects and assignments.
Key job responsibilities
* Design and implement a large-data, high-performance distributed data storage system
* Develop service on Kubernetes
* Develop system-level software using Rust and Java programming language
* Build scalable infrastructure on AWS cloud platforms
* Integrate advanced data solutions with AI and big data technologies
* Collaborate with Spark and other big data ecosystem technologies
* Create high-performance, distributed computing architectures
* Deliver systems and features with top-notch quality, on time.
* Own the end-to-end Software Development Life Cycle (SDLC).
About the team
Our team's mission is to build the best high-performance high-throughput storage technology to provide the best experience for the customer. We have the talented engineers and technical leaders on the team.
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- Solid communication skills and ability to work well in a team
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Strong knowledge of Computer Science fundamentals in object-oriented design, data structures, algorithm design, and problem solving
- Experience in Rust programing language
- Experience in building system on Kubernetes and Helm
- Proficiency in high-performance, multi-threaded programming
- Experience designing and building highly-scaled distributed systems and web services
- Experience with in-memory data storage solutions
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region youre applying in isnt listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit . This position will remain posted until filled. Applicants should apply via our internal or external career site.