Our website is best viewed using a modern browser like Chrome, Firefoxor Microsoft Edge.

Find your dream job at a Trinity portfolio company.





Senior Machine Learning Engineer, FedRAMP (Customer Identity)



Software Engineering, Customer Service
United States
Posted on Sunday, June 9, 2024

Get to know Okta

Okta is The World’s Identity Company. We free everyone to safely use any technology—anywhere, on any device or app. Our Workforce and Customer Identity Clouds enable secure yet flexible access, authentication, and automation that transforms how people move through the digital world, putting Identity at the heart of business security and growth.

At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we’re looking for lifelong learners and people who can make us better with their unique experiences.

Join our team! We’re building a world where Identity belongs to you.

The CIC Engineering Team

Okta’s Customer Identity Cloud (CIC), is an easy-to-implement authentication and authorization platform designed by developers for developers. We make access to applications safe, secure, and seamless for the more than 100 million daily logins around the world. Our modern approach to identity enables this Tier-Ø global service to deliver convenience, privacy, and security so customers can focus on innovation.

Senior Machine Learning Engineer

The Machine Learning team is responsible for building ML models, leveraging Generative AI, and developing infrastructure and platform components to scale up AI/ML operations.

This Machine Learning Engineer role will help build and scale Generative AI use cases from integrating Large Language Models (LLM) to developing reusable platform components. The ideal candidate will have a deep technical background and hands-on experience in building and deploying AI/ML systems, as well as promoting a data-driven culture across the organization. They would not hesitate to wrangle data, if necessary, and are acutely familiar with what makes an effective and efficient ML team. They will also show passion generally for the field of applied AI/ML. Additionally, the candidate will have interest in learning about and potentially contributing towards cutting edge open source AI/ML technologies.


  • Design and implement infrastructure and platform components for leveraging LLM in production.
  • Tune and optimize LLM to improve response quality and optimize performance.
  • Build workflows and pipelines to process data from myriad sources into a knowledge base for various use cases.
  • Collaborate with platform engineering teams to ensure that AI/ML systems integrate successfully into production environments while adhering to performance and availability SLOs.
  • Participate in project planning, design, development, and code reviews.
  • Communicate verbally and in writing to business customers and leadership teams with various levels of technical knowledge, educating them about our systems, as well as sharing insights and recommendations.
  • Partnership across Engineering, Product Management, Security and Design teams to solve technical and non-technical challenges.

Basic Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Fluency in a computing language, e.g. Python, Scala, C++, Java, etc.
  • Knowledge of AWS Bedrock, OpenAI or similar Generative AI platforms.
  • Experience with developing production AI/ML systems and platforms at scale, including retrieval-augmented generation (RAG) and embedding workflows.
  • Experience with LLMOps, CI/CD, and IaC.
  • Familiar with the full AI/ML lifecycle from model development, training, testing, deployment, monitoring, and iterating.
  • Knowledge in prompt engineering and guardrails.
  • Excellent verbal and written communication.
  • Exceptional troubleshooting and problem solving skills, thrive in a fast-paced, innovative environment.

Preferred Qualifications

  • Master’s degrees in Computer Science, Engineering, or a related field.
  • Familiar with training and fine tuning models at scale with experience in LLM evaluation.
  • Experience with ML frameworks (e.g. TensorFlow, Spark ML, PyTorch), data workflow platforms (e.g. Airflow), and container technologies (e.g. Docker, Kubernetes).
  • Familiar with Python and AI/ML libraries such as LangChain and FastAPI. .
  • Ability to work with ambiguity, ability to self-motivate, prioritizing needs, and delivering results in a dynamic environment.
  • Combination of deep technical skills and business savvy to interface with all levels and disciplines within our and our customer’s organizations.


  • This position requires the ability to access federal environments and/or have access to protected federal data. As a condition of employment for this position, the successful candidate must be able to submit documentation establishing U.S. Person status (e.g. a U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee. 22 CFR 120.15) upon hire.



Below is the annual base salary range for candidates located in California, Colorado, New York and Washington. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: https://rewards.okta.com/us.

The annual base salary range for this position for candidates located in California (excluding San Francisco Bay Area), Colorado, New York, and Washington is between:$146,000$218,000 USD The annual base salary range for this position for candidates located in the San Francisco Bay area is between: $163,000$245,000 USD

What you can look forward to as an Full-Time Okta employee!

Okta cultivates a dynamic work environment, providing the best tools, technology and benefits to empower our employees to work productively in a setting that best and uniquely suits their needs. Each organization is unique in the degree of flexibility and mobility in which they work so that all employees are enabled to be their most creative and successful versions of themselves, regardless of where they live. Find your place at Okta today! https://www.okta.com/company/careers/.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to participate in the job application or interview process, please use this Form to request an accommodation.

Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Privacy Policy at https://www.okta.com/privacy-policy/.