Ragas

Company Overview and Mission

Ragas is an open-source company that is building the standard for evaluating and testing large language model (LLM) applications. Founded in 2023 by Jithin James and Shahul ES, the company is on a mission to help developers deploy their LLM applications in production with confidence. Ragas provides a framework that includes metrics, synthetic test data generation, and workflows for evaluating LLM applications.

What the company does (products/services)

Ragas provides an open-source evaluation and testing infrastructure for LLM application developers. The platform makes use of model-graded evaluations and testing techniques to ensure quality. This includes automated synthesis of test data points, explainable metrics, and adversarial testing. Ragas started by building this for RAGs (Retrieval-Augmented Generation), which is the most popular application of LLM as of today. Ragas is now the default open-source standard for evaluating RAG applications, processing over 4.7 million responses last month and used by engineers from enterprises like AWS, Microsoft, Databricks, Moody’s, UHG, and Tencent.

Technology stack and engineering culture

Ragas is built on an open-source technology stack that is centered around LLMs. The company's GitHub repository is very popular, and the company is a major contributor to the open-source AI community. The company's engineering culture is likely to be focused on collaboration, innovation, and a passion for open-source software. The founders have a strong background in engineering and have experience working at companies like BentoML and as a Kaggle Grandmaster.

Work environment and benefits

As a company that is focused on open-source software, Ragas's work environment is likely to be collaborative and transparent. The company is based in San Francisco, CA, but it has a global community of contributors. Employees at Ragas will have the opportunity to work on a cutting-edge product that is being used by thousands of people around the world. The company's founders are passionate about what they are building, and they are looking for talented individuals who share their vision.

Why someone should work there

Working at Ragas is an opportunity to be a part of a company that is at the forefront of the AI revolution. The company's open-source platform is being used by thousands of people around the world, and it has the potential to change the way we build and evaluate LLM applications. Employees at Ragas will have the opportunity to work with a talented and passionate team, and they will be able to make a real difference in the world.

Key roles they typically hire for

As an open-source company, Ragas is likely to be hiring for a variety of roles, including software engineers, community managers, and developer advocates. The company is looking for individuals who are passionate about open-source software and who are excited about the opportunity to build a global community.