Python GenAI Model Evaluator Job at ClifyX, Austin, TX

clhsNkdHSFkrUitEZVpqQUxLRWwwRXRNVnc9PQ==
  • ClifyX
  • Austin, TX

Job Description

Please share 2 onsite profiles for Model Evaluators . Location can be either SCV or Austin. Billing : $78/Hr Technical Skills

  • Strong understanding of LLMs, generative AI, and transformer-based architectures.
  • Experience with Python, data analysis, and model evaluation frameworks.
  • Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
  • Experience building evaluation datasets and working with annotation platforms.
  • Understanding of safety alignment, bias detection, and adversarial testing.
Tools & Platforms
  • ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
  • Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
  • Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Job Tags

Similar Jobs

PacifiCorp

Journeyman Lineman (Local 57) - Lava Hot Springs, UT - #114284 Job at PacifiCorp

 ...trucks, aerial boom, lifts and wire pulling equipment. These duties include: Maintenance of lines and services will require pole climbing, hot sticking, and working out of truck mounted bucket lifts to construct, repair or maintain line equipment or string, splice and... 

Aspire

Senior Software Engineer - North America (San Francisco) Job at Aspire

 ...industryleading software platform, combined with our awardwinning Agency Services team, has served household names such as M&Ms, Keurig, Samsung, HelloFresh, Dyson, and many other highgrowth ecommerce companies while paying out $100M to creators around the world. The Role... 

*US AMR-Jones Lang LaSalle Americas, Inc.

Mechanical SME Job at *US AMR-Jones Lang LaSalle Americas, Inc.

 ...JLL empowers you to shape a brighter way . Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients. We are committed to hiring the best, most talented... 

SSM Health

Physician - Radiation Oncologist - Janesville, WI Job at SSM Health

 ...SSM Health is an Equal Opportunity Employer: Community Description: About SSM Health St. Mary's Hospital: Exceptional Radiation Oncology Position in Janesville WI Shop, Work, Play, Stay! - Wisconsin's best-kept secret! Join a collegial group 2 hrs North... 

Home Instead

Caregiver - No Experience Required Job at Home Instead

 ...Home Caregiver $13.00-13.50/hr | Weekly Pay | Benefits Available Earn steady income doing meaningful work as a Caregiver with...  ...Requirements Minimum of 6 months of paid professional caregiving experience (non-family) OR be a CNA, HHA, LVN/LPN, or RN Have reliable...