This is a remote position.
Work across multiple different projects to improve LLM performance on code: sample projects
Leading and delivering end-to-end agent use cases such as home automation agents, coding copilots, or creative design assistants.
Collaborate with the team to identify edge cases and ambiguities in model behavior.
Review and compare 3–4 model-generated code responses per task using a structured ranking system.
Evaluate code diffs for correctness, code quality, style, and efficiency. Provide clear, detailed rationales explaining the reasoning behind each ranking decision.
Required Skills & Experience
Several years of software engineering experience, including 2+ continuous years at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research).
Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
Proven ability to review code diffs and evaluate correctness, maintainability, and efficiency.
Excellent oral and written communication skills for clear, structured evaluation rationales.
Engagement Details
Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week (partial PST overlap required).
Type: Contractor (no medical/paid leave).
Duration: 1 month potential extensions based on performance and fit.
...Farmer Couple (6521) Location: Orcas, Washington JobNumber: 6521 Responsible for planting schedules, crop rotation, harvesting... ...veterans Benefits: This is a full-time, salaried position; work hours are flexible based on the seasons and weather Paid...
...integrate electrical designs into overall project plans.**District Overview**Mass. Electric Construction Company, a subsidiary of Kiewit Corporation, is one of North America's premier electrical contractors. We specialize in providing a wide range of electrical...
...roadmap with control mappings to various processes. Demonstrated expertise with Framework integration with Enterprise Risk Management (ERM), Identity and Access Management (IAM) and Cloud security controls. Ensure interoperability with compliance (HIPAA, COPPA, FERPA,...
...ventaja, pero no es un requisito. Experiencia o deseo de aprender mtricas de rendimiento, mejora de procesos y herramientas Lean/Six Sigma. Conocimiento prctico de las aplicaciones de Microsoft Office. Conocimiento prctico del almacn / equipo mecnico....
...advance if possible.~Limit outside distractions (visitors, sharing family/personal information with the client, and personal calls on agency phone and/ or cell phone).~Use of internet for office purposes only: no games, Facebook during working hours.~Copying & sending...