Position: Senior Software Engineer – C++ (LLM Evaluation & Repository Validation)Type: Contractor AssignmentLocation: RemoteCommitment: 20-40 hours/week with some overlap with PSTEngagement Length: 3 monthsRole ResponsibilitiesDesign and develop verifiable software engineering tasks using public repository dataAnalyze and triage GitHub issues across trending open-source repositoriesSet up and configure codebases including Dockerization and environment setupEvaluate unit test coverage, code quality, and repository robustnessRun, modify, and test real-world C++ codebases to assess LLM performanceIdentify incorrect outputs, weak reasoning, and grounding issues in model responsesCollaborate with research teams to identify challenging datasets for LLM trainingExpand dataset coverage across programming languages and difficulty levelsSupport or lead junior engineers in repository evaluation and task executionRequirementsMinimum 3+ years of overall software engineering experienceStrong proficiency in C++ is mandatoryHands-on experience with Git and DockerAbility to understand and navigate complex, large-scale codebasesExperience working with real-world projects and debugging code locallyStrong analytical thinking and problem-solving skillsFamiliarity with software testing and pipeline setupAbility to work independently in a remote environmentReliable system setup with stable internet connectionApplication ProcessApply / Easy Apply and check email for further stepsOnline Assessment (approx. 75 minutes)Shortlisting and onboarding process