Software Engineer · AI Systems & Agentic Workflows · LLM Evaluation · Full-Stack

Mahmut Safa Alıcı

I build intelligent software systems and reliable AI workflows, and turn complex engineering problems into products that hold up in real use.

Portrait of Mahmut Safa Alıcı
01

About

Software engineer working on production AI systems, agentic workflows, and LLM evaluation. My experience spans production AI applications, benchmark and evaluator design, agent orchestration, backend infrastructure, and industrial software.

Most recently I worked on AI systems that generate documents, spreadsheets, presentations, and video - building evaluation and QA checks for generated output, working on agent orchestration and model selection, and improving the reliability of TypeScript/Node.js backend and sandboxed execution. Before that, I designed deterministic benchmark tasks and automated evaluators for agentic AI systems.

On the industrial side, I built a full-stack ERP and three connected factory-floor tablet apps, and I am now extending that system with an AI assistant that combines retrieval over technical documentation with tool access to live operational data. Earlier work includes cross-platform mobile apps and game development.

I apply SOLID principles, clean architecture, and thoughtful UX across every stack - whether I am writing Python evaluators for AI benchmarks, shipping Firebase-backed mobile apps, or crafting Pixi.js-powered browser games.

Years Experience3+
AI Benchmark & Evaluation Tasks750+
Technologies25+
02

Skills

Languages & frameworks

  • TypeScript
  • JavaScript (ES6+)
  • React
  • HTML5 / CSS3
  • Pixi.js / WebGL

Backend & databases

  • Node.js
  • Python
  • Flask
  • Firebase
  • SQLite / SQL
  • Cloud Services & Deployment

Game development

  • C#
  • Unity / 2D & 3D Mechanics
  • Multiplayer & iGaming

AI & ML

  • LLM Evaluation & Benchmarking
  • AI Agents & Orchestration
  • RAG / Vector Retrieval
  • Tool & Function Calling
  • Prompt Engineering
  • TensorFlow / AI Integration

Principles & practices

  • Git / SOLID / Clean Code
03

Experience

Aug 2026 - Oct 2026

Software Engineer

Apptribe

Worked on production AI systems for document, spreadsheet, presentation, and video generation, focusing on evaluation pipelines, agent orchestration, model optimization, and backend reliability.

  • Developed and improved AI generation pipelines and agent-based workflows for documents, spreadsheets, and presentations
  • Built evaluation and QA mechanisms to detect structural, visual, and content-related generation failures
  • Contributed to model selection and optimization, and to the reliability and lifecycle management of sandboxed execution
  • Investigated and improved video generation and editing pipelines and long-running backend workflows
  • Worked across TypeScript/Node.js backend services, cloud-based infrastructure, and deployment workflows

Aug 2025 - Aug 2026

AI Systems Evaluator / LLM Task Designer

Turing

Completed 500+ deterministic benchmark tasks for agentic AI systems at a sustained pace of 10+ per week, building automated evaluators across nearly a year of active work.

  • Designed deterministic benchmark tasks for agentic AI systems across diverse software environments, including LibreOffice and Google Chrome
  • Built automated evaluators with JSON schemas and Python logic, testing instruction-evaluator alignment and reducing false-failure paths
  • Identified evaluator loopholes and ambiguous success conditions where a successfully completed task could be incorrectly rejected
  • Improved evaluator robustness by making success criteria more deterministic

May 2025 - May 2026

LLM Developer - Prompt Engineering, Tooling & Evaluation

Outlier AI

Completed 250+ task-specific LLM development and evaluation assignments across roughly six months of primary active work, spanning coding prompt design, tool/function implementation, and technical model-output evaluation, with a 4.5/5 average platform rating.

  • Designed task-specific coding prompts and instructions for model training and evaluation workflows
  • Developed assignment-specific callable tools and functions for LLM tool-use scenarios - for example, weather- and calendar-related functions - as individual tasks required
  • Evaluated AI-generated code and outputs against defined requirements, correctness, quality, and software-engineering criteria, identifying logical bugs, UI mismatches, and OOP/SOLID violations

Jan 2024 - Feb 2025

ERP Software Developer

Arden Sentetik Çuval

Developed a full-stack ERP web application centralizing sales, inventory, and financial tracking.

  • Automated KDV calculations, stock validation, and multi-product sales handling
  • Designed modal-based UI flows that accelerated daily data entry operations
  • Built data visualization features with graphs for actionable business insights
  • Extended the ERP into three factory-floor tablet applications for weaving, printing, and garment operations, sharing a common backend and enabling QR-based material traceability across production stages
Currently extending this system with an AI assistant — see Currently Building

Earlier experience

Mar 2024 - Nov 2024

Software Developer — Ingreats

Co-developed a cross-platform culinary app with a real-time Firebase backend and an AI-powered multilingual chatbox for recipe Q&A and meal planning.

Feb 2024 - Apr 2024

Web Application Developer — ERC Research

Built a research data application with Turkish-language PDF extraction, PDF generation from Excel, and fuzzy-search retrieval.

Aug 2023 - Nov 2023

Software Developer Intern — GetdeHealth

Enhanced a sperm count analysis application with complex UI components and real-time data visualization.

Apr 2023 - Jun 2023

Intern Game Developer — Digital Factory 34

Contributed gameplay mechanics and performance optimizations to a 3D endless runner.

Feb 2023 - Mar 2023

Mobile Game Developer — Koç University, Economy Department

Designed and led Running Cat, a two-player research game with multiplayer mechanics and cloud-based behavioral data capture.

Dec 2022

Game Developer (Jam) — Jingle Jam Game Jam

Co-developed Save the Christmas, a WebGL game built in Unity within a 48-hour game jam deadline.

04

Currently Building

In development

Arden AI Assistant

An AI layer extending the Arden production-control ecosystem — the ERP plus its connected factory-floor apps — with retrieval over technical documentation and tool-based access to live operational data.

  • Converting roughly 8GB of technical documentation into a searchable vector-based knowledge layer for retrieval-augmented responses
  • Developing the retrieval and tool-calling architecture that combines document retrieval with structured calls, with Qwen planned as the model layer
  • Developing tools for the assistant to query live operational data across the ERP and its connected factory-floor apps — covering weaving, printing, and garment operations
RAG/Vector Retrieval/Qwen/Tool Calling/ERP Integration
In development

Reel Generation Factory

A multi-stage generative video pipeline that orchestrates short-form content from idea through rendered output - script and scene generation, visuals, voice, captions, and music - for TikTok, Instagram Reels, and YouTube Shorts.

  • Orchestrates the full generation pipeline: idea and script generation, scene planning, visual and character generation, voice/TTS, captions, and music
  • Supports both Eachlabs and local LLMs per capability, selectable through a provider-selection and orchestration layer built to support additional providers
  • Added a partial-run test mode that generates only up to a chosen step (e.g. just the story) at $0 cost, so a local model can be validated without running a full video generation
  • Built persistent, resumable workflow state with cost and budget tracking across generation stages
  • Renders final short-form video output, with multi-platform publishing planned next
AI Orchestration/Video Generation/Provider Integration/Local LLM/Workflow Automation
1 / 5
05

Projects

A collection of projects that showcase my approach to building thoughtful, performant digital products.

Online Piano

Online Piano

A responsive browser piano with note visualization, keyboard controls, and a sleek dark interface - currently in active development.

HTML5/JavaScript/CSS3/Web Audio
Blackjack (21)

Blackjack (21)

Personal project: a fast, accessible single-page Blackjack game with state machine logic, Pixi.js rendering effects, and casino-style polish.

Vanilla JS/Tailwind/Pixi.js/OOP
ERP System

ERP System

Full-stack ERP for sales, inventory, and financial tracking with automated KDV calculations and data visualization.

Full-Stack/SQL/Git/Data Viz
Running Cat Game

Running Cat Game

Research-driven two-player mobile game with multiplayer mechanics and cloud-based behavioral data capture for Koç University.

Mobile/Multiplayer/Cloud/Research
Save the Christmas

Save the Christmas

WebGL game jam project built in 48 hours with Unity - play as Santa, drop presents down chimneys, and restore holiday spirit before the night ends.

Unity/WebGL/Game Jam/2D
06

Live demos

Interactive projects you can play with right here — switch tabs to explore each demo.

Open fullscreen ↗

Online Piano

Interactive browser piano with keyboard mapping, note board, and a polished dark UI - built as a standalone HTML5 experience.

HTML5/JavaScript/Web Audio
07

Contact

Have a project in mind or just want to say hello? I'd love to hear from you.

Istanbul, Turkey

+90 532 689 6344

© 2026 Mahmut Safa Alıcı