17.05.2024 - 19.05.2024Hackathon project

RZD.Negotiations

RZD.Negotiations

Tech stack I used:

  • React
  • TypeScript
  • AntD
  • NestJS
  • Python
  • Saiga
  • Whisper
  • Llama
  • Flask

Service for full review of negotiation recorder audio and flagging regulatory violations

Technical highlights

  • Audio noise and silence removal for better recognition quality
  • Audio-to-text transcription with Whisper
  • Situation classification and error detection via LLM (Llama, Saiga)
  • Negotiation context and key data extraction per scenario
  • RZD-branded design with AntD UI kit
  • Flexible configuration supporting any number of participant roles
  • Speaker identification in recordings for personal analysis and retraining

My role in the project

  • Audio negotiation analysis system architecture
  • Web interface design
  • Frontend-backend integration

Gallery

Demo