Kanerika Software logo

Senior AI Governance Java Engineer

Kanerika Software
1 hour ago
Full-time
On-site
Hyderabad, Telangana, India
AI Governance

About the Role: 

We are seeking strong Senior Java + AI Platform Engineers to work on strategic enterprise initiatives focused on building scalable AI Governance, observability, and Compliance platforms.

The ideal candidate will have strong expertise in Java backend engineering, distributed systems, AI integrations, telemetry pipelines, and cloud-native architectures. This role involves designing scalable enterprise-grade platforms capable of monitoring, governing, and securing AI interactions across large-scale enterprise environments. 

Key Responsibilities:

  • Design and build pluggable evaluator services using Java and Spring Boot 
  • Develop scalable SaaS/cloud-native backend services and microservices 
  • Integrate with AI platforms including AWS Bedrock, Azure AI Foundry, Google Vertex AI, OpenAI, and Anthropic APIs 
  • Build orchestration frameworks and schedulers for evaluation execution workflows
  • Develop AI risk scoring systems and evaluation pipelines 
  • Design and implement telemetry, monitoring, and observability solutions 
  • Build dashboards and reporting systems for evaluation results and governance insights 
  • Develop integrations/connectors for cloud-native event streams and event-driven architectures 
  • Collaborate with cross-functional engineering teams in an Agile sprint environment 
  • Participate in code reviews, CI/CD setup, and quality engineering practices 
  • Ensure adherence to software development lifecycle and engineering best practices


Requirements

Required Skills & Qualifications

  • 4–7 years of strong backend engineering experience using Java and Spring Boot 
  • Proven expertise in SaaS application development and cloud-native architecture 
  • Strong understanding of REST APIs and microservices architecture 
  • Hands-on experience with at least one AI platform: 
    - AWS Bedrock 
    - Azure OpenAI 
    - Google Vertex AI 
    -OpenAI APIs 
  • Experience with cloud SDKs such as AWS SDK for Java, Azure SDK, or Google Cloud Java libraries 
  • Strong knowledge of CI/CD tools like GitHub Actions, Jenkins, or similar 
  • Experience with testing frameworks including unit, integration, and contract testing 
  • Understanding of orchestration/scheduler frameworks such as Quartz or Spring Batch 
  • Experience with event streaming platforms such as Kafka, AWS Kinesis, Azure Event Hub, or GCP Pub/Sub 
  • Knowledge of ETL/ELT pipelines and stream processing technologies like Flink or Spark Streaming 
  • Experience designing schemas and data models for high-volume telemetry/time-series data 
  • Strong understanding of event-driven architecture and connector development 

Preferred Skills

  • Familiarity with LLM evaluation frameworks such as: 
    -RAGAS 
    -TruLens 
    -DeepEval 

  • Knowledge of AI governance standards and EU AI Act requirements 
  • Experience with workflow orchestration frameworks 
  • Cloud certifications in AWS, Azure, or GCP 
  • Exposure to AI risk assessment and governance tooling 

Must-Have Skills (Non-Negotiable)

  • Strong production-grade experience in Java + Spring Boot 
  • Experience building multi-tenant SaaS/cloud-ntive applications 
  • Strong software development lifecycle discipline 
  • Hands-on exposure to at least one AI platform 
  • REST API and Microservices architecture expertise 
  • Experience with AI evaluation/testing frameworks
  • Telemetry and observability engineering expertise


Benefits

Employee Benefits

  • Culture:

    • Open Door Policy: Encourages open communication and accessibility to management.
    • Open Office Floor Plan: Fosters a collaborative and interactive work environment.
    • Flexible Working Hours: Allows employees to have flexibility in their work schedules.
    • Employee Referral Bonus: Rewards employees for referring qualified candidates.
    • Appraisal Process Twice a Year: Provides regular performance evaluations and feedback. 

  • Inclusivity and Diversity:

    • Hiring practices that promote diversity: Ensures a diverse and inclusive workforce.
    • Mandatory POSH training: Promotes a safe and respectful work environment. 

  • Health Insurance and Wellness Benefits:

    • GMC and Term Insurance: Offers medical coverage and financial protection.
    • Health Insurance: Provides coverage for medical expenses.
    • Disability Insurance: Offers financial support in case of disability. 

  • Child Care & Parental Leave Benefits:

    • Company-sponsored family events: Creates opportunities for employees and their families to bond.
    • Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child.
    • Family Medical Leave: Offers leave for employees to take care of family members' medical needs. 

  • Perks and Time-Off Benefits:

    • Company-sponsored outings: Organizes recreational activities for employees.
    • Gratuity: Provides a monetary benefit as a token of appreciation.
    • Provident Fund: Helps employees save for retirement.
    • Generous PTO: Offers more than the industry standard for paid time off.
    • Paid sick days: Allows employees to take paid time off when they are unwell.
    • Paid holidays: Gives employees paid time off for designated holidays.
    • Bereavement Leave: Provides time off for employees to grieve the loss of a loved one. 

  • Professional Development Benefits:

    • L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development.
    • Mentorship Program: Offers guidance and support from experienced professionals.
    • Job Training: Provides training to enhance job-related skills.
    • Professional Certification Reimbursements: Assists employees in obtaining professional certifications.