Java Big Data Developer (AVP) - Hybrid (citi)

Job Description

The Java Bid Data Developer (Applications Development Sr Programmer Analyst - C12) is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Overview:

• Design and Develop Scalable Data Pipelines: Lead the design, development, and maintenance of high-performance, scalable data pipelines using Apache Spark, Scala, and PySpark to handle large-scale datasets in the financial industry.

• ETL Process Implementation: Implement ETL (Extract, Transform, Load) processes for data integration, transforming complex data from multiple sources into structured, actionable insights.

• Data Optimization and Performance Tuning: Monitor, troubleshoot, and optimize the performance of data pipelines and applications, ensuring high availability, low-latency, and efficient resource usage.

• Data Workflow Orchestration: Use Apache Airflow to orchestrate and automate complex data workflows, ensuring seamless integration and efficient execution of tasks across systems.

• Real-Time Data Processing: Integrate real-time data streaming solutions using Apache Kafka for processing and managing large volumes of data in real-time.

• Collaboration with Business and Technical Teams: Work closely with business stakeholders and cross-functional teams to define data requirements and ensure solutions meet business objectives.

• Data Security and Compliance: Ensure that all data processing workflows adhere to relevant regulatory standards and security best practices.

• Cloudera Ecosystem Utilization: Leverage Cloudera Ecosystem tools (Hadoop, HDFS, Hive, Impala, Flume, etc.) to manage and process big data, ensuring that systems are scalable and efficient.

• Continuous Improvement: Identify opportunities for continuous improvement in data architecture and processing, contributing to the overall modernization of the organization’s data systems.

Responsibilities:

• Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas

• Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users

• Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement

• Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality

• Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems

• Ensure essential procedures are followed and help define operating standards and processes

• Serve as advisor or coach to new or lower level analysts

• Has the ability to operate with a limited level of direct supervision.

• Can exercise independence of judgement and autonomy.

• Acts as SME to senior stakeholders and /or other team members.

• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Skills & Qualifications:

• 5-8 years of relevant experience

• Experience in systems analysis and programming of software applications

• Experience in managing and implementing successful projects

• Working knowledge of consulting/project management techniques/methods

• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

• Hands on relevant experience in Angular, HTML, CSS Java, Spring boot, Oracle, NoSQL OR Design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala.

• Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines.

• Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN.

• Programming and Scripting: Advanced knowledge of Scala and a good understanding of Python for data engineering tasks.

• Data Modeling and ETL Processes: Solid understanding of data modeling principles and ETL processes in big data environments.

• • Analytical and Problem-Solving Skills: Strong ability to analyze and solve performance issues in Spark jobs and distributed systems.

• • Version Control and CI/CD: Familiarity with Git, Jenkins, and other CI/CD tools for automating the deployment of big data applications.

• Experience managing a data focused product, ML platform and or UI/UX

• Experience with building UI components using Angular, HTML, CSS Java, Spring boot, Oracle, NoSQL OR Design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala.

Desired Skills & Qualifications:

• Real-Time Data Streaming: Experience with streaming platforms such as Apache Kafka or Spark Streaming.

• Financial Services Context: Familiarity with financial data processing, ensuring scalability, security, and compliance requirements.

• Leadership in Data Engineering: Proven ability to work collaboratively with teams to develop robust data pipelines and architectures.

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

------------------------------------------------------

Job Family:

------------------------------------------------------

Time Type:

------------------------------------------------------

Primary Location:

------------------------------------------------------

Primary Location Full Time Salary Range:

In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

------------------------------------------------------

Anticipated Posting Close Date:

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.