human

forward.

Lead Data Engineer

Location: Hyderabad, Telangana, India

Notice

This position is no longer open.

Requisition Number: 1678

Position Title: ROS Lead Data Engineer

External Description:

The Lead Data Engineer will work on  collecting, storing, processing, migrating, and analyzing  huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Because we work on the cutting edge of a lot of technologies, this job requires a creative problem solver, resourced in getting things done, and productive working independently or collaboratively.

Duties & Responsibilities:

Description

% of Time Spent

• Data - Analysis, Modeling, Architecture, etc.: Expert; mentors others. Gather and process raw data at scale. Defining data retention policies. Acquire data from primary or secondary sources and maintain databases/systems. Create data sets and tables to store data. Make and test database schema changes when needed. Identify user needs to create and administer the data lake. Ingest and move data between databases that includes relational and no-SQL databases like Oracle, SQL Server, MongoDB, Elastic Search, Google Bigquery etc.Implement security measures by encrypting sensitive data

15%

• ETL Development: Expert; mentors others. Build and implement ETL processes. Modify ETL jobs to improve performance and efficiency

40%

• Support: Troubleshoot high complexity problems and guides others.

20%

• Team: Mentors others. Work closely with management to prioritize business and information needs.

25%

Education


Min/Preferred

Education Level

Description

Minimum

4 Year / Bachelors Degree

Computer Science, Statistics, Applied Mathematics or equivalent

 

Work Experience


Minimum Years of Experience

Maximum Years of Experience

Comments

8

 

Experience with integration of data from multiple data sources utilizing ETL tools (Apache Airflow/Cloud Composer, Apache Beam/Dataflow, or similar)

8

 

Strong knowledge of and experience with database systems (Oracle, SQL Server, MySQL, Google BigQuery, MongoDB, Elastic Search etc.)

6

 

Understanding of distributed computing principles,
Programming Language (Python)

6

 

Experience with Big Data (Hadoop, Horton Works, etc.) and NoSQL databases, such as (Hbase, Spark, Hive, Cloudera etc.)

4

 

Experience working with cloud technologies - GCP, AWS, Azure, etc.

Job Structure


Manager Level

Supervisory Responsibility

Non-Manager/Individual Contributor

Provides guidance, leadership, or training to other internal employees (no direct supervision)

Organizational Structure


Job Title to which this position reports

Job Titles directly reporting to this position

Sr Mgr, Data Engineering 

None

Working Conditions


Travel

Work Hours

 

Occasional nights and weekends required

Knowledge, Skills, and Abilities


• World League IT Competencies

  • Business Impact: Expert Business Domain knowledge. Provides solutions to complex problems.
  • Strategic Architect: Expert level understanding of technical area relevant to role, leads others.
  • Influential Networker: Influential inside and outside of team. Could be viewed as external expert in field.
  • Governance & Protection: Leader in understanding and managing Risk and business continuity.
  • Culture of Innovation: Identifies opportunities for improvement & innovation within functional area. Research latest trends in technology and tools. Ability to learn and educate others on new concepts.

• Leadership 2020 Competencies

  • Intellectual Strength: Expert at working with abstract requirements. Expert ability to identify issues/gaps at early stage. Demonstrated ability to solve the most complex problems. Expert at applying concepts, leads others.
  • Agility: Ability to respond to customer needs with speed and accuracy. Willingness and eager to learn; is curious, role model and teaches others. Anticipates changes and issues in advance, adjusts course quickly. Has broad perspective on the business and functional area.
  • Excellent Execution: Ability for setting and following standards & directions. Ability to multi-task and prioritize work, can help junior team members with prioritization. Accountable for personal results and teamwork. Leads others.
  • Leadership: Sense of ownership & commitment. Values diverse perspectives. Has a high standard for own work and results, Mentors and Directs technical team.
  • Connecting: Expert verbal and written communication skills, across broad audiences and with influence. Ability to communicate commitment and work collaboratively across broad audiences.
  • Partnering: Expert situation analysis combining the technical and business point of view.

City:

State:

Community / Marketing Title: Lead Data Engineer

Company Profile:

Location_formattedLocationLong: Hyderabad, Telangana IN

CountryEEOText_Description: