Lead Data Engineer
Location: Hyderabad, Telangana, India
This position is no longer open.
Requisition Number:
1678
Position Title:
ROS Lead Data Engineer
External Description:
The Lead Data Engineer will work on collecting, storing, processing, migrating, and analyzing huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Because we work on the cutting edge of a lot of technologies, this job requires a creative problem solver, resourced in getting things done, and productive working independently or collaboratively.
Duties & Responsibilities:
Description |
% of Time Spent |
• Data - Analysis, Modeling, Architecture, etc.: Expert; mentors others. Gather and process raw data at scale. Defining data retention policies. Acquire data from primary or secondary sources and maintain databases/systems. Create data sets and tables to store data. Make and test database schema changes when needed. Identify user needs to create and administer the data lake. Ingest and move data between databases that includes relational and no-SQL databases like Oracle, SQL Server, MongoDB, Elastic Search, Google Bigquery etc.Implement security measures by encrypting sensitive data |
15% |
• ETL Development: Expert; mentors others. Build and implement ETL processes. Modify ETL jobs to improve performance and efficiency |
40% |
• Support: Troubleshoot high complexity problems and guides others. |
20% |
• Team: Mentors others. Work closely with management to prioritize business and information needs. |
25% |
Education |
Min/Preferred |
Education Level |
Description |
Minimum |
4 Year / Bachelors Degree |
Computer Science, Statistics, Applied Mathematics or equivalent |
|
Work Experience |
Minimum Years of Experience |
Maximum Years of Experience |
Comments |
8 |
|
Experience with integration of data from multiple data sources utilizing ETL tools (Apache Airflow/Cloud Composer, Apache Beam/Dataflow, or similar) |
8 |
|
Strong knowledge of and experience with database systems (Oracle, SQL Server, MySQL, Google BigQuery, MongoDB, Elastic Search etc.) |
6 |
|
Understanding of distributed computing principles, Programming Language (Python) |
6 |
|
Experience with Big Data (Hadoop, Horton Works, etc.) and NoSQL databases, such as (Hbase, Spark, Hive, Cloudera etc.) |
4 |
|
Experience working with cloud technologies - GCP, AWS, Azure, etc. |
|
Job Structure |
Manager Level |
Supervisory Responsibility |
Non-Manager/Individual Contributor |
Provides guidance, leadership, or training to other internal employees (no direct supervision) |
|
Organizational Structure |
Job Title to which this position reports |
Job Titles directly reporting to this position |
Sr Mgr, Data Engineering |
None |
|
Working Conditions |
Travel |
Work Hours |
|
Occasional nights and weekends required |
|
Knowledge, Skills, and Abilities |
• World League IT Competencies
- Business Impact: Expert Business Domain knowledge. Provides solutions to complex problems.
- Strategic Architect: Expert level understanding of technical area relevant to role, leads others.
- Influential Networker: Influential inside and outside of team. Could be viewed as external expert in field.
- Governance & Protection: Leader in understanding and managing Risk and business continuity.
- Culture of Innovation: Identifies opportunities for improvement & innovation within functional area. Research latest trends in technology and tools. Ability to learn and educate others on new concepts.
|
• Leadership 2020 Competencies
- Intellectual Strength: Expert at working with abstract requirements. Expert ability to identify issues/gaps at early stage. Demonstrated ability to solve the most complex problems. Expert at applying concepts, leads others.
- Agility: Ability to respond to customer needs with speed and accuracy. Willingness and eager to learn; is curious, role model and teaches others. Anticipates changes and issues in advance, adjusts course quickly. Has broad perspective on the business and functional area.
- Excellent Execution: Ability for setting and following standards & directions. Ability to multi-task and prioritize work, can help junior team members with prioritization. Accountable for personal results and teamwork. Leads others.
- Leadership: Sense of ownership & commitment. Values diverse perspectives. Has a high standard for own work and results, Mentors and Directs technical team.
- Connecting: Expert verbal and written communication skills, across broad audiences and with influence. Ability to communicate commitment and work collaboratively across broad audiences.
- Partnering: Expert situation analysis combining the technical and business point of view.
|
|
City:
State:
Community / Marketing Title:
Lead Data Engineer
Company Profile:
Location_formattedLocationLong:
Hyderabad, Telangana IN
CountryEEOText_Description: