- develop, test, and deploy data pipelines and automation solutions using Python, SQL, KQl, DAX, and other tools and frameworks.
- and troubleshoot the performance and reliability of the data pipelines and automation solutions.
- data engineering tasks, including data modelling, data pipeline development, and cube development.
- data pipelines that execute ETL/ELT processes to move and integrate data between data sources.
- with Azure's core data and analysis services, including Data Factory, Synapse Analytics, Data Explorer, Power BI, etc.
- data warehouses, including the use of ETL/ELT, SQL, Data Lake, Spark, Azure Synapse, Databricks, tabular cubes.
- with other engineers, data scientists, and business stakeholders to understand the data needs and provide technical guidance and support.
- and maintain the code, data models, and data dictionaries.
- degree in Computer Science, Engineering, or related field
- years of experience in Python automation and data engineering
- working with big data databases and frameworks such as Snowflake, Azure Synapse Analytics, Redshift, Databricks, and EMR.
- understanding of various database management systems, architecture, and design principles including relational, non-relational, and/or distributed systems.
- hands-on experience with Azure's core data and analysis services (Data Factory, Data Lake, Data Explorer, SQL, Power BI).
- building warehouses using cloud platform technologies including ETL/ELT, SQL, Data Lake, Spark, Azure Synapse, Databricks, tabular cubes, etc.
- with data pipeline and automation tools and frameworks, such as Airflow, Spark, Kafka, or Luigi
- Flask and Quart apps, Web APIs, Azure Functions
- communication, collaboration, and problem-solving skills
Senior Data Engineer - Hyderabad, India - Launch India
Description
Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to create a career you can be proud of. Your new trajectory starts here at Launch.
Job Summary
We are looking for a data engineer with automation experience to join our team and help us design, develop, and maintain scalable and reliable data pipelines and automation solutions. You will work closely with other engineers, data scientists, and business stakeholders to understand the data needs and deliver high-quality solutions that meet the business requirements.
Responsibilities
Qualifications
We are Navigators in the Age of Transformation:
We use sophisticated technology to transform clients into the digital age, but our top priority is our positive impact on the human experience. We ease anxiety and fear around digital transformation and replace it with opportunity. Launch IT is an equal opportunity employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Launch IT is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation.
About Company :
About Launch IT Launch IT India is wholly owned subsidiary of The Planet Group (; ) a US company, offers attractive compensation and work environment for the prospective employees. Launch is an entrepreneurial business and technology consultancy. We help businesses and people navigate from current state to future state. Technology, tenacity, and creativity fuel our solutions with offices in Bellevue, Sacramento, Dallas, San Francisco, Hyderabad & Washington D.C.