- Experience working with AWS service for data ETL
- 5 years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions
- Experience in designing data models effectively to manage optimal performance.
- Designing, developing, monitoring and maintaining endtoend data pipelines
- Should have extensive working knowledge of handling around 100GB of data in data ingestion, data processing and pipeline creation.
- Experience with designing and implementing complex high throughput distributed batch and/or realtime solutions using one of AWS Glue, Apache Kafka, AWS Kinesis, Spark, Flink and Apache Airflow
- Extensive handson experience implementing data migration, data processing, ETL or ELT pipeline development and monitoring.
- Strong programming skills in Python, SQL skills for data analysis and reporting
- Should have knowledge of anyone Data Warehouse like Redshift, Snowflake and BigQuery
- Proven ability to work independently, mentor peers and meet tight deadlines
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Postgres, SQL Server, MySQL
- Should have knowledge of NoSQL Database like MongoDB, Cassandra, Neptune
- Experience in write complex query, function, store procedure, execution plan, Performance Tuning and Query Optimization, Indexing, Partitioning and Denormalization
- Should be well versed with migration strategies by manual and automated processes
- Excellent interpersonal, communication skills (both verbal and written), and ability to interact effectively
- Should attend client call independently
- AWS certification would be big plus
-
Simform Solutions
12 hours ago
simform solutions pvt ltd Ahmedabad, IndiaJob Overview : · We are looking for a detail-oriented DevOps engineer to be a part of our DevOps team. This role requires designing and implementing CI/CD pipelines, managing cloud infrastructure for medium-sized multi-tier deployment, plan and implementing best practices for dep ...
-
Simform Solutions
1 week ago
simform solutions pvt ltd Ahmedabad, IndiaJob brief : · Sr QA engineer responsibilities include defining and managing test documents and the plan, executing manual and automation testing. You will also manage a small team of QA engineers and review Quality metrics. · Responsibilities : · Review requirements, specificatio ...
-
Senior Software Engineer
1 week ago
Simform Solutions Ahmedabad/Gujarat, India permanentAbout Simform : · Simform is a fast-growing software services company mainly serving and having a presence in North America. Simform has built a solid work culture that is focused on learning, growth, and work-life balance. Simform is well-known for its very good work culture an ...
-
avp
2 days ago
Simform Solutions Pvt Ltd Ahmedabad, IndiaWe are looking for an experienced senior engineering leader with a diverse background to lead large engineering teams at Simform. You should have a mature understanding of software design and architecture, backend and cloud tech, data and ML tech and have experience leading a lar ...
Simform Solutions - Ahmedabad, India - Simform Solutions Pvt Ltd
Description
Experience : 5+ Years
We are looking for Senior Data Engineer who is passionate about managing large amount of data, eager to learn and accept challenges, and who is committed to delivering exceptional results.
Roles and Responsibilities :
