- Linux knowledge, security permissions as well as shell scripting and SSH for binary deployments.
- GIT and source code management
- Java and its upgrades, JMX, JVM monitoring, Threading, debugging.
- Spring Cloud Streams API, Spring Integration API
- Networking, Firewall, Load Balancer concepts to be able to troubleshoot data access issues and new pipelines from new IPS as well as deploy new syslog listeners that are load balanced.
- SSL and Security concepts, to generate certificates and configure Kafka ACLs that use them.
- RedHat Kafka installation, upgrades, expansion, administration, alerting and security. Understanding of offsets, publishers, subscribers, consumer groups, partitions
- Graphana and the agents associated with the different components.
- Syslog protocol understanding
- Google Pub/Sub understanding.
- General systems administration concepts monitoring and alerting on systems and processes (CPU, disk I/O, disk space, memory usage, access, logs etc.)
- Ability to enhance the operationalization of this environment as well as upgrades and BCDR. For instance, explore additional tooling such as Linked in's cruise control and other Kafka tools.
-
Data Engineer
3 days ago
Layer7 SAPI de CV New Delhi, IndiaJob DescriptionThis is a remote position. · • Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. · • Mantener y optimizar la infraestructura de datos necesaria para una extracción, transformación y carga precisas de datos de una amplia var ...
-
Data Engineering
4 days ago
Treyas Infotech and Consulting Pvt Ltd Noida, IndiaJOB DESCRIPTION : · As Manager, Data Engineering, you will be responsible for translating client requirements · into design, architecting, and implementing GCP Cloud-based big data solutions for clients. · Your role will be focused on delivering high-quality solutions by independ ...
-
Data Engineer
18 hours ago
HCLTech Noida, IndiaJob Description · Experience in designing & implementing solution in mentioned areas: · Strong Google Cloud Platform Data Components – BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion, Etc · Professional Summary · Data Engineer who is strong on Data Warehousing, B ...
-
Data Engineer
5 days ago
Infogain Noida, IndiaExperience : 6 to 9 years · Requirement : Immediate Joiner or one month notice period only. · Location : Bangalore · Work Mode : Hybrid · Title: · Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data ...
-
Data Engineer
6 days ago
WSP in India Noida, IndiaDescription · We seek a technical backend data engineer to help us develop solutions in our Azure Synapse Analytics platform. · The responsibility is to work with ingesting data (On-Prem SQL, Rest API to cloud solutions, etc), the transformation to the silver layer (PySpark, SQL) ...
-
Data Engineer
6 days ago
Network18 Media & Investments Limited Noida, IndiaKey Responsibilities · Lead the design and implementation of the data & analytics architecture ensuring · compliance, quality, and sustainable platform growth · Build scalable end-to-end data pipelines to integrate and model datasets from different · sources that meet functio ...
-
Data Engineer
2 days ago
Hexaconcepts Noida, India Full timeThe Company : · A data-sciences company, serving clients across industries across geographies. A fast growing organisation witnessing huge demand for their services, covering Business Intelligence, Data warehousing, Data engineering and Predictive analytics (AI/ML). On this growt ...
-
Data Engineer
6 days ago
SAM Manpower and Career Services LLP Noida, IndiaRole: DataEngineerExperience: 57YearsLocation:NoidaNotice: Immediate joinersonlyJobDescription We arelooking for an experienced data engineer to join our team. You willuse various methods to transform raw data into useful data systems.For example you ll create algorithms and cond ...
-
Data Engineer
1 day ago
RateGain Noida, India Full timeAbout the Organization: · RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel proper ...
-
Data Engineer
2 days ago
Techugo Noida, India Full timeSkills and Qualifications. · Engage in all aspects of a project, to design the python based solution · end-to-end. Successfully translate functional designs into technical · solutions using best practices. · Create functional and technical specification documents by · understandi ...
-
Celonis Data Engineer
6 days ago
Tech Mahindra Noida, IndiaJob Role: SR Data Engineer · Experience: 5 to 12 Years · Mandatory Skills: Celonis, Process Mining, SQL · Location: PAN India · Skills: Celonis, Process Mining, O2C, P2P, R2R, SQL, PQL, ERP Systems, Data Integration, Data Visualization, Power BI, Tableau, ETL · Role & responsibi ...
-
Senior Data Engineer
6 days ago
InfoStride Noida, IndiaAs a Senior Data Platform Engineer, you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving ...
-
Data Governance Engineer
6 days ago
3i Infotech Ltd. Noida, IndiaJob Description – Data Governance Engineer · Total Experience : 6 to 8 Yrs · Preferred/ Secondary Skill Set : Data Lineage,PL/SQL · Location : Pan India · OvalEdge Data Governance Engineer will be responsible for ensuring that an organization's data assets are properly managed, s ...
-
Senior Data Engineer
6 days ago
Coforge Noida, IndiaWhat you will do: · Support and improve ETL based upon Informatica, SQL Server and Teradata Tech Stack. · Identify and solve root cause of operational issues (e.g. data quality, critical process degradation). · Develop a deep understanding of vast data sources and know-how to use ...
-
Junior Data Engineer
6 days ago
Xperthunt Bangalore/Noida, India permanentAbout the Role : · We're seeking a passionate and detail-oriented Junior Data Engineer to join our growing team In this role, you'll play a vital role in designing, developing, and maintaining data pipelines to support our organization's data-driven initiatives. · You'll work clo ...
-
Azure Data Engineer
21 hours ago
Codestore Technologies Pvt. Ltd. Noida, India permanentResponsibilities : · - Designing & Building data architectures including the design & set-up of scalable Modern Data Platforms. · - Collaborate with cross functional teams and stakeholders including the Executive, Product, Data, and Design teams, to support their data infrastruct ...
-
Senior Data Engineer
21 hours ago
Infostride Technologies Pvt Ltd Noida, India permanentAs a Senior Data Platform Engineer, you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving ...
-
AWS Data Engineer
19 hours ago
Infogain Noida, IndiaAWS Data Engineer (Lead) with skills AWS - EKS, AWS - CloudFormation, AWS-Apps, AWS-Infra, AWS DBA, Python, Apache Hive, SQL for location Noida, India · Posted on: May 07, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Job description · Respo ...
-
Junior Data Engineer
2 days ago
XpertHunt Noida, India Full timeGood Day · Dear Aspirants, We are seeking for a talented and motivated Junior Data Engineer for our client. please find the job description below · Role: Data Engineer · Location: Noida, Gurugram · Permanent/ Direct Position with Client · Experience: 1.5 3 Years · Mandatory Skill ...
-
Senior Data Engineer
1 day ago
RateGain Noida, India Full timeAbout the Organization: RateGain is a leading provider of SaaS products, which help travel and hospitality companies with cognitive revenue management, smart e-distribution, and brand engagement to make more revenue every day. RateGain is proud to support 250,000+ hotel propertie ...
Data Engineer - Noida, India - HCLTech
Description
Role: Data Engineer
Total years of experience: 5-10 Years
Location: PAN India (Any HCL office)
Relevant experience for engagement: 5 Years
Job Description: