- Design and maintainenhancements to our data warehouse data lake and data pipelines toincrease their reliability andconsistency
- Improve queriability of largehistorical datasets through industrystandard tools careful datarepresentation and aggregation for both technical and businessunits
- Ensure data governance andsecurity/retention policies can be implemented andenforced
- Ensure that operational systemintegrations driven from the data stack are running monitored andavailable
- Continually review the data platformto ensure that it is fit for purpose and meeting the needs of thebusiness
- Support and maintain downstreamintegrations from our data lake for example business intelligenceand visualization tools and third partysystems
- Experience in thedata engineering field with demonstrated design and technicalimplementation of data warehouses
- Experiencewith OLAP databases how they differ from OLTP databases and datastructuring/modeling with understanding of key data points in abusiness sense for tradeoffs between storage/performance andusability
- Experience with building deployingand troubleshooting reliable idempotent and consistent datapipelines working with disparate inhouse and external datasourcese.g. using Airflow DAGs
- Experience with AWSRedshift Glue Data Catalog S3 PostgreSQL Parquet Iceberg Trino andhow they are managed using Terraform &Kubernetes
- Experience with data loadingextraction manipulation and preparing data for ingestion andintegration with visualization platforms such asTableau.
-
Data Engineer
1 week ago
NewPage Solution Inc Sany, IndiaWho Are We · NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ...
-
Data Engineer
3 weeks ago
Kenan Management Consultants Pvt Ltd Sany, IndiaJob Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only · using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& · KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Exper ...
-
Data Engineer
2 weeks ago
TalentPulse Consultant Sany, IndiaOverview: · The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor ...
-
Data Engineer
3 weeks ago
Randstad India sany, IndiaYears of exp: 5 to 7years · CTc Range: 11 to 12LPA · Database knowledge datamanagement person who can do parting and cleansing ofdata · 4 to 5 years in Advanced levelof SQL complex Tableau manipulation different logics andcombination · Knowledge of Pyspark willbe a plus · Wo ...
-
Data Engineer
4 weeks ago
SPECTRAL CONSULTANTS Sany, IndiaKey Requirement for the Position MicrosoftETL SSIS ADF Experience on Azure technology · stalk. Experience8 to 12 years · Job Description · Technical Expertise: · Should haveexperience of working on Microsoft Azure tools like Spark DatabrickSynapse (knowledge · of these will be ...
-
Data Engineer
4 days ago
Informica sany, IndiaJob Description · Experience Required: 48 yrs. · Knowledge on Data Modelling Data warehouse andData Analysis is also required. · Immediate requirement: 1520 days joineronly. · Data Engineer · Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools ...
-
Data engineer
4 weeks ago
HR Aspiration Sany, IndiaSenior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperience · Expertise with AWS services: S3Redshift EMR Glue Kinesis Dy ...
-
Advisor Data Engineering
4 weeks ago
Tekwissen India Sany, IndiaOverview TekWissen Group is a workforce managementprovider operating throughout India and several other countriesworldwide. The client below is a leading technology companyoffering a range of IT solutions to businesses and organizationsenabling them to transform their digital f ...
-
Azure Data Engineer
4 weeks ago
Manvision Technologies Sany, IndiaPySpark Development experienceespecially in Spark SQL and Complex Transformations · Python development experience · Experience in Azure Data Lake Azure Data Factory AzureDatabricks Azure Databases · Azure SkillsMust have working experience in Azure DataLake Azure Data Factory Azu ...
-
Snowflake Data Engineer
2 weeks ago
Agilite Global Solutions Company sany, IndiaRole: Snowflakes DataEngineer Location: India Remote Work from Anywhere inIndiaMinimum Qualification: Bachelors degree or higher in thetechnologyfield.IndicativeExperience: 3 YearsDomain: USHealthCare.Customer Profile: Captive research and development pods for a 500millionmember ...
-
Senior Data Engineer
3 weeks ago
Royal Cyber Inc. sany, IndiaSr. Data Engineer – Google Cloud Platform Minimum Qualification: · • Bachelor's degree in Computer Science or related technical field, or equivalent practical experience. · • Minimum 4 years of industry experience in software development, data engineering, business intelligence ...
-
Data Engineer with Datastage
17 hours ago
eTek IT Services, Inc. Sany, IndiaRole :DataEngineerLocation: CincinnatiOhioExperience:5years · W2Contract · JobDescription · JobOverview: · Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintain ...
-
AWS Data Engineer
2 weeks ago
Forward Eye Technologies sany, IndiaJD : AWS DataEngineer · NeedAWS DataEngineerLocation:RemoteContractFulltime4Years ExperienceRequiredQualifications: · 46years of relevantexperience.Familiaritywith Data lake Data migration and Data integrationconcepts.Knowledgeof OLAP and OLTPsystems. · TechnicalSkills: · Abilit ...
-
Azure Data Engineer
3 weeks ago
Manvision Technologies sany, IndiaMustHave (Ideally should not be morethan 35): · Azure Datatechnologies PaaS components (ADF ADB Data Lake) · PL/SQL. Handson Azure Data technologies experience foratleast 2 years · GoodtoHave : · Goodcommunication skills · AzureDevOps · SQL Server · Responsibility of / E ...
-
Data Science Lead ML Engineering
1 week ago
ConsultBae India Private limited Sany, IndiaJobOverviewBranch launched inIndia in early 2019 and has seen rapid adoption and growth. We arelooking for talented Machine Learning Engineers to join us and bepart of this journey. You will work closely with other EngineersProduct Managers and Data Scientists to develop improve ...
-
Horigine Consulting Pvt. Ltd Sany, India: MandatorySkills:Tech: Apache Spark PySpark · Programming Languages: JavaPython · CloudPlatform: GCP · 69 Years with Specific skills required: · Skills: · Experience in Spark and Distributedcomputing frameworks. · Professional handon experience inscala/python. · Professional ha ...
-
Data Engineer with Datastage
4 weeks ago
eTek IT Services, Inc. sany, IndiaRole : DataEngineer Location: CincinnatiOhio Experience:5years · W2Contract · JobDescription · JobOverview: · Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and ma ...
-
ETL Developer
3 weeks ago
Talent Join Sany, IndiaJob Description: Weare seeking an experienced ETL Engineer with expertise in GoogleCloud Platform (GCP) to join our team. As an ETL Engineer you willbe responsible for designing developing and maintaining efficientExtract Transform Load (ETL) processes within the GCPenvironment. ...
-
Production Executive
2 weeks ago
After Passout Pvt Ltd Sany, IndiaAardhyaGemsWhat will ascience/maths/ engineering graduate do in jewellerymaking · Actuallya lot. Jewellery production is about basic mechanics materialscience strength of materials machine elements manufacturingtechniques and production data management. The impact of work onthe f ...
-
Data bricks Admin
3 weeks ago
TalentPulse Consultant sany, IndiaResponsibilities: Installconfigure and maintain Databricks environments to support dataengineering and analyticsactivities.Collaboratewith crossfunctional teams to understand data requirements andoptimize Databricks clustersaccordingly.MonitorDatabricks performance troubleshoot i ...
Data Engineer - Sany, India - Bitcoin Devs Company
1 week ago
![Default job background](https://contents.bebee.com/public/img/bg-user-ex-1.jpg)
Description
Overview:
TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.
TheData Engineering team is part of the broader DevOps department andsits at the core of the business bridging the fastpaced andneverending data feeds from the trading platform to the entirety ofthe firm. Whether it is about business development financialproducts risk management compliance & market surveillancemarketing consistent and reliable data is key making DataEngineering the cornerstone to the firm ssuccess.
KeyResponsibilities:
RequiredQualifications:
datawarehouse,postgresql,data modeling,glue,s3,amazon redshift,oltpdatabases,online transaction processing (oltp),data extraction,dataloading,aws glue,data manipulation,kubernetes,olap,tableau,dataengineering,data pipelines,olap databases,awsredshift,terraform