Jobs
>
Chennai

    Data Engineer - Chennai, India - Blackstraw

    Blackstraw
    Blackstraw Chennai, India

    1 week ago

    Default job background
    Technology / Internet
    Description

    Data Engineer

    Company Name:

    Office Location: Chennai (Work from Office)

    Job Type: Full-time

    Experience: 4+ Years

    Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.

    Job Requirements:

    ● Participate in the customer's system design meetings and collect the functional/technical requirements.

    ● Build up data pipelines for consumption by the data science team.

    ● Skillful in ETL process and tools.

    ● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.

    ● Experience in writing Python programs and SQL queries.

    ● Experience in SQL Query tuning.

    ● Experienced in Shell Scripting(Unix/Linux).

    ● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.

    ● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.

    ● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka

    ● Suggest and implement best practices in data integration.

    ● Guide the QA team in defining system integration tests as needed.

    ● Split the planned deliverables into tasks and assign them to the team.

    ● Needs to Maintain/Deploy the ETL code and follow the Agile methodology

    ● Needs to work on optimization wherever applicable.

    ● Good oral, written and presentation skills.

    Preferred Qualifications:

    ● Degree in Computer Science, IT, or similar field; a Master's is a plus.

    ● Hands-on experience with Python and Pyspark Or

    ● Hands-on experience with Spark and SCALA.

    ● Great numerical and analytical skills.

    ● Working knowledge of cloud platforms such as MS Azure, AWS, etc...

    ● Technical expertise with data models, data mining, and segmentation techniques

    Key traits:

    ● Should have excellent communication skills.

    ● Should be self motivated and willing to work as part of a team.

    ● Should be able to collaborate and coordinate in a remote environment.

    ● Be a problem solver and be proactive to solve the challenges that come his way.

    Company Profile:

    Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

  • BU Soft Tech

    Data Engineer

    5 days ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • InfoCepts

    Data Engineering

    4 days ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • OptiSol Business Solutions

    Data Engineer

    2 days ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • Aspire Systems

    Data Engineer

    3 days ago

    Aspire Systems Chennai, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Movate

    Data Engineer

    1 week ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • HTC Global Services

    Data Engineer

    5 days ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • Integrate

    Data Engineer

    1 day ago

    Integrate Chennai, India

    Role: Data Engineer L2 · Experience: 4-6 yrs · Skills required: Snowflake, spark, SQL, python · Work Location: Global Infocity, Chennai · Model: Hybrid · About us: · Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an om ...

  • Mindsprint

    Data Engineer

    2 days ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • culture highway

    Data Engineer

    4 days ago

    culture highway Chennai, India

    Job Description : · Tech Anchor- Data Engineering Role Overview : · Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. You will be responsible for designing, implementing and optimizing data pipelines, ensuring data qu ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Ashley Global Capability Center

    Data Engineer

    1 week ago

    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • Notus

    Data Engineer

    2 days ago

    Notus Chennai, India

    AWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintainin ...

  • Astonishic LLC

    Data Engineer

    1 day ago

    Astonishic LLC Chennai, India

    Title : Data Engineer - Databricks Specialist · Location : Chennai, Tamil Nadu · Experience : 2-6 years · Employment Type : Onsite · Number of Positions : 10 · Job Description : · - Design, build, and maintain scalable and robust data pipelines using Databricks. · - Develop an ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    4 days ago

    TIGI HR Solution Pvt. Ltd. Chennai, India

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • HTC Global Services

    Data Engineer

    1 week ago

    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • iTechMinds Consulting LLP

    Data Engineer

    1 week ago

    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • Cynosure Corporate Solutions

    Data Engineer

    1 day ago

    Cynosure Corporate Solutions Chennai, India

    Lead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data war ...

  • Makonis

    Data Engineer

    3 days ago

    Makonis Chennai, India

    Work Location: Chennai & Coimbatore · Required Exp: 3 to 6yrs (Fulltime Position) · Client: Leading Investment Bank · Mandatory skills: · We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. · If that matches your profile, please share a copy o ...

  • Randstad

    Data Engineer

    4 days ago

    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • SGS Technical Services Pvt. Ltd

    Data Engineer

    4 days ago

    SGS Technical Services Pvt. Ltd Chennai, India

    Job Title : Data : Chennai, India · Immediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL control · Job Description : · We are seeking a highly skilled Data Engineer to join our team ...