Jobs
>
Delhi

    Data Engineer - Delhi, India - Blackstraw

    Blackstraw
    Blackstraw Delhi, India

    5 days ago

    Default job background
    Technology / Internet
    Description

    Data Engineer

    Company Name:

    Office Location: Delhi (Work from Office)

    Job Type: Full-time

    Experience: 4+ Years

    Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.

    Job Requirements:

    ● Participate in the customer's system design meetings and collect the functional/technical requirements.

    ● Build up data pipelines for consumption by the data science team.

    ● Skillful in ETL process and tools.

    ● Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.

    ● Experience in writing Python programs and SQL queries.

    ● Experience in SQL Query tuning.

    ● Experienced in Shell Scripting(Unix/Linux).

    ● Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.

    ● Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.

    ● Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka

    ● Suggest and implement best practices in data integration.

    ● Guide the QA team in defining system integration tests as needed.

    ● Split the planned deliverables into tasks and assign them to the team.

    ● Needs to Maintain/Deploy the ETL code and follow the Agile methodology

    ● Needs to work on optimization wherever applicable.

    ● Good oral, written and presentation skills.

    Preferred Qualifications:

    ● Degree in Computer Science, IT, or similar field; a Master's is a plus.

    ● Hands-on experience with Python and Pyspark Or

    ● Hands-on experience with Spark and SCALA.

    ● Great numerical and analytical skills.

    ● Working knowledge of cloud platforms such as MS Azure, AWS, etc...

    ● Technical expertise with data models, data mining, and segmentation techniques

    Key traits:

    ● Should have excellent communication skills.

    ● Should be self motivated and willing to work as part of a team.

    ● Should be able to collaborate and coordinate in a remote environment.

    ● Be a problem solver and be proactive to solve the challenges that come his way.

    Company Profile:

    Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

  • Muoro

    Data Engineer

    2 days ago

    Muoro Delhi, India

    Responsibilities : · - Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies. · - Implement data ingestion processes from various sources, ensuring data quality and integrity. · - Optimize and tune data pipelines for perfo ...

  • KARYA CONSULTANTS PRIVATE LIMITED

    Data Engineer

    1 day ago

    KARYA CONSULTANTS PRIVATE LIMITED Delhi, India

    As a GCP Data Engineer, you will be a key player in designing, implementing, and optimizing data solutions on the Google Cloud Platform. · We are seeking a professional with hands-on experience in data engineering and a strong understanding of GCP services. · Key Responsibilities ...

  • TransOrg Analytics

    Data Engineer

    19 hours ago

    TransOrg Analytics Delhi, India

    Roles and Responsibilities : · 1. Design and implement data engineering projects. · 2. Integrate multiple data sources to create data lake/data mart Perform data ingestion and ETL processes using SQL, Scoop, Spark or Hive · 3. Knowledge of new components and various emerging tec ...

  • Macropace technologies

    Data Engineer

    19 hours ago

    Macropace technologies Delhi, India

    Role : Data Engineer · Job Description : · We are seeking a highly skilled Data Engineer to join our team. · The ideal candidate will have a strong foundation in SQL and Snowflake, with a passion for transforming and optimizing data pipelines. · As a Data Engineer, you will p ...

  • Huquo Consulting

    Data Engineer

    19 hours ago

    Huquo Consulting Delhi, India

    Position : Data Engineer · Location : Gurgaon · Experience : Min 4+ years · Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the d ...

  • Resources valley

    Data Engineer

    2 days ago

    Resources valley Delhi, India

    Job Description : · Ownership of Data Engineering solution development, including ingestion, transformation, loading, modelling, curation, profiling, migration, and validation of data, also maintaining security, access control, compliance, and SLAs · - Design and create data mode ...

  • Terminus

    Data Engineer

    1 week ago

    Terminus Delhi, India

    Role · We are looking for a Data Engineer to join our team who will be involved data management and transformation at scale and optimize to prepare the data pipe for the AI /Analytical technology stack. The ideal candidate is an experienced data pipeline builder and data wrangle ...

  • Uplers

    Data Engineer

    1 day ago

    Uplers New Delhi, India

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through ...

  • HARP Technologies and Services

    Data Engineer

    2 days ago

    HARP Technologies and Services Delhi, India

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. ) · Exp range : 6+ years · Shift timings : General 9am - 6pm IST or 10am - 7pm IST · Mandatory skills : Data engineering (4+years) ...

  • SKYGATE CONSULTING

    Data Engineer

    19 hours ago

    SKYGATE CONSULTING Delhi, India

    Data Engineer (Snowflake) · Job Description : · As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitc ...

  • SIENT TECHOLOGIES PVT LTD

    Data Engineer

    1 week ago

    SIENT TECHOLOGIES PVT LTD New Delhi, India

    Company Overview: · SIENT Technologies is a pioneering technology firm at the forefront of innovation, dedicated to revolutionizing industries through the power of advanced solutions. Committed to excellence, we specialize in creating transformative technology that enhances effic ...

  • Reliable Group

    Data Engineer

    1 day ago

    Reliable Group Delhi, India

    POSITION DESCRIPTION : · WHAT YOU'LL DO : · - Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow. · - Ensure correctness and completeness of the data being transformed via engineering pipelines ...

  • INSIGHT GLOBAL SOLUTIONS

    Data Engineer

    23 hours ago

    INSIGHT GLOBAL SOLUTIONS Delhi, India

    Data Engineer · Must Haves : · - Bachelors Degree in science, technology, or another related field. · - 3+ years of data engineering experience. · - 3+ years of experience with Cloud platforms like GCP, Azure, Airflow. · - 4+ years of data warehouse, relational database, and SQL ...

  • Triumph Ladders Pvt. Ltd.

    Data Engineer

    2 days ago

    Triumph Ladders Pvt. Ltd. Delhi Division, India

    Title - Data Engineer · Exp years · Location - Delhi · Notice period days · Responsibilities : · - Collaborate with Data Scientists to test and scale new algorithms through pilots and later industrialize · the solutions at scale to the comprehensive fashion network of the Group ...

  • Vbeyond

    Data Engineer

    2 days ago

    Vbeyond Delhi NCR/Mumbai/Noida, India permanent

    JOB SUMMARY : · We are seeking a skilled and experienced Data Engineer with strong developments skills and solid track record in terms of implementing scalability, availability and excellence when building data pipelines and platforms for our royalties and revenue share initiati ...

  • WovV Technologies

    Data Engineer

    1 day ago

    WovV Technologies Delhi, India

    Job Description : Data Engineer · Location : Remote · Experience : 5+ years. · Durations : 6 months with a very likely extension · Mandatory Technology : DBT, SQL, Snowflake,data integration practices, and Tableau · Primary Skills : Expertise in transaction refunds and a comprehe ...

  • HS Solutions Inc

    Data Engineer

    19 hours ago

    HS Solutions Inc Delhi, India

    About the job : · Tech stack : · BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc. · - 3-5 years' Experience in Data warehouse and Data lake implementation. · - 1-2 years of experience in Google Cloud Platform (especially Big Query). · - 1-2 years of w ...

  • RS Consultants

    Data Engineer

    1 week ago

    RS Consultants Delhi, India

    About the job : · Responsibilities : · - Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · - Collaborate with Business Intelligence team and other stakeholders for data requirements · - Collaborate with the Dat ...

  • Vision Beyond Resources India Pvt. Ltd.

    Data Engineer

    19 hours ago

    Vision Beyond Resources India Pvt. Ltd. Delhi, India

    Role : Data : UK Shift Range : 7+ Requirements : · Excellent understanding of data structures with 5+ years of experience in enterprise-wide data platforms design and implementation. · - Strong knowledge of common design patterns used in Data Integrations and Warehousing. · - Pro ...

  • USEReady Technology Pvt. Ltd.

    Data Engineer

    3 days ago

    USEReady Technology Pvt. Ltd. Any Location/Bangalore, India permanent

    Role Responsibility : · - Translate functional specifications and change requests into technical specifications. · - Translate business requirement document, functional specification, and technical specification to related coding. · - Develop efficient code with unit testing and ...