Big Data Developer - Dubai, United Arab Emirates - Client of Emirates Consulting Group LLC ( ECG)

    Client of Emirates Consulting Group LLC ( ECG)
    Client of Emirates Consulting Group LLC ( ECG) Dubai, United Arab Emirates

    1 week ago

    Default job background
    Full time
    Description
    Responsibilities


    • Develop and maintain data pipelines implementing ETL processes
    • Take responsibility for Hadoop development and implementation
    • Work closely with a data science team implementing data analytic pipelines
    • Help define data governance policies and support data versioning processes
    • Maintain security and data privacy working closely with Data Protection Officer internally
    • Analyze a vast number of data stores and uncover insights
    Requirements


    • Experience in Python, Spark and Hive
    • Understanding of data warehousing and data modeling techniques
    • Knowledge of industry-wide analytical and visualization tools (Tableau and R)
    • Strong data engineering skills on the Azure Cloud Platform is essential
    • Streaming frameworks like Kafka
    • Knowledge of core Java, Linux, SQL, and any scripting language
    • Good interpersonal skills and positive attitude

    Desired Candidate Profile




    Education:
    Bachelor of Technology/Engineering(), Bachelor of Science(Computers)


    Gender:
    nm


    Nationality:
    Any Nationality