
Krishna Yadav
Technology / Internet
Services offered
Dedicated Data Engineer experienced in designing and developing robust data pipelines, optimizing ETL processes, and enabling data-driven decision-making. Seeking a challenging role to leverage my skills and expertise in a dynamic organization.
Experience
Working on Azure services for development and implementation of the ELT and ETL pipeline. Data from 4 regions (NAA, EMEA, APAC and China) were integrated with the help of Azure Data Factory and MS-SSIS from on-premises databases to Azure cloud. Implemented ELT pipelines via Azure Databricks for servicedata in Python PySpark, streaming real-time data via AutoLoader and storing data into DataLake. Databricks features - DeltaLake, unity catalog, autoloader and Databricks SQL. Experienced In Azure Cloud service like- ADF, Azure Blob Storage, Azure Event Hubs, Azure Synapse Analytics and for Database, experienced in MySQL, MS SQL Server, snowflake. Defined workflows to process real-time events via ServiceBus and EventHub with Azure Function app and Azure SQL DB, optimizing a previously slow batch process. Built ETL pipelines with ADF for data modeling, parallel processing, and automation. Enhanced existing modules, automated manual processes and developed new features.
Education
bachelor of technology
Professionals in the same Technology / Internet sector as Krishna Yadav
Professionals from different sectors near Dubai, دبي
Other users who are called Krishna
Jobs near Dubai, دبي
-
Azure Data Platform Security Engineer
2 weeks ago
The Solution Consulting DubaiAzure Data Platform Security Engineer will support project delivery by designing, implementing, testing and validating technical security controls within Azure Data Factory (ADF) and Azure Data Lake environments. · ...
-
Full Stack Data Scientist-Azure AI Engineer
1 month ago
CloudJune Technologies Dubai, DubaiWe're hiring a Full Stack Data Scientist / Azure AI Engineer to design, develop, and deploy production-grade AI solutions leveraging the Azure AI ecosystem. · Ai-102: Azure Ai Engineer Associate · DP-100: Azure Data Scientist Associate · ...
-
Data Warehouse Engineer
1 week ago
Parsons Corporation DubaiImagine a career where you thrive, work with exceptional people and be yourself.Parsons is seeking a high-potential Data Engineer Graduate Intern to join our Technology and Innovation team. · We truly invest and care about our employee's wellbeing. · We provide endless growth opp ...