
Krishna Yadav
Technology / Internet
Services offered
Dedicated Data Engineer experienced in designing and developing robust data pipelines, optimizing ETL processes, and enabling data-driven decision-making. Seeking a challenging role to leverage my skills and expertise in a dynamic organization.
Experience
Working on Azure services for development and implementation of the ELT and ETL pipeline. Data from 4 regions (NAA, EMEA, APAC and China) were integrated with the help of Azure Data Factory and MS-SSIS from on-premises databases to Azure cloud. Implemented ELT pipelines via Azure Databricks for servicedata in Python PySpark, streaming real-time data via AutoLoader and storing data into DataLake. Databricks features - DeltaLake, unity catalog, autoloader and Databricks SQL. Experienced In Azure Cloud service like- ADF, Azure Blob Storage, Azure Event Hubs, Azure Synapse Analytics and for Database, experienced in MySQL, MS SQL Server, snowflake. Defined workflows to process real-time events via ServiceBus and EventHub with Azure Function app and Azure SQL DB, optimizing a previously slow batch process. Built ETL pipelines with ADF for data modeling, parallel processing, and automation. Enhanced existing modules, automated manual processes and developed new features.
Education
bachelor of technology
Professionals in the same Technology / Internet sector as Krishna Yadav
Professionals from different sectors near Dubai, دبي
Other users who are called Krishna
Jobs near Dubai, دبي
-
+Job summary · Role & responsibilities · Develop complex Power BI reports and dashboards using advanced DAX and calculation groups ...
Dubai3 weeks ago
-
The Data Analyst supports AI and Digital teams by collecting preparing analysing interpreting data drive intelligent automation business insights data-driven decision-making. · ...
Dubai3 weeks ago
-
Design build and maintain data pipelines for batch near Real Time processing Develop manage data ingestion and transformation processes Ensure data quality reliability performance across data platforms Collaborate with data architects scientists analytics teams to support downstr ...
Dubai1 month ago