Description
Databricks Architect:
·10- 12 years of experience in building solutionsusing Databricks on Azure or on Big Data, SQL Data, and other sources.
·In depth understanding of DataBricksArchitecture including Lakehouse, Performance tuning, Compute and Storage
·1-2 Migration project level experience fromHadoop ecosystem to Azure Databricks & related DBs along with dataintegration job migration.
·Good knowledge and Proven practical experiencein migrating relational data base from on-prem to cloud OR to build cloud-baseddata lake using either Big Data / Azure Synapse / Databricks / Snowflake
·Experience in building data platforms usingAzure services like Azure Data Factory, ADLS Gen2, Databricks, Azure IaaS/PaaSdatabase and Azure Synapse data warehouse/analytical systems.
·Worked on the both the development andmaintenance projects and followed the operational processes.
·Hands-on experience on selecting and integratingany Data related tools and frameworks required to provide requestedcapabilities.
·Responsible for end-to-end data platform designand architecture for DataBricks on Azure.
·Extensive experience writing and tuning SQLqueries.
·In-depth knowledge in data virtualization usingDataIQ.
·3+ years programming in one or more languages (PySpark,Python, Java, Scala)
·Excellent in Written and Verbal Communication
·Experience with Agile process methodology,CI/CD.
·Hands-on experience in ETL/ELT tools like FiveTran,Talend and Informatica Power Centre.
·Certification on cloud or DataBricks (related toData) would be preferred.
·Knowledge of Hadoop ecosystem will be an addedadvantage.