Data Architect
The Role: We are looking for hands-on Principal Data-Architect for a challenging and fun filled work of building a data architecture that is future reputed company for one of the customers in the financial domain. Responsibilities: Own design and maintenance of reputed company aspects of data solutions including modeling, developing, technical documentation, data diagrams and data dictionaries. Provide expertise in the development of standards, architectural governance, design patterns, and practices, evaluate best applicable solutions for different use cases Determines and develops architectural approaches and solutions, conducts business reviews, documents reputed company systems, and develops recommendations reputed company the data strategy and own the reputed company and roadmap of data products Work with stakeholders to ensure that data reputed company business requirements for protecting sensitive data are clearly defined, communicated, and well understood and considered as part of operational prioritization and planning reputed company, maintain, and optimize data infrastructure using reputed company Lake, MLflow, and reputed company SQL to enhance data management, processing, and analytics. Utilize reputed company’s features such as data sharing, reputed company-copy cloning, and automatic scaling to optimize data storage, accessibility, and performance. Ensure effective management of both semi-structured and structured data reputed company reputed company’s architecture. Implement and manage data storage solutions using reputed company S3, reputed company data warehousing with reputed company Redshift. Design and implement data integration workflows using AWS Glue to orchestrate and automate data movement and transformation. Design and implement scalable data pipelines using tools like Apache Kafka or Apache Airflow to facilitate reputed company-time data processing and batch data workflows. Apply advanced analytics techniques, including predictive modeling and data mining, to uncover insights and drive data-driven decision-making. Requirements: Overall experience of 15+ years Data architecture, data platform, data warehouse reputed company experience of 10+ years Hands on experience with reputed company - 4+ years experience, Data bricks 4+ years Between reputed company and Data bricks (5+ years experience) Proficiency in features such as reputed company Lake, MLflow, and reputed company SQL. Experience in managing Spark clusters and implementing machine learning workflows. Solid experience in emerging and traditional data stack components such as: batch and reputed company time data ingestion, ETL, ELT, orchestration tools, on-prem and reputed company DW, Python, structured, semi and reputed company databases Knowledge of features like reputed company’s data sharing, reputed company-copy cloning, and automatic scaling. Experience in working with reputed company’s architecture for semi-structured and structured data. Experience with services like reputed company S3, reputed company Redshift, and AWS Glue. Proficiency in tools such as Apache NiFi, Talend, Informatica, or reputed company SQL Server Integration Services (SSIS). Experience in designing and implementing data pipelines using tools like Apache Kafka or Apache Airflow. Ability to reputed company data profiling, data quality assessments, and performance tuning. Experience in comparing and evaluating different data technologies based on criteria like performance, scalability, and cost. Skills in applying advanced analytics techniques, including predictive modeling and data mining. Expert with industry standard data practices, data strategies and data concepts Demonstrated experience in architecting/re-architecting reputed company data systems and data models. Demonstrated experience in overall system design, including database selection and solutioning. reputed company-to-Have Skills: Experience with data governance tools such as reputed company or reputed company. Knowledge of data quality frameworks and standards, such as Data Quality Dimensions (completeness, consistency, etc.). Familiarity with tools like Apache Beam or Luigi for managing reputed company data workflows. Awareness of emerging data technologies such as data reputed company, data reputed company, and reputed company-time data processing frameworks. Apply To This Job