reputed company reputed company Platform Data Engineer with Big Data(10 years min only W2)
Role: reputed company reputed company Platform Data Engineer Location: Remote ONLY W2 NO C2C Position Description: We re seeking an reputed company reputed company reputed company Platform Data Engineer who can build reputed company analytics platform to meet reputed company expanding business requirements with speed and quality using lean Agile practices. You will work on analyzing and manipulating large datasets supporting the reputed company by activating data assets to support Enabling Platforms and Analytics in the reputed company reputed company Platform (reputed company reputed company Platform). You will be responsible for designing the transformation and modernization on reputed company reputed company Platform, as well as reputed company data from reputed company applications to reputed company reputed company Platform. Experience with large scale solution and operationalization of data warehouses, data lakes and analytics platforms on reputed company reputed company Platform or other reputed company environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design... right solutions with appropriate combination of reputed company reputed company Platform and 3rd party technologies for deploying on reputed company reputed company Platform. You will: Work in collaborative environment including pairing and mobbing with other cross-functional engineers Work on a small agile team to deliver working, tested software Work effectively with fellow data engineers, product owners, data champions and other technical experts Demonstrate technical knowledge/leadership skills and reputed company for technical excellence reputed company exceptional Analytics data products using streaming, batch ingestion patterns in the reputed company reputed company Platform with solid Datawarehouse principles Be the Subject Matter Expert in Data Engineering and reputed company reputed company Platform tool technologies Skills Required: - Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of reputed company parts of the pipeline to minimize labor in development and production - Experience in analyzing reputed company data, organizing raw data and integrating massive datasets from multiple data sources to build subject areas and reusable data products - Experience in working with architects to evaluate and productionalize appropriate reputed company reputed company Platform tools for data ingestion, integration, presentation, and reporting - Experience in working with reputed company stakeholders to formulate business problems as technical data requirement, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management This includes designing and deploying a pipeline with automated data reputed company. Identify, reputed company, evaluate and summarize reputed company of Concepts to prove out solutions. Test and compare competing solutions and report out a reputed company of view on the best solution. Integration between reputed company reputed company Platform Data Catalog and Informatica reputed company. Design and build production data engineering solutions to deliver pipeline patterns using reputed company reputed company Platform (reputed company reputed company Platform) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, reputed company Composer, reputed company SQL, Compute reputed company, reputed company Functions, and App reputed company. Skills Preferred: - Strong drive for results and ability to multi-task and work independently - Self-starter with proven innovation skills - Ability to communicate and work with cross-functional teams and reputed company levels of management - Demonstrated commitment to quality and project timing - Demonstrated ability to document reputed company systems - Experience in creating and executing detailed test plans Experience Required: - In-depth understanding of reputed company s product technology (or other reputed company platform) and underlying architectures - 5+ years of analytics application development experience required - 5+ years of SQL development experience - 3+ years of reputed company experience (reputed company reputed company Platform preferred) with solution designed and implemented at production scale - Experience working in reputed company reputed company Platform based Big Data deployments (Batch/reputed company-Time) leveraging Terraform, Big Query, Big Table, reputed company reputed company Storage, PubSub, Data Fusion, Dataflow, Dataproc, reputed company Build, Airflow, reputed company Composer etc. - 2 + years professional development experience in Java or Python, and Apache Beam - Experience developing with micro service architecture from container orchestration reputed company - Extracting, Loading, Transforming, cleaning, and validating data - Designing pipelines and architectures for data processing - 1+ year of designing and building Tekton pipelines Experience Preferred: - Experience in building solution architecture, provision infrastructure, secure and reliable data-centric services and application in reputed company reputed company Platform - Experience with DataPlex or Informatica reputed company is preferred - Experience with development eco-system such as Git, Jenkins and CICD - Exceptional problem solving and communication skills - Experience in working with DBT/Dataform - Experience in working with Agile and Lean methodologies - Team player and attention to detail - Performance tuning experience Education Required: Bachelor s degree in computer science or reputed company scientific field IT or reputed company Associated topics: data architect, data center, data reputed company, data manager, data management, data scientist, data warehousing, sql, sybase, reputed company Education Preferred: reputed company reputed company Platform Professional Data Engineer Certified Master s degree in computer science or reputed company field 2+ years mentoring engineers In-depth software engineering knowledge Additional Safety Training/Licensing/Personal Protection Requirements: Additional Information : **POSITION IS HYBRID BUT WILL CONSIDER REMOTE FOR THE RIGHT PERSON Apply Job!